Llama 3.1 405B

General language model Generally available Open Weights

Meta AI open-weights 405-billion parameter foundation model offering frontier-class reasoning, code generation, and synthetic data synthesis.

Overview

Llama 3.1 405B is Meta AI's massive open-weights foundation model released in July 2024. As the first open-weights model to rival top-tier proprietary frontier LLMs on benchmark evaluations, Llama 3.1 405B provides unprecedented capabilities for enterprise self-hosting, synthetic data generation, and custom model distillation. Built on a standard dense Transformer architecture with Grouped-Query Attention (GQA), the model was trained on over 15 trillion tokens. It features a 131,072-token (128K) context window, accepting text inputs and generating text completions. It natively supports function calling, structured output generation, and multi-lingual processing across Meta's 8 officially supported languages (English, German, French, Italian, Portuguese, Hindi, Spanish, Thai). Distributed under the Llama 3.1 Community License, the weights are freely downloadable on Hugging Face. Local deployment is feasible on multi-GPU server setups or via quantized inference frameworks.

Technical Specifications

Context Window 131,072 tokens
Max Input Tokens 128,000
Parameters 405.0B
Architecture Dense Autoregressive Transformer
Released 2024-07-23

Modalities

Text → Text (Both)

Capabilities

Text Generation Code Generation Reasoning Function Calling Long Context Multilingual Support

Use Cases

Content Creation Coding Assistance Research

Languages

English (en) Spanish (es) French (fr) German (de) Chinese (zh)

Access Routes

Route Type Protocol Region / Scope Provider Status
Meta AI Hosted API (Direct provider) Custom REST API Global Meta AI Available
HuggingFace Hugging Face Hub / Inference Hugging Face Inference API Global Meta AI Available

Provider

Meta AI

Family: Llama 3

Identifiers

  • meta-llama/Meta-Llama-3.1-405B-Instruct Canonical identifier Default
  • meta-llama/Llama-3.1-405B-Instruct Canonical identifier Default
  • meta-llama/Llama-3.1-405B Alias
  • meta-llama/Llama-3.1-405B-Instruct Alias Default

Sources

Compare

See how this model stacks up against others.

Compare with Other Models

Platform Status

Optix AI is under active development. Verified model records, pricing schemas, deployment guides, and published benchmark data are being added progressively. Our mission is to provide transparent AI model discovery and comparison with clearly sourced facts.

Data Verification: Ongoing curation and manual verification of model specifications against official sources.
Regular Updates: Addition of newly released commercial and open-source models as records are verified.
Developer First: Built with transparency, clearly sourced facts, and community feedback.