Meta: Llama 3.1 405B (base) (free)

meta-llama/llama-3.1-405b:free

Created Aug 2, 202464,000 context
$0/M input tokens$0/M output tokens

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This is the base 405B pre-trained version.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Providers for Llama 3.1 405B (base) (free)

OpenRouter routes requests to the best providers that are able to handle your prompt size and parameters, with fallbacks to maximize uptime.

Chutes
fp8
Context
64K
Max Output
64K
Input
$0
Output
$0

Apps using Llama 3.1 405B (base) (free)

Top public apps this week using this model

1.
Favicon for https://cline.bot/
Cline
Autonomous coding agent right in your IDE
3.85Mtokens
2.
Favicon for https://sillytavern.app/
SillyTavern
LLM frontend for power users
3.46Mtokens
3.
Favicon for https://openrouter.ai/chat
OpenRouter: Chatroom
Chat with multiple LLMs at once
2.46Mtokens
4.
Favicon for https://roocode.com/
Roo Code
A whole dev team of AI agents in your editor
1.13Mtokens
5.
Favicon for https://github.com/cosmicoptima/loom
Loomsidian
new
934Ktokens
6.
Favicon for https://chub.ai/
Chub AI
GenAI for everyone
751Ktokens
7.
Favicon for https://www.typingmind.com/
TypingMind
A better UI for ChatGPT
595Ktokens
8.
Favicon for https://agnai.chat/
Agnaistic
A "bring your own AI" chat service
389Ktokens
9.
Favicon for https://risuai.xyz/
RisuAI
Browse characters, choose models, and chat
332Ktokens
10.
Favicon for https://openwebui.com/
Open WebUI
Extensible, self-hosted AI interface
319Ktokens
11.
Favicon for https://github.com/your-repo
TaskWeaver-UI
new
301Ktokens
12.
Favicon for https://cherry-ai.com/
Cherry Studio
new
272Ktokens
13.
Favicon for https://github.com/HybridTalentComputing/cline-chinese
Cline Chinese
new
257Ktokens
14.
Favicon for https://art-from-the-machine.github.io/
Mantella
Skyrim & Fallout 4 mod, naturally speak to NPCs
255Ktokens
15.
Favicon for https://novelcrafter.com/
novelcrafter
Your personal novel writing toolbox. Plan, write and tinker with your story.
183Ktokens
16.
Favicon for https://lite.koboldai.net/
lite.koboldai.net
new
162Ktokens
17.
Favicon for https://anythingllm.com/
AnythingLLM
new
97Ktokens
18.
Favicon for https://m31.bot/
M31-Autonomous
new
89Ktokens
19.
Favicon for https://dreamio.xyz/
DREAMIO: AI-Powered Adventures
new
76Ktokens
20.
Favicon for https://big-agi.com/
big-AGI
Precision AI for professionals
74Ktokens

Recent activity on Llama 3.1 405B (base) (free)

Tokens processed per day

Apr 20Apr 22Apr 24Apr 26Apr 28Apr 30May 2May 4May 6May 8May 10May 1203M6M9M12M

Versions by Token Share

Uptime stats for Llama 3.1 405B (base) (free)

Uptime stats for Llama 3.1 405B (base) (free) on the only provider

When an error occurs in an upstream provider, we can recover by routing to another healthy provider, if your request filters allow it.

Learn more about our load balancing and customization options.

Sample code and API for Llama 3.1 405B (base) (free)

OpenRouter normalizes requests and responses across providers for you.

OpenRouter provides an OpenAI-compatible completion API to 300+ models & providers that you can call directly, or using the OpenAI SDK. Additionally, some third-party SDKs are available.

In the examples below, the OpenRouter-specific headers are optional. Setting them allows your app to appear on the OpenRouter leaderboards.

from openai import OpenAI

client = OpenAI(
  base_url="https://openrouter.ai/api/v1",
  api_key="<OPENROUTER_API_KEY>",
)

completion = client.chat.completions.create(
  extra_headers={
    "HTTP-Referer": "<YOUR_SITE_URL>", # Optional. Site URL for rankings on openrouter.ai.
    "X-Title": "<YOUR_SITE_NAME>", # Optional. Site title for rankings on openrouter.ai.
  },
  extra_body={},
  model="meta-llama/llama-3.1-405b:free",
  messages=[
    {
      "role": "user",
      "content": "What is the meaning of life?"
    }
  ]
)
print(completion.choices[0].message.content)

Using third-party SDKs

For information about using third-party SDKs and frameworks with OpenRouter, please see our frameworks documentation.

See the Request docs for all possible fields, and Parameters for explanations of specific sampling parameters.

    Llama 3.1 405B (base) (free) - API, Providers, Stats | OpenRouter