Meta: Llama 3.1 8B Instruct (free)

meta-llama/llama-3.1-8b-instruct:free

Created Jul 238,192 context

$0/M input tokens$0/M output tokens

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

Usage of this model is subject to Meta's Acceptable Use Policy.

These are free, rate-limited endpoints for Llama 3.1 8B Instruct. Outputs may be cached. Read about rate limits here.

Providers for Llama 3.1 8B Instruct (free)

OpenRouter load-balances requests across providers weighted by price unless you use dynamic routing.

Apps using Llama 3.1 8B Instruct (free)

Top public apps this week using this model

Recent activity on Llama 3.1 8B Instruct (free)

Tokens processed per day

Uptime stats for Llama 3.1 8B Instruct (free)

Uptime stats for Llama 3.1 8B Instruct (free) across all providers

Sample code and API for Llama 3.1 8B Instruct (free)

OpenRouter normalizes requests and responses across providers for you.

To get started, you can use Llama 3.1 8B Instruct (free) via API like this:

fetch("https://openrouter.ai/api/v1/chat/completions", {
  method: "POST",
  headers: {
    "Authorization": `Bearer ${OPENROUTER_API_KEY}`,
    "HTTP-Referer": `${YOUR_SITE_URL}`, // Optional, for including your app on openrouter.ai rankings.
    "X-Title": `${YOUR_SITE_NAME}`, // Optional. Shows in rankings on openrouter.ai.
    "Content-Type": "application/json"
  },
  body: JSON.stringify({
    "model": "meta-llama/llama-3.1-8b-instruct:free",
    "messages": [
      {
        "role": "user",
        "content": "What is the meaning of life?"
      }
    ]
  })
});

You can also use OpenRouter with OpenAI's client API:

import OpenAI from "openai"

const openai = new OpenAI({
  baseURL: "https://openrouter.ai/api/v1",
  apiKey: $OPENROUTER_API_KEY,
  defaultHeaders: {
    "HTTP-Referer": $YOUR_SITE_URL, // Optional, for including your app on openrouter.ai rankings.
    "X-Title": $YOUR_SITE_NAME, // Optional. Shows in rankings on openrouter.ai.
  }
})

async function main() {
  const completion = await openai.chat.completions.create({
    model: "meta-llama/llama-3.1-8b-instruct:free",
    messages: [
      {
        "role": "user",
        "content": "What is the meaning of life?"
      }
    ]
  })

  console.log(completion.choices[0].message)
}
main()

See the Request docs for all possible parameters, and Parameters for recommended values.