Meta: Llama 3.1 8B Instruct

meta-llama/llama-3.1-8b-instruct

Created Jul 23, 2024131,072 context
$0.02/M input tokens$0.05/M output tokens

Providers for Llama 3.1 8B Instruct

OpenRouter routes requests to the top-ranked providers able to handle your prompts.

Apps using Llama 3.1 8B Instruct

Top public apps this week using this model

Recent activity on Llama 3.1 8B Instruct

Tokens processed per day

Oct 26, 2024Nov 2Nov 9Nov 16Nov 23Nov 30Dec 7Dec 14Dec 21Dec 28Jan 4Jan 11Jan 180500M1B1.5B2B

Versions by Token Share

Uptime stats for Llama 3.1 8B Instruct

Uptime stats for Llama 3.1 8B Instruct across all providers

Sample code and API for Llama 3.1 8B Instruct

OpenRouter normalizes requests and responses across providers for you.

OpenRouter provides an OpenAI-compatible completion API to 0 models & providers that you can call directly, or using the OpenAI SDK. Additionally, some third-party SDKs are available.

In the examples below, the OpenRouter-specific headers are optional. Setting them allows your app to appear on the OpenRouter leaderboards.

Using the OpenAI SDK

import OpenAI from "openai"

const openai = new OpenAI({
  baseURL: "https://openrouter.ai/api/v1",
  apiKey: "<OPENROUTER_API_KEY>",
  defaultHeaders: {
    "HTTP-Referer": "<YOUR_SITE_URL>", // Optional. Site URL for rankings on openrouter.ai.
    "X-Title": "<YOUR_SITE_NAME>", // Optional. Site title for rankings on openrouter.ai.
  }
})

async function main() {
  const completion = await openai.chat.completions.create({
    model: "meta-llama/llama-3.1-8b-instruct",
    messages: [
      {
        "role": "user",
        "content": "What is the meaning of life?"
      }
    ]
  })

  console.log(completion.choices[0].message)
}
main()

Using the OpenRouter API directly

fetch("https://openrouter.ai/api/v1/chat/completions", {
  method: "POST",
  headers: {
    "Authorization": "Bearer <OPENROUTER_API_KEY>",
    "HTTP-Referer": "<YOUR_SITE_URL>", // Optional. Site URL for rankings on openrouter.ai.
    "X-Title": "<YOUR_SITE_NAME>", // Optional. Site title for rankings on openrouter.ai.
    "Content-Type": "application/json"
  },
  body: JSON.stringify({
    "model": "meta-llama/llama-3.1-8b-instruct",
    "messages": [
      {
        "role": "user",
        "content": "What is the meaning of life?"
      }
    ]
  })
});

Using third-party SDKs

For information about using third-party SDKs and frameworks with OpenRouter, please see our frameworks documentation.

See the Request docs for all possible parameters, and Parameters for recommended values.