Meta: Llama 2 70B Chat

meta-llama/llama-2-70b-chat

Created Jun 20, 20234,096 context
$0.90/M input tokens$0.90/M output tokens

The flagship, 70 billion parameter language model from Meta, fine tuned for chat completions. Llama 2 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align to human preferences for helpfulness and safety.

Providers for Llama 2 70B Chat

OpenRouter routes requests to the best providers that are able to handle your prompt size and parameters, with fallbacks to maximize uptime.

Apps using Llama 2 70B Chat

Top public apps this week using this model

Recent activity on Llama 2 70B Chat

Tokens processed per day

Feb 1Feb 7Feb 13Feb 19Feb 25Mar 3Mar 9Mar 15Mar 21Mar 27Apr 2Apr 8Apr 14Apr 20Apr 26May 2020M40M60M80M

Uptime stats for Llama 2 70B Chat

Uptime stats for Llama 2 70B Chat across all providers

Sample code and API for Llama 2 70B Chat

OpenRouter normalizes requests and responses across providers for you.

OpenRouter provides an OpenAI-compatible completion API to 300+ models & providers that you can call directly, or using the OpenAI SDK. Additionally, some third-party SDKs are available.

In the examples below, the OpenRouter-specific headers are optional. Setting them allows your app to appear on the OpenRouter leaderboards.

from openai import OpenAI

client = OpenAI(
  base_url="https://openrouter.ai/api/v1",
  api_key="<OPENROUTER_API_KEY>",
)

completion = client.chat.completions.create(
  extra_headers={
    "HTTP-Referer": "<YOUR_SITE_URL>", # Optional. Site URL for rankings on openrouter.ai.
    "X-Title": "<YOUR_SITE_NAME>", # Optional. Site title for rankings on openrouter.ai.
  },
  extra_body={},
  model="meta-llama/llama-2-70b-chat",
  messages=[
    {
      "role": "user",
      "content": "What is the meaning of life?"
    }
  ]
)
print(completion.choices[0].message.content)

Using third-party SDKs

For information about using third-party SDKs and frameworks with OpenRouter, please see our frameworks documentation.

See the Request docs for all possible fields, and Parameters for explanations of specific sampling parameters.

    Meta: Llama 2 70B Chat | OpenRouter