
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases.
It has demonstrated strong performance compared to leading closed-source models in human evaluations.
To read more about the model release, click here(opens in new tab). Usage of this model is subject to Meta's Acceptable Use Policy(opens in new tab).
Modalities
In / Out Price
$0.40 / $0.40per 1M
Context
131K
Released
Jul 23, 2024
Knowledge Cutoff
Dec 2023
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.
Llama 3.1 70B Instruct costs $0.40/M input tokens and $0.40/M output tokens.
Llama 3.1 70B Instruct has a 131,072 token context window. It supports up to 16,384 completion tokens.
Yes. Llama 3.1 70B Instruct accepts tools and tool_choice for function calling. It also supports structured outputs via a JSON schema in response_format.
Llama 3.1 70B Instruct is served by 3 providers on OpenRouter: DeepInfra (Turbo), Amazon Bedrock and CoreWeave. Requests are routed to the best available provider, with automatic failover to the others, and you can pin or exclude providers with provider routing.
Llama 3.1 70B Instruct was released on July 23, 2024. Its knowledge cutoff is December 31, 2023.