Perplexity: Llama 3.1 Sonar 405B Online
perplexity/llama-3.1-sonar-huge-128k-online
Created Aug 14, 2024127,072 context
$5/M input tokens$5/M output tokens$5/K reqs
Llama 3.1 Sonar is Perplexity's latest model family. It surpasses their earlier Sonar models in cost-efficiency, speed, and performance. The model is built upon the Llama 3.1 405B and has internet access.
Sample code and API for Llama 3.1 Sonar 405B Online
OpenRouter normalizes requests and responses across providers for you.
OpenRouter provides an OpenAI-compatible completion API to 291 models & providers that you can call directly, or using the OpenAI SDK. Additionally, some third-party SDKs are available.
In the examples below, the OpenRouter-specific headers are optional. Setting them allows your app to appear on the OpenRouter leaderboards.
Using the OpenAI SDK
import OpenAI from "openai"
const openai = new OpenAI({
baseURL: "https://openrouter.ai/api/v1",
apiKey: $OPENROUTER_API_KEY,
defaultHeaders: {
"HTTP-Referer": $YOUR_SITE_URL, // Optional, for including your app on openrouter.ai rankings.
"X-Title": $YOUR_APP_NAME, // Optional. Shows in rankings on openrouter.ai.
}
})
async function main() {
const completion = await openai.chat.completions.create({
model: "perplexity/llama-3.1-sonar-huge-128k-online",
messages: [
{
"role": "user",
"content": "What is the meaning of life?"
}
]
})
console.log(completion.choices[0].message)
}
main()
Using the OpenRouter API directly
fetch("https://openrouter.ai/api/v1/chat/completions", {
method: "POST",
headers: {
"Authorization": `Bearer ${OPENROUTER_API_KEY}`,
"HTTP-Referer": `${YOUR_SITE_URL}`, // Optional, for including your app on openrouter.ai rankings.
"X-Title": `${YOUR_SITE_NAME}`, // Optional. Shows in rankings on openrouter.ai.
"Content-Type": "application/json"
},
body: JSON.stringify({
"model": "perplexity/llama-3.1-sonar-huge-128k-online",
"messages": [
{
"role": "user",
"content": "What is the meaning of life?"
}
]
})
});
Using third-party SDKs
For information about using third-party SDKs and frameworks with OpenRouter, please see our frameworks documentation.
See the Request docs for all possible parameters, and Parameters for recommended values.