How much does Llama 3.1 8B Instruct cost?

Llama 3.1 8B Instruct costs $0.02/M input tokens and $0.04/M output tokens.

What is the context length of Llama 3.1 8B Instruct?

Llama 3.1 8B Instruct has a 131,072 token context window. It supports up to 16,384 completion tokens.

Does Llama 3.1 8B Instruct support tool calling and structured outputs?

Yes. Llama 3.1 8B Instruct accepts tools and tool_choice for function calling on 2 of the 4 providers serving it, and requests that send tools are routed to those providers. It also supports structured outputs via a JSON schema in response_format.

Which providers serve Llama 3.1 8B Instruct?

Llama 3.1 8B Instruct is served by 4 providers on OpenRouter: DeepInfra, Groq, Cloudflare, and CoreWeave. Requests are routed to the best available provider, with automatic failover to the others, and you can pin or exclude providers with provider routing.

When was Llama 3.1 8B Instruct released?

Llama 3.1 8B Instruct was released on July 23, 2024. Its knowledge cutoff is December 31, 2023.

Meta: Llama 3.1 8B Instruct

meta-llama/llama-3.1-8b-instruct

Model weights

Compare

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Modalities

In / out price

$0.02 / $0.04per 1M

Context

131K

Released

Jul 23, 2024

Knowledge cutoff

Dec 2023

Providers

Different companies host the same model. OpenRouter routes your request to one of them based on the routing mode you pick: Balanced (price + speed), Nitro (fastest), or Floor (cheapest).

Latency / throughput


$0.02	$0.04	--	0.75s	22 tok/s	99.91%
$0.05	$0.08	$0.025	0.13s	346 tok/s	99.73%
$0.22	$0.22	$0.22	0.19s	137 tok/s	100.00%
$0.152	$0.287	--	0.43s	18 tok/s	98.68%

Input $0.02Output $0.04
22 tok/s99.91% uptime
Input $0.05Output $0.08
346 tok/s99.73% uptime
Input $0.22Output $0.22
137 tok/s100.00% uptime
Input $0.152Output $0.287
18 tok/s98.68% uptime

Pricing

The average price customers actually pay for this model, next to the prices providers post. Caching and discounts mean the price actually paid is often well below the listed one.

Weighted average

Input

$0.06829/M tokens

Output

$0.05421/M tokens

Llama 3.1 8B Instruct — Price history

Price history

No effective price data for this selection

$0.0195	$0.0373	0.0%	70.0%
$0.0437	$0.0771	24.1%	8.5%
$0.1513	$0.2822	0.0%	0.8%
$0.2197	$0.2137	12.2%	20.7%

Effective in $0.0195Effective out $0.0373
Token share
70.0%
Effective in $0.0437Effective out $0.0771
Token share
8.5%
Effective in $0.1513Effective out $0.2822
Token share
0.8%
Effective in $0.2197Effective out $0.2137
Token share
20.7%

Performance

Throughput is how fast the model writes (tokens per second — higher is better). Latency is total round-trip time (lower is better). TTFT is time-to-first-token — how long before you see anything appear (lower is better).

Throughput

346tok/s

P50, best across providers

Latency

0.13s

P50, best provider

Latency / throughput

AutoExacto benchmarks

GPQA DiamondTAU-Benchauto-routing26.9%33.7%Groq30.1%--CoreWeave27.7%--Novita26.3%--DeepInfra26.3%--

+1 more providers

Uptime

Uptime is the percentage of the past 3 days that at least one provider was responding to requests. Availability is the percentage of time that inference was successfully served. OpenRouter continuously monitors and uses the next-best provider when one returns an error.

Uptime (3d)

100.00%

Availability (3d)

99.97%

Availability over the last 3 days

Last 72 hours

Availability 99.97%

3 Days Ago2 Days AgoYesterdayNow

Availability over the last 24 hours

OpenRouter Availability

99.97%

Without Routing

98.26%

When an error occurs in an upstream provider, we can recover by routing to another healthy provider, if your request filters allow it. You can access per-provider uptime data programmatically through the Endpoints API. Learn more about our load balancing and provider routing options.

Benchmarks

Scores on standardized evaluations and this model’s own outputs on shared benchmark prompts. Higher percentages are better — and each rank shows where this model lands among the models evaluated on that source.

Benchmark score summary for Meta: Llama 3.1 8B Instruct (Artificial Analysis)
Source	Benchmark	Score
Artificial Analysis	Llama 3.1 Instruct 8B Coding Index	5.4
Artificial Analysis	Llama 3.1 Instruct 8B GPQA Diamond	25.9%
Artificial Analysis	Llama 3.1 Instruct 8B HLE	5.3%
Artificial Analysis	Llama 3.1 Instruct 8B IFBench	28.6%
Artificial Analysis	Llama 3.1 Instruct 8B τ²-Bench Telecom	16.4%
Artificial Analysis	Llama 3.1 Instruct 8B AA-LCR	18.0%
Artificial Analysis	Llama 3.1 Instruct 8B GDPval-AA	0.0%
Artificial Analysis	Llama 3.1 Instruct 8B CritPt	0.0%
Artificial Analysis	Llama 3.1 Instruct 8B LiveCodeBench	11.6%
Artificial Analysis	Llama 3.1 Instruct 8B Terminal-Bench Hard	0.8%
Artificial Analysis	Llama 3.1 Instruct 8B Terminal-Bench 2.1	1.5%
Artificial Analysis	Llama 3.1 Instruct 8B MMLU-Pro	47.6%
Artificial Analysis	Llama 3.1 Instruct 8B AIME 2025	4.3%
Artificial Analysis	Llama 3.1 Instruct 8B AIME	7.7%
Artificial Analysis	Llama 3.1 Instruct 8B MATH-500	51.9%

Not currently available through EU in-region routing. In-region routing docs

More models from Meta Llama

Llama 3.3 8B Instruct

A lightweight and ultra-fast variant of Llama 3.3 70B, for use when quick response times are needed most.

Text128K context

Llama Guard 4 12B

Llama Guard 4 is a Llama 4 Scout-derived multimodal pretrained model, fine-tuned for content safety classification. Similar to previous versions, it can be used to classify content in both LLM inputs (prompt classification) and in LLM responses (response classification). It acts as an LLM—generating text in its output that indicates whether a given prompt or response is safe or unsafe, and if unsafe, it also lists the content categories violated.

Llama Guard 4 was aligned to safeguard against the standardized MLCommons hazards taxonomy and designed to support multimodal Llama 4 capabilities. Specifically, it combines features from previous Llama Guard models, providing content moderation for English and multiple supported languages, along with enhanced capabilities to handle mixed text-and-image prompts, including multiple images. Additionally, Llama Guard 4 is integrated into the Llama Moderations API, extending robust safety classification to text and images.

Text164K context$0.18 / $0.18

Llama 4 Maverick

Llama 4 Maverick 17B Instruct (128E) is a high-capacity multimodal language model from Meta, built on a mixture-of-experts (MoE) architecture with 128 experts and 17 billion active parameters per forward pass (400B total). It supports multilingual text and image input, and produces multilingual text and code output across 12 supported languages. Optimized for vision-language tasks, Maverick is instruction-tuned for assistant-like behavior, image reasoning, and general-purpose multimodal interaction.

Maverick features early fusion for native multimodality and a 1 million token context window. It was trained on a curated mixture of public, licensed, and Meta-platform data, covering ~22 trillion tokens, with a knowledge cutoff in August 2024. Released on April 5, 2025 under the Llama 4 Community License, Maverick is suited for research and commercial applications requiring advanced multimodal understanding and high model throughput.

Text524K context$0.35 / $1

Llama 4 Scout

Llama 4 Scout 17B Instruct (16E) is a mixture-of-experts (MoE) language model developed by Meta, activating 17 billion parameters out of a total of 109B. It supports native multimodal input (text and image) and multilingual output (text and code) across 12 supported languages. Designed for assistant-style interaction and visual reasoning, Scout uses 16 experts per forward pass and features a context length of 10 million tokens, with a training corpus of ~40 trillion tokens.

Built for high efficiency and local or commercial deployment, Llama 4 Scout incorporates early fusion for seamless modality integration. It is instruction-tuned for use in multilingual chat, captioning, and image understanding tasks. Released under the Llama 4 Community License, it was last trained on data up to August 2024 and launched publicly on April 5, 2025.

Text1.3M context$0.10 / $0.30

Llama Guard 3 8B

Llama Guard 3 is a Llama-3.1-8B pretrained model, fine-tuned for content safety classification. Similar to previous versions, it can be used to classify content in both LLM inputs (prompt classification) and in LLM responses (response classification). It acts as an LLM – it generates text in its output that indicates whether a given prompt or response is safe or unsafe, and if unsafe, it also lists the content categories violated.

Llama Guard 3 was aligned to safeguard against the MLCommons standardized hazards taxonomy and designed to support Llama 3.1 capabilities. Specifically, it provides content moderation in 8 languages, and was optimized to support safety and security for search and code interpreter tool calls.

Text

Llama 3.3 70B Instruct

The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks.

Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.

Model Card

Text131K context$0.10 / $0.32

Llama 3.2 11B Vision Instruct

Llama 3.2 11B Vision is a multimodal model with 11 billion parameters, designed to handle tasks combining visual and textual data. It excels in tasks such as image captioning and visual question answering, bridging the gap between language generation and visual reasoning. Pre-trained on a massive dataset of image-text pairs, it performs well in complex, high-accuracy image analysis.

Its ability to integrate visual understanding with language processing makes it an ideal solution for industries requiring comprehensive visual-linguistic AI applications, such as content creation, AI-driven customer service, and research.

Click here for the original model card.

Usage of this model is subject to Meta's Acceptable Use Policy.

Text131K context

Llama 3.2 1B Instruct

Llama 3.2 1B is a 1-billion-parameter language model focused on efficiently performing natural language tasks, such as summarization, dialogue, and multilingual text analysis. Its smaller size allows it to operate efficiently in low-resource environments while maintaining strong task performance.

Supporting eight core languages and fine-tunable for more, Llama 1.3B is ideal for businesses or developers seeking lightweight yet powerful AI solutions that can operate in diverse multilingual settings without the high computational demand of larger models.

Click here for the original model card.

Usage of this model is subject to Meta's Acceptable Use Policy.

Text60K context$0.027 / $0.201

Llama 3.2 90B Vision Instruct

The Llama 90B Vision model is a top-tier, 90-billion-parameter multimodal model designed for the most challenging visual reasoning and language tasks. It offers unparalleled accuracy in image captioning, visual question answering, and advanced image-text comprehension. Pre-trained on vast multimodal datasets and fine-tuned with human feedback, the Llama 90B Vision is engineered to handle the most demanding image-based AI tasks.

This model is perfect for industries requiring cutting-edge multimodal AI capabilities, particularly those dealing with complex, real-time visual and textual analysis.

Click here for the original model card.

Usage of this model is subject to Meta's Acceptable Use Policy.

Text131K context

Llama 3.2 3B Instruct

Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with the latest transformer architecture, it supports eight languages, including English, Spanish, and Hindi, and is adaptable for additional languages.

Trained on 9 trillion tokens, the Llama 3.2 3B model excels in instruction-following, complex reasoning, and tool use. Its balanced performance makes it ideal for applications needing accuracy and efficiency in text generation across multilingual settings.

Click here for the original model card.

Usage of this model is subject to Meta's Acceptable Use Policy.

Text131K context$0.05 / $0.33

Llama 3.1 405B

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This is the base 405B pre-trained version.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Text131K context

Llama 3.1 70B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Text131K context$0.72 / $0.72

Llama 3.1 405B Instruct

The highly anticipated 400B class of Llama3 is here! Clocking in at 128k context with impressive eval scores, the Meta AI team continues to push the frontier of open-source LLMs.

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 405B instruct-tuned version is optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models including GPT-4o and Claude 3.5 Sonnet in evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Text131K context

LlamaGuard 2 8B

This safeguard model has 8B parameters and is based on the Llama 3 family. Just like is predecessor, LlamaGuard 1, it can do both prompt and response classification.

LlamaGuard 2 acts as a normal LLM would, generating text that indicates whether the given input/output is safe/unsafe. If deemed unsafe, it will also share the content categories violated.

For best results, please use raw prompt input or the /completions endpoint, instead of the chat API.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Text8K context

Llama 3 8B

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This is the base 8B pre-trained version.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Text8K context

Llama 3 70B

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This is the base 70B pre-trained version.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Text8K context

Llama 3 8B Instruct

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Text8K context

Llama 3 70B Instruct

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Text8K context

CodeLlama 70B Instruct

Code Llama is a family of large language models for code. This one is based on Llama 2 70B and provides zero-shot instruction-following ability for programming tasks.

Text2K context

CodeLlama 34B Instruct

Code Llama is built upon Llama 2 and excels at filling in code, handling extensive input contexts, and following programming instructions without prior training for various programming tasks.

Text8K context

Meta: Llama 3.1 8B Instruct

Providers