Meta: Llama 3.1 8B Instruct
Llama 3.1 8B Instruct is a language model from Meta released on Jul 23, 2024. It reads text and writes text, with a 128K token context window and up to 4K tokens per reply.
Show moreShow less
It costs $0.02 per million input tokens and $0.05 per million output tokens.
It supports tool calling and structured JSON output, and its weights are open, so you can host it yourself.
3 providers serve it, including Vercel AI Gateway, Abacus and Neon.
- Modalities
- In / out price
- $0.02 / $0.05 per 1M
- Context
- 128K
- Max output
- 4K
- Released
- Jul 23, 2024
- Knowledge cutoff
- n/a
- Tool calling
- Structured output
- Reasoning
- Prompt caching
- Open weights
- Free to use
Llama 3.1 8B Instruct pricing
USD, as listed on Oct 15, 2026. Most bills are input heavy, so the cached input rate matters as much as the headline price.
| Input | $0.02 / 1M tokens | |
|---|---|---|
| Output | $0.05 / 1M tokens |
Llama 3.1 8B Instruct providers
3 providers serve it, including Vercel AI Gateway, Abacus and Neon. Each host sets its own price and limits, so the cheapest one is not always the one with the longest context.
| Provider | Input /M | Output /M | Cache read /M | Context | Max output |
|---|---|---|---|---|---|
| Vercel AI Gateway | $0.22 | $0.22 | – | 128K | 8K |
| Abacus | $0.02 | $0.05 | – | 128K | 4K |
| Neon | $0.15 | $0.45 | – | 131K | 8K |
What Llama 3.1 8B Instruct costs per month
Pick a workload close to yours or type your own volumes.
Supported request parameters
What you can set when you call Llama 3.1 8B Instruct through an OpenAI compatible API.
- Tools
tools - Structured outputs
structured_outputs - Temperature
temperature
Alternatives to Llama 3.1 8B Instruct
Models that take the same inputs and call tools, closest in price, cheaper ones first.
- 66K context
Reads text. Tool calling, reasoning. Served by 2 providers.
by sarvamFeb 18, 2026$0.02/M input tokens$0.10/M output tokens2 providers
Reads text and audio. Tool calling, structured output. Served by 2 providers.
by mistralaiJul 15, 2025$0.04/M input tokens$0.04/M output tokens2 providers
- 128K context
Reads text. Tool calling. Served by 5 providers.
by mistralaiOct 1, 2024$0.04/M input tokens$0.04/M output tokens5 providers
- 131K context
Reads text. Tool calling, structured output. Served by 3 providers.
by ibm-graniteOct 2, 2025$0.017/M input tokens$0.112/M output tokens3 providers
- 128K context
Reads text. Tool calling, structured output. Served by 5 providers.
by cohereDec 2, 2024$0.0375/M input tokens$0.15/M output tokens5 providers
- 131K context
Reads text and images. Tool calling, structured output. Served by 7 providers.
by googleMar 12, 2025$0.04/M input tokens$0.08/M output tokens7 providers
More from Meta
- 164K context
Reads text and images.
by meta-llamaApr 30, 2025$0.18/M input tokens$0.18/M output tokens
- 131K context
Reads text and images. Tool calling, structured output. Served by 5 providers.
by meta-llamaApr 5, 2025$0.20/M input tokens$0.78/M output tokens5 providers
- Index 10
Reads text and images. Tool calling, structured output. Served by 7 providers.
by meta-llamaJan 15, 20251.05M context$0.25/M input tokens$1/M output tokens7 providers
- Index 8.1
Reads text and images. Tool calling, structured output. Served by 4 providers.
by meta-llamaJan 1, 2025328K context$0.085/M input tokens$0.46/M output tokens4 providers
- 128K context
Reads text. Tool calling, structured output. Served by 3 providers.
by meta-llamaDec 6, 2024$1.35/M input tokens$1.35/M output tokens3 providers
- 24K context
Reads text. Tool calling, structured output. Served by 34 providers.
by meta-llamaDec 1, 2024$0.71/M input tokens$0.71/M output tokens34 providers
Llama 3.1 8B Instruct questions
How much does the Llama 3.1 8B Instruct API cost?
$0.02 per million input tokens and $0.05 per million output tokens. The estimator on this page turns that into a monthly bill for your own workload.
What is the context window of Llama 3.1 8B Instruct?
128,000 tokens of input, and it can write up to 4,096 tokens in one reply. As a rough guide, a million tokens is around 750,000 English words.
Which providers serve Llama 3.1 8B Instruct?
3 providers serve it, including Vercel AI Gateway, Abacus and Neon. Prices differ by host, so the Providers table on this page lists each one with its input and output price.
Does Llama 3.1 8B Instruct support tool calling?
Yes. It accepts tool definitions and can return JSON that matches a schema, which is what an agent needs to call your APIs.
Is Llama 3.1 8B Instruct open source?
Its weights are published, so you can run it on your own hardware or a cloud of your choice. Read the license before commercial use.
When was Llama 3.1 8B Instruct released?
Jul 23, 2024.
Catalog data from models.dev (MIT licensed), refreshed daily, last on Oct 15, 2026. The summary is written from these facts.
Building on Llama 3.1 8B Instruct?
I test your real tasks on it and the two closest alternatives, then ship the agent on whichever wins on cost and accuracy.
Book Meeting