Meta: Llama-3.1-70B-Instruct
Llama-3.1-70B-Instruct is a language model from Meta released on Jul 23, 2024. It reads text and writes text, with a 131K token context window and up to 16K tokens per reply.
Show moreShow less
It costs $0.72 per million input tokens and $0.72 per million output tokens.
It supports tool calling and structured JSON output, and its weights are open, so you can host it yourself.
5 providers serve it, including Amazon Bedrock, Vercel AI Gateway and Kilo Gateway. The lowest input price is $0.40 per million tokens at Kilo Gateway.
- Modalities
- In / out price
- $0.72 / $0.72 per 1M
- Context
- 131K
- Max output
- 16K
- Released
- Jul 23, 2024
- Knowledge cutoff
- Dec 2023
- Tool calling
- Structured output
- Reasoning
- Prompt caching
- Open weights
- Free to use
Llama-3.1-70B-Instruct pricing
USD, as listed on Oct 15, 2026. Most bills are input heavy, so the cached input rate matters as much as the headline price.
| Input | $0.72 / 1M tokens | |
|---|---|---|
| Output | $0.72 / 1M tokens |
Llama-3.1-70B-Instruct providers
5 providers serve it, including Amazon Bedrock, Vercel AI Gateway and Kilo Gateway. The lowest input price is $0.40 per million tokens at Kilo Gateway. Each host sets its own price and limits, so the cheapest one is not always the one with the longest context.
| Provider | Input /M | Output /M | Cache read /M | Context | Max output |
|---|---|---|---|---|---|
| Amazon Bedrock | $0.72 | $0.72 | – | 128K | 4K |
| Vercel AI Gateway | $0.72 | $0.72 | – | 128K | 8K |
| Kilo Gateway | $0.40 | $0.40 | – | 131K | 16K |
| DevPass (LLM Gateway) | $0.72 | $0.72 | – | 128K | 2K |
| Merge Gateway | $0.99 | $0.99 | – | 128K | 2K |
What Llama-3.1-70B-Instruct costs per month
Pick a workload close to yours or type your own volumes.
Supported request parameters
What you can set when you call Llama-3.1-70B-Instruct through an OpenAI compatible API.
- Tools
tools - Structured outputs
structured_outputs - Temperature
temperature
Alternatives to Llama-3.1-70B-Instruct
Models that take the same inputs and call tools, closest in price, cheaper ones first.
- Index 25.2
Reads text, images and video. Tool calling, structured output, reasoning. Served by 24 providers.
by qwenJun 2, 20261M context$0.40/M input tokens$1.60/M output tokens24 providers
- Index 17.5
Reads text and images. Tool calling, structured output, reasoning. Served by 12 providers.
by metaAug 10, 2026131K context$0.35/M input tokens$1.50/M output tokens12 providers
- Index 13.1
Reads text and images. Tool calling, structured output, reasoning. Served by 2 providers.
by cohereMay 20, 2026192K context$0.30/M input tokens$1.50/M output tokens2 providers
- 1.05M context
Reads text, images, files, audio and video. Tool calling, structured output, reasoning. Served by 25 providers.
by googleFeb 18, 2026$0.25/M input tokens$1.50/M output tokens25 providers
- Index 46.3
Reads text, images, audio and video. Tool calling, structured output, reasoning. Served by 17 providers.
by xiaomiSep 22, 20261.05M context$0.435/M input tokens$0.87/M output tokens17 providers
- Index 29.2
Reads text, images and video. Tool calling, structured output, reasoning. Served by 42 providers.
by minimaxMay 31, 20261M context$0.30/M input tokens$1.20/M output tokens42 providers
More from Meta
- 164K context
Reads text and images.
by meta-llamaApr 30, 2025$0.18/M input tokens$0.18/M output tokens
- 131K context
Reads text and images. Tool calling, structured output. Served by 5 providers.
by meta-llamaApr 5, 2025$0.20/M input tokens$0.78/M output tokens5 providers
- Index 10
Reads text and images. Tool calling, structured output. Served by 7 providers.
by meta-llamaJan 15, 20251.05M context$0.25/M input tokens$1/M output tokens7 providers
- Index 8.1
Reads text and images. Tool calling, structured output. Served by 4 providers.
by meta-llamaJan 1, 2025328K context$0.085/M input tokens$0.46/M output tokens4 providers
- 128K context
Reads text. Tool calling, structured output. Served by 3 providers.
by meta-llamaDec 6, 2024$1.35/M input tokens$1.35/M output tokens3 providers
- 24K context
Reads text. Tool calling, structured output. Served by 34 providers.
by meta-llamaDec 1, 2024$0.71/M input tokens$0.71/M output tokens34 providers
Llama-3.1-70B-Instruct questions
How much does the Llama-3.1-70B-Instruct API cost?
$0.72 per million input tokens and $0.72 per million output tokens. The estimator on this page turns that into a monthly bill for your own workload.
What is the context window of Llama-3.1-70B-Instruct?
131,072 tokens of input, and it can write up to 16,384 tokens in one reply. As a rough guide, a million tokens is around 750,000 English words.
Which providers serve Llama-3.1-70B-Instruct?
5 providers serve it, including Amazon Bedrock, Vercel AI Gateway and Kilo Gateway. The lowest input price is $0.40 per million tokens at Kilo Gateway. Prices differ by host, so the Providers table on this page lists each one with its input and output price.
Does Llama-3.1-70B-Instruct support tool calling?
Yes. It accepts tool definitions and can return JSON that matches a schema, which is what an agent needs to call your APIs.
Is Llama-3.1-70B-Instruct open source?
Its weights are published, so you can run it on your own hardware or a cloud of your choice. Read the license before commercial use.
When was Llama-3.1-70B-Instruct released?
Jul 23, 2024, with training data up to Dec 2023.
Catalog data from models.dev (MIT licensed), refreshed daily, last on Oct 15, 2026. The summary is written from these facts.
Building on Llama-3.1-70B-Instruct?
I test your real tasks on it and the two closest alternatives, then ship the agent on whichever wins on cost and accuracy.
Book Meeting