Meta: Llama 3.1 8B Instruct fp8
Llama 3.1 8B Instruct fp8 is a language model from Meta released on Jun 30, 2024. It reads text and writes text, with a 32K token context window and up to 32K tokens per reply.
Show moreShow less
It costs $0.22 per million input tokens and $0.22 per million output tokens. Cached input bills at $0.22, 0% less than fresh input.
It supports tool calling, structured JSON output and prompt caching, and its weights are open, so you can host it yourself.
12 providers serve it, including Novita AI, Hugging Face and Cloudflare Workers AI. The lowest input price is $0.02 per million tokens at Novita AI.
- Modalities
- In / out price
- $0.22 / $0.22 per 1M
- Context
- 32K
- Max output
- 32K
- Released
- Jun 30, 2024
- Knowledge cutoff
- Dec 2023
- Tool calling
- Structured output
- Reasoning
- Prompt caching
- Open weights
- Free to use
Llama 3.1 8B Instruct fp8 pricing
USD, as listed on Oct 15, 2026. Most bills are input heavy, so the cached input rate matters as much as the headline price.
| Input | $0.22 / 1M tokens | |
|---|---|---|
| Output | $0.22 / 1M tokens | |
| Cached input (read) | $0.22 / 1M tokens | 0% off input |
Llama 3.1 8B Instruct fp8 providers
12 providers serve it, including Novita AI, Hugging Face and Cloudflare Workers AI. The lowest input price is $0.02 per million tokens at Novita AI. Each host sets its own price and limits, so the cheapest one is not always the one with the longest context.
| Provider | Input /M | Output /M | Cache read /M | Context | Max output |
|---|---|---|---|---|---|
| Novita AI | $0.02 | $0.05 | – | 16K | 16K |
| Hugging Face | $0.06 | $0.06 | – | 131K | 4K |
| Cloudflare Workers AI | $0.152 | $0.287 | – | 32K | 32K |
| Amazon Bedrock | $0.22 | $0.22 | – | 128K | 4K |
| Helicone | $0.02 | $0.05 | – | 16K | 16K |
| Kilo Gateway | $0.02 | $0.04 | – | 131K | 118K |
| Inference | $0.025 | $0.025 | – | 16K | 4K |
| NanoGPT | $0.0544 | $0.085 | $0.0272 | 131K | 16K |
| Cortecs | $0.167 | $0.167 | – | 128K | 128K |
| Pioneer | $0.20 | $0.20 | $0.20 | 128K | 8K |
| CoreWeave | $0.22 | $0.22 | $0.22 | 131K | 131K |
| Merge Gateway | $0.22 | $0.22 | – | 128K | 2K |
What Llama 3.1 8B Instruct fp8 costs per month
Pick a workload close to yours or type your own volumes.
Supported request parameters
What you can set when you call Llama 3.1 8B Instruct fp8 through an OpenAI compatible API.
- Tools
tools - Structured outputs
structured_outputs - Temperature
temperature
Alternatives to Llama 3.1 8B Instruct fp8
Models that take the same inputs and call tools, closest in price, cheaper ones first.
- Index 14.7
Reads text and images. Tool calling, structured output, reasoning. Served by 38 providers.
by googleApr 2, 2026262K context$0.14/M input tokens$0.40/M output tokens38 providers
- Index 43.4
Reads text, images and files. Tool calling, structured output, reasoning. Served by 26 providers.
by anthropicOct 7, 20261M context$0.10/M input tokens$0.50/M output tokens26 providers
- Index 38.1
Reads text, images and files. Tool calling, structured output, reasoning. Served by 27 providers.
by openaiSep 22, 20261.05M context$0.10/M input tokens$0.50/M output tokens27 providers
- Index 6
Reads text and images. Tool calling, structured output. Served by 10 providers.
by mistralaiDec 2, 2025262K context$0.20/M input tokens$0.20/M output tokens10 providers
- 262K context
Reads text and images. Tool calling, structured output, reasoning. Served by 28 providers.
by googleApr 1, 2026$0.13/M input tokens$0.40/M output tokens28 providers
- Index 8.1
Reads text and images. Tool calling, structured output. Served by 4 providers.
by meta-llamaJan 1, 2025328K context$0.085/M input tokens$0.46/M output tokens4 providers
More from Meta
- 164K context
Reads text and images.
by meta-llamaApr 30, 2025$0.18/M input tokens$0.18/M output tokens
- 131K context
Reads text and images. Tool calling, structured output. Served by 5 providers.
by meta-llamaApr 5, 2025$0.20/M input tokens$0.78/M output tokens5 providers
- Index 10
Reads text and images. Tool calling, structured output. Served by 7 providers.
by meta-llamaJan 15, 20251.05M context$0.25/M input tokens$1/M output tokens7 providers
- Index 8.1
Reads text and images. Tool calling, structured output. Served by 4 providers.
by meta-llamaJan 1, 2025328K context$0.085/M input tokens$0.46/M output tokens4 providers
- 128K context
Reads text. Tool calling, structured output. Served by 3 providers.
by meta-llamaDec 6, 2024$1.35/M input tokens$1.35/M output tokens3 providers
- 24K context
Reads text. Tool calling, structured output. Served by 34 providers.
by meta-llamaDec 1, 2024$0.71/M input tokens$0.71/M output tokens34 providers
Llama 3.1 8B Instruct fp8 questions
How much does the Llama 3.1 8B Instruct fp8 API cost?
$0.22 per million input tokens and $0.22 per million output tokens, with cached input at $0.22. The estimator on this page turns that into a monthly bill for your own workload.
What is the context window of Llama 3.1 8B Instruct fp8?
32,000 tokens of input, and it can write up to 32,000 tokens in one reply. As a rough guide, a million tokens is around 750,000 English words.
Which providers serve Llama 3.1 8B Instruct fp8?
12 providers serve it, including Novita AI, Hugging Face and Cloudflare Workers AI. The lowest input price is $0.02 per million tokens at Novita AI. Prices differ by host, so the Providers table on this page lists each one with its input and output price.
Does Llama 3.1 8B Instruct fp8 support tool calling?
Yes. It accepts tool definitions and can return JSON that matches a schema, which is what an agent needs to call your APIs.
Is Llama 3.1 8B Instruct fp8 open source?
Its weights are published, so you can run it on your own hardware or a cloud of your choice. Read the license before commercial use.
When was Llama 3.1 8B Instruct fp8 released?
Jun 30, 2024, with training data up to Dec 2023.
Catalog data from models.dev (MIT licensed), refreshed daily, last on Oct 15, 2026. The summary is written from these facts.
Building on Llama 3.1 8B Instruct fp8?
I test your real tasks on it and the two closest alternatives, then ship the agent on whichever wins on cost and accuracy.
Book Meeting