NVIDIA: Llama 3.1 Nemotron 70B Instruct
Llama 3.1 Nemotron 70B Instruct is a language model from NVIDIA released on Apr 15, 2025. It reads text and writes text, with a 128K token context window and up to 8K tokens per reply.
Show moreShow less
It costs $0.357 per million input tokens and $0.408 per million output tokens. Cached input bills at $0.1785, 50% less than fresh input.
It supports tool calling and prompt caching, and its weights are open, so you can host it yourself.
3 providers serve it, including NanoGPT and Eden AI.
- Modalities
- In / out price
- $0.357 / $0.408 per 1M
- Context
- 128K
- Max output
- 8K
- Released
- Apr 15, 2025
- Knowledge cutoff
- n/a
- Tool calling
- Structured output
- Reasoning
- Prompt caching
- Open weights
- Free to use
Llama 3.1 Nemotron 70B Instruct pricing
USD, as listed on Oct 15, 2026. Most bills are input heavy, so the cached input rate matters as much as the headline price.
| Input | $0.357 / 1M tokens | |
|---|---|---|
| Output | $0.408 / 1M tokens | |
| Cached input (read) | $0.1785 / 1M tokens | 50% off input |
Llama 3.1 Nemotron 70B Instruct providers
3 providers serve it, including NanoGPT and Eden AI. Each host sets its own price and limits, so the cheapest one is not always the one with the longest context.
| Provider | Input /M | Output /M | Cache read /M | Context | Max output |
|---|---|---|---|---|---|
| Nvidia First party | $0 | $0 | – | 128K | 8K |
| NanoGPT | $0.357 | $0.408 | $0.1785 | 16K | 8K |
| Eden AI | $0.60 | $0.60 | – | 131K | 8K |
What Llama 3.1 Nemotron 70B Instruct costs per month
Pick a workload close to yours or type your own volumes.
Supported request parameters
What you can set when you call Llama 3.1 Nemotron 70B Instruct through an OpenAI compatible API.
- Tools
tools - Temperature
temperature
Alternatives to Llama 3.1 Nemotron 70B Instruct
Models that take the same inputs and call tools, closest in price, cheaper ones first.
- Index 39.5
Reads text and images. Tool calling, structured output, reasoning. Served by 55 providers.
by deepseekSep 10, 20261M context$0.15/M input tokens$0.60/M output tokens55 providers
- Index 11.3
Reads text and images. Tool calling, structured output, reasoning. Served by 15 providers.
by mistralaiMar 16, 2026262K context$0.15/M input tokens$0.60/M output tokens15 providers
- 128K context
Reads text. Tool calling, structured output. Served by 5 providers.
by cohereAug 30, 2024$0.15/M input tokens$0.60/M output tokens5 providers
- Index 11.6
Reads text. Tool calling, structured output, reasoning. Served by 60 providers.
by openaiJan 1, 2024131K context$0.15/M input tokens$0.60/M output tokens60 providers
- Index 25.3
Reads text. Tool calling, structured output, reasoning. Served by 17 providers.
by tencentJul 6, 2026262K context$0.14/M input tokens$0.58/M output tokens17 providers
- 100K context
Reads text. Tool calling, structured output. Served by 3 providers.
by mistralaiDec 2, 2025$0.3359/M input tokens$0.4478/M output tokens3 providers
More from NVIDIA
- 1.05M context
Reads text, images and video. Tool calling, reasoning.
by nvidiaOct 15, 2026$0/M input tokens$0/M output tokens
- Index 12.9
Reads text. Tool calling, structured output, reasoning. Served by 3 providers.
by nvidiaAug 11, 2026262K context$0/M input tokens$0/M output tokens3 providers
- 262K context
Reads text. Tool calling, structured output, reasoning. Served by 9 providers.
by nvidiaAug 11, 2026$0.05/M input tokens$0.20/M output tokens9 providers
- Index 22.9
Reads text. Tool calling, structured output, reasoning. Served by 18 providers.
by nvidiaJun 4, 20261M context$0.50/M input tokens$2.50/M output tokens18 providers
- 128K context
Reads text and images. Reasoning. Served by 6 providers.
by nvidiaJun 4, 2026$0.05/M input tokens$0.15/M output tokens6 providers
- 256K context
Reads text, images, audio and video. Tool calling, structured output, reasoning. Served by 7 providers.
by nvidiaApr 28, 2026$0.10/M input tokens$0.25/M output tokens7 providers
Llama 3.1 Nemotron 70B Instruct questions
How much does the Llama 3.1 Nemotron 70B Instruct API cost?
$0.357 per million input tokens and $0.408 per million output tokens, with cached input at $0.1785. The estimator on this page turns that into a monthly bill for your own workload.
What is the context window of Llama 3.1 Nemotron 70B Instruct?
128,000 tokens of input, and it can write up to 8,192 tokens in one reply. As a rough guide, a million tokens is around 750,000 English words.
Which providers serve Llama 3.1 Nemotron 70B Instruct?
3 providers serve it, including NanoGPT and Eden AI. Prices differ by host, so the Providers table on this page lists each one with its input and output price.
Does Llama 3.1 Nemotron 70B Instruct support tool calling?
Yes. It accepts tool definitions, which is what an agent needs to call your APIs.
Is Llama 3.1 Nemotron 70B Instruct open source?
Its weights are published, so you can run it on your own hardware or a cloud of your choice. Read the license before commercial use.
When was Llama 3.1 Nemotron 70B Instruct released?
Apr 15, 2025.
Catalog data from models.dev (MIT licensed), refreshed daily, last on Oct 15, 2026. The summary is written from these facts.
Building on Llama 3.1 Nemotron 70B Instruct?
I test your real tasks on it and the two closest alternatives, then ship the agent on whichever wins on cost and accuracy.
Book Meeting