Pricing
Mortar charges per token. A prompt token read from the prefix cache costs 0.1× the input price; one that has to be processed is written to the cache for later requests at 1.25×, so caching saves money once more than about 22% of prompt tokens are read from it.
Mortar has not published prices yet. Each rate is derived from on-demand GPU list prices and measured throughput at 65% utilisation.
How you are charged
- Managed Cloud
- Per token, at the rates below. A prompt token read from the prefix cache costs 0.1× the input price, and every token that has to be processed is written to the cache at 1.25×. Output tokens are billed at the output rate.
- Bring Your Own Cloud
- Fees are not published yet. Email hello@mortalinference.si for a quote. Your cloud provider bills you for the GPU nodes.
- Currency
- US dollars. Figures on this page exclude tax.
- Billing month
- 730 hours, the cloud-billing convention, so a monthly figure reconciles with an invoice.
Rates
| Model | Input | Read from cache | Written to cache | Output | Calculator |
|---|---|---|---|---|---|
Qwen 2.5 7B Instruct
Qwen/Qwen2.5-7B-Instruct
|
$0.0313 | $0.0031 | $0.0391 | $0.2373 | Estimate with Qwen 2.5 7B Instruct |
Llama 3.1 8B Instruct
meta-llama/Llama-3.1-8B-Instruct
|
$0.0347 | $0.0035 | $0.0434 | $0.2654 | Estimate with Llama 3.1 8B Instruct |
Mistral 7B Instruct
mistralai/Mistral-7B-Instruct-v0.3
|
$0.0297 | $0.0030 | $0.0371 | $0.2278 | Estimate with Mistral 7B Instruct |
Qwen 2.5 32B Instruct
Qwen/Qwen2.5-32B-Instruct
|
$0.1529 | $0.0153 | $0.1911 | $1.1046 | Estimate with Qwen 2.5 32B Instruct |
Llama 3.3 70B Instruct
meta-llama/Llama-3.3-70B-Instruct
|
$0.6253 | $0.0625 | $0.7816 | $4.5671 | Estimate with Llama 3.3 70B Instruct |
DeepSeek-V3
deepseek-ai/DeepSeek-V3
|
$1.1057 | $0.1106 | $1.3821 | $7.7809 | Estimate with DeepSeek-V3 |
Context windows, model families and availability are in the model catalogue.
Estimate your monthly cost
Enter your own traffic. Nothing is filled in for you: the cache-hit rate has no default, and Mortar is compared with the same model without a prefix cache, or with prices you give for your current provider.
Or start from an illustrative example:
- Support assistant: a long shared system prompt and multi-turn chats.
- Retrieval: retrieved passages that differ for every question.
- Batch of unrelated prompts: nothing shared between requests, so the cache only adds cost.
What the estimate leaves out
- Tax.
- The GPU nodes of a Bring Your Own Cloud deployment, which your cloud provider bills.
- Network egress.
- Committed-use discounts, at Mortar or at your provider.
- Any surcharge your provider adds for writing to its cache, as Anthropic documents. Leaving it out understates what you pay today, so a saving shown here is, if anything, too small.
Spend controls
Mortar does not offer spend alerts or spend caps yet.
Questions
Why does output cost more than input?
A prompt's tokens are processed together in one pass. A reply is generated one token at a time, so each output token takes far more GPU time than an input token.
What counts as a cached token?
A prompt token that Mortar's prefix cache serves instead of processing again, at 0.1× the input price. The cache matches from the first token of a prompt and stops at the first difference, so only a shared prefix counts; every token after it is processed and written to the cache at 1.25×. Write cache-friendly prompts explains how to order one.
How do I measure my cache-hit rate?
Divide cached prompt tokens by all prompt tokens over a period. OpenAI-compatible APIs report the cached count for each response in usage.prompt_tokens_details.cached_tokens. On Mortar, the telemetry stream reports each session's cacheHitRate: see Measure your hit rate.