Batch API cost calculator
A workload sent request by request against the same workload through each provider's own Batch API, at the discount the provider states.
What it does
Some providers run requests asynchronously, at a discount, when you do not need the answer right away. Describe the workload — tokens per request, requests per day, how many days — and the calculator compares, model by model, what it costs sent request by request (sync) and through the provider's own Batch API.
Salyro does not offer a Batch API. The batch figures describe each provider's own, so you can decide which workloads belong there.
Everything runs in your browser. Nothing you enter is sent anywhere.
How it computes
- Sync is priced by the function Salyro prices usage with (
calculateCost), from Salyro's price list, and multiplied by the number of requests. - Batch is the sync amount less the discount the provider states for its Batch API, in exact decimals. A provider that bills every batch token at half its standard rate halves every amount, so this equals pricing at the halved rates.
- Discounts are read from each provider's own documentation and dated. They are listed under the table.
What it does not know
- A discount nobody has read from the provider's page is unknown, not an assumed 50%. The batch column then says unknown.
- It does not model how long a batch takes, the provider's limits on batch size, or requests that fail and must be sent again.
- It does not combine the batch discount with prompt caching. Some providers apply both; see the prompt caching calculator for the caching side.
- A model that is not priced sync is not priced in batch either.
FAQ
Why is the batch cost "unknown" for some models?
The provider's page with its batch discount could not be read when the facts were compiled. Only the provider's own page may supply a discount, so it stays unknown until someone reads it.
Can I send batch jobs through Salyro?
No. Salyro does not offer a Batch API. This calculator helps you compare against the providers' own batch offerings.
Is the discount the same for every model?
The discount is recorded per model, as each provider states it. Where the provider's page also lists batch prices per model, the recorded discount was checked against them when it was read.
Sources
Prices come from Salyro's catalogue, with the revision and each provider's pricing page named under the table. Every batch discount names the provider page it was read from, and the date.
Where the numbers come from
- Model and pricing data is a snapshot of the catalogue Salyro itself uses, taken when this site was built.
- Facts about models and providers that are not in that catalogue carry their own source and the date they were checked, and are shown as unknown where no reliable source exists.