Market preview
DeepSeek: DeepSeek Pro Latest+27%DeepSeek V4 Flash Latest+16%DeepSeek: DeepSeek V4 Flash 0731+16%@cf/ai4bharat/indictrans2-en-indic-1B$0.342 / 1MV100$0.02/hr
Meta Llama · Tools · Structured output · Sampling controls · Output limits · Released Jul 23, 2024
Provider pricing
Published rates for providers serving this model. Open any source to see where and when the price was checked.
| Provider | Input | Output | Cached input | Batch input | Evidence |
|---|---|---|---|---|---|
 OpenRouteropenrouter.ai ↗ | $0.4/ 1M | $0.4/ 1M | Not published | Not published | Sourcehttps://openrouter.ai/api/v1/models See where this value came from and when it was checked.
|
Performance
Benchmark results collected from published sources. Scores from different benchmark versions or test setups may not be directly comparable.
| Benchmark | Category | Score | Origin | Evidence |
|---|---|---|---|---|
| IFEval | reasoning | 86.69 | Public benchmark | SourceIFEval via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| BBH | reasoning | 55.93 | Public benchmark | SourceBBH via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MATH Lvl 5 | reasoning | 38.07 | Public benchmark | SourceMATH Lvl 5 via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA | reasoning | 14.21 | Public benchmark | SourceGPQA via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MUSR | reasoning | 17.69 | Public benchmark | SourceMUSR via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MMLU-PRO | reasoning | 47.88 | Public benchmark | SourceMMLU-PRO via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| Artificial Analysis Intelligence | reasoning | 11.00 | Public benchmark | SourceArtificial Analysis Intelligence via openlm.ai See where this value came from and when it was checked.
|
| Chatbot Arena Elo | reasoning | 1265.00 | Public benchmark | SourceChatbot Arena Elo via openlm.ai See where this value came from and when it was checked.
|
| Chatbot Arena Coding Elo | reasoning | 1268.00 | Public benchmark | SourceChatbot Arena Coding Elo via openlm.ai See where this value came from and when it was checked.
|
| MMLU-Pro | reasoning | 67.60 | Public benchmark | SourceMMLU-Pro via openlm.ai See where this value came from and when it was checked.
|
History
Recorded changes in pricing, availability and other tracked model data.