Meta Llama · Tools · Structured output · Sampling controls · Output limits · Released Dec 6, 2024
Provider pricing
Published rates for providers serving this model. Open any source to see where and when the price was checked.
| Provider | Input | Output | Cached input | Batch input | Evidence |
|---|---|---|---|---|---|
| $0.2/ 1M | $0.52/ 1M | $0.1 | Not published | Sourcehttps://openrouter.ai/api/v1/models See where this value came from and when it was checked.
| |
| $0.585/ 1M | $0.768/ 1M | $0.293 | Not published | Sourcehttps://api.intelligence.io.solutions/api/v1/models See where this value came from and when it was checked.
|
Performance
Benchmark results collected from published sources. Scores from different benchmark versions or test setups may not be directly comparable.
| Benchmark | Category | Score | Origin | Evidence |
|---|---|---|---|---|
| IFEval | reasoning | 89.98 | Public benchmark | SourceIFEval via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| BBH | reasoning | 56.56 | Public benchmark | SourceBBH via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MATH Lvl 5 | reasoning | 48.34 | Public benchmark | SourceMATH Lvl 5 via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA | reasoning | 10.51 | Public benchmark | SourceGPQA via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MUSR | reasoning | 15.57 | Public benchmark | SourceMUSR via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MMLU-PRO | reasoning | 48.13 | Public benchmark | SourceMMLU-PRO via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA Diamond | reasoning | 46.60 | Public benchmark | SourceGPQA Diamond via OpenRouter See where this value came from and when it was checked.
|
| TAU-Bench | reasoning | 40.80 | Public benchmark | SourceTAU-Bench via OpenRouter See where this value came from and when it was checked.
|
| Artificial Analysis Coding | reasoning | 11.90 | Public benchmark | SourceArtificial Analysis Coding via OpenRouter See where this value came from and when it was checked.
|
| Artificial Analysis Intelligence | reasoning | 14.00 | Public benchmark | SourceArtificial Analysis Intelligence via openlm.ai See where this value came from and when it was checked.
|
| Chatbot Arena Elo | reasoning | 1276.00 | Public benchmark | SourceChatbot Arena Elo via openlm.ai See where this value came from and when it was checked.
|
| Chatbot Arena Coding Elo | reasoning | 1279.00 | Public benchmark | SourceChatbot Arena Coding Elo via openlm.ai See where this value came from and when it was checked.
|
| MMLU-Pro | reasoning | 71.30 | Public benchmark | SourceMMLU-Pro via openlm.ai See where this value came from and when it was checked.
|
History
Recorded changes in pricing, availability and other tracked model data.
Input, output and cached input rates changed.
See where this value came from and when it was checked.
Input, output and cached input rates changed.
See where this value came from and when it was checked.