Meta Llama · Tools · Structured output · Sampling controls · Output limits · Released Dec 6, 2024
Provider pricing
Published rates for providers serving this model. Open any source to see where and when the price was checked.
| Provider | Input | Output | Cached input | Batch input | Evidence |
|---|---|---|---|---|---|
| $0.1/ 1M | $0.32/ 1M | Not published | Not published | Sourcehttps://openrouter.ai/api/v1/models See where this value came from and when it was checked.
| |
| $0.547/ 1M | $1.023/ 1M | $0.273 | Not published | Sourcehttps://api.intelligence.io.solutions/api/v1/models See where this value came from and when it was checked.
|
Performance
Benchmark results collected from published sources. Scores from different benchmark versions or test setups may not be directly comparable.
| Benchmark | Category | Score | Origin | Evidence |
|---|---|---|---|---|
| IFEval | reasoning | 89.98 | Public benchmark | SourceIFEval via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| BBH | reasoning | 56.56 | Public benchmark | SourceBBH via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MATH Lvl 5 | reasoning | 48.34 | Public benchmark | SourceMATH Lvl 5 via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA | reasoning | 10.51 | Public benchmark | SourceGPQA via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MUSR | reasoning | 15.57 | Public benchmark | SourceMUSR via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MMLU-PRO | reasoning | 48.13 | Public benchmark | SourceMMLU-PRO via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA Diamond | reasoning | 46.60 | Public benchmark | SourceGPQA Diamond via OpenRouter See where this value came from and when it was checked.
|
| TAU-Bench | reasoning | 40.80 | Public benchmark | SourceTAU-Bench via OpenRouter See where this value came from and when it was checked.
|
| Artificial Analysis Coding | reasoning | 11.90 | Public benchmark | SourceArtificial Analysis Coding via OpenRouter See where this value came from and when it was checked.
|
| Artificial Analysis Intelligence | reasoning | 14.00 | Public benchmark | SourceArtificial Analysis Intelligence via openlm.ai See where this value came from and when it was checked.
|
| Chatbot Arena Elo | reasoning | 1276.00 | Public benchmark | SourceChatbot Arena Elo via openlm.ai See where this value came from and when it was checked.
|
| Chatbot Arena Coding Elo | reasoning | 1279.00 | Public benchmark | SourceChatbot Arena Coding Elo via openlm.ai See where this value came from and when it was checked.
|
| MMLU-Pro | reasoning | 71.30 | Public benchmark | SourceMMLU-Pro via openlm.ai See where this value came from and when it was checked.
|
History
Recorded changes in pricing, availability and other tracked model data.
Input, output and cached input rates changed.
See where this value came from and when it was checked.