Meta Llama · Structured output · Sampling controls · Output limits · Released Sep 25, 2024
Provider pricing
Published rates for providers serving this model. Open any source to see where and when the price was checked.
| Provider | Input | Output | Cached input | Batch input | Evidence |
|---|---|---|---|---|---|
| $0.05/ 1M | $0.33/ 1M | Not published | Not published | Sourcehttps://openrouter.ai/api/v1/models See where this value came from and when it was checked.
| |
| $0.051/ 1M | $0.335/ 1M | Not published | Not published | Sourcehttps://developers.cloudflare.com/workers-ai/platform/pricing/ See where this value came from and when it was checked.
|
Performance
Benchmark results collected from published sources. Scores from different benchmark versions or test setups may not be directly comparable.
| Benchmark | Category | Score | Origin | Evidence |
|---|---|---|---|---|
| IFEval | reasoning | 73.93 | Public benchmark | SourceIFEval via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| BBH | reasoning | 24.06 | Public benchmark | SourceBBH via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MATH Lvl 5 | reasoning | 17.67 | Public benchmark | SourceMATH Lvl 5 via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA | reasoning | 3.80 | Public benchmark | SourceGPQA via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MUSR | reasoning | 1.37 | Public benchmark | SourceMUSR via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MMLU-PRO | reasoning | 24.39 | Public benchmark | SourceMMLU-PRO via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA Diamond | reasoning | 11.60 | Public benchmark | SourceGPQA Diamond via OpenRouter See where this value came from and when it was checked.
|
| Artificial Analysis Intelligence | reasoning | 2.00 | Public benchmark | SourceArtificial Analysis Intelligence via openlm.ai See where this value came from and when it was checked.
|
| Chatbot Arena Elo | reasoning | 1118.00 | Public benchmark | SourceChatbot Arena Elo via openlm.ai See where this value came from and when it was checked.
|
| Chatbot Arena Coding Elo | reasoning | 1097.00 | Public benchmark | SourceChatbot Arena Coding Elo via openlm.ai See where this value came from and when it was checked.
|
| MMLU-Pro | reasoning | 34.70 | Public benchmark | SourceMMLU-Pro via openlm.ai See where this value came from and when it was checked.
|
History
Recorded changes in pricing, availability and other tracked model data.