Meta Llama · Sampling controls · Output limits · Released Sep 25, 2024
Provider pricing
Published rates for providers serving this model. Open any source to see where and when the price was checked.
| Provider | Input | Output | Cached input | Batch input | Evidence |
|---|---|---|---|---|---|
| $0.027/ 1M | $0.201/ 1M | Not published | Not published | Sourcehttps://openrouter.ai/api/v1/models See where this value came from and when it was checked.
| |
| $0.027/ 1M | $0.201/ 1M | Not published | Not published | Sourcehttps://developers.cloudflare.com/workers-ai/platform/pricing/ See where this value came from and when it was checked.
|
Performance
Benchmark results collected from published sources. Scores from different benchmark versions or test setups may not be directly comparable.
| Benchmark | Category | Score | Origin | Evidence |
|---|---|---|---|---|
| IFEval | reasoning | 56.98 | Public benchmark | SourceIFEval via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| BBH | reasoning | 8.74 | Public benchmark | SourceBBH via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MATH Lvl 5 | reasoning | 7.02 | Public benchmark | SourceMATH Lvl 5 via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA | reasoning | 3.36 | Public benchmark | SourceGPQA via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MUSR | reasoning | 2.97 | Public benchmark | SourceMUSR via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MMLU-PRO | reasoning | 7.58 | Public benchmark | SourceMMLU-PRO via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| Chatbot Arena Elo | reasoning | 1067.00 | Public benchmark | SourceChatbot Arena Elo via openlm.ai See where this value came from and when it was checked.
|
| Chatbot Arena Coding Elo | reasoning | 1063.00 | Public benchmark | SourceChatbot Arena Coding Elo via openlm.ai See where this value came from and when it was checked.
|
| MMLU-Pro | reasoning | 20.00 | Public benchmark | SourceMMLU-Pro via openlm.ai See where this value came from and when it was checked.
|
History
Recorded changes in pricing, availability and other tracked model data.