Qwen · Tools · Structured output · Sampling controls · Output limits · Released Oct 16, 2024
Provider pricing
Published rates for providers serving this model. Open any source to see where and when the price was checked.
| Provider | Input | Output | Cached input | Batch input | Evidence |
|---|---|---|---|---|---|
| $0.1/ 1M | $0.2/ 1M | Not published | Not published | Sourcehttps://openrouter.ai/api/v1/models See where this value came from and when it was checked.
|
Performance
Benchmark results collected from published sources. Scores from different benchmark versions or test setups may not be directly comparable.
| Benchmark | Category | Score | Origin | Evidence |
|---|---|---|---|---|
| IFEval | reasoning | 75.85 | Public benchmark | SourceIFEval via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| BBH | reasoning | 34.89 | Public benchmark | SourceBBH via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MATH Lvl 5 | reasoning | 50.00 | Public benchmark | SourceMATH Lvl 5 via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA | reasoning | 5.48 | Public benchmark | SourceGPQA via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MUSR | reasoning | 8.45 | Public benchmark | SourceMUSR via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| MMLU-PRO | reasoning | 36.52 | Public benchmark | SourceMMLU-PRO via the Open LLM Leaderboard See where this value came from and when it was checked.
|
| GPQA Diamond | reasoning | 32.80 | Public benchmark | SourceGPQA Diamond via OpenRouter See where this value came from and when it was checked.
|
| TAU-Bench | reasoning | 16.70 | Public benchmark | SourceTAU-Bench via OpenRouter See where this value came from and when it was checked.
|
History
Recorded changes in pricing, availability and other tracked model data.