| Spec | Value |
|---|---|
| Maker | Anthropic[1][2][6] |
| API price per 1M tokens | $15 input, $75 output |
| Availability | Claude[3] API, Amazon Bedrock, Google Cloud Vertex AI |
From Anthropic's Claude 4 launch post and its benchmark table; scores are single-attempt, without parallel test-time compute. The post states no context window or maximum output. · source
Estimate from the version's published specs, benchmarks and reviews, 0-5; scores are only comparable within one criteria year. Scored as launched (Claude Opus 4, 22 May 2025): 200K-token input window (Willison: 'still stuck at 200,000'; Latent Space AINews: 200K tokens, text and vision in; OpenRouter page: 200K); list price $15 in / $75 out per 1M tokens = $30 blended at 3:1 (Anthropic); text and image input. Anthropic: SWE-bench Verified 72.5%, original Terminal-Bench 43.2% - not Terminal-Bench 4.0, so coding is null rather than borrowed; Anthropic's GPQA Diamond 79.6% (Willison) has no AA-index anchor. Reasoning null (no launch-version AA index opened), speed null. Reviews: Zvi, 16x Engineer (own eval set, 25 May 2025), TechCrunch, Latent Space AINews; all are early reactions.[1]
If you don't care about price or speed, Opus is probably the best model available today.
Claude Opus 4 should be used when you need the most concise, precise code generation, particularly for complex tasks requiring sustained focus. However, at $15/$75 per million tokens (input/output), it comes at a premium price point.
To be clear, these improvements haven't yielded the world's best models by every benchmark. For example, while Opus 4 beats Google's Gemini 2.5 Pro and OpenAI's o3 and GPT-4.1 on SWE-bench Verified, which is designed to evaluate a model's coding abilities, it can't surpass o3
@gallabytes noted that while Claude4 is fun to code with, it's still not as good as Gemini at writing correct code on the first try, but the code it writes is a lot cleaner & easier to test.
| Anthropic's new Claude 4 AI models can reason over many steps · May 22, 2025 | 0.10 |
|---|---|
| Anthropic releases Claude 4 Sonnet and Opus: Memory, Agent Capabilities, Claude Code, Redteam Drama · May 22, 2025 | 0.20 |
| Claude Opus 4 and Claude Sonnet 4 Evaluation Results · May 25, 2025 | 0.30 |
| Claude 4 You: The Quest for Mundane Utility · May 26, 2025 | 0.80 |
Photos from readers, kept apart from the pin's sourced media. Rate what you ate or saw, and on a restaurant pin tag the dishes right on your photo.
The first entry is always the pin's source. Overall confidence is a weighted average of how firmly each reference supports the start and end times used above; a reference counts half as much for every 180 days older than the newest.
Anthropic's[2][6] post is dated "May 22, 2025": "Today, we're introducing the next generation of Claude[3] models: Claude Opus 4 and Claude Sonnet 4", "available on our API, Amazon Bedrock, and Google Cloud's Vertex AI"; CNBC[4] and TechCrunch[5] report the launch that Thursday.
Anthropic's[1][6] system card: training data from the public internet as of March 2025; in a fictional test where it learns it will be replaced and the engineer responsible is having an affair, Claude[3] Opus 4 "will often attempt to blackmail the engineer" - in 84% of rollouts even when the replacement shares its values.
Anthropic[1][2][6] notified developers on 14 April 2026 that Claude Opus 4 (claude-opus-4-20250514) would be retired; it was retired on 15 June 2026, with claude-opus-4-8 as the replacement.
CNBC's same-day report (datePublished 2025-05-22T16:42Z): "Anthropic[1][2][6], the Amazon-backed OpenAI rival, on Thursday launched its most powerful group of AI models yet: Claude[3] 4"; Opus 4 is the "best coding model in the world" and could work autonomously for nearly a full corporate workday - seven hours - per chief science officer Jared Kaplan.
TechCrunch (9:45 AM PDT, 22 May 2025): launched at Anthropic's[1][2][6] inaugural developer conference; only paying users get Opus 4, priced at $15/$75 per million tokens on the API, Bedrock and Vertex AI; it beats Gemini 2.5 Pro, o3 and GPT-4.1 on SWE-bench Verified but not o3 on MMMU or GPQA Diamond.
Something missing or wrong? Say it in your own words: a link that backs this pin up, a different start or end date and why, or a fact it lacks or gets wrong. The AI checks it against this pin's sources, searches for better ones, and adds any page that backs you up. The pin's own sources still count most. A picture that shows something else, or shows it badly, is looked at too, and moved down or replaced.
| Benchmark | Claude Opus 4 | Claude Sonnet 4 | Claude Sonnet 3.7 | OpenAI o3 | OpenAI GPT-4.1 | Gemini 2.5 Pro Preview (05-06) |
|---|---|---|---|---|---|---|
| SWE-bench Verified¹˒⁵ (agentic coding) | 72.5% / 79.4% | 72.7% / 80.2% | 62.3% / 70.3% | 69.1% | 54.6% | 63.2% |
| Terminal-bench²˒⁵ (agentic terminal coding) | 43.2% / 50.0% | 35.5% / 41.3% | 35.2% | 30.2% | 30.3% | 25.3% |
| GPQA Diamond⁵ (graduate-level reasoning) | 79.6% / 83.3% | 75.4% / 83.8% | 78.2% | 83.3% | 66.3% | 83.0% |
| TAU-bench (agentic tool use) | Retail 81.4%, Airline 59.6% | Retail 80.5%, Airline 60.0% | Retail 81.2%, Airline 58.4% | Retail 70.4%, Airline 52.0% | Retail 68.0%, Airline 49.4% | — |
| MMMLU³ (multilingual Q&A) | 88.8% | 86.5% | 85.9% | 88.8% | 83.7% | — |
| MMMU, validation (visual reasoning) | 76.5% | 74.4% | 75.0% | 82.9% | 74.8% | 79.6% |
| AIME 2025⁴˒⁵ (high school math competition) | 75.5% / 90.0% | 70.5% / 85.0% | 54.8% | 88.9% | — | 83.0% |
¹ Opus 4 and Sonnet 4 score 72.5% and 72.7% pass@1 with bash/editor tools, averaged over 10 trials. ² 39.2% and 33.5% with the same agent as non-Claude models; 43.2% and 35.5% with Claude Code as the agent framework. ³ Average over 14 non-English languages. ⁴ Run with nucleus sampling, top_p 0.95. ⁵ The second figure uses parallel test-time compute, sampling several attempts and picking the best with an internal scoring model.