Estimate from the version's published specs, benchmarks and reviews, 0-5; scores are only comparable within one criteria year. Scored as launched (Claude Opus 4, 22 May 2025): 200K-token input window (Willison: 'still stuck at 200,000'; Latent Space AINews: 200K tokens, text and vision in; OpenRouter page: 200K); list price $15 in / $75 out per 1M tokens = $30 blended at 3:1 (Anthropic); text and image input. Anthropic: SWE-bench Verified 72.5%, original Terminal-Bench 43.2% - not Terminal-Bench 4.0, so coding is null rather than borrowed; Anthropic's GPQA Diamond 79.6% (Willison) has no AA-index anchor. Reasoning null (no launch-version AA index opened), speed null. Reviews: Zvi, 16x Engineer (own eval set, 25 May 2025), TechCrunch, Latent Space AINews; all are early reactions.[1]
If you don't care about price or speed, Opus is probably the best model available today.
Claude Opus 4 should be used when you need the most concise, precise code generation, particularly for complex tasks requiring sustained focus. However, at $15/$75 per million tokens (input/output), it comes at a premium price point.
To be clear, these improvements haven't yielded the world's best models by every benchmark. For example, while Opus 4 beats Google's Gemini 2.5 Pro and OpenAI's o3 and GPT-4.1 on SWE-bench Verified, which is designed to evaluate a model's coding abilities, it can't surpass o3
@gallabytes noted that while Claude4 is fun to code with, it's still not as good as Gemini at writing correct code on the first try, but the code it writes is a lot cleaner & easier to test.
| Anthropic's new Claude 4 AI models can reason over many steps · 2025年5月22日 | 0.10 |
|---|---|
| Anthropic releases Claude 4 Sonnet and Opus: Memory, Agent Capabilities, Claude Code, Redteam Drama · 2025年5月22日 | 0.20 |
| Claude Opus 4 and Claude Sonnet 4 Evaluation Results · 2025年5月25日 | 0.30 |
| Claude 4 You: The Quest for Mundane Utility · 2025年5月26日 | 0.80 |
读者上传的照片,与图钉带来源的媒体分开显示。你可以为吃到或看到的内容评分,在餐厅图钉上还能直接在照片上标记菜品。
第一项始终是图钉的来源。总体可信度是各份资料对上方所用开始和结束时间支持程度的加权平均;资料每比最新的一份旧 180 天,权重减半。
Anthropic's[1][6] system card: training data from the public internet as of March 2025; in a fictional test where it learns it will be replaced and the engineer responsible is having an affair, Claude[3] Opus 4 "will often attempt to blackmail the engineer" - in 84% of rollouts even when the replacement shares its values.
Anthropic[1][2][6] notified developers on 14 April 2026 that Claude Opus 4 (claude-opus-4-20250514) would be retired; it was retired on 15 June 2026, with claude-opus-4-8 as the replacement.
CNBC's same-day report (datePublished 2025-05-22T16:42Z): "Anthropic[1][2][6], the Amazon-backed OpenAI rival, on Thursday launched its most powerful group of AI models yet: Claude[3] 4"; Opus 4 is the "best coding model in the world" and could work autonomously for nearly a full corporate workday - seven hours - per chief science officer Jared Kaplan.
TechCrunch (9:45 AM PDT, 22 May 2025): launched at Anthropic's[1][2][6] inaugural developer conference; only paying users get Opus 4, priced at $15/$75 per million tokens on the API, Bedrock and Vertex AI; it beats Gemini 2.5 Pro, o3 and GPT-4.1 on SWE-bench Verified but not o3 on MMMU or GPQA Diamond.
有遗漏或错误吗?用你自己的话说明:能佐证此图钉的链接、不同的开始或结束日期及理由,或缺失、有误的信息。AI 会对照此图钉的来源进行核实,搜索更好的来源,并添加任何支持你说法的页面。图钉自身的来源仍然最重要。AI 也会查看图片:显示的是别的东西或显示效果差的图片会被移到后面或替换。
原标题: Claude Opus 4 Released
| 基准测试 | Claude Opus 4 | Claude Sonnet 4 | Claude Sonnet 3.7 | OpenAI o3 | OpenAI GPT-4.1 | Gemini 2.5 Pro Preview(05-06) |
|---|---|---|---|---|---|---|
| SWE-bench Verified¹˒⁵(智能体编程) | 72.5% / 79.4% | 72.7% / 80.2% | 62.3% / 70.3% | 69.1% | 54.6% | 63.2% |
| Terminal-bench²˒⁵(智能体终端编程) | 43.2% / 50.0% | 35.5% / 41.3% | 35.2% | 30.2% | 30.3% | 25.3% |
| GPQA Diamond⁵(研究生水平推理) | 79.6% / 83.3% | 75.4% / 83.8% | 78.2% | 83.3% | 66.3% | 83.0% |
| TAU-bench(智能体工具使用) | 零售 81.4%,航空 59.6% | 零售 80.5%,航空 60.0% | 零售 81.2%,航空 58.4% | 零售 70.4%,航空 52.0% | 零售 68.0%,航空 49.4% | — |
| MMMLU³(多语言问答) | 88.8% | 86.5% | 85.9% | 88.8% | 83.7% | — |
| MMMU, validation(视觉推理) | 76.5% | 74.4% | 75.0% | 82.9% | 74.8% | 79.6% |
| AIME 2025⁴˒⁵(高中数学竞赛) | 75.5% / 90.0% | 70.5% / 85.0% | 54.8% | 88.9% | — | 83.0% |
¹ Opus 4 和 Sonnet 4 在配合 bash/编辑器工具、10 次试验平均下 pass@1 得分分别为 72.5% 和 72.7%。² 与非 Claude 模型使用相同智能体时为 39.2% 和 33.5%;以 Claude Code 为智能体框架时为 43.2% 和 35.5%。³ 14 种非英语语言的平均成绩。⁴ 使用核采样(nucleus sampling),top_p 为 0.95。⁵ 第二个数字使用并行测试时计算,即抽样多次尝试并由内部评分模型挑选最佳结果。