Estimate from the version's published specs, benchmarks and reviews, 0-5; scores are only comparable within one criteria year. Scored as launched (Claude 3 Opus, 4 Mar 2024): 200K-token context (Anthropic; >1M for select customers only); list price $15 in / $75 out per 1M tokens = $30 blended at 3:1; text and image input (Anthropic, TechCrunch). Reasoning null: the Artificial Analysis Intelligence Index did not exist at launch and AA's current page re-scores Opus 3 on index v4.1, so no launch-version figure was opened; Anthropic's own headline benchmarks (GPQA, MMLU, HumanEval) have no anchor. Coding null: no Terminal-Bench 4.0 result. Speed null: no tokens/s published at launch. Reviews: Ars Technica, TechCrunch (own question-set test of Opus), Zvi, Willison, The Decoder; independent hands-on tests of Opus are mostly early-days impressions.[1]
I'll say off the bat that Opus is among the more helpful chatbots I've played with, at least in the sense that its answers — when it gives answers — are succinct, pretty jargon-free and actionable.
We signed up for Claude Pro to try Opus for ourselves with a few informal tests. Opus feels similar in capability to ChatGPT-4.
Claude 3.0's largest version is in a similar class to GPT-4 and Gemini Advanced. It could plausibly now be the best model for many practical uses, with praise especially coming in on coding and creative writing.
Claude 3 Opus has self-reported benchmark scores that consistently beat GPT-4. This is a really big deal: in the 12+ months since the GPT-4 release no other model has consistently beat it in this way.
the recently released Claude 3 Opus is capable of generating coherent code for entire applications.
| The AI wars heat up with Claude 3, claimed to have "near-human" abilities · 2024年3月4日 | 0.30 |
|---|---|
| The new Claude 3 model family from Anthropic · 2024年3月4日 | 0.80 |
| On Claude 3.0 · 2024年3月6日 | 0.80 |
| We tested Anthropic's new chatbot — and came away a bit disappointed · 2024年3月7日 | 0.30 |
| Claude 3 writes multi-user browser painting app in 2 minutes and 48 seconds · 2024年3月7日 | 0.60 |
读者上传的照片,与图钉带来源的媒体分开显示。你可以为吃到或看到的内容评分,在餐厅图钉上还能直接在照片上标记菜品。
第一项始终是图钉的来源。总体可信度是各份资料对上方所用开始和结束时间支持程度的加权平均;资料每比最新的一份旧 180 天,权重减半。
Anthropic[2] 的发布文章标注日期为“2024 年 3 月 4 日”,并写道“Opus 和 Sonnet 现已在 claude[3].ai 和 Claude API 中可用,该 API 现已在 159 个国家全面开放”;CNBC[4] 和 TechCrunch[5] 均报道该发布发生在同一个周一。
Anthropic's[1] Claude[3] 3 model card (the link resolves to the PDF): the Claude 3 models' knowledge cutoff is August 2023 and they are offered through the Claude API, Amazon Bedrock and Google Vertex AI; it carries the full evaluations behind the launch post's table.
Anthropic's[1][2] deprecation history: on 30 June 2025 it notified developers of Claude Opus 3's retirement, and claude-3-opus-20240229 was retired on 5 January 2026 with claude-opus-4-8 as the recommended replacement.
CNBC's same-day report (published 2024-03-04T14:00Z): "Anthropic[1][2] on Monday debuted Claude[3] 3"; Opus outperformed GPT-4 and Gemini Ultra on benchmark tests, it is Anthropic's first multimodal model, Opus and Sonnet are available in 159 countries, and Anthropic's backers include Google, Salesforce and Amazon after about $7.3 billion in funding deals over the past year.
TechCrunch (Kyle Wiggers, 11:50 AM PST, 4 March 2024): Claude[3] 3 is Anthropic's[1][2] first multimodal model, can analyze up to 20 images in one request, starts with a 200,000-token context window (1 million for select customers), answers from data before August 2023, and Opus costs $15 per million input and $75 per million output tokens.
有遗漏或错误吗?用你自己的话说明:能佐证此图钉的链接、不同的开始或结束日期及理由,或缺失、有误的信息。AI 会对照此图钉的来源进行核实,搜索更好的来源,并添加任何支持你说法的页面。图钉自身的来源仍然最重要。AI 也会查看图片:显示的是别的东西或显示效果差的图片会被移到后面或替换。
原标题: Claude 3 Opus Released
| 基准测试 | Claude 3 Opus | Claude 3 Sonnet | Claude 3 Haiku | GPT-4 | GPT-3.5 | Gemini 1.0 Ultra | Gemini 1.0 Pro |
|---|---|---|---|---|---|---|---|
| MMLU(本科水平知识) | 86.8% 5-shot | 79.0% 5-shot | 75.2% 5-shot | 86.4% 5-shot | 70.0% 5-shot | 83.7% 5-shot | 71.8% 5-shot |
| GPQA, Diamond(研究生水平推理) | 50.4% 0-shot CoT | 40.4% 0-shot CoT | 33.3% 0-shot CoT | 35.7% 0-shot CoT | 28.1% 0-shot CoT | — | — |
| GSM8K(小学数学) | 95.0% 0-shot CoT | 92.3% 0-shot CoT | 88.9% 0-shot CoT | 92.0% 5-shot CoT | 57.1% 5-shot | 94.4% Maj1@32 | 86.5% Maj1@32 |
| MATH(数学问题求解) | 60.1% 0-shot CoT | 43.1% 0-shot CoT | 38.9% 0-shot CoT | 52.9% 4-shot | 34.1% 4-shot | 53.2% 4-shot | 32.6% 4-shot |
| MGSM(多语言数学) | 90.7% 0-shot | 83.5% 0-shot | 75.1% 0-shot | 74.5% 8-shot | — | 79.0% 8-shot | 63.5% 8-shot |
| HumanEval(代码) | 84.9% 0-shot | 73.0% 0-shot | 75.9% 0-shot | 67.0% 0-shot | 48.1% 0-shot | 74.4% 0-shot | 67.7% 0-shot |
| DROP, F1 score(文本推理) | 83.1 3-shot | 78.9 3-shot | 78.4 3-shot | 80.9 3-shot | 64.1 3-shot | 82.4 可变样本数 | 74.1 可变样本数 |
| BIG-Bench-Hard(综合评测) | 86.8% 3-shot CoT | 82.9% 3-shot CoT | 73.7% 3-shot CoT | 83.1% 3-shot CoT | 66.6% 3-shot CoT | 83.6% 3-shot CoT | 75.0% 3-shot CoT |
| ARC-Challenge(知识问答) | 96.4% 25-shot | 93.2% 25-shot | 89.2% 25-shot | 96.3% 25-shot | 85.2% 25-shot | — | — |
| HellaSwag(常识) | 95.4% 10-shot | 89.0% 10-shot | 85.9% 10-shot | 95.3% 10-shot | 85.5% 10-shot | 87.8% 10-shot | 84.7% 10-shot |