第一项始终是图钉的来源。总体可信度是各份资料对上方所用开始和结束时间支持程度的加权平均;资料每比最新的一份旧 180 天,权重减半。
Meta 的模型卡注明“Model Release Date: 70B Instruct: December 6, 2024”;TechCrunch[5] 的报道日期为 2024年12月6日,OpenRouter[6] 也将 meta-llama/llama-3.3-70b-instruct 列为同一天创建。
Reproduces Meta's benchmark and pricing table: Llama 3.3 70B against Llama 3.1 70B and 405B, Amazon Nova Pro, Gemini Pro 1.5, GPT-4o and Claude 3.5 Sonnet, with a $0.1 input and $0.4 output per 1 million tokens row; notes training on over 15 trillion tokens to December 2023 and the 700 million monthly user cap.[1]
Secondary explainer: head-to-head with GPT-4o (IFEval 92.1 against 84.6, HumanEval 88.4 against 86.0, MMLU Pro 68.9 against 73.8), Artificial Analysis Quality Index 74 against 86 for o1-preview, and where to run it: Hugging Face[1], Ollama (about 42 GB), Groq, Deep Infra, Hyperbolic, Fireworks and Together AI.
Meta's model card: 70B text-in text-out, 128k context, GQA, 15T+ pretraining tokens with a December 2023 cutoff, over 25M synthetic fine-tuning examples, 7.0M H100 GPU hours and 12.9 tons CO2eq location-based, eight supported languages, and the instruction-tuned table against Llama 3.1 8B, 70B and 405B.[1]
Same-day report by Kyle Wiggers: Meta says it delivers the performance of Llama 3.1 405B at lower cost, Ahmad Al-Dahle's chart against Gemini 1.5 Pro, GPT-4o and Nova Pro, the 700-million-user licence clause, more than 650 million Llama downloads, Meta AI near 600 million monthly users, and Llama 4 needing 10x the compute.[1]
有遗漏或错误吗?用你自己的话说明:能佐证此图钉的链接、不同的开始或结束日期及理由,或缺失、有误的信息。AI 会对照此图钉的来源进行核实,搜索更好的来源,并添加任何支持你说法的页面。图钉自身的来源仍然最重要。AI 也会查看图片:显示的是别的东西或显示效果差的图片会被移到后面或替换。
原标题: Llama 3.3 70B Released
| 基准 | Llama 3.1 8B | Llama 3.1 70B | Llama 3.3 70B | Llama 3.1 405B |
|---|---|---|---|---|
| MMLU (CoT, 0-shot) | 73.0 | 86.0 | 86.0 | 88.6 |
| MMLU Pro (CoT, 5-shot) | 48.3 | 66.4 | 68.9 | 73.3 |
| IFEval | 80.4 | 87.5 | 92.1 | 88.6 |
| GPQA Diamond (CoT) | 31.8 | 48.0 | 50.5 | 49.0 |
| HumanEval (pass@1) | 72.6 | 80.5 | 88.4 | 89.0 |
| MBPP EvalPlus (base) | 72.8 | 86.0 | 87.6 | 88.6 |
| MATH (CoT) | 51.9 | 68.0 | 77.0 | 73.8 |
| BFCL v2 | 65.4 | 77.5 | 77.3 | 81.1 |
| MGSM | 68.9 | 86.9 | 91.1 | 91.6 |