Pins matching tag:"Long Context"

Google unveils Gemini 1.5 Pro, a mixture-of-experts model that matches Gemini 1.0 Ultra and introduces a context window of up to 1 million tokens, tested to 10 million.

Anthropic releases Claude 3 Opus, the most capable of its new Claude 3 models, which it says beats GPT-4 and Gemini 1.0 Ultra on most common benchmarks and brings image understanding to Claude for the first time.

At Google I/O 2024 Google debuts Gemini 1.5 Flash, a lighter and faster model with the same 1 million token context window as 1.5 Pro, alongside a 2 million token private preview for Pro.

OpenAI releases GPT-4.1, GPT-4.1 mini and GPT-4.1 nano in its API with 1-million-token context, a June 2024 knowledge cutoff and OpenAI's first nano model, priced at $0.10 per 1 million input tokens.

MiniMax releases M1, an open-weight 456B hybrid mixture-of-experts reasoning model with lightning attention, a 1M-token context and 80K-token reasoning output, trained with a new reinforcement-learning algorithm for a reported $534,700.

Moonshot AI releases Kimi K2-Instruct-0905, an update to its 1-trillion-parameter Kimi K2 that doubles the context window from 128K to 256K tokens and improves agentic coding and front-end output, with SWE-bench Verified at 69.2%.

Alibaba releases Qwen3-Next-80B-A3B-Instruct and Thinking, ultra-sparse 80B models that activate only 3B parameters per token, run a hybrid Gated DeltaNet attention design and carry an Apache 2.0 licence.

DeepSeek releases the experimental DeepSeek-V3.2-Exp, the first model with DeepSeek Sparse Attention, and cuts its API prices by more than half to $0.28 per million input tokens and $0.42 per million output tokens.

Z.ai (Zhipu AI) releases GLM-4.6, its flagship coding model with a 200K-token context window, which wins 48.6% of head-to-head real-world coding tasks against Claude Sonnet 4 and uses over 30% fewer tokens than GLM-4.5.

Anthropic releases Claude Sonnet 4.6, its most capable Sonnet, which coding testers preferred to Opus 4.5 and which becomes the free default in claude.ai with a 1M-token context window at $3 per million input tokens.

DeepSeek releases the DeepSeek-V4 preview as open weights: V4-Pro with 1.6 trillion parameters (49 billion active) and V4-Flash with 284 billion (13 billion active), both with a 1 million token context window and launch API prices from $0.14 per million input tokens.

Z.ai (Zhipu AI) releases GLM-5.2, an MIT-licensed 753B-parameter flagship built for long-horizon coding with a 1M-token context window, scoring 62.1 on SWE-bench Pro and 81.0 on Terminal Bench 2.1.

Moonshot AI releases Kimi K3, a 2.8-trillion-parameter open-weight multimodal model with a 1 million token context window, priced at $3.00 per million input tokens and $15.00 per million output tokens, with weights published on 27 July.

Upstage releases Solar Pro 4, an API-only agentic model with a 512K context window that scores 57 on Terminal-Bench v2.1, up from 12 for Solar Pro 3, at $0.30 per 1 million input tokens.

StepFun launches Step 5 Preview, a 600B-parameter sparse mixture-of-experts flagship with 27B active parameters and a 1M-token context, priced at $1.00 per 1 million input tokens and scoring 44 on the Artificial Analysis Intelligence Index.