| Found the embedded text 99% of the time, up to 1M tokens |
| Google's benchmark panel | Better than 1.0 Pro on 87% of benchmarks; broadly similar to 1.0 Ultra |
|---|
From Google's launch post, which gives these figures in text but no benchmark scores, price or maximum output; it says pricing tiers were still to come. · source
Estimate from the version's published specs, benchmarks and reviews, 0-5; scores are only comparable within one criteria year. Scored as launched (Gemini 1.5 Pro, 15 Feb 2024, limited preview). Reasoning null: no Artificial Analysis Intelligence Index entry at launch; Google's claim is parity with 1.0 Ultra, no single headline benchmark comparable to the anchors. Coding null. Context 4: standard window 128,000 tokens but the launch headline and a private preview offered up to 1,000,000 tokens (tested to 10M in research); scored on the 1M headline; 1 if scored on the 128k standard window. Price null: preview was free at launch, paid list prices ($3.50 in / $10.50 out per 1M up to 128k) were only published in May 2024. Speed null (Google said latency was longer at 1M). Modalities 5: text, image, audio and video input per the launch post. Reviews are launch-week analysis and early-access impressions (Tom's Guide and Pat McGuinness are commentary on the announcement, Simon Willison is hands-on).[1]
I’ve been playing with Gemini Pro 1.5 for a few days, and I think the most exciting feature isn’t so much the token count... it’s the ability to use video as an input.
Gemini Pro 1.5 has a significantly larger context window than any other model on the market, up to 10 million tokens compared to, for example, 128,000 tokens for GPT-4.
showing off a 1 million token context window in a production AI model is most remarkable
| I test AI for a living and Google’s Gemini Pro 1.5 is a true turning point · Feb 16, 2024 | 0.70 |
|---|---|
| SHOCK NEWS x2! Gemini 1.5 & Sora Breakthroughs · Feb 16, 2024 | 0.70 |
| The killer app of Gemini Pro 1.5 is video · Feb 21, 2024 | 0.80 |
Photos from readers, kept apart from the pin's sourced media. Rate what you ate or saw, and on a restaurant pin tag the dishes right on your photo.
The first entry is always the pin's source. Overall confidence is a weighted average of how firmly each reference supports the start and end times used above; a reference counts half as much for every 180 days older than the newest.
Google's post "Our next-generation model: Gemini 1.5" is dated 15 February 2024 and opens a limited preview of 1.5 Pro for developers and enterprise customers that day.
The Wikipedia article lists Gemini 1.5 Pro as released on 15 February 2024 and describes the new mixture-of-experts architecture and one-million-token context window.
Something missing or wrong? Say it in your own words: a link that backs this pin up, a different start or end date and why, or a fact it lacks or gets wrong. The AI checks it against this pin's sources, searches for better ones, and adds any page that backs you up. The pin's own sources still count most. A picture that shows something else, or shows it badly, is looked at too, and moved down or replaced.
Epoch AI model database (Gemini 1.5 Pro); Epoch's confidence in the figures: Speculative. Blank tiles are not published.