| Spec | Value |
|---|---|
| Maker | Google DeepMind |
| Models | Ultra, Pro and Nano |
From Google's launch post and its text benchmark table image (GPT-4 MMLU is the CoT@32 figure given in the table's footnote). The post gives no context window, price or maximum output. · source
Estimate from the version's published specs, benchmarks and reviews, 0-5; scores are only comparable within one criteria year. Scored as launched: Gemini 1.0 family, 6 Dec 2023; Pro in Bard then, API from 13 Dec, Ultra unreleased. Existing axes preserved: reasoning/coding/speed/price null, 32k context=0, family modalities=5 (Bard shipped text-only). Reviews concern Gemini Pro or launch analysis, not an independently tested Ultra. Round21 replaces conflicting-date Akkio analysis with Akter et al. arXiv v1 (18 Dec 2023), a transparent ten-dataset comparison with code. Gemini Pro is slightly below GPT-3.5 Turbo overall, with task-specific strengths. This small early API-era study does not establish current model performance or anchor-compatible scores.[1]
I’d say both models are on the same level.
The updated version of Bard did well with some travel tasks, particularly finding flight options, but its answers still need to be taken with a grain of salt.
I love that ‘above 90%’ turns out to be exactly 90.04%, whereas human expert is 89.8%, prior SOTA was 86.4%.
Gemini Pro achieves accuracy that is close but slightly inferior to the corresponding GPT 3.5 Turbo
| Gemini 1.0 · Dec 7, 2023 | 0.60 |
|---|---|
| Google Bard’s Gemini Upgrade: We Tested it for Travel · Dec 9, 2023 | 0.00 |
| A Hands-On Comparison: Gemini Pro vs GPT-3.5 · Dec 12, 2023 | 0.20 |
| An In-depth Look at Gemini's Language Abilities · Dec 18, 2023 | -0.25 |
This pin follows the news: it shows what is known now, and here is what changed and what brought it.
New referenceby @ThePinGang
New referenceby @ThePinGang
Photos from readers, kept apart from the pin's sourced media. Rate what you ate or saw, and on a restaurant pin tag the dishes right on your photo.
The first entry is always the pin's source. Overall confidence is a weighted average of how firmly each reference supports the start and end times used above; a reference counts half as much for every 180 days older than the newest.
Google's launch post "Introducing Gemini: our largest and most capable AI model" is dated 6 December 2023 (Pichai and Hassabis announced it at a virtual press conference); Gemini Pro reached Bard on 13 December and Ultra followed on 8 February 2024.
Opened source supports this specific review extract; publication semantics and any live-benchmark scope are recorded in the research catalog. Does not establish pin event date. Review verification 2026-10-27 (round 21): Excluded from native reviews. Akkio original publication chronology remains conflicting. Replace active citation with version-fixed original third-party Gemini Pro benchmark paper; this does not resolve the old article date.
The Wikipedia article on the Gemini family dates the 1.0 announcement to 6 December 2023 and lists Nano (6 Dec), Pro (13 Dec) and Ultra (8 Feb 2024) as separate availability dates.
Review evidence round21: Original arXiv v1 submission 2023-12-18 18:47:42 UTC, not Dec24 v2 revision. Abstract and linked code identify ten datasets and Gemini Pro; no Ultra test or present-day Gemini inferred. Passage sentiment is a modest negative comparative verdict, not a benchmark-derived axis. Review verification 2026-10-27 (round 21): Original arXiv v1 submission 2023-12-18 18:47:42 UTC, not Dec24 v2 revision. Abstract and linked code identify ten datasets and Gemini Pro; no Ultra test or present-day Gemini inferred. Passage sentiment is a modest negative comparative verdict, not a benchmark-derived axis.
Something missing or wrong? Say it in your own words: a link that backs this pin up, a different start or end date and why, or a fact it lacks or gets wrong. The AI checks it against this pin's sources, searches for better ones, and adds any page that backs you up. The pin's own sources still count most. A picture that shows something else, or shows it badly, is looked at too, and moved down or replaced.