GPT-5.5
A model used as an automated judge in Claire Vo’s benchmark. It contributes 30% of the scoring alongside her manual evaluation.
Key Highlights
- GPT-5.5 is notably used as the automated judge for 30% of Claire Vo’s live benchmark scoring.
- Newsletter mentions connect GPT-5.5 to coding workflows, agentic development, browser automation, and enterprise deployment.
- OpenAI’s evaluation guidance used GPT-5.5 to show how harness design can materially change benchmark outcomes.
- Its release on AWS Bedrock makes GPT-5.5 especially relevant for enterprise AI PMs with governance and procurement constraints.
- GPT-Live delegates deeper search and reasoning to GPT-5.5, positioning it as a background intelligence layer in voice experiences.
GPT-5.5
Overview
GPT-5.5 is an OpenAI model referenced across product, coding, evaluation, and voice workflows in the newsletter corpus. In the clearest recurring usage, it appears as an automated judge in Claire Vo’s benchmark, where it contributes 30% of total scoring alongside her 70% manual evaluation. Across other mentions, GPT-5.5 also shows up as a general-purpose reasoning and coding model used through ChatGPT, Codex, AWS Bedrock, and supporting systems like GPT-Live.For AI Product Managers, GPT-5.5 matters less as a single launch event and more as an indicator of how frontier models are being operationalized in real workflows: benchmark scoring, coding-agent orchestration, browser/computer automation, enterprise deployment, and voice products that hand off deeper reasoning in the background. The mentions suggest it is valued for speed, steering controls, long-context performance when properly harnessed, and strong utility in development workflows, while also being compared head-to-head with Anthropic’s Opus line and other frontier models.
Key Developments
- 2026-05-25: Dan Shipper described Every’s custom “senior engineer benchmark,” where GPT 5.5 scored 62/100 on a rewrite task; this was a major jump over prior coding models that had scored 30/100.
- 2026-05-29: Anthropic’s Claude Opus 4.8 announcement cited internal or comparative results showing Opus 4.8 completed every Super-Agent case end-to-end, outperforming prior Opus models and GPT-5.5 on that benchmark.
- 2026-05-30: OpenAI’s guidance on trustworthy third-party evaluations used GPT-5.5 to illustrate how harness design changes results, noting better performance when compaction preserves task-relevant long-context information.
- 2026-05-31: Peter Yang highlighted Josh Pigford’s solo-building workflow, which used adversarial code review with Opus plus GPT-5.5 to catch bugs and strengthen agent-built products.
- 2026-06-02: OpenAI made GPT-5.5 and Codex generally available on AWS Bedrock, enabling enterprise access through AWS-native security, governance, billing, and procurement workflows.
- 2026-06-08: A Codex CLI + GPT-5.5 high workflow was described as production-ready for fast software delivery, emphasizing failing tests first, guardrails, review cycles, and process changes to match increased coding velocity.
- 2026-06-20: Peter Yang said he switched from Claude Code to Codex because of GPT-5.5’s speed, generous limits, steering controls, and strong browser/computer automation.
- 2026-07-08: Simon Willison documented an experimental GitHub code-embedding Web Component built using GPT-5.5, showing practical utility for developer tooling and lightweight code interfaces.
- 2026-07-09: OpenAI launched GPT-Live, a full-duplex voice model that can delegate deeper search and reasoning tasks to GPT-5.5 in the background.
- 2026-07-25: Claire Vo’s live benchmark used GPT-5.5 as the automated judge for 30% of model scoring across tasks including PRD creation, prototype creation, wireframes, bug triage, agentic coding, and agent voice.
Relevance to AI PMs
1. Useful for evaluation design and benchmark ops. GPT-5.5 is explicitly used as an automated judge in Claire Vo’s benchmark, making it relevant for PMs building internal evals, scorecards, and human-plus-model review pipelines. A practical takeaway is to treat the model not just as a generator, but also as part of the measurement stack.2. Strong fit for coding and agent workflows. Multiple mentions tie GPT-5.5 to Codex, CLI workflows, adversarial reviews, and browser/computer automation. PMs responsible for developer tools, internal copilots, or agentic product features can use these patterns to structure workflows with tests, guardrails, and review loops instead of relying on one-shot prompting.
3. Important for enterprise deployment decisions. Its availability on AWS Bedrock makes GPT-5.5 easier to adopt inside organizations that require AWS-native procurement, compliance, and governance. PMs evaluating model vendors should see this as a practical enabler for regulated or large-scale deployments.
Related
- OpenAI: GPT-5.5 is presented as an OpenAI frontier model and is connected to launches such as GPT-Live, Codex availability, and AWS Bedrock distribution.
- Claire Vo: A key reference point because she uses GPT-5.5 as the automated judge for 30% of her live benchmark scoring.
- Codex / Codex CLI: Frequently paired with GPT-5.5 in coding workflows, especially for high-velocity software delivery and browser/computer automation.
- ChatGPT: One of the aliases and likely primary user-facing surface through which many users interact with GPT-5.5-powered experiences.
- AWS Bedrock: Enterprise delivery channel that expanded access to GPT-5.5 in commercial and GovCloud contexts.
- GPT-Live / gpt-realtime-2 / gpt-live: Related OpenAI voice and realtime experiences that delegate deeper reasoning work to GPT-5.5.
- Claude Code / Opus / Anthropic: Main competitive comparison set in the mentions, especially for coding quality, agent benchmarks, and workflow preferences.
- Simon Willison / Peter Yang / Josh Pigford / Dan Shipper: Practitioners and commentators whose examples show GPT-5.5 in real product-building, benchmarking, and coding contexts.
Newsletter Mentions (18)
“#17 ▶️ I hate Opus 5. It’s the best model, anyway. How I AI Podcast Claire Vo runs a live How I AI benchmark comparing seven AI models (Opus 5, Sonnet 5, Fable, Opus 4, Mabu, GPT Terra and Gemini 3.1 Pro) across six tasks—PRD creation, prototype creation, wireframe creation, bug triage, agentic coding and agent voice—scored 70% by her manual vibe check and 30% by GPT-5.5, with Opus 5 emerging first on the leaderboard.”
#17 ▶️ I hate Opus 5. It’s the best model, anyway. How I AI Podcast Claire Vo runs a live How I AI benchmark comparing seven AI models (Opus 5, Sonnet 5, Fable, Opus 4, Mabu, GPT Terra and Gemini 3.1 Pro) across six tasks—PRD creation, prototype creation, wireframe creation, bug triage, agentic coding and agent voice—scored 70% by her manual vibe check and 30% by GPT-5.5, with Opus 5 emerging first on the leaderboard.
“OpenAI is launching GPT‑Live, a full‑duplex voice model that can listen and speak simultaneously, use conversational cues like “mhmm,” and delegate deeper searches or reasoning to GPT‑5.5 in the background; two versions (GPT‑Live‑1 and GPT‑Live‑1 mini) are rolling out to ChatGPT users globally today with an API sign‑up available.”
Today's top 25 insights for PM Builders, ranked by relevance from X, Blogs, and YouTube. OpenAI launches GPT-Live full-duplex voice API #1 𝕏 Sam Altman announced that GPT-5.6 Sol launches Thursday, urging builders to start integrating and experimenting with the new model. #2 📝 OpenAI News Introducing GPT-Live - OpenAI is launching GPT‑Live, a full‑duplex voice model that can listen and speak simultaneously, use conversational cues like “mhmm,” and delegate deeper searches or reasoning to GPT‑5.5 in the background; two versions (GPT‑Live‑1 and GPT‑Live‑1 mini) are rolling out to ChatGPT users globally today with an API sign‑up available.
“An experimental Web Component was built (using GPT-5.5) to embed code from GitHub URLs by converting them to raw.githubusercontent links and fetching/displaying specified ranges of lines with line numbers.”
#4 📝 Simon Willison github-code Web Component - An experimental Web Component was built (using GPT-5.5) to embed code from GitHub URLs by converting them to raw.githubusercontent links and fetching/displaying specified ranges of lines with line numbers.
“in Peter Yang switched from Claude Code to Codex for GPT-5.5’s speed, generous limits, steering controls and best-in-class browser/computer automation. He still uses Claude Code’s Opus frontend and welcomes the ongoing AI competition benefiting builders.”
#8 in Peter Yang switched from Claude Code to Codex for GPT-5.5’s speed, generous limits, steering controls and best-in-class browser/computer automation. He still uses Claude Code’s Opus frontend and welcomes the ongoing AI competition benefiting builders. #9 ▶️ My First Winning Agentic AI Trading Strategy On Polymarket All About AI An agentic AI trading strategy on Polymarket that uses AI-calculated fair values and a fixed 4¢ spread to provide liquidity as a maker on 5-minute Bitcoin up/down markets.
“He describes a Codex CLI + GPT‑5.5 high workflow (one project per window, create a failing test first, strict guardrails, /review cycles, and Codiff walkthroughs) and argues teams must change processes (e.g., push to main faster) to retain that new velocity.”
#8 📝 Mario Zechner Modern Engineering Values - The author says he rarely writes code by hand anymore and has shipped or contributed to multiple projects largely AI-written—Vite+ (Rust features, ~90% AI-written), fate 1.0 (100% AI-written), Codiff (100% AI-written), Athena Crisis (70+ bugfixes, 100% AI-written), and Void (100% AI-written, not yet shipped)—because coding agents now produce production-quality code in minutes. He describes a Codex CLI + GPT‑5.5 high workflow (one project per window, create a failing test first, strict guardrails, /review cycles, and Codiff walkthroughs) and argues teams must change processes (e.g., push to main faster) to retain that new velocity.
“OpenAI made its frontier models (including GPT‑5.5) and Codex generally available on AWS via Amazon Bedrock on June 1, 2026, enabling enterprises to run those models in Commercial and GovCloud regions using AWS-native security, procurement, billing, and governance workflows.”
OpenAI’s GPT-5.5 and Codex now on AWS Bedrock #1 📝 OpenAI News OpenAI frontier models and Codex are now available on AWS - OpenAI made its frontier models (including GPT‑5.5) and Codex generally available on AWS via Amazon Bedrock on June 1, 2026, enabling enterprises to run those models in Commercial and GovCloud regions using AWS-native security, procurement, billing, and governance workflows.
“#4 in Peter Yang highlights how Josh Pigford—fresh off a $4M exit— is solo-building five AI-agent products, using a 3-phase build process, adversarial code reviews with Opus + GPT-5.5, and a “but for real” AI bug-catching hack.”
GenAI PM Daily May 31, 2026 GenAI PM Daily 🎧 Listen to this brief 3 min listen Today's top 19 insights for PM Builders, ranked by relevance from X, LinkedIn, Blogs, and YouTube. Josh Pigford’s 3-phase AI-agent build process #1 𝕏 NVIDIA AI launched DynoSim, a full-Rust, workload-driven simulator for the Dynamo serving stack that models your entire inference pipeline on one virtual timeline and screens thousands of deployment configurations in high-fidelity simulation. #2 𝕏 Clement Delangue hails AI Security Institute’s open release of its evals, datasets and models on Hugging Face, empowering researchers worldwide to scrutinize, reproduce and build on their AI safety work. #3 𝕏 Guillermo Rauch rolled out per-API Key spend caps on AI Gateway, letting users set budget limits for each key to better control costs. #4 in Peter Yang highlights how Josh Pigford—fresh off a $4M exit— is solo-building five AI-agent products, using a 3-phase build process, adversarial code reviews with Opus + GPT-5.5, and a “but for real” AI bug-catching hack. #5 𝕏 There’s An AI For That launched a free, open-source AI that uses only Wi-Fi signal reflections—no cameras or sensors—to reconstruct real-time, full-body poses through walls, in the dark, and across rooms.
“They show harness choices materially affect measured capability—for example, GPT‑5.5 performs better when compaction preserves long-context task-relevant information, and UK AISI’s cyber range reported up to a 59% performance gain when test-time budget rose from 10M to 100M tokens, with performance still increasing at the highest budget.”
#6 📝 OpenAI News A shared playbook for trustworthy third party evaluations - OpenAI recommends third-party evaluations explicitly state the claim being tested (capability elicitation, safeguard performance, or comparison) and provide evidence validating results by detailing the harness (tools, scaffolding, budget/tokens/time), scoring, and checks for reward hacking, refusals, contamination, broken problems, and sandbagging. They show harness choices materially affect measured capability—for example, GPT‑5.5 performs better when compaction preserves long-context task-relevant information, and UK AISI’s cyber range reported up to a 59% performance gain when test-time budget rose from 10M to 100M tokens, with performance still increasing at the highest budget.
“Also, Opus 4.8 is about four times less likely than Opus 4.7 to let code flaws pass unremarked, scored 84% on Online-Mind2Web, was the only model to complete every Super-Agent case end-to-end (beating prior Opus models and GPT-5.5), is the first to break 10% on the Legal Agent all-pass standard, and shows misalignment rates similar to Claude Mythos Preview while Genie users report 61% cheaper token cost versus Opus 4.7 for multimodal reasoning.”
Anthropic releases Claude Opus 4.8 with dynamic workflows #1 📝 Anthropic News Introducing Claude Opus 4.8 - Anthropic released Claude Opus 4.8 today at the same price as Opus 4.7, adding user-selectable effort levels, Claude Code “dynamic workflows,” and a fast mode that runs 2.5× faster and is three times cheaper than on prior models. The company reports broad capability and alignment gains—Opus 4.8 is about four times less likely than Opus 4.7 to let code flaws pass unremarked, scored 84% on Online-Mind2Web, was the only model to complete every Super-Agent case end-to-end (beating prior Opus models and GPT-5.5), is the first to break 10% on the Legal Agent all-pass standard, and shows misalignment rates similar to Claude Mythos Preview while Genie users report 61% cheaper token cost versus Opus 4.7 for multimodal reasoning. Also covered by: @v0 , @There's An AI For That , @There's An AI For That , @Aravind Srinivas , @claire vo 🖤, building @chatprd , @Mike Krieger , @Claude, @Cognition, @Claire Vo , @Dan Shipper , @How I AI Podcast
“#8 🟣 The AI paradox: More automation, more humans, more work | Dan Shipper Lennys Podcast Dan Shipper describes Every’s custom “senior engineer benchmark” that asks models and engineers to rewrite their vibe-coded Proof application from first principles, showing GPT 5.5 (Opus 4.7 plan) scored 62/100 versus human engineers in the high 80s to low 90s.”
#8 🟣 The AI paradox: More automation, more humans, more work | Dan Shipper Lennys Podcast Dan Shipper describes Every’s custom “senior engineer benchmark” that asks models and engineers to rewrite their vibe-coded Proof application from first principles, showing GPT 5.5 (Opus 4.7 plan) scored 62/100 versus human engineers in the high 80s to low 90s. All coding models prior to GPT 5.5 scored 30/100 on the senior engineer benchmark. GPT 5.5 running on the Opus 4.7 plan achieved 62/100 on the benchmark rewrite. Human senior engineers each scored in the high 80s to low 90s out of 100 on the same benchmark.
Related
Anthropic’s coding assistant and agentic development tool. The newsletter references guidance, containment, and model selection for Claude Code.
An AI company building Claude and related research products. In this newsletter, it is discussed in relation to AGI timing, product leadership, and policy lobbying.
An AI research and product company known for models, assistants, and developer tools. The newsletter mentions its safety review of the Hugging Face incident and several product references including Codex and GPT Live.
An AI coding environment and editor with model comparison capabilities. The newsletter mentions its evals dashboard for comparing model performance.
A PM/AI builder referenced for using Codex to triage work across communication and task-management tools. He is highlighted as an example of practical AI-assisted workflow design for PMs.
A prominent AI blogger and commentator referenced in connection with an article on token reselling and fraud. He is cited as the source of the newsletter item discussing the marketplace and API-key abuse.
An AI coding assistant that can be orchestrated to triage tasks and draft responses. In this newsletter, it is described as acting like a “heartbeat” for checking email, Slack, and Linear on a schedule.
CEO of Perplexity and a prominent builder in AI search and agent workflows. The newsletter credits him with unveiling a Perplexity CLI for live web data.
AI product builder and evaluator featured running a benchmark across multiple models. The newsletter highlights her manual vibe-check scoring approach.
CEO of OpenAI, referenced here through a quoted internal email describing OpenAI’s strategy around releasing a local model. The newsletter uses him as a source for competitive positioning context.
An agent platform whose agents can schedule wake-ups, retain context, and trigger workflows. Useful for PMs exploring persistent, scheduled AI automation tied into collaboration tools.
A model used in the newsletter as a reasoning and execution engine for product experimentation. It is described as generating daily A/B test ideas and implementing winners for a mobile game economy.
A model version associated with the Claude Code hackathon. It is referenced as the build basis for the event and its winners.
Stay updated on GPT-5.5
Get curated AI PM insights delivered daily — covering this and 1,000+ other sources.
Subscribe Free