GPT-5.5
A model used as an automated judge in Claire Vo’s benchmark. It contributes 30% of the scoring alongside her manual evaluation.
Key Highlights
- GPT-5.5 was used as the automated judge for 30% of Claire Vo’s live multi-model benchmark scoring.
- Newsletter mentions tie GPT-5.5 closely to Codex, Codex CLI, code review workflows, and browser/computer automation.
- OpenAI stated that GPT-5.5 performance can vary significantly based on harness design, long-context compaction, and token budget.
- GPT-5.5 became generally available on AWS Bedrock, increasing its relevance for enterprise deployment and governance.
- Practitioners including Peter Yang and Simon Willison referenced GPT-5.5 in real-world developer tooling and product workflows.
At a glance
- Category
- Model
GPT-5.5
Overview
GPT-5.5 is an OpenAI model referenced across coding, evaluation, and agent workflows. In the newsletter corpus, it appears both as a model used directly by builders—especially through Codex, Codex CLI, and ChatGPT-adjacent experiences—and as an evaluation component in Claire Vo’s live benchmark, where it contributes 30% of the score alongside her 70% manual “vibe check.”For AI Product Managers, GPT-5.5 matters because it shows up in three practical roles: as a coding and automation engine, as infrastructure available through enterprise channels like AWS Bedrock, and as a judge or scorer in benchmark design. The mentions also highlight an important PM lesson: measured performance depends heavily on harness design, context handling, tooling, and evaluation budget—not just the base model.
Key Developments
- 2026-05-25: Dan Shipper described Every’s custom “senior engineer benchmark,” where GPT 5.5 scored 62/100 on a rewrite task; earlier coding models had scored 30/100, while human senior engineers scored in the high 80s to low 90s.
- 2026-05-29: Anthropic’s Claude Opus 4.8 announcement cited Super-Agent results where Opus 4.8 beat GPT-5.5 and prior Opus models on completing cases end-to-end.
- 2026-05-30: OpenAI emphasized that evaluation harness choices materially affect capability measurements, noting GPT-5.5 performs better when compaction preserves task-relevant long-context information.
- 2026-05-31: Peter Yang highlighted Josh Pigford’s workflow using adversarial code reviews with Opus plus GPT-5.5 while solo-building multiple AI-agent products.
- 2026-06-02: OpenAI made GPT-5.5 and Codex generally available on AWS Bedrock, enabling enterprise deployment with AWS-native security, billing, procurement, and governance workflows.
- 2026-06-08: A workflow built around Codex CLI and GPT-5.5 high was described as enabling fast, production-quality coding with guardrails, failing tests first, review cycles, and walkthroughs.
- 2026-06-20: Peter Yang said he switched from Claude Code to Codex for GPT-5.5’s speed, generous limits, steering controls, and strong browser/computer automation.
- 2026-07-08: Simon Willison shared an experimental GitHub code web component built using GPT-5.5 to fetch and display code ranges from GitHub URLs.
- 2026-07-09: OpenAI launched GPT-Live, which can delegate deeper search or reasoning tasks to GPT-5.5 in the background.
- 2026-07-25: Claire Vo’s live benchmark used GPT-5.5 as 30% of the scoring across six tasks, with her manual evaluation accounting for the remaining 70%.
Relevance to AI PMs
1. Useful for evaluation design and benchmarking. GPT-5.5 was used as an automated judge in Claire Vo’s benchmark, making it relevant for PMs designing internal scorecards, rubric-based reviews, or blended human-plus-model evaluation systems. 2. Strong signal in coding and agent workflows. Multiple mentions connect GPT-5.5 to Codex, Codex CLI, code review, bug-finding, and browser/computer automation. PMs building developer tools or internal copilots can study these usage patterns when selecting models and setting workflows. 3. Important example of deployment and measurement tradeoffs. The Bedrock launch shows enterprise procurement and governance relevance, while OpenAI’s evaluation guidance shows that prompt scaffolding, context compaction, and token budget can materially change results. PMs should evaluate the full system, not just the model name.Related
- OpenAI: Creator and primary platform context for GPT-5.5, including ChatGPT, Codex, GPT-Live, and AWS Bedrock availability.
- Claire Vo: Used GPT-5.5 as the automated judge for 30% of her benchmark scoring.
- Codex / Codex CLI: Frequently paired with GPT-5.5 in coding workflows, especially for agentic development and structured review loops.
- AWS Bedrock: Enterprise distribution channel where GPT-5.5 became generally available.
- GPT-Live / GPT-Realtime-2: Related OpenAI voice and real-time experiences; GPT-Live delegates deeper reasoning to GPT-5.5.
- Claude Code / Opus / Anthropic: Common comparison set in the mentions, especially for coding benchmarks, adversarial review, and agent performance.
- Simon Willison / github-code-web-component: Example of GPT-5.5 being used in a practical developer-facing build.
- Peter Yang / Josh Pigford: Examples of practitioners discussing GPT-5.5 in real production and product-building workflows.
Frequently asked questions
What is GPT-5.5?
A model used as an automated judge in Claire Vo’s benchmark. It contributes 30% of the scoring alongside her manual evaluation.
What should AI product managers know about GPT-5.5?
GPT-5.5 was used as the automated judge for 30% of Claire Vo’s live multi-model benchmark scoring. Newsletter mentions tie GPT-5.5 closely to Codex, Codex CLI, code review workflows, and browser/computer automation. OpenAI stated that GPT-5.5 performance can vary significantly based on harness design, long-context compaction, and token budget.
Explore this topic
Newsletter Mentions (18)
“#17 ▶️ I hate Opus 5. It’s the best model, anyway. How I AI Podcast Claire Vo runs a live How I AI benchmark comparing seven AI models (Opus 5, Sonnet 5, Fable, Opus 4, Mabu, GPT Terra and Gemini 3.1 Pro) across six tasks—PRD creation, prototype creation, wireframe creation, bug triage, agentic coding and agent voice—scored 70% by her manual vibe check and 30% by GPT-5.5, with Opus 5 emerging first on the leaderboard.”
#17 ▶️ I hate Opus 5. It’s the best model, anyway. How I AI Podcast Claire Vo runs a live How I AI benchmark comparing seven AI models (Opus 5, Sonnet 5, Fable, Opus 4, Mabu, GPT Terra and Gemini 3.1 Pro) across six tasks—PRD creation, prototype creation, wireframe creation, bug triage, agentic coding and agent voice—scored 70% by her manual vibe check and 30% by GPT-5.5, with Opus 5 emerging first on the leaderboard.
“OpenAI is launching GPT‑Live, a full‑duplex voice model that can listen and speak simultaneously, use conversational cues like “mhmm,” and delegate deeper searches or reasoning to GPT‑5.5 in the background; two versions (GPT‑Live‑1 and GPT‑Live‑1 mini) are rolling out to ChatGPT users globally today with an API sign‑up available.”
Today's top 25 insights for PM Builders, ranked by relevance from X, Blogs, and YouTube. OpenAI launches GPT-Live full-duplex voice API #1 𝕏 Sam Altman announced that GPT-5.6 Sol launches Thursday, urging builders to start integrating and experimenting with the new model. #2 📝 OpenAI News Introducing GPT-Live - OpenAI is launching GPT‑Live, a full‑duplex voice model that can listen and speak simultaneously, use conversational cues like “mhmm,” and delegate deeper searches or reasoning to GPT‑5.5 in the background; two versions (GPT‑Live‑1 and GPT‑Live‑1 mini) are rolling out to ChatGPT users globally today with an API sign‑up available.
“An experimental Web Component was built (using GPT-5.5) to embed code from GitHub URLs by converting them to raw.githubusercontent links and fetching/displaying specified ranges of lines with line numbers.”
#4 📝 Simon Willison github-code Web Component - An experimental Web Component was built (using GPT-5.5) to embed code from GitHub URLs by converting them to raw.githubusercontent links and fetching/displaying specified ranges of lines with line numbers.
“in Peter Yang switched from Claude Code to Codex for GPT-5.5’s speed, generous limits, steering controls and best-in-class browser/computer automation. He still uses Claude Code’s Opus frontend and welcomes the ongoing AI competition benefiting builders.”
#8 in Peter Yang switched from Claude Code to Codex for GPT-5.5’s speed, generous limits, steering controls and best-in-class browser/computer automation. He still uses Claude Code’s Opus frontend and welcomes the ongoing AI competition benefiting builders. #9 ▶️ My First Winning Agentic AI Trading Strategy On Polymarket All About AI An agentic AI trading strategy on Polymarket that uses AI-calculated fair values and a fixed 4¢ spread to provide liquidity as a maker on 5-minute Bitcoin up/down markets.
“He describes a Codex CLI + GPT‑5.5 high workflow (one project per window, create a failing test first, strict guardrails, /review cycles, and Codiff walkthroughs) and argues teams must change processes (e.g., push to main faster) to retain that new velocity.”
#8 📝 Mario Zechner Modern Engineering Values - The author says he rarely writes code by hand anymore and has shipped or contributed to multiple projects largely AI-written—Vite+ (Rust features, ~90% AI-written), fate 1.0 (100% AI-written), Codiff (100% AI-written), Athena Crisis (70+ bugfixes, 100% AI-written), and Void (100% AI-written, not yet shipped)—because coding agents now produce production-quality code in minutes. He describes a Codex CLI + GPT‑5.5 high workflow (one project per window, create a failing test first, strict guardrails, /review cycles, and Codiff walkthroughs) and argues teams must change processes (e.g., push to main faster) to retain that new velocity.
“OpenAI made its frontier models (including GPT‑5.5) and Codex generally available on AWS via Amazon Bedrock on June 1, 2026, enabling enterprises to run those models in Commercial and GovCloud regions using AWS-native security, procurement, billing, and governance workflows.”
OpenAI’s GPT-5.5 and Codex now on AWS Bedrock #1 📝 OpenAI News OpenAI frontier models and Codex are now available on AWS - OpenAI made its frontier models (including GPT‑5.5) and Codex generally available on AWS via Amazon Bedrock on June 1, 2026, enabling enterprises to run those models in Commercial and GovCloud regions using AWS-native security, procurement, billing, and governance workflows.
“#4 in Peter Yang highlights how Josh Pigford—fresh off a $4M exit— is solo-building five AI-agent products, using a 3-phase build process, adversarial code reviews with Opus + GPT-5.5, and a “but for real” AI bug-catching hack.”
GenAI PM Daily May 31, 2026 GenAI PM Daily 🎧 Listen to this brief 3 min listen Today's top 19 insights for PM Builders, ranked by relevance from X, LinkedIn, Blogs, and YouTube. Josh Pigford’s 3-phase AI-agent build process #1 𝕏 NVIDIA AI launched DynoSim, a full-Rust, workload-driven simulator for the Dynamo serving stack that models your entire inference pipeline on one virtual timeline and screens thousands of deployment configurations in high-fidelity simulation. #2 𝕏 Clement Delangue hails AI Security Institute’s open release of its evals, datasets and models on Hugging Face, empowering researchers worldwide to scrutinize, reproduce and build on their AI safety work. #3 𝕏 Guillermo Rauch rolled out per-API Key spend caps on AI Gateway, letting users set budget limits for each key to better control costs. #4 in Peter Yang highlights how Josh Pigford—fresh off a $4M exit— is solo-building five AI-agent products, using a 3-phase build process, adversarial code reviews with Opus + GPT-5.5, and a “but for real” AI bug-catching hack. #5 𝕏 There’s An AI For That launched a free, open-source AI that uses only Wi-Fi signal reflections—no cameras or sensors—to reconstruct real-time, full-body poses through walls, in the dark, and across rooms.
“They show harness choices materially affect measured capability—for example, GPT‑5.5 performs better when compaction preserves long-context task-relevant information, and UK AISI’s cyber range reported up to a 59% performance gain when test-time budget rose from 10M to 100M tokens, with performance still increasing at the highest budget.”
#6 📝 OpenAI News A shared playbook for trustworthy third party evaluations - OpenAI recommends third-party evaluations explicitly state the claim being tested (capability elicitation, safeguard performance, or comparison) and provide evidence validating results by detailing the harness (tools, scaffolding, budget/tokens/time), scoring, and checks for reward hacking, refusals, contamination, broken problems, and sandbagging. They show harness choices materially affect measured capability—for example, GPT‑5.5 performs better when compaction preserves long-context task-relevant information, and UK AISI’s cyber range reported up to a 59% performance gain when test-time budget rose from 10M to 100M tokens, with performance still increasing at the highest budget.
“Also, Opus 4.8 is about four times less likely than Opus 4.7 to let code flaws pass unremarked, scored 84% on Online-Mind2Web, was the only model to complete every Super-Agent case end-to-end (beating prior Opus models and GPT-5.5), is the first to break 10% on the Legal Agent all-pass standard, and shows misalignment rates similar to Claude Mythos Preview while Genie users report 61% cheaper token cost versus Opus 4.7 for multimodal reasoning.”
Anthropic releases Claude Opus 4.8 with dynamic workflows #1 📝 Anthropic News Introducing Claude Opus 4.8 - Anthropic released Claude Opus 4.8 today at the same price as Opus 4.7, adding user-selectable effort levels, Claude Code “dynamic workflows,” and a fast mode that runs 2.5× faster and is three times cheaper than on prior models. The company reports broad capability and alignment gains—Opus 4.8 is about four times less likely than Opus 4.7 to let code flaws pass unremarked, scored 84% on Online-Mind2Web, was the only model to complete every Super-Agent case end-to-end (beating prior Opus models and GPT-5.5), is the first to break 10% on the Legal Agent all-pass standard, and shows misalignment rates similar to Claude Mythos Preview while Genie users report 61% cheaper token cost versus Opus 4.7 for multimodal reasoning. Also covered by: @v0 , @There's An AI For That , @There's An AI For That , @Aravind Srinivas , @claire vo 🖤, building @chatprd , @Mike Krieger , @Claude, @Cognition, @Claire Vo , @Dan Shipper , @How I AI Podcast
“#8 🟣 The AI paradox: More automation, more humans, more work | Dan Shipper Lennys Podcast Dan Shipper describes Every’s custom “senior engineer benchmark” that asks models and engineers to rewrite their vibe-coded Proof application from first principles, showing GPT 5.5 (Opus 4.7 plan) scored 62/100 versus human engineers in the high 80s to low 90s.”
#8 🟣 The AI paradox: More automation, more humans, more work | Dan Shipper Lennys Podcast Dan Shipper describes Every’s custom “senior engineer benchmark” that asks models and engineers to rewrite their vibe-coded Proof application from first principles, showing GPT 5.5 (Opus 4.7 plan) scored 62/100 versus human engineers in the high 80s to low 90s. All coding models prior to GPT 5.5 scored 30/100 on the senior engineer benchmark. GPT 5.5 running on the Opus 4.7 plan achieved 62/100 on the benchmark rewrite. Human senior engineers each scored in the high 80s to low 90s out of 100 on the same benchmark.
Related
The AI company behind Claude and Claude Managed Agents. Here it appears in the context of governed agent workflows and MCP tooling.
A coding agent environment supported by several agent toolkits and workflows in this newsletter. It appears as a client/integration target for AWS tools and multi-agent systems.
An AI company whose API compatibility is referenced here as the integration target for Ollama’s speech streaming endpoint. For AI PMs, this signals ecosystem compatibility and easier model/tool interchange.
An AI coding environment supported by AWS’s agent toolkit and a design skill in this newsletter. It is part of the agent productivity ecosystem relevant to PM builders.
A newsletter/video creator who recapped comparative tests of multiple frontier models. For PMs, his analysis highlights practical strength differences across use cases.
An AI coding tool referenced as a supported client for AWS tooling and multi-agent workflows. It is used here as part of the broader ecosystem of coding agents.
A prominent AI blogger and commentator referenced in connection with an article on token reselling and fraud. He is cited as the source of the newsletter item discussing the marketplace and API-key abuse.
CEO of Perplexity, mentioned here announcing the local-capable Perplexity Decision Model and sharing Perplexity Computer automation examples. Relevant as a product leader driving AI search and agent features.
A creator and product thinker sharing AI usage tracking and product documentation workflows. Relevant to PMs focused on measurement and prompt-to-spec workflows.
CEO of OpenAI, referenced here sharing OpenAI's mathematics progress page. He is a central figure in AI product strategy and model launches.
An AI agent that can now be assigned issues in Linear and respond within an Agent Session. It appears in the Amp sidebar and is designed for workflow-based task handling.
A model used in the newsletter as a reasoning and execution engine for product experimentation. It is described as generating daily A/B test ideas and implementing winners for a mobile game economy.
A Claude model variant referenced in Anthropic's cybersecurity evaluation report. It is one of the models involved in the incidents described.
An OpenAI voice experience focused on continuous, ongoing conversation. The post highlights engineering work to improve real-time voice interaction and user experience.
Stay updated on GPT-5.5
Get curated AI PM insights delivered daily — covering this and 1,000+ other sources.
Subscribe Free