Ali Ghodsi
Data infrastructure leader mentioned for recommending database branching to protect against destructive agent actions.
Key Highlights
- Ali Ghodsi is repeatedly associated with practical enterprise AI patterns spanning governance, routing, agent safety, and data infrastructure.
- He highlighted that changing inference harnesses and using smart routing can materially reduce AI costs without sacrificing quality.
- He emphasized speed and responsiveness in agentic systems, citing open-source GLM as significantly faster than proprietary frontier models.
- He promoted database branching on Neon Lakebase as a safeguard against destructive AI agent actions.
- His launches and commentary connect Databricks products like Omnigent, Genie, AI Extract, and Lakebase into a coherent enterprise AI stack.
Overview
Ali Ghodsi appears in these newsletters as a highly influential data and AI infrastructure leader shaping how enterprises deploy AI products at scale. Across mentions, he is associated with Databricks’ expanding AI stack and with practical guidance on cost, speed, safety, governance, and data infrastructure for agents. For AI Product Managers, he stands out not just as an executive voice, but as a source of concrete operating patterns: model routing to cut cost, database branching to reduce agent risk, open-source harnesses for agent control, and business-data-aware AI systems that deliver faster answers.Why this matters to AI PMs is simple: many of the hardest product questions in enterprise AI are no longer just about model quality. They are about reliability, governance, latency, unit economics, and safe interaction with production systems. Ghodsi’s commentary and launches repeatedly focus on those issues, making his perspective especially relevant to PMs building agentic workflows, internal copilots, AI gateways, and data-connected enterprise applications.
Key Developments
- 2026-06-14: Ali Ghodsi launched Omnigent, an open-source harness that plugs into Claude Code, Codex, OpenCode, and pi. It supports collaboration through Slack, Teams, CLI, and WebUI, and emphasizes fine-grained security controls for agent actions.
- 2026-06-26: He highlighted performance advantages of open-source GLM, reporting over 300 tokens/sec versus roughly 100 tokens/sec for proprietary frontier models, arguing that speed is essential for responsive agentic workloads.
- 2026-06-28: Ghodsi said Genie Code passed the 50% mark for code generation inside Databricks, with AI-written code outpacing human-authored code by 3x.
- 2026-07-09: He shared results from an in-house evaluation across a 3,000-engineer, multi-cloud codebase, finding that changing the inference harness alone could cut AI costs in half while maintaining quality; GLM 5.2 emerged as a strong performer.
- 2026-07-18: He was cited in connection with Databricks raising funding at a $188 billion valuation to expand an AI stack including Unity AI Gateway for multi-model cost governance, Genie for business-data-fluent AI coworkers, and Lakebase for serverless Postgres aimed at AI agents.
- 2026-07-26: Ghodsi argued that agents which “cook” longer often do worse, and that Genie’s fast results are more effective. He also stressed the importance of a strong ontology to give agents the right context.
- 2026-08-12: He announced the acquisition of ElectricSQL, the team behind PGlite, to strengthen the Lakebase Postgres offering with browser-based, WebAssembly Postgres that can sync asynchronously with Postgres instances.
- 2026-08-15: Ghodsi explained how Smart Routing works in the AI Gateway, describing it as a simple approach that reduces costs by about 30% without hurting quality. He also noted that Genie uses org-chart and popularity signals, surfaces uncertainty, and remembers user answers over time.
- 2026-08-21: He said AI Extract was released for extracting fields from PDFs, claiming 95% accuracy versus 87% for alternatives at very low cost, with direct SQL integration across the platform.
- 2026-08-28: Ghodsi recommended using database branching on Neon Lakebase to protect against destructive agent behavior, sharing the command `neonctl branches create --name newbranch` as a safeguard against permanent data loss.
Relevance to AI PMs
1. He offers practical patterns for safe agent deployment. The recommendation to branch databases before letting agents operate on them is directly useful for PMs designing workflows that touch production data. It suggests a concrete product requirement: sandboxing, rollback paths, and environment isolation should be first-class features.2. He consistently frames AI product success around cost-performance tradeoffs, not just model benchmarks. His comments on Smart Routing, inference harness swaps, and faster open models point PMs toward a tactical playbook: measure latency, throughput, and unit cost at the workflow level, then route tasks dynamically rather than standardizing on a single premium model.
3. He emphasizes enterprise context and governance as product differentiators. From Genie’s use of ontology, org signals, and uncertainty handling to Omnigent’s fine-grained permissions, the lesson for PMs is that enterprise AI products win when they combine strong model output with business context, access controls, auditability, and user trust mechanisms.
Related
- Databricks: The core company most closely associated with Ali Ghodsi in these mentions; many product launches and strategic moves are tied to its AI platform direction.
- Omnigent: Open-source agent harness launched under his leadership, focused on integrations and security controls.
- Unity AI Gateway / AI Gateway: Connected to his messaging on model governance, smart routing, and cost optimization across multiple AI providers.
- Genie / Genie Code: Central to his view of enterprise AI coworkers and AI-assisted software development, including ontology-driven answers and persistent learning from users.
- Lakebase / Lakebase Postgres / Neon Lakebase: Infrastructure theme tied to serverless Postgres for agents and safety practices such as branching before risky operations.
- ElectricSQL / PGlite: Acquisition-related technologies that strengthen browser-native and sync-capable Postgres workflows within the Lakebase ecosystem.
- GLM / GLM 5.2 / proprietary-frontier-models: Referenced in his performance and cost comparisons, reinforcing his focus on throughput and economics over brand-name models alone.
- AI Extract: Example of vertically integrated AI functionality embedded directly into SQL and enterprise data workflows.
- Claude Code / Codex / OpenCode / pi: Tools and agent surfaces that Omnigent can plug into, illustrating an interoperability strategy rather than a single-agent bet.
Newsletter Mentions (11)
“Ali Ghodsi recommended branching databases on Neon Lakebase to prevent agents from permanently wiping data, sharing the command `neonctl branches create --name newbranch`.”
Ali Ghodsi recommended branching databases on Neon Lakebase to prevent agents from permanently wiping data, sharing the command `neonctl branches create --name newbranch`.
“Ali Ghodsi says AI Extract was released to extract fields from PDFs, achieving 95% accuracy versus 87% for others at extremely low cost.”
#1 𝕏 Ali Ghodsi says AI Extract was released to extract fields from PDFs, achieving 95% accuracy versus 87% for others at extremely low cost. The function can be called directly from SQL and used throughout the platform.
“Ali Ghodsi shared how Smart Routing works on the author’s AI Gateway, describing it as a “super simple idea” that lowers costs by about 30% without sacrificing quality.”
#10 𝕏 Ali Ghodsi shared how Smart Routing works on the author’s AI Gateway, describing it as a “super simple idea” that lowers costs by about 30% without sacrificing quality. #12 𝕏 Ali Ghodsi commented that Genie uses org-chart and popularity signals to select the “right” answer, surfaces uncertainty, and remembers user answers across future sessions to improve over time.
“"#8 𝕏 Ali Ghodsi announced that “we” acquired ElectricSQL, the team behind PGlite."”
#8 𝕏 Ali Ghodsi announced that “we” acquired ElectricSQL, the team behind PGlite. Its browser-based WebAssembly implementation of Postgres can sync asynchronously with Postgres instances and will enhance the Lakebase Postgres offering.
“Ali Ghodsi notes that agents that “cook” longer often underperform, while Genie's rapid result generation proves more efficient.”
GenAI PM Daily July 26, 2026 GenAI PM Daily 🎧 Listen to this brief 3 min listen Today's top 18 insights for PM Builders, ranked by relevance from X, Blogs, and LinkedIn. Perplexity unveils CLI for live web data #1 𝕏 OpenAI calls the Hugging Face incident an unprecedented AI safety event and is reviewing it with external advisors and its Safety and Security Committee. It will publish a technical report of findings in the coming weeks. #2 𝕏 Demis Hassabis reports that Gemma 4 models have been downloaded over 300 million times, driving the total Gemma open model series downloads past 900 million. #3 𝕏 Sundar Pichai celebrates Google’s commitment to open source, highlighting that they’ve long contributed and released open-weight AI models via the Gemma platform from Google DeepMind and Demis Hassabis. #6 𝕏 Ali Ghodsi notes that agents that “cook” longer often underperform, while Genie's rapid result generation proves more efficient. He argues that a solid ontology is vital for giving these agents the context they need to deliver accurate answers quickly.
“Ali Ghodsi is raising funding at a $188 billion valuation to turbocharge Databricks’ AI stack with Unity AI Gateway (multi-AI cost governance), Genie (AI coworkers fluent in your business data), and Lakebase (serverless Postgres for AI agents).”
#22 𝕏 Ali Ghodsi is raising funding at a $188 billion valuation to turbocharge Databricks’ AI stack with Unity AI Gateway (multi-AI cost governance), Genie (AI coworkers fluent in your business data), and Lakebase (serverless Postgres for AI agents).
“Ali Ghodsi ran an in-house evaluation on his 3,000-engineer, multi-cloud codebase and found that simply swapping inference harnesses can halve AI costs while maintaining quality, with GLM 5.2 emerging as a top performer.”
Today's top 25 insights for PM Builders, ranked by relevance from X, Blogs, and YouTube. OpenAI launches GPT-Live full-duplex voice API #1 𝕏 Sam Altman announced that GPT-5.6 Sol launches Thursday, urging builders to start integrating and experimenting with the new model. #2 📝 OpenAI News Introducing GPT-Live - OpenAI is launching GPT‑Live, a full‑duplex voice model that can listen and speak simultaneously, use conversational cues like “mhmm,” and delegate deeper searches or reasoning to GPT‑5.5 in the background; two versions (GPT‑Live‑1 and GPT‑Live‑1 mini) are rolling out to ChatGPT users globally today with an API sign‑up available. OpenAI says over 150 million people use ChatGPT voice weekly, reports users strongly prefer GPT‑Live to Advanced Voice Mode (GPT‑Live‑1 preferred ~75.7%), and shows large evaluation gains — GPQA rising from 45.3% (AVM) to up to 84.2% and BrowseComp from 0.7% to up to 75.2%. Also covered by: @Sam Altman #3 𝕏 OpenAI rolled out GPT-Live voice models in ChatGPT on iOS, Android, and web starting today (full rollout over the next few days), with API access coming soon—just tap the Voice button to talk with ChatGPT. Also covered by: @Sam Altman #4 𝕏 Mistral AI launched Robostral Navigate, its first embodied navigation model with 8B parameters that guides robots to perform natural-language specified tasks using a single RGB camera. It achieves state-of-the-art results on the R2R-CE benchmark. #5 𝕏 Logan Kilpatrick rolled out “import from GitHub” in Google AI Studio Build, automagically converting your repo into a runtime-compatible format. Now you can seamlessly iterate on it in AI Studio, deploy it, and more. #6 📝 OpenAI News Separating signal from noise in coding evaluations - A detailed audit of SWE-Bench Pro estimates roughly 30% of tasks are broken—an automated pipeline flagged 200 (27.4%) and human annotators found 249 (34.1%)—primarily due to overly strict tests, underspecified prompts, low-coverage tests, and misleading prompts. #7 𝕏 Cognition launched SWE-1.7, their most capable model yet, scoring within a few points of top frontier models at a fraction of the cost and running at 1000 tok/s. They report that their refined RL training recipe continues to deliver scaling gains. #8 𝕏 Ali Ghodsi ran an in-house evaluation on his 3,000-engineer, multi-cloud codebase and found that simply swapping inference harnesses can halve AI costs while maintaining quality, with GLM 5.2 emerging as a top performer.
“#5 𝕏 Ali Ghodsi reports that Genie Code has just crossed the 50% mark for code generation on Databricks, and AI‐written code now outpaces human authors by 3×.”
#5 𝕏 Ali Ghodsi reports that Genie Code has just crossed the 50% mark for code generation on Databricks, and AI‐written code now outpaces human authors by 3×.
“Ali Ghodsi shows that open-source GLM runs at over 300 tokens/sec versus ~100 tokens/sec for proprietary frontier models, delivering a 3× speedup that’s critical for responsive agentic workloads.”
#12 𝕏 Ali Ghodsi shows that open-source GLM runs at over 300 tokens/sec versus ~100 tokens/sec for proprietary frontier models, delivering a 3× speedup that’s critical for responsive agentic workloads.
“Ali Ghodsi launched Omnigent, an open-source harness that plugs into Claude Code, Codex, OpenCode and pi, lets teams collaborate via Slack/Teams, CLI or WebUI, and enforces a fine-grained security model to tightly control what agents can do.”
Ali Ghodsi launched Omnigent, an open-source harness that plugs into Claude Code, Codex, OpenCode and pi, lets teams collaborate via Slack/Teams, CLI or WebUI, and enforces a fine-grained security model to tightly control what agents can do. #6 𝕏 Teresa Torres highlights how Musubi built a moderation pipeline that flags AI-human disagreements and sends the content, both decisions, and the customer’s policy to a reasoning model as a tiebreaker.
Related
Anthropic’s coding agent. It is relevant to AI PMs as a coding workflow product competing in enterprise and community adoption.
OpenAI’s coding tool/agent used for software development workflows. It matters for PMs as a replacement or alternative in enterprise coding adoption.
Google model recommended for OCR and VQA workloads. It is highlighted for speed, cost, and accuracy tradeoffs relevant to PM decision-making.
A developer tool or coding environment that announced availability of Qwen3.8-Flash. It appears as the platform distributing model access.
Stay updated on Ali Ghodsi
Get curated AI PM insights delivered daily — covering this and 1,000+ other sources.
Subscribe Free