Philipp Schmid
AI developer advocate and AI product communicator associated with Google DeepMind. He is credited here for announcing new Gemini API Managed Agent features.
Key Highlights
- Philipp Schmid is a prominent Google-associated AI communicator who often translates Gemini launches into practical builder workflows.
- His 2026 mentions center on managed agents, computer use, live translation, streaming TTS, and multimodal Gemini product capabilities.
- AI PMs can use his updates as an early signal for where Google is making agent infrastructure more production-ready.
- He is especially relevant for model-selection, latency-sensitive UX design, and evaluating real-world Gemini integration patterns.
Philipp Schmid
Overview
Philipp Schmid is an AI developer advocate and product communicator closely associated with Google DeepMind and the broader Gemini ecosystem. In this knowledge base, he appears primarily as a public-facing explainer and launch messenger for new Gemini API capabilities, agent tooling, multimodal model updates, and practical implementation patterns. His posts and demos frequently translate platform releases into concrete developer workflows, making him a useful signal source for what Google wants builders to adopt next.For AI Product Managers, Schmid matters because he sits at the intersection of model capability, developer tooling, and productization. His announcements often surface not just new model features, but the operational details that determine whether teams can actually ship: background execution, remote MCP support, function calling, streaming TTS, live translation, computer use, and packaged skills for agent development. Tracking his updates helps PMs understand where Google’s agent platform is becoming more production-ready and what use cases are gaining first-class support.
Key Developments
- 2026-06-17: Shared a free 5-day YouTube course on building AI agents, covering agent architectures, tool integration, planning, memory management, and evaluation with hands-on code and notebooks.
- 2026-06-17: Highlighted Gemini 3.5 Flash as an underrated multimodal model, citing stronger performance than Gemini 3.1 Pro in some scenarios while being faster and cheaper.
- 2026-06-18: Announced streaming support for Gemini TTS, enabling developers to set `stream: true` and receive audio chunks as they are generated for low-latency voice experiences.
- 2026-06-19: Demonstrated how to build a real-time translation app using Gemini Live API, LiveKit, and Cloud Run, with full example code for deployment.
- 2026-06-23: Announced general availability of the Gemini Interactions API and its packaging as an npm skill for injecting rules, SDK patterns, and current model versions into workflows.
- 2026-06-25: Showcased Google’s Gemini 3.5 Flash computer-use model with a live Browserbase test experience, emphasizing practical agent control workflows.
- 2026-06-26: Announced computer use in Gemini 3.5 Flash across browser, mobile, and desktop environments.
- 2026-07-02: Launched ghealth, an open-source CLI for the Google Health API that pulls Fitbit Air metrics into the terminal or AI agents, illustrating agent-ready health data access.
- 2026-07-07: Recommended Gemini 3.5 Flash for OCR and VQA tasks, stressing its speed, lower cost, and accuracy advantages.
- 2026-07-08: Rolled out four new Managed Agent features in the Gemini API: Background Execution (`background: true`), Remote MCP servers, Custom Function Calling, and credentials refresh across turns.
Relevance to AI PMs
1. Early signal on platform direction: Schmid’s announcements often indicate where Google is investing in production-grade agent infrastructure, such as managed agents, MCP connectivity, and long-running task support. PMs can use these signals to prioritize roadmap experiments before features become table stakes.2. Practical implementation patterns: His demos connect abstract model capabilities to shippable applications like live translation, voice interfaces, computer use, and health-data agents. PMs can use these examples to define MVP scope, identify required infra, and estimate integration complexity.
3. Model selection and cost-performance decisions: Schmid frequently comments on when to choose Gemini 3.5 Flash versus other models for tasks like OCR, VQA, and multimodal understanding. That makes his updates useful for PMs managing latency, quality, and margin tradeoffs.
Related
- Google DeepMind / Google AI: Schmid is most often associated with communicating launches across Google’s AI stack, especially Gemini-related APIs and tools.
- Gemini API / Managed Agents / Gemini Interactions API: These are central to his relevance in this dataset, especially around agent orchestration, tool use, and developer workflow packaging.
- Gemini 3.5 Flash / Gemini Live API / Gemini TTS: Many of his mentions focus on multimodal, real-time, and lower-latency product use cases built on these capabilities.
- MCP / Remote MCP servers / agent skills: His updates point to a growing ecosystem around tool interoperability, reusable skills, and agent platform standards.
- Browserbase / LiveKit / Cloud Run / Google Health API: These related technologies appear in his demos, showing how Gemini capabilities connect to full application stacks rather than isolated model calls.
Newsletter Mentions (69)
“Philipp Schmid rolled out four new Managed Agent features in the Google DeepMind Gemini API—Background Execution (`background: true`), Remote MCP servers, Custom Function Calling, and credentials refresh across turns.”
#6 𝕏 Philipp Schmid rolled out four new Managed Agent features in the Google DeepMind Gemini API—Background Execution (`background: true`), Remote MCP servers, Custom Function Calling, and credentials refresh across turns. Also covered by: @Logan Kilpatrick
“Philipp Schmid recommends Gemini 3.5 Flash for OCR and VQA tasks, highlighting its faster, cheaper, and more accurate performance.”
GenAI PM Daily July 07, 2026 GenAI PM Daily 🎧 Listen to this brief 3 min listen Today's top 20 insights for PM Builders, ranked by relevance from Blogs, YouTube, and LinkedIn. #9 𝕏 Philipp Schmid recommends Gemini 3.5 Flash for OCR and VQA tasks, highlighting its faster, cheaper, and more accurate performance.
“Philipp Schmid launched ghealth, an open-source CLI for the Google Health API that pulls 40 Fitbit Air metrics—like per-stage sleep breakdowns (awake, deep, REM) and heart rate—directly in your terminal or into AI agents.”
#3 𝕏 Philipp Schmid launched ghealth, an open-source CLI for the Google Health API that pulls 40 Fitbit Air metrics—like per-stage sleep breakdowns (awake, deep, REM) and heart rate—directly in your terminal or into AI agents.
“Philipp Schmid launched computer use in Gemini 3.5 Flash across browser, mobile, and desktop environments.”
#4 𝕏 Philipp Schmid launched computer use in Gemini 3.5 Flash across browser, mobile, and desktop environments.
“Philipp Schmid showcases Google’s new Gemini 3.5 Flash “computer-use” model you can test live on Browserbase.”
Philipp Schmid is repeatedly referenced for demonstrating practical AI tooling and integrations. The surrounding items focus on browser, desktop, and agent control use cases.
“Philipp Schmid announces the Gemini Interactions API is now GA and available as an npm skill (`npx skills add google-gemini/gemini-skills --skill gemini-interactions-api --global`) to inject baked-in rules, SDK patterns, and current model versions.”
Philipp Schmid is named as the announcer of Gemini Interactions API GA and the npm skill command.
“Philipp Schmid shows how to build a real-time translation app using Google’s Gemini Live API for streaming transcription/translation, LiveKit for audio routing, and deploy it on Cloud Run—with full example code on GitHub.”
📝 𝕏 Philipp Schmid shows how to build a real-time translation app using Google’s Gemini Live API for streaming transcription/translation, LiveKit for audio routing, and deploy it on Cloud Run—with full example code on GitHub.
“Philipp Schmid launched streaming support for Gemini TTS—just set `stream: true` to receive audio chunks as they’re generated, so your voice assistants, narration tools, or conversational apps can start talking instantly.”
#9 𝕏 Philipp Schmid launched streaming support for Gemini TTS—just set `stream: true` to receive audio chunks as they’re generated, so your voice assistants, narration tools, or conversational apps can start talking instantly.
“#20 𝕏 Philipp Schmid shares a free 5-day YouTube course on building AI agents, covering agent architectures, tool integration, chain-of-thought planning, memory management and evaluation with hands-on code and notebooks.”
#20 𝕏 Philipp Schmid shares a free 5-day YouTube course on building AI agents, covering agent architectures, tool integration, chain-of-thought planning, memory management and evaluation with hands-on code and notebooks.
“#18 𝕏 Philipp Schmid lauds Gemini 3.5 Flash’s underrated multimodal understanding, outpacing Gemini 3.1 Pro. It’s 3× faster and costs half as much, thanks to work by @roboflow.”
#18 𝕏 Philipp Schmid lauds Gemini 3.5 Flash’s underrated multimodal understanding, outpacing Gemini 3.1 Pro. It’s 3× faster and costs half as much, thanks to work by @roboflow. #20 𝕏 Philipp Schmid shares a free 5-day YouTube course on building AI agents, covering agent architectures, tool integration, chain-of-thought planning, memory management and evaluation with hands-on code and notebooks.
Related
A code editor and AI agent workspace that introduced Side Chats and cloud agent hooks in this newsletter. For AI PMs, it shows how copilots are evolving into persistent, context-aware agent threads.
A developer and AI commentator quoted here in relation to OpenAI’s clarification of ChatGPT Work behavior. He is relevant as an interpreter and critic of product messaging.
The AI platform whose profiles are mentioned as a future personalization signal for HuggingNews. For PMs, it indicates ecosystem-based personalization and developer identity integration.
Google’s AI research lab, mentioned here in connection with interpretability and model reasoning. For PMs, it represents frontier research into understanding and auditing model behavior.
A developer platform company mentioned for launching an AI gateway and model routing/origin controls. Relevant to PMs building multi-model infrastructure and trusted inference paths.
An AI educator and researcher cited here for model-usage advice on agentic coding. He is relevant to PMs as a source of practical guidance on model selection and cost/performance tradeoffs.
Google’s AI assistant/model family, referenced here through Josh Woodward’s community feedback post. The newsletter suggests product improvements are being informed by large-scale user replies.
Technology company named as a challenger in the predicted AI super app market. It is a major platform owner and AI competitor for PMs.
Google’s research organization, mentioned here for launching Open Health Stack and SensorFM. The items suggest work in health infrastructure and wearable-data foundation models.
MCP is a deployment and integration concept for exposing tools and workflows to AI systems. In the newsletter it is mentioned as a way to deploy an analytics tool everywhere.
Google’s app-building environment, here highlighted for globally unique ai.studio subdomains and instant publishing. For PMs, it represents low-friction deployment and branded app distribution.
An AI infrastructure company known for building tools for LLM apps and agents. In this newsletter, it is associated with DeepAgents and open-source coding infrastructure.
Google’s AI organization is credited here with launching a Street View grounding feature in Project Genie. It matters to PMs as an example of multimodal, map-grounded experience design.
Co-founder and CEO of Google DeepMind, cited unveiling DiffusionGemma. His mention ties Google’s research leadership to model launches.
Google AI leader and prominent engineering executive. Here he is cited highlighting a TPU supercomputing paper and hardware progression.
Google’s API for building with Gemini models, including managed agents and developer workflows. In this newsletter it’s highlighted for new agent features like background tasks, remote MCP, function calling, and credential refresh.
CEO of Google and Alphabet, mentioned here in connection with Gemini/DiffusionGemma announcements and open-sourcing model weights.
Systems that use models plus tools, memory, and planning to perform multi-step tasks autonomously or semi-autonomously. The newsletter references both agent architectures and agentic coding/workflows.
A Google model described as best-in-class across hardware tiers and suitable for local on-device intelligence.
Google’s interactions-oriented API for model and agent workflows. The newsletter notes it reaching GA and being available as an npm skill.
An AI-native development approach where builders use AI tools to rapidly create software. The newsletter treats it as a growth and product-building methodology.
Google model recommended for OCR and VQA workloads. It is highlighted for speed, cost, and accuracy tradeoffs relevant to PM decision-making.
An opinionated build environment for coding with AI that uses a coding agent. The newsletter notes that projects can be exported from it directly to Antigravity.
A Gemini model variant used here to power agentic workflow examples and multi-agent systems. It is relevant to AI PMs as an example of frontier model capability enabling more complex automated workflows.
A Google DeepMind skill or interface for AI-assisted history analysis. It integrates Gemini with expert models to help translate and study ancient texts using plain English.
A Gemini model variant that was noted as moving out of preview status.
Google’s search product, mentioned as another interface for detecting SynthID watermarks. It illustrates how AI safety features can be embedded into mainstream consumer search.
A research capability embedded into Perplexity Computer as a built-in skill. For PMs, it indicates the packaging of advanced research into agent workflows.
Agent Skills are reusable capability modules or instructional patterns for agents. The newsletter references a React best-practices tutorial framed as an agent skill.
An API interface for orchestrating models and agents together. The newsletter frames it as OpenAI’s new default interface and a foundational layer for agent workflows.
A React framework used to build web applications. The newsletter highlights a new error helper feature that uses prompts to guide debugging, pointing to more agentic developer tooling.
An embedding model powering multimodal file search in the Gemini API. Relevant for PMs designing retrieval, citation, and metadata-aware workflows.
A W3C-backed browser extension that exposes website functionality to MCP-capable agents. It lets developers register site functions as structured tools in the browser.
Google’s video generation model with updates to portrait mode, visual consistency, and higher-resolution upscaling.
A Google AI text-to-speech model with native multi-speaker dialogue support across many languages. It is positioned as part of the Gemini product family.
Google AI Edge Gallery is a Google tool for showcasing and running on-device AI experiences at the edge, including offline use cases.
Google’s mapping product used as a grounding source in AI Studio. It is mentioned as part of building location-aware, citation-backed apps.
Google's Gemini model family referenced in guidance for integrating it into Android apps.
Google's latest Gemini model highlighted for improved reasoning and multimodal capabilities. It is positioned as a model that can code full environments and work with integrated generative audio and UI controls.
An open-source command-line tool for dynamic discovery of Model Context Protocol servers. It is described as reducing MCP token usage and improving AI agent tool interactions.
Stay updated on Philipp Schmid
Get curated AI PM insights delivered daily — covering this and 1,000+ other sources.
Subscribe Free