Jev
A system for handling many agent steps as typed questions with calibrated probabilities. It is positioned as a harness component for inexpensive yes/no decisions.
Key Highlights
- Jev is positioned as a specialized decision tool that converts unstructured text into typed choice, score, true/false, or null outputs with confidence values.
- Coverage repeatedly frames Jev as a harness component for agent systems, where many steps are simple yes/no judgments rather than full text generation.
- Reported use cases include model routing, eval labeling, fraud checks, lead qualification, clustering, safety review, and large-scale product analytics.
- Newsletter mentions emphasize low latency and cost efficiency, including examples of high-volume classification workflows completed for cents rather than dollars.
- LangChain and LangSmith examples show Jev fitting into practical AI PM workflows for orchestration, trace scoring, and production evaluation.
At a glance
- Category
- Developer Tool
Overview
Jev is a tool from TypeSafe AI for turning unstructured text into strongly typed decisions such as multiple-choice selections, true/false answers, scores, or null outputs, with calibrated probabilities attached. Across newsletter mentions, it is consistently framed not as a general-purpose generation model, but as a specialized harness component for fast, inexpensive decision steps inside larger AI systems. Reported use cases include classification, routing, clustering, safety review, eval labeling, and business process automation.
For AI Product Managers, Jev matters because it represents a different design pattern for agentic products: many steps in an AI workflow do not need open-ended text generation, only a reliable yes/no or typed judgment. In that framing, Jev can reduce cost and latency on high-volume decision points while reserving frontier models for harder reasoning or synthesis tasks. The recurring theme in coverage is that Jev helps teams operationalize structured AI decisions with confidence thresholds, schema guarantees, and model-routing roles inside production harnesses.
Key Developments
- 2026-09-17: Guillermo Rauch shared results from TypeSafe AI indicating Jev was reportedly up to 18x faster at p95 and more accurate in a safety-review context, with plans to bring it to Vercel AI Gateway and potentially make it a default option.
- 2026-09-20: Greg Isenberg highlighted Jev as a structured-output classifier returning probability-based decisions in about 200 ms per query; Ryan Vogle used it to categorize 1,700 emails with fields like category, priority, spam score, and reply likelihood for roughly $0.18.
- 2026-09-21: Jev was shown in business automation workflows with Treg data enrichment and API endpoints for fraud classification, lead qualification, viral-post screening, and routing decisions using multiple-choice, true/false, and scored outputs with probability thresholds.
- 2026-09-22: Fireship described Jev, created by ex-OpenAI researcher Diogo Almeida and TypeSafe AI, as a System 1 classifier that removes natural-language output and returns strongly typed choice, score, or null responses. Coverage also cited RLCD for calibrated decisions, non-deterministic outputs, a 32K context window, and claims of much higher speed and lower cost than standard LLM usage. OpenJeb was noted as an open reproduction of the interface using a frozen Qwen-4B model.
- 2026-09-29: How I AI Podcast emphasized Jev’s economics for classification, routing, clustering, and real-time decisions, citing $0.04 per million input tokens with no output-token charge. It also described large-scale analytical workflows, including analysis of 1,700 ChatPRD pull requests and over 200,000 classifications and pairwise groupings in a broader product-insights graph.
- 2026-10-04: In a DSPy and Jev model-router example, Jev was described as reading the first message to select a model for the entire run, with a custom hook enabling reselection after each tool result. This positioned Jev as part of routing and orchestration logic rather than only as a classifier endpoint.
- 2026-10-10: LangSmith evals coverage showed Jev assessing trajectory difficulty and correctness with separate typed answers in a single pass on every trace, underscoring its usefulness for evaluation pipelines where multiple dimensions must be labeled efficiently.
- 2026-10-11: Harrison Chase shared the framing that many agent steps are yes/no calls rather than generation; Jev handles these as typed questions with calibrated probabilities, while frontier models handle harder work. LangChain’s harness guidance was referenced as an example of where these calls fit.
Relevance to AI PMs
1. Lower-cost agent and workflow design: AI PMs can use Jev for high-frequency decisions such as routing, moderation, qualification, fraud checks, and tool gating instead of paying frontier-model costs for every step. This is especially relevant when workflows contain many binary or multiple-choice judgments.
2. Better product control through typed outputs: Because Jev is described as returning structured choice, score, or null outputs with calibrated probabilities, PMs can design deterministic downstream logic around thresholds, escalation rules, and fallback paths more easily than with free-form model text.
3. Scalable evals and instrumentation: The LangSmith and LangChain mentions suggest a practical role in labeling traces, scoring difficulty, and measuring correctness across many runs. PMs building agent products can use Jev-like components to make evaluation pipelines cheaper, faster, and more granular.
Related
- TypeSafe AI / typesafeai / typesafe-ai: The company behind Jev; most core product claims and launch details come from this source.
- Diogo Almeida: Identified as the ex-OpenAI researcher associated with Jev’s creation.
- Vercel AI Gateway / vercel-ai-gateway: Mentioned as an upcoming integration point, suggesting relevance for deployment and model access infrastructure.
- GPT Luna / gpt-luna / gpt-56-luna / gemini-flash: Referenced as comparison or companion models in safety review, routing, and cost-speed tradeoff discussions.
- LangChain, LangSmith, Harrison Chase: Closely tied to the “harness” framing, eval workflows, and examples of where Jev fits in agent systems.
- DSPy and ModelRouterMiddleware: Connected through examples where Jev participates in model routing and orchestration logic.
- OpenJeb and Qwen-4B: OpenJeb is presented as a reproduction of the Jev interface using a frozen Qwen-4B model, offering an open comparison point.
- Greg Isenberg, Ryan Vogle, ChatPRD, browser-use: These entities appear in demos, workflows, and adjacent tooling discussions that illustrate Jev’s practical use in product and automation scenarios.
Frequently asked questions
What is Jev?
A system for handling many agent steps as typed questions with calibrated probabilities. It is positioned as a harness component for inexpensive yes/no decisions.
What should AI product managers know about Jev?
Jev is positioned as a specialized decision tool that converts unstructured text into typed choice, score, true/false, or null outputs with confidence values. Coverage repeatedly frames Jev as a harness component for agent systems, where many steps are simple yes/no judgments rather than full text generation. Reported use cases include model routing, eval labeling, fraud checks, lead qualification, clustering, safety review, and large-scale product analytics.
Explore this topic
Newsletter Mentions (8)
“#8 𝕏 Harrison Chase shared @ch3nweiii’s framing that many agent steps are yes/no calls rather than generation: Jev handles them as typed questions with calibrated probabilities, leaving harder work to the frontier model.”
#8 𝕏 Harrison Chase shared @ch3nweiii’s framing that many agent steps are yes/no calls rather than generation: Jev handles them as typed questions with calibrated probabilities, leaving harder work to the frontier model. LangChain’s “Building a Harness with Jev” explains where those calls fit within a harness.
“In LangSmith evals, LangChain’s Jev assesses difficulty and correctness with separate typed answers in one pass on every trace.”
Harrison Chase commented that trajectory labeling involves several questions rather than a single pass/fail judgment. In LangSmith evals, LangChain’s Jev assesses difficulty and correctness with separate typed answers in one pass on every trace.
“Jev reads the first message to select a model for the entire run, with a custom hook allowing reselection after each tool result.”
GenAI PM Daily - Perplexity Computer now generates interactive 3D learning visualizations October 04, 2026 GenAI PM Daily 🎧 Listen to this brief 3 min listen Today's top 12 insights for PM Builders from X and LinkedIn. Perplexity Computer now generates interactive 3D learning visualizations #3 𝕏 Harrison Chase shared ModelRouterMiddleware, a LangChain project by @dbreunig, in the context of a DSPy and Jev model-router example. Jev reads the first message to select a model for the entire run, with a custom hook allowing reselection after each tool result.
“How I AI Podcast shared that TypeSafe AI’s Jev turns unstructured text into type-safe choice, score, or probability values for classification, routing, clustering, and real-time decisions at $0.04 per million input tokens with no output-token charge.”
GenAI PM Daily - Anthropic announces faster, lower-cost Claude Sonnet 5.5 September 29, 2026 GenAI PM Daily 🎧 Listen to this brief 3 min listen Today's top 20 insights for PM Builders, ranked by relevance from Blogs, X, YouTube, and LinkedIn. Anthropic announces faster, lower-cost Claude Sonnet 5.5 #9 ▶️ I’m using Jev more than Opus 5.5 or GPT-6. Here’s why. How I AI Podcast How I AI Podcast shared that TypeSafe AI’s Jev turns unstructured text into type-safe choice, score, or probability values for classification, routing, clustering, and real-time decisions at $0.04 per million input tokens with no output-token charge. Jev analyzed 1,700 ChatPRD GitHub PRs, formed 17,000 candidate pairs, and grouped the results into themes in about two minutes for $0.09, while ChatPRD’s broader product-insights graph produced more than 200,000 Jev classifications and pairwise groupings for about $4 on the Jev side.
“Jev, created by ex-OpenAI researcher Diogo Almeida and TypeSafe AI, is presented as a System 1 classifier that removes language output and returns strongly typed choice, score, or null responses with claimed 200× faster speed, 400× lower cost, free output tokens, and zero hallucinations.”
#12 ▶️ An ex-OpenAI researcher just deleted language from the LLM... Fireship Jev, created by ex-OpenAI researcher Diogo Almeida and TypeSafe AI, is presented as a System 1 classifier that removes language output and returns strongly typed choice, score, or null responses with claimed 200× faster speed, 400× lower cost, free output tokens, and zero hallucinations. TypeSafe AI raised $40 million; Jev accepts a question plus unstructured-text context and guarantees schema matching for one of three output shapes: choice, score, or null. Jev uses RLCD (reinforcement learning for calibrated decisions) to return a calibrated confidence value, such as 60%; identical inputs can still produce different outputs because the model is not deterministic. OpenJeb reproduces the Jev interface by reading option probabilities from a frozen Qwen-4B model in a single forward pass, requires no new training, runs on an RTX 3090, and has a WebGPU browser demo. Also covered by: @Harrison Chase
“Jev is used with Treg data enrichment and API endpoints to classify fraud, qualify leads, screen viral Twitter posts, and route business decisions using multiple-choice, true/false, or scored outputs with probability-based confidence thresholds.”
#5 ▶️ How to use Jev to automate your business (Step-by-step w/ Treg) AI Jason Jev is used with Treg data enrichment and API endpoints to classify fraud, qualify leads, screen viral Twitter posts, and route business decisions using multiple-choice, true/false, or scored outputs with probability-based confidence thresholds. Jev has a 32K context window and was measured at roughly 5–7 times faster and 5 times cheaper than GPT 5.6 Luna in the comparison cited.
“Jev is used as a structured-output classifier that receives an input plus an output schema and returns probability-based decisions in about 200 milliseconds per query, including categorizing 1,700 emails for 18 cents.”
#5 ▶️ Jev is HERE. How to use it Greg Isenberg Jev is used as a structured-output classifier that receives an input plus an output schema and returns probability-based decisions in about 200 milliseconds per query, including categorizing 1,700 emails for 18 cents. Ryan Vogle passed 1,700 email objects into Jev with category, priority, spam-score, and reply-likelihood output fields; the run used 4.2 million input tokens and 500,000 output tokens and cost 18 cents.
“Guillermo Rauch announced results from @typesafeai: fx defaults to auto mode, with a GPT Luna safety reviewer analyzing every command, while Jev is reportedly up to 18x faster at p95 and more accurate.”
#10 𝕏 Guillermo Rauch announced results from @typesafeai: fx defaults to auto mode, with a GPT Luna safety reviewer analyzing every command, while Jev is reportedly up to 18x faster at p95 and more accurate. He added that it is coming to Vercel AI Gateway and will likely become the new default.
Related
Co-founder of LangChain, cited here discussing model routing inside an agent harness. He frames many agent steps as cheaper, typed decisions rather than frontier-model generation.
Entrepreneur and AI workflow commentator mentioned presenting a masterclass on deploying AI agents. The newsletter frames him around workflow redesign and automation economics.
An AI infrastructure company focused on agent tooling and harnesses. The newsletter cites its explanation of where typed yes/no calls fit inside a harness.
LangChain’s evaluation and observability product, referenced in the context of trajectory labeling. Useful for PMs instrumenting agent traces and evals.
Vercel’s model-routing and gateway product, mentioned in relation to spend and token share shifts across providers. Relevant to AI PMs for model traffic management and provider strategy.
An AI-first product management tool or startup referenced by Claire Vo. The newsletter uses it in a discussion of shipping an AI-first version of an app without traditional PM tooling.
Stay updated on Jev
Get curated AI PM insights delivered daily — covering this and 1,000+ other sources.
Subscribe Free