Your technical library
Emerging Models
1 modules · 11 topics
About this book
Emerging Models
New kinds of model keep appearing that fit none of the classical courses: they are not chat language models, not embeddings and not classical machine learning. Each one gets a module here, taught the way the rest of the library teaches — the concrete problem it answers, the contract it exposes, how it actually works, what it deliberately gives up, and what people have already built with it. Modules are independent: read whichever technology is new to you.
Jev: System One decision models covers TypeSafe AI's first decision model, which reads the current state together with typed questions and returns calibrated, probabilistic decisions instead of generated text. Later modules follow the same pattern for whichever family arrives next.
11 topics across 1 module(s), in dependency order.
Lessons are concept-first. SDK code appears only where the shape of a request or answer is itself the content, and read-first links stay inside the course.
Read at your own pace. Each topic is one continuous page; mark it done as you finish.
Start with 01.1 · A model that only decides: the System One contractReview what you have finished↷ 0 skipped topics- 01.1A model that only decides: the System One contract
- 01.2State and questions: the input contract
- 01.3Choice, Score and Noul: the three primitives
- 01.4How Jev answers: a parallel sampler, not a generator
- 01.5Calibrated probabilities and confidence
- 01.6Cost, speed and the operating envelope
- 01.7What people built: decision loops in the wild
- 01.8The official patterns: five ways to compose a decision call
- 01.9The cookbooks that find and extract
- 01.10The cookbooks that screen and guard
- 01.11Where Jev is jagged: nine honest edges
01.2State and questions: the input contract
01.3Choice, Score and Noul: the three primitives
01.4How Jev answers: a parallel sampler, not a generator
01.5Calibrated probabilities and confidence
01.6Cost, speed and the operating envelope
01.7What people built: decision loops in the wild
01.8The official patterns: five ways to compose a decision call
01.9The cookbooks that find and extract
01.10The cookbooks that screen and guard
01.11Where Jev is jagged: nine honest edges
Skipped topics
Moved past without finishing. A skipped topic still closes its module, and Continue goes on without it — open one to read it or mark it understood.
Glossary
The vocabulary this course uses, with a link to the topic that derives each idea.
System One model
A model that reads state plus typed questions and returns typed probabilistic decisions — never generated text.
More detail
Named for Kahneman’s fast, automatic judgment. The caller declares the legal answers in the request; the model returns a distribution over exactly those. Jev is TypeSafe AI’s first public System One model.
State
The context a decision is about — a string, JSON object, or array of text records.
More detail
State is text-only and English-primary. Labelled structure is preferred over raw blobs because field names carry signal; images, audio and video must be serialised to text first. Budget: 32k tokens with the longest question inside a 64k-token request.
Question map
The set of typed judgments a request asks over one state, all evaluated independently in one call.
More detail
Each question gets a caller-chosen key, an instructions string, and primitive-specific fields (options for Choice, criteria for Score). One focused judgment per question — fused judgments smear probability mass.
Choice
A primitive that picks one option from a declared unordered set and returns the full probability distribution.
More detail
Answer fields: the winning choice, per-option probabilities, and confidence. Always declare an "other" option — without an escape hatch, off-menu inputs are force-fit into the nearest declared option.
Score
A primitive that places the state on an ordered rubric and returns a probability-weighted position.
More detail
The declared criteria are ordered rungs; the returned score is the expectation over their probabilities and can land between rungs. Use it when the judgment is "how much / how severe", not "which one".
Noul
A primitive answering the probability that a single yes/no proposition holds — "not a bool".
More detail
Returns a bare probability with no separate confidence field: for two outcomes the spread is already visible. The natural input to a threshold policy (act above τ, escalate below).
Calibrated probability
A stated probability that matches real correctness frequency — declared 0.8 is right ~80% of the time on similar inputs.
More detail
An aggregate guarantee, not a per-case one: it makes thresholds into policies with a measurable error budget. It does not survive distribution shift and does not promise low error rates on hard tasks.
Confidence
A scalar derived from the probability spread — how decisive the distribution was, normalised across arities.
More detail
Concentrated distributions give high confidence, flat ones low. Computed deterministically from probabilities, so it can never disagree with them; absent on Noul where the probability already encodes the contest.
RLCD
Reinforcement Learning for Calibrated Decisions — training that rewards probabilities matching real correctness rates.
More detail
Contrasts with RLHF (human preference over responses) and RLVR (verifiable rewards). The optimisation target is the honesty of the reported number, which is what makes thresholds meaningful.
Parallel sampler
Jev’s non-autoregressive evaluation: every declared option of every question scored against the state in one pass.
More detail
No token-by-token generation, hence no decoder and no prose output. Adding questions widens the pass instead of lengthening it — marginal cost per question is small and outputs are unmetered.
Confidence gate
A threshold policy over returned confidence or probability: act automatically above it, route to a human below.
More detail
The pattern behind guardrails, routers and stream filters. Choosing the threshold is choosing an error budget; it should be measured on your own distribution because calibration is only promised in aggregate.
Decision loop
The four-step pattern every Jev build shares: serialise state to text, ask typed questions, gate on confidence, act in code.
More detail
Appears in games (per-tick action choice), browser agents (per-page next action), stream filters (per-item keep/drop), and agent guardrails (per-tool-call allow/deny). The model decides; code acts.
Speculative fan-out
Ask every question in the decision tree in one call — including ones that may not apply — and let code ignore the irrelevant answers.
More detail
All questions evaluate in the same parallel pass, so speculative questions cost scoring, not a round trip. Sequential conditional calls trade away a latency the model never charged.
Cascade
A cheap model produces; a calibrated verifier checks; an expensive model sees only the failures.
More detail
Confidence routing one level up: the gated object is another model’s output. The SDE-cascade and self-consistency cookbooks run it in both directions.
Uncertain band
A probability range — e.g. 0.30–0.70 — mapped to an explicit “uncertain” outcome for human review instead of a forced side.
More detail
An honest model near a threshold should wobble; the band turns the wobble into a routed signal. In the nouls cookbook it holds questions like covered and fraud_flag across all 15 repeats.
Find then judge
A cheap mechanical step (regex, BM25, splitter) enumerates candidates; the model spends one judgment on what is left.
More detail
Keeps state inside the 32k budget and guarantees extracted values are real spans. The canonical instance: BM25 top-30 reranked by Jev, top-1 5%→18% on CLERC.
Jaggedness
The vendor’s catalogue of where jev-1.13 is weak: literal reading, counting, dates, indirection, noisy state, adversarial input, contradictory fields, non-invariance, generation.
More detail
The shared fix: computation, arithmetic and multi-hop interpretation go in code; the model keeps the judgment. Consistency does not imply identities like p(q) + p(¬q) = 1.
Escape hatch (NONE)
Every closed selection should offer an explicit none-of-the-above option so a missing answer is a valid output, not a forced wrong one.
More detail
Used in pre-parsed extraction (NONE of the regex spans) and skill suggestion (no skill fits — reject all). The hatch converts force-fit errors into a routed outcome.
Progressive disclosure
Rank all options on one-line state, then re-read only the top few in detail — with the option to reject all of them.
More detail
The skill-suggestion cookbook’s shape over 182 skills: rank in one pass, then a second pass reads the top three properly and may still return nothing. Wrong-skill loads fell by over half.
Which primitive or pattern?
A judgment’s shape, the primitive or pattern it needs, the contract behind the choice, and the topic that derives it.
Pick one of a fixed set
Use Choice when the judgment is “which one” over an unordered set — intents, routes, severities-as-labels.
More detail
Preconditions: you can enumerate the legal answers, including an escape hatch (always declare other). Reads: winning choice + probabilities + confidence. Failure mode without other: off-menu inputs are force-fit into the nearest option.
Place it on an ordered scale
Use Score when the judgment is “how much” — urgency, severity, quality — along rungs you define.
More detail
The answer is a probability-weighted position that can land between rungs, so thresholds act on a continuum. Do not use it for unordered categories: a fake ordering produces a meaningless middle.
Decide a yes/no proposition
Use Noul when the judgment is a single proposition — “is this urgent”, “is this an ad”, “is this safe”.
More detail
Returns one probability and nothing else; the spread is visible in the number itself. The cleanest input to a gate: if (noul > τ) act. Do not mimic Choice with several Nouls — overlapping yeses stop summing to one.
Split fused judgments
When a question asks two things, ask it as two questions — they cost the same call.
More detail
Questions evaluate independently in one pass, so “urgent AND billing?” should be is_urgent plus route-to-billing. Fused questions smear probability mass and hide the contest.
Set the threshold on your own data
A gate’s τ is an error budget: measure calibration on your real traffic, then pick the operating point.
More detail
Calibration is promised in aggregate over the training distribution, not on your shifted inputs. Re-derive the threshold when traffic drifts; pinned model versions keep the measurement reproducible.
Compact state, stable questions
Billing is input-only, so cost follows state size — keep state dense and the question set fixed.
More detail
Answers are unmetered and extra questions are marginal. Within budgets: 64k tok/request, 32k for state + longest question, ~20 rps. Compress or split oversized state upstream rather than truncating silently.
Decisions inside a clock
Jev fits when a bounded decision must happen inside a latency budget — games, browser actions, trading blocks.
More detail
~70–500ms per call makes a ~10 qps loop playable. Where the loop is inside a clock, latency is the feature; for batch streams it is merely convenient.
Gates over another agent’s actions
Jev fits as the permission layer over a generative agent — score each proposed tool call, block or escalate below τ.
More detail
The LLM reasons freely in prose; only typed decisions act. Seen in jev-guard, jev-axi, pi-verdict, LangChain’s AutoModeMiddleware and model routers.
When not to use it
Do not reach for Jev when the answer is prose, code or an explanation, or when the answer space cannot be enumerated.
More detail
There is no text output and no chain-of-thought. If the taxonomy itself must be discovered, an open-ended model or a human defines the options first — Jev only judges within a declared space.