06-reference/research

agentic targeting conviction calibrated confidence

2026-06-12·research-brief·source: deep-research
targeting-systemcalibrated-confidencemac-positioningconviction-in-uncertaintyhuman-ai-decision-making

Can instrumentation manufacture conviction in fuzzy domains, or does conviction stay human?

The question

Can an agentic targeting system (evals, benchmarks, test harnesses) provide the conviction for human decision-makers to push ahead in un-instrumented situations — or is conviction the one thing that stays with the implicit (taste/experience) targeting system? Does any published work show AI outputs leading humans to commit in fuzzy domains at a rate that matches or beats senior-operator conviction? (Surfaced 2026-04-24 in the RDCO Targeting System synthesis; this is where MAC's positioning earns its keep.)

What we already know (from the vault)

What the web says

Convergences and contradictions

Synthesis for RDCO

The published evidence comes down on the side the founder already suspected: conviction in genuinely un-instrumented situations stays human, and the targeting-system frame is correct to treat that residual as the durable seat of senior judgment. As of mid-2026 there is no work showing AI matching or beating senior-operator conviction in fuzzy domains. Frontier models trail expert forecasters by roughly 6x on Brier score, are overconfident exactly where stakes are highest, and — most importantly — can verbalize uncertainty but cannot convert it into risk-sensitive commitment. The mechanism by which AI confidence does move humans ("confidence alignment") is a contamination effect, not a conviction-transfer: it changes how sure the human feels without changing whether they should be. That is the opposite of what a trustworthy targeting system would do.

This tightens, rather than weakens, MAC / agent-deployer positioning — provided RDCO sells the honest version. The defensible, evidence-backed pitch is the one the vault already drafted: "we convert as much of the implicit targeting system into the agentic one as your domain allows." MAC's job is to expand the instrumentable frontier — turn taste into acceptance criteria, "good enough" into a gradeable spec, anomaly-escalation instinct into eval-backed thresholds — and the published evidence shows this is real value precisely because real-time observable feedback is the one lever that fixes miscalibrated reliance. MAC is in the business of manufacturing the feedback loop that makes conviction transferable. What it must never claim is that it manufactures conviction in the un-instrumented residual; the calibration literature would falsify that on contact, and a confident-but-miscalibrated agent is a liability, not a feature.

The strategic refinement: RDCO should treat "the un-instrumented residual" not as a permanent fixed quantity but as a moving frontier MAC pushes outward, while explicitly conceding the frontier never reaches zero. Two assets fall out of this. First, a credibility moat — RDCO can say, with citations, exactly why a vendor promising "AI conviction in fuzzy domains" is overselling (overconfidence + confidence-alignment contamination), which is a sharp Sanity Check re-frame and a trust-building move in sales. Second, a product wedge — Client Reporting and MAC should be sold as instrumentation services that earn the right to transfer conviction, with the explicit boundary that the final "proceed under genuine ambiguity" call stays with the human until outcomes become observable. That boundary is not a weakness to hide; per the appropriate-reliance research, senior operators trust vendors who respect their judgment-seat more, so naming the boundary is itself a positioning advantage.

Open follow-ups

Related

Sources