06-reference

technically are reasoning models actually thinking

2026-11-17·reference·source: Technically·by Technically (byline not rendered in email)
reasoning-modelsrlvrchain-of-thoughtcot-monitorabilityverifiable-rewardsevals

Why this is in the vault

A plain-English explainer of how reasoning models are trained (RLVR), why verifiable domains improve fastest, and why chain-of-thought is useful but not an honest window into the model.

The core argument

Mapping against Ray Data Co

Strong on the "evals are the product" belief: the RLVR point (verifiable reward = trainable) is the same logic behind giving agents acceptance contracts and deterministic audits, such as the newsletter audit script and pre-registered acceptance contracts in dispatches, instead of letting an LLM grade its own work. The unfaithful-CoT finding also supports the fresh-eyes critic rule: never trust a model's stated reasoning as verification of its own output. Practical for phData client talk: "reasoning effort is a cost/latency dial" is a clean framing for model-tier and effort pairing decisions. No project-direction change; reinforcement of existing practice.

Related