Why this is in the vault
Context Window issue that repackages Every's Thesis: 2027 conference into one thesis (when models are commodity, human judgment about what is good is the scarce input) and one portable technique (turn your own corrections into yes/no evals).
The core argument
Dan Shipper's closing keynote (shared as The Every Podcast episode) splits forecasting into "aggregate" (trend lines from data, which make AI look like a replacement) and "intimate" (zoom into one real situation, which looks very different). Every's own survey exercise is the evidence: the same customer survey run through Claude yielded different findings per team member, because generation is cheap and ranking is hard. Corollary: benchmarks on math and code with checkable answers are the wrong test; the right question is how good a model is at your work from your perspective.
Supporting pieces: Mike Taylor's Classroom session (convert the corrections you already make into a personal benchmark of yes/no checks an AI judge can apply; overfitting is the main trap, since a check can smuggle in an over-broad rule) and a Backstage section of speaker takeaways. Hugh Wimberly (Ode) reports agent-driven onboarding cut from about 100 to about 30 hours without layoffs because cheaper onboarding opened new customers, with the caveat that his sample is self-selected. Katy George (Microsoft) predicts that by 2027 the job is teaching AI. Browser Company CEO Josh Miller dissents on delegation. Ivan Zhao (Notion) argues people will keep paying for human-made work, framed as hope, not forecast.
Issue contents
- Podcast + keynote (Dan Shipper): aggregate vs intimate lens; ranking over generation. Self-produced Every content.
- Skill share (Mike Taylor, Every head of evals): personal-benchmark method plus a paste-in prompt; GPT 6.1 Sol failed the custom-SVG check, Grok 4.6 passed (single anecdote).
- Counterpoint (Hugh Wimberly, Ode): automation did not shrink teams; some offshore click-work jobs did go away. Ode is the Anthropic/Blackstone/H&F services venture, so it is a vendor-side view.
- Prediction (Katy George, Microsoft): teaching AI is the 2027 job. Every's "our take" endorses it.
- Dissent (Josh Miller, Browser Company): keep agency in your craft; plugs his Clackety Clack app.
- Interview questions (Curtis Anderson, Nursa): hire for tolerance for ambiguity.
- Discuss (Ivan Zhao, Notion): "meatball tokens" - human-made work stays valued.
- Log on: Fable 5.2 Vibe Check, Nov 13 Zoom session, Thesis recordings (paywalled for members, free on YouTube later).
Deep-fetches: 0. All items carried enough substance in the email's own text.
Mapping against Ray Data Co
Strongest connection: Mike Taylor's corrections-to-checks method is the same loop as RDCO's fresh-eyes verification gates and the newsletter-note audit invariants, where each founder correction becomes a deterministic or critic-applied check. It also names the failure mode RDCO should watch in its own feedback memories: a check that encodes an over-broad rule (overfitting) and passes work that is still wrong. Also reinforces the "advisor, not pair programmer" posture: the human supplies the ranking and the standard, the agent supplies generation. For phData sales credibility, the Wimberly onboarding example (70% task automation, headcount up) is a usable client-facing counter to layoff-framed objections, but treat it as one self-selected, vendor-adjacent anecdote. Mapping strength: medium. No decision threshold crossed.
Related
- [[2026-11-08-every-thesis-2027-recap]]
- [[2026-11-10-every-vibe-check-fable-5-2]]
- [[2026-08-18-every-100-thinkers-human-work-after-automation]]
- [[2026-05-21-every-after-automation]]
- [[2026-09-10-every-evals-for-everyone]]
- [[2026-09-24-every-why-evals-are-so-hot-right-now]]
- [[feedback_fresh_eyes_subagent_for_own_artifacts]]
⚠️ Sponsorship
No third-party paid sponsor block. House promotion only: Every Agent (Slack) upsell, the Upgrade to paid CTA, Every's tool bundle (Monologue, Compound Engineering), the Nov 13 camp, and Thesis recordings. The issue is also structurally self-promotional: most content is Every's own conference and people, and the "our take" line endorses Every's own speakers' framing. Portfolio-adjacent guests (Notion, Browser Company) also plug their own products.