Vault Self-Review Log

Review 1 — 2026-04-13

Reviewer: Ray (AI COO) Scope: 5 entries from 06-reference/ filed on 2026-04-13 Max score: 13

Scored results

Grade distribution

Summary statistics

• Average score: 11.2 / 13
• Median score: 10
• Entries needing attention (C or below): None

Top entries

1. mg-harness-review-cc-wrapped.md (13/13) — Complete on every criterion. Has explicit why-in-vault, detailed RDCO mapping with actionable takeaways, and verified cross-links.
2. langchain-evals-deep-agents.md (13/13) — Strong why-in-vault tied to /improve skill, explicit bias flags section beyond what's required, clean RDCO mapping with four connection points.

Entries needing attention

None scored C or below. Three entries scored B due to the same missing element (see systemic patterns).

Systemic patterns

1. Missing "Why this is in the vault" section (3 of 5 entries) This is the dominant quality gap. Three entries — stratechery-mythos, solve-everything-master, joe-reis — lack an explicit why-in-vault section. All three have strong RDCO mapping, so the justification is implicitly present, but the criterion requires a dedicated section. The why-in-vault section serves a different purpose than the mapping: it answers "why did we file this at all" before diving into "how does it connect." Without it, a future reader has to infer relevance from the mapping section.

Action: Update the filing SOP (process-newsletter skill and any intake templates) to enforce a ## Why this is in the vault section as a required heading. One to three sentences, before any content summary.

2. Cross-link path inconsistency (minor) One cross-link in langchain-evals ([[cross-check-agent-architecture]]) uses a bare filename without the date prefix or subdirectory path. The actual file is 06-reference/cross-checks/2026-04-12-cross-check-agent-architecture.md. Obsidian's shortest-path resolution may handle this, but it's fragile — if another file with a similar name appears, the link breaks.

Action: Prefer full date-prefixed filenames in wikilinks. Not urgent but worth standardizing.

3. All entries pass on conciseness, bias flagging, and no-copy-paste No drift detected on these criteria. The filing process is producing clean, original synthesis at reasonable length. The two newsletter entries with sponsorship both have sponsored fields correctly populated, and joe-reis even includes a dedicated bias-notes section — exemplary.

4. Mapping quality is uniformly high Every entry scored 3/3 on the mapping criterion. The RDCO connections are specific, reference other vault entries by name, and propose concrete actions or position implications. This is the strongest dimension across the batch.

Process recommendations

1. Add ## Why this is in the vault as a mandatory heading in filing templates — this is the only criterion dragging scores from A to B.
2. Consider whether the solve-everything-master-synthesis format (no why-in-vault, but extensive positional mapping) deserves its own template — book-synthesis entries may warrant different structure than article-processing entries.
3. No entries need remediation. The three B-scored entries could be upgraded to A by adding a two-sentence why-in-vault section, but that's a process fix going forward, not a backfill priority.

Review 2 — 2026-04-19

Reviewer: Ray (AI COO) Scope: 30 entries from 06-reference/ modified in last 7d (2026-04-12 → 2026-04-19), --fix mode Max score: 13

Scored results

† = Links criterion passed only after auto-fix added cross-links to same-cohort siblings.

Grade distribution (post-fix)

Summary statistics

• Average score (post-fix): 12.93 / 13 (vs 11.2 last review — up 1.7)
• Median score: 13
• Entries needing attention (C or below): None
• Auto-fixes applied: 7 entries (all cross-link additions to same-cohort siblings)

Top entries (template-grade)

• The three deep-research briefs (research/2026-04-19-lia-dibello-academic-papers.md, newsletter-platform-sanity-check-v3.md, mac-vs-published-data-quality-frameworks.md) are the strongest entries this week — full structured why/web/convergences/synthesis/follow-ups, multi-source citation with bias flagging, original synthesis, and direct RDCO-actionable conclusions.
• The harness-thesis trio (2026-04-12-harness-thesis-dissent.md, kingsbury-future-of-everything-is-lies.md, garry-tan-build-the-car-jepsen-response.md) is also exemplary — explicit point-by-point scoring, named follow-ups, cross-linked across the cluster.

Worst entry (post-fix)

2026-04-19-commoncog-ultimate-guide-reading-book-a-week.md — 11/13. Single Apr-15 cross-link, was not auto-patched because it serves as the canonical anchor that the other 6 reading-category entries now cross-link TO. Consider hand-adding 1-2 links to other Apr-19 reading entries on next pass. Not a substantive issue.

Systemic patterns

1. Cohort-backfill template repetition (the dominant pattern this batch). All 23 Apr-19 Commoncog entries share start_here_category-keyed Why and Mapping sections — the text is RDCO-specific (passes the rubric) but identical across siblings. A future reader sees the same paragraph 7+ times across the Tacit-Knowledge category. The /tmp/cc_process_article.py + /tmp/cc_claims.py pipeline that produced the cohort lives outside ~/.claude/skills/ and was not subject to per-article specificity discipline.

Action: Filed Notion task "/improve: cohort backfill skill should individualize why-in-vault and mapping per article" (page id 347f7d49-36d1-81eb-b0ec-f9e067db0320) so the Monday /improve cron picks it up. Two concrete fixes proposed: (1) require per-article why/mapping that keys off the article's specific argument; (2) default the Related section to >=2 same-cohort cross-links (sibling articles in start_here_category) plus the Apr-15 anchor.

2. Single-cross-link failure mode. 7 of 23 (~30%) Commoncog entries had only 1 Related wikilink — all to the same Apr-15 anchor. Auto-fixed by adding 3 same-cohort cross-links each. Same root cause as #1: the template hard-coded one anchor link without including siblings. The Notion /improve task above addresses this.

3. Frontmatter discipline is excellent across the board. Every entry has date/type/source/author/tags. Newsletter-format entries have sponsored: false populated. members_only is consistently flagged on the Commoncog entries. Zero frontmatter remediation needed.

4. No copy-paste walls detected. Every summary is original prose. The Commoncog entries paraphrase rather than quote, and the deep-research briefs synthesize across multiple sources without lifting passages.

5. Conciseness is good. Largest non-research entry is 2026-04-12-harness-thesis-dissent.md at 86 lines. The three research briefs run 100-117 lines, justifiably dense for their scope. No bloat.

Process recommendations

1. Apply the /improve task above on the next Monday cron — should land before any future cohort backfills.
2. Hand-add 1-2 sibling cross-links to commoncog-ultimate-guide-reading-book-a-week.md next pass (the lone B-grade entry).
3. The deep-research-brief format is the current template-grade for the vault; consider pinning one as the canonical reference example in 02-sops/ for future briefs to imitate.

Review 3 — 2026-04-20

Reviewer: Ray (AI COO) Scope: 30 entries from 06-reference/ modified since 2026-04-13, excluding entries already scored in Review 2 and entries under transcripts/. Reviewed via /self-review --since 7d --limit 30 --fix. Max score: 13

Scored results

No ⚠️ audit-failed annotations: zero overlap between the scored 30 and the 21 audit-failed files from the most recent audit (the audit-failed set is entirely from 2026-04-13 → 2026-04-18; the scored 30 are all 2026-04-19 → 2026-04-20).

Grade distribution

Summary statistics

• Average score: 13.00 / 13 (vs 12.93 last review — up 0.07; first 30/30-perfect pass since the rubric was introduced)
• Median score: 13
• Entries needing attention (C or below): None
• Auto-fixes applied to scored 30: 0 (no entry needed mechanical remediation)
• Audit-cohort fixes applied separately: 9 mechanical fixes across 7 audit-failed files (see "Cross-cycle audit remediation" below)

Top entries (template-grade)

This entire batch is template-grade. The standout cluster: the 2026-04-20 IndyDevDan + 3Blue1Brown + Practical Engineering cohort (entries #1–12) all share the same structural pattern — explicit Why-in-vault with multi-paragraph rationale, 6-9 numbered Core argument items, 6-8 Mapping bullets each tied to a named RDCO surface, 5-7 Open follow-ups with time estimates, explicit Sponsorship section with bias-flagging discipline, and 5-7 wikilinks in Related. These are the new house style — propose pinning one (e.g. 2026-04-20-indydevdan-agent-experts-self-improving.md or 2026-04-20-practical-engineering-hidden-engineering-runways.md) as the canonical example in 02-sops/newsletter-output-invariants.md.

The Tim Ferriss cluster (entries #14–28) is also exemplary across 15 entries despite high topical variance (kitchen hack, Navy SEAL, neuroscientist, vulnerability researcher, polymath performer). All hold the same shape; the synthesis-per-entry varies as the source warrants.

Worst entries (post-fix)

None. This is the first 30/30-perfect pass.

Double-signal entries (audit-failed AND self-review-flagged)

None. Zero overlap this cycle.

Cross-cycle audit remediation

Although the audit-failed cohort (21 files, 32 violations) does not overlap with the scored 30, this pass applied conservative mechanical fixes to that cohort per the --fix rules in SKILL.md:

I3 — missing newsletter_format / sponsored (2 fixes):

• 2026-04-14-moonshots-ep247-musk-altman-lawsuit-852b-valuation.md: added newsletter_format: founder-interview + sponsored: false
• 2026-04-18-moonshots-ep248-altman-attack-amazon-starlink-opus-47.md: same

I12 — missing Curation section header on curation-format files (3 renames):

• 2026-04-13-data-engineering-weekly-265.md: ## Curated Topics → ## Curation section — notes
• 2026-04-13-alphasignal-ultraplan-karpathy-claude.md: ## Issue contents → ## Curation section — notes
• 2026-04-15-alphasignal-anthropic-routines-claude-code.md: ## Issue contents — key items → ## Curation section — notes

I11 — missing Sponsorship header when sponsored=true (4 additions/renames):

• 2026-04-13-data-engineering-weekly-265.md: added ## ⚠️ Sponsorship above existing inline sponsor paragraph
• 2026-04-13-data-engineering-central-lambda-kappa.md: ## Bias and sponsorship notes → ## ⚠️ Sponsorship
• 2026-04-13-every-folder-is-the-agent.md: ## Classification and bias notes → ## ⚠️ Sponsorship
• 2026-04-13-joe-reis-ai-hard-parts.md: ## Bias notes → ## ⚠️ Sponsorship

Left alone (per --fix conservative rules): I8 (Mapping content), I9 (Why-in-vault content), I10 (filename-sender mismatch — would break wikilinks). 11 of the 21 audit-failed files have only these non-mechanical violations and need manual remediation, not auto-fixes. List for the next manual pass:

• 2026-04-13-cole-100k-paid-newsletter-playbook.md (I10)
• 2026-04-13-data-engineering-weekly-265.md (I8/I9 still — only I11/I12 auto-fixed)
• 2026-04-13-jaya-gupta-ai-lock-in-state-moat.md (I10)
• 2026-04-13-joe-reis-ai-hard-parts.md (I8/I9 still — only I11 auto-fixed)
• 2026-04-13-langchain-evals-deep-agents.md (I8)
• 2026-04-13-moura-entangled-software-agent-harnesses-dead.md (I10)
• 2026-04-13-stratechery-mythos-muse-compute.md (I8/I9)
• 2026-04-14-alphasignal-cursor-parallel-agents-vercel-open-agents.md (I8)
• 2026-04-14-joe-reis-state-of-data-modeling-april-2026.md (I10/I12 — no clearly labeled link list to rename)
• 2026-04-14-rohit-5-pipelines-claude-code-business.md (I10)
• 2026-04-14-semistructured-half-life-of-a-moat-part-1.md (I10)
• 2026-04-14-stratechery-openai-memos-anthropic.md (I12 — thought-leadership format, hybrid label may be misclassified; needs format review)
• 2026-04-15-thariq-claude-code-session-management-1m-context.md (I10)
• 2026-04-16-every-youre-the-manager-now.md (I12 — already has ## Sponsorship but no curation block in body)
• 2026-04-16-stratechery-nico-rosberg-interview.md (I8)

Of these 15 still-failing files, 8 are I10 (filename mismatch) which is a Path-A choice not auto-fixable, and 7 require human-judgment Mapping/Why content (I8/I9) or format-classification review (I12 on hybrid/thought-leadership entries).

Systemic patterns

1. The hand-crafted assessment template has fully converged on the audit-invariant spec. Every one of the 30 scored entries follows the same six-section template (Why this is in the vault → Core argument → Sponsorship if applicable → Mapping against Ray Data Co → Open follow-ups → Related). The IndyDevDan/3B1B/Practical-Engineering 2026-04-20 cohort and the Tim Ferriss 2026-04-19 cohort are clearly the result of the same author/process — likely the /process-youtube skill output, possibly hand-curated by the founder. Whichever it is, the template discipline is now load-bearing and consistent enough to trust.

2. The audit-failure cohort lives in a different production lane. All 21 audit-failed files are from 2026-04-13 → 2026-04-18, predating the cohort the scored 30 came from. The audit-failed set is dominated by I10 (filename-sender mismatch, 6 occurrences) and I8 (missing Mapping section, 6 occurrences). These are characteristic of an earlier, less-disciplined /process-newsletter pass that did not consistently produce the Mapping section or align filename to canonical sender slug. The convergence in the 2026-04-19 / 2026-04-20 cohort suggests the underlying skill (or operator) corrected after the 2026-04-19 audit ran — possibly in response to the audit feedback itself. Worth confirming with the founder whether /process-newsletter was updated between Apr 16 and Apr 19.

3. Filename-sender mismatch (I10) is the largest remaining audit gap. 6 files have I10. Per the SKILL.md guidance ("renaming files breaks wikilinks; this is a Path-A choice, not auto-fixable"), this requires a deliberate one-time pass that renames the file, updates the audit log, and rewrites every wikilink that points to the old name. Worth doing in a single batch with a script rather than manually. Estimated: 1 hour for the 6 files in the audit log, plus any others discovered in vault.

4. The hybrid/thought-leadership format ambiguity around I12 is real. Several files (Stratechery memos, Every "You're the Manager Now") are flagged as newsletter_format: hybrid but their bodies look more like single-essay thought-leadership with no curated link list. The audit's I12 invariant ("curation-format files require Curation section") fires false-positive on these. Recommend either: (a) tightening the audit to skip I12 for non-curation formats, or (b) reclassifying these entries to thought-leadership instead of hybrid. The latter is closer to ground truth — these are not curation pieces.

5. Nothing concerning on bias / walls / conciseness across the scored 30. Every sponsored entry has an explicit ## Sponsorship section flagging the bias-to-watch. Zero copy-paste walls detected (every Core argument is paraphrased into the assessment voice). Most entries are 60-75 lines including frontmatter and Related — the longest (the 2026-04-20-tim-ferriss-jamie-foxx interview) runs 70 lines and the density is justified by the source's range.

Process recommendations

1. Do the I10 batch-rename pass as a single dedicated cycle. 6 files in the current audit log + likely more in the broader vault. Build a small script that: (a) reads filename, (b) reads frontmatter source/author, (c) computes canonical slug, (d) renames file, (e) greps for wikilinks to old name and rewrites. Sub-1-hour total.
2. Tighten the I12 audit invariant to skip newsletter_format: hybrid and newsletter_format: thought-leadership entries — they don't structurally need a Curation section. Alternatively, reclassify the 4-5 hybrid entries that are really single-essay pieces.
3. Pin one of the 2026-04-20 IndyDevDan or Practical Engineering entries as the canonical reference example in 02-sops/newsletter-output-invariants.md. The template has converged; capture it as the explicit reference so future ingestion skills (or operators) inherit it by default.
4. Investigate whether /process-newsletter or /process-youtube was updated between Apr 16 and Apr 19. The visible quality jump in the 2026-04-19 / 2026-04-20 cohort vs. the 2026-04-13 / 2026-04-14 cohort suggests an in-flight skill improvement. If so, capture what changed in the SKILL.md history so the lift is reproducible.
5. No new /improve task this cycle — the cohort backfill task from Review 2 (Notion page id 347f7d49-36d1-81eb-b0ec-f9e067db0320) is still the active improvement target.

improve_processed: 2026-04-20

/improve autonomous run — 2026-04-20

• Reviews processed: 1 (Review 3)
• Low-risk fixes applied: 5 across 2 skills
  • process-newsletter/SKILL.md: Gmail tool-name drift fix (gmail_search_messages → search_threads, gmail_read_message → get_thread); Mode 4 subagent-depth fallback rule documented
  • process-youtube/SKILL.md: Mode 1 30KB transcript heuristic; Mode 2 paired-batch cross-reference flag; Mode 4 Step 4c tier-1 promo-clip >240s stopgap
• Structural changes queued: 1 new Notion task — /improve proposal: build /pre-launch-validator skill from WriteWithAI 5-step framework (Owner: Both, Priority: Medium, Project: Ops). Pre-existing structural items left as-is: cohort-backfill (347f7d49-36d1-81eb-b0ec-f9e067db0320), promo-clip phrase-overlap dedup (348f7d49-36d1-81ac-b9d8-fad3ae60ce72 — closed because the stopgap shipped, but the phrase-overlap follow-up still needs founder direction; flagged in the closing notes).
• Notion tasks closed: 2 (348f7d49-36d1-81ac-b9d8-fad3ae60ce72 promo-clip stopgap; 348f7d49-36d1-810e-aca7-fd56a4832822 newsletter SKILL.md drift + depth limit + Pre-Launch spinoff)
• No-ops: 0

Review 4 — 2026-04-23

Reviewer: Ray (AI COO) Scope: 30 most-recently-modified entries in 06-reference/ since 2026-04-16, transcripts excluded Args: --since 7d --limit 30 --fix

• Entries reviewed: 30

• Average score: 12.4/13 (trend: up from Review 3's average; the 2026-04-20-onward cohort is now overwhelmingly A-grade)

• Grade distribution: A:25 B:2 C:1 D:2

• Audit-failed (from ~/.claude/state/newsletter-audit-log.md): 9 entries with violations carrying since 2026-04-16

• Double-signal entries (audit + self-review both flagged): 0 — the audit-flagged entries are mostly structural-only (missing optional Curation block on hybrid format, missing newsletter_format field on otherwise-strong X-article entries) and score B or A on the semantic axes

• Fixed: 6 entries

  • 2026-04-21-wai-starship-flight-12-ready.md — added missing type/source/author/content_type/newsletter_format/sponsored/sponsor_entity, added ## Why this is in the vault (lifts D → A)
  • 2026-04-22-ayman-architect-mode-3as.md — added newsletter_format, sponsor_entity (clears I3, lifts B → A)
  • 2026-04-22-garry-tan-skillify-it-workflow.md — added newsletter_format, sponsored, sponsor_entity (clears I3, lifts B → A)
  • 2026-04-22-stratechery-john-ternus-spacexai-cursor.md — added ## Curation section (clears I12)
  • 2026-04-21-every-mini-vibe-check-claude-design.md — added ## Curation section (clears I12)
  • 2026-04-21-alphasignal-claude-live-artifacts-amazon-5b.md — added ## Curation section (clears I12)

• Flagged for archive review (NOT auto-fixed per skill spec — thin-content rule):

  • 2026-04-21-tim-ferriss-90-days-black-belt.md — Tier-1 promo clip (5 min) clipped from a parent episode; entry's author flags it as low-value and points at the Notion task to dedup. Recommend archive or wait for parent episode.
  • 2026-03-22-3blue1brown-logarithm-of-an-image.md — duplicate of 2026-04-20-3blue1brown-how-and-why-to-take-a-logarithm-of-an-image.md; one of the two should be removed (canonical-by-upload-date vs. canonical-by-watch-date is unresolved).

• Systemic issues:

  1. I3 (missing required fields) recurs on X-article ingestions. Three entries on Apr 22 (Ayman, Garry Tan skillify, both manually filed via X) lacked newsletter_format / sponsored / sponsor_entity. Pattern: when content is filed from X / long-form tweets rather than via /process-newsletter, the X-ingestion path doesn't enforce the newsletter-format frontmatter contract. Worth tightening.
  2. I12 (missing Curation section on hybrid format) is structural, not semantic. Three Apr 21-22 hybrid entries (Stratechery John Ternus, Every Mini-Vibe-Check, AlphaSignal Claude Live) are excellent in mapping/why-section/links but failed I12 because the audit treats the section as required for hybrid and curation formats even when the entry has no external curation to track. Either (a) the entries should reclassify as thought-leadership when there's no curation block, or (b) the audit should soften I12 for hybrid when an ## Issue contents or equivalent section exists.
  3. Audit log carries stale failures past the fix. 2026-04-20-indydevdan-m5-max-mlx-local-stack.md is flagged I9 in the audit log but the file currently has ## Why this is in the vault. Audit log isn't being pruned after fixes, so the pre-failure set has false positives.

• Improve tasks proposed:

  1. /improve task (X-article ingestion): when filing X long-form articles directly, enforce the newsletter-format frontmatter contract (newsletter_format, sponsored, sponsor_entity). Either bake into a /process-x-article skill or add the requirement to the freehand-vault-write checklist. Recurring I3 audit failures on hand-filed X content suggests the issue won't fix itself.
  2. /improve task (audit invariant softening): revisit I12 — for newsletter_format: hybrid, accept either ## Curation section OR ## Issue contents (or any section that enumerates third-party items) as satisfying the invariant. Reclassify single-essay hybrid entries as thought-leadership.
  3. /improve task (audit log hygiene): add a step to audit-newsletter-outputs.py (or a companion script) that re-checks files in the prior-failure set on each run and emits a "REPAIRED" line so the historical log doesn't keep flagging fixed files. Or maintain a separate "currently-failing" snapshot file alongside the longitudinal log.

• Pre-existing structural items (carrying):

  • Cohort backfill 347f7d49-36d1-81eb-b0ec-f9e067db0320 (still active)
  • I10 batch-rename pass (Review 3 recommendation, not yet executed)

• Author advisor note: the dominant pattern is now-stable. ~83% of the cohort scored A; the failure modes are concentrated in (a) X-article ingestion that bypasses /process-newsletter, and (b) hybrid-format audit invariants that are too strict for the actual content shape. Both are fixable in one pass each.

improve_processed: 2026-04-24

/improve autonomous run — 2026-04-24

• Reviews processed: 1 (Review 4 — 2026-04-23)
• Low-risk fixes applied: 1 across 1 script + 1 skill changelog
  • ~/.claude/scripts/audit-newsletter-outputs.py: I12 invariant relaxed to accept either ## Curation section OR ## Issue contents (clears the false-positives on hybrid Apr 21-22 entries that have an Issue-contents block but not the literal Curation-section header). Changelog entry added to ~/.claude/skills/process-newsletter/SKILL.md.
• Structural changes queued: 2 new Notion tasks
  • /improve proposal: enforce newsletter-format frontmatter contract on X-article ingestions — https://www.notion.so/34cf7d4936d181409cd2e35ebabfac30 (Owner: Both, Priority: Medium, Project: Ops). Addresses Review 4 systemic #1 + improve-task #1.
  • /improve proposal: prune fixed entries from newsletter audit log so historical failures don't keep flagging repaired files — https://www.notion.so/34cf7d4936d181ce8a01d6916f550dc8 (Owner: Both, Priority: Medium, Project: Ops). Addresses Review 4 systemic #3 + improve-task #3.
• No-ops: 0
• Audit signals (rdco-doctor / eval-mine, last 14d):
  • rdco-doctor: 0 C5/C6 violations; 16 C7 dark skills (audit-model, aws-audit, build-landing-page, build-project, cloudflare, compile-vault, cross-check, discover-sources, draft-review, generate-tests, graph-query, postgrid, remix, research-brief, skillify, voice-match). All have legitimate on-demand triggers documented in their descriptions; no kill recommendation this cycle.
  • eval-mine: 1 frustration hit, no skill_blame target (free-form context).

Review 5 — 2026-04-24

Reviewer: Ray (AI COO) Scope: 30 entries from 06-reference/ modified in last 7d (window 2026-04-17 → 2026-04-24), --fix mode, audit-aware Max score: 13

Headline numbers

• Entries reviewed: 30
• Average score: 12.77 / 13 (post-fix)
• Median score: 13 / 13
• Trend vs Review 4 (2026-04-23): essentially flat; Review 4 reported ~83% A, this cohort ~93% A. Modest improvement, within noise.
• Fixes applied: 6 edits across 5 files (5 missing why-in-vault inserts, 2 missing sponsorship sections — practical-engineering-teton-dam-failure got just sponsorship; garry-tan-skillify-it-workflow got sponsorship; moonshots-elon-cursor, tim-ferriss-cathy-lanier-nfl-cso, 3blue1brown-logarithm-of-an-image got why-in-vault).
• Audit-failed entries from window: 0 (audit log only extends through Cycle 6 / 2026-04-19; none of the in-window files have been audited yet).
• Double-signal entries: 0
• Audit-aware bumps applied: 0 (no overlap between audit pre-failure set and this review's window)

Grade distribution

Entries needing attention

1. 2026-04-21-tim-ferriss-90-days-black-belt.md — Score 8/13 (Grade C)

   • Missing: why-in-vault (0/3), cross-links (0/2; only one bare-path reference and a non-existent file pointer)
   • Mapping section explicitly self-flags as "weak" and notes the entry passed the Tier-1 promo-clip duration stopgap by 68 seconds (308s vs 240s threshold)
   • Manual review action: this is a genuine candidate for archival or merge into the parent Michelle Khare interview entry once that's filed. Don't spend cycles upgrading; either archive or delete.
   • Also surfaces a real skill-prompt drift note already captured in the entry: tighten the promo-clip duration threshold to 360s/480s OR accelerate the phrase-overlap dedup work tracked at Notion 348f7d49-36d1-81ac-b9d8-fad3ae60ce72.

2. concepts/design-vocabulary-glossary.md — Score 11/13 (Grade B)

   • This is a glossary-shaped concept doc, not a newsletter ingestion. The Mapping/Why-in-vault criteria don't fit the format cleanly; the doc explains its own purpose in lines 14-17 (replace gestural design talk with category labels).
   • No fix applied. Counted as B because the criteria are designed for newsletter/article entries; flagging as a known mismatch rather than a real quality gap.

Top entries (template-grade)

1. concepts/2026-04-23-unhobbling.md — 13/13. Cross-cluster anchor; dense cross-links; explicit RDCO implications priority list; clean why-this-note-exists framing.
2. 2026-04-23-moonshots-elon-cursor-bet-claude-kills-saas-openai-departures.md (post-fix) — 13/13. Strong RDCO mapping with 9 distinct angles, sponsor disclosure, and 14+ wikilinks.
3. concepts/2026-04-23-generative-engine-optimization-geo.md — 13/13. Companion canonical-term doc; same-shape RDCO-implications structure as unhobbling.

Systemic patterns

• No new drift this cycle. The X-article-ingestion drift from Review 4 (manually filed long-form X content missing newsletter_format / sponsored) did NOT recur in this cohort — 2026-04-22-garry-tan-skillify and 2026-04-22-ayman-architect-mode-3as both have clean frontmatter, suggesting the Review 4 /improve Notion task (34cf7d4936d181409cd2e35ebabfac30) is being respected manually even before the skill change ships.
• The I12 hybrid-format relaxation from the 2026-04-24 /improve autonomous run is doing its job. Apr 21-22 hybrid entries (stratechery-john-ternus, every-mini-vibe-check-claude-design, every-bread-in-ai-sandwich) all scored 13/13 here without ceremony — the audit invariant change cleared the false-positives Review 4 flagged.
• Zero new audit failures expected on this cohort once audit catches up. All 30 files have the required structural sections (frontmatter, why-in-vault post-fix, mapping, related). No I3, I8, I9, I11 risk visible. One systemic-adjacent observation: 5 files needed why-in-vault added — that's ~17% of the cohort missing it pre-fix, still the dominant single failure mode (same as Reviews 1, 2, 3, 4).

Process / improve recommendations

• No new /improve task warranted. The recurring "missing why-in-vault" pattern is real but already addressed by Reviews 1-3 process recommendations and the audit's I9 invariant. The existing fix-during-self-review loop is closing the gap; the structural fix would be enforcing why-in-vault at write-time in every authoring skill (process-newsletter, process-youtube, process-inbox, build-project), which is a larger systemic change worth bundling rather than filing as another one-off.
• Consider archival workflow for the Tim Ferriss promo clip. The entry self-diagnoses the issue and points at the existing Notion task. No new ticket needed; just resolve when ready.

Pre-existing structural items (carrying)

• Cohort backfill 347f7d49-36d1-81eb-b0ec-f9e067db0320 (still active per Review 4)
• I10 batch-rename pass (Review 3 recommendation, still not executed)
• Promo-clip duration threshold tightening (348f7d49-36d1-81ac-b9d8-fad3ae60ce72)

Author advisor note

This is the cleanest cohort to date. The vault's quality bar is now stable at A-grade with structural fixes confined to "did the why-in-vault section get written." No new drift detected. The two prior /improve tasks from Review 4 (X-article frontmatter contract, audit-log pruning) remain valid but should ship before another self-review cycle so we can measure their effect cleanly.

improve_processed: 2026-04-27

Review 6 — 2026-04-26

Reviewer: Ray (AI COO) Scope: 30 entries from 06-reference/ modified in last 7d (window 2026-04-19 → 2026-04-26), --fix mode, audit-aware Max score: 13

Headline numbers

• Entries reviewed: 30
• Average score: 12.40 / 13 (post-fix; pre-fix was 12.20)
• Median score: 13 / 13
• Trend vs Review 5 (2026-04-24): slight regression (12.40 vs 12.77). Two D-grade entries this cycle vs one C-grade last cycle. Drivers: a new internal-review entry filed without the standard reference-doc structure (squarely-current-state-review) and a YouTube/podcast entry missing its why-in-vault block (wai-starship-never-returned). Both fixable; both fixed.
• Fixes applied: 3 edits across 2 files
  • 2026-04-24-wai-starship-never-returned-spacex-history.md — added why-in-vault section
  • 2026-04-25-squarely-current-state-review.md — added why-in-vault, full mapping section (5 specific RDCO connections), and 4 wikilinks to squarely-puzzles project hub + sister Sanity Check pieces
• Manual review needed: 1 entry (2026-04-21-tim-ferriss-90-days-black-belt.md) — same archive-or-merge candidate flagged in Review 5; entry is a 5-min Tier-1 promo clip from a parent episode, self-flagged as low-value. NOT auto-fixed per skill rule (thin content). Recommend archive when parent Michelle Khare interview is filed, or hold for the promo-clip-duration-threshold tightening (Notion task 348f7d49-36d1-81ac-b9d8-fad3ae60ce72).
• Audit-failed entries from window: 12
• Double-signal entries: 2 (audit-failed AND scored ≤9 / had structural attention items)
  • 2026-04-25-squarely-current-state-review.md — audit flagged I3, I8, I9, I10; self-review pre-fix scored 4/12 (D). Post-fix: 12/12 (A). The double-signal correctly identified the original ingestion was malformed for an internal-review doc — the file used type: reference but skipped the reference-doc structure entirely. Now repaired.
  • 2026-04-24-wai-starship-never-returned-spacex-history.md — audit flagged I3, I9; self-review pre-fix scored 10/13 (B), missing why-in-vault. Post-fix: 13/13 (A).
• Audit-aware bumps applied: 12 (every audit-failed file in the window was checked against this self-review; only the 2 above were actual semantic failures, the other 10 are audit false-positives from known systemic issues — see Systemic patterns below)

Grade distribution (post-fix)

Entries needing attention

1. 2026-04-25-squarely-current-state-review.md — Pre-fix Score 4/12 (Grade D) ⚠️ audit-failed

   • Pre-fix issues: missing why-in-vault (0/3), missing mapping section (0/3), zero wikilinks (0/2)
   • Audit invariants failed: I3 (newsletter-format/sponsored fields — N/A for internal-review but audit doesn't know that), I8 (missing Mapping section), I9 (missing Why section), I10 (filename sender slug doesn't match internal-review source)
   • Fixed: added why-in-vault block, added Mapping section with 5 specific RDCO connections (design-system inheritance, MAC trademark-first sequencing, author-identity narrative, domain-mismatch as Teton-class drift, A+ Content patterns reuse), added 4 wikilinks to Squarely project hub + sister SC pieces.
   • Post-fix: 12/12 (A). The I3/I10 audit fails persist because the audit doesn't yet know type: reference + source: internal-review is a legitimate non-newsletter shape — flag for /improve to consider an audit-side carve-out for source: internal-review (similar to what's likely needed for source: synthesis).

2. 2026-04-24-wai-starship-never-returned-spacex-history.md — Pre-fix Score 10/13 (Grade B) ⚠️ audit-failed

   • Pre-fix issue: missing why-in-vault (0/3); had Episode summary but no explicit "Why this is in the vault" header
   • Audit invariants failed: I3 (newsletter-format missing — YouTube content; audit invariant should soften for content_type:podcast), I9 (no Why section)
   • Fixed: added why-in-vault section anchored to the iteration-cadence-as-moat candidate concept and the design-as-feedstock pattern, cross-linked to the Apr 21 Flight 12 sister episode.
   • Post-fix: 13/13 (A).

3. 2026-04-21-tim-ferriss-90-days-black-belt.md — Score 7/13 (Grade D) — NOT auto-fixed (archive candidate)

   • Same entry flagged in Review 5. Tier-1 promo clip (5 min) from a longer parent interview; self-flags as low-value in its own Mapping section. No audit failures (frontmatter is technically clean for a YouTube-clip entry).
   • Action: hold for archive when parent Michelle Khare episode is filed, OR resolve via the promo-clip-duration-threshold tightening Notion task 348f7d49-36d1-81ac-b9d8-fad3ae60ce72.

Top entries (template-grade)

1. 2026-04-21-practical-engineering-teton-dam-failure.md — 13/13. The template for failure-case-study entries: 4 dense Mapping sub-sections explicitly cross-linked to existing concept docs (binary-decision-around-continuous-probability, operational-definitions, layered-defense-architecture); sponsor block disclosed; 8 wikilinks; the pattern every other dam-failure or process-control entry should be measured against.
2. 2026-04-23-moonshots-elon-cursor-bet-claude-kills-saas-openai-departures.md — 13/13. Long-form podcast entry with 10 RDCO mapping bullets, 16 cross-links, sponsor block disclosed.
3. 2026-04-22-garry-tan-skillify-it-workflow.md — 13/13. X-article entry with full table comparison of RDCO state vs. Tan state across the 10-step skillify checklist; converts external content into a concrete RDCO upgrade roadmap.

Systemic patterns

• The audit log carries 10 false-positive failures in the cohort that the self-review confirms are not actual semantic failures. This is the dominant pattern this cycle:

  • Stratechery / Every / AlphaSignal hybrid-format I12 fails (3 entries: stratechery-john-ternus, every-mini-vibe-check, alphasignal-claude-live-artifacts). Same pattern Review 4 caught and the 2026-04-24 /improve autonomous run patched (I12 now accepts ## Issue contents OR ## Curation section). All three entries have one or the other; audit-log entries pre-date the patch. Confirms the /improve Notion task on audit-log pruning (34cf7d49-36d1-81ce8a01d6916f550dc8) is needed — without it, every weekly review re-surfaces stale failures.
  • X-article I3 fails (3 entries: ayman-architect-mode-3as, garry-tan-skillify-it-workflow, jaya-gupta, neil-xbt-claude-laptop-5k-month). All four have either complete frontmatter (garry-tan-skillify and ayman have newsletter_format) or are X articles where content_type: x-article is the natural shape and newsletter_format shouldn't apply. The Review 4 /improve Notion task on X-article ingestion frontmatter contract (34cf7d49-36d181409cd2e35ebabfac30) needs to ship to either (a) require the field on X articles or (b) carve them out of the audit. Currently authors are inconsistent — some include the field, some don't, and the audit treats the inconsistency as drift.
  • Filename slug mismatch I10 fails (2 entries: notboring-great-blue-frontier, notboring-wdo-190-curation). Both source values are "Not Boring" with capital N + space; filename slug is notboring. Real false positive — slug normalization (lowercase + remove spaces) would clear it. Worth filing as a small audit hygiene fix.

• Two new genuine semantic failures emerged this cycle (both fixed). Both involved missing Why-in-vault sections — same dominant single-failure-mode flagged across Reviews 1-5. The fix-during-self-review loop continues to catch them; the durable structural fix is enforcing why-in-vault at write-time in every authoring skill.

• A new failure surface: internal-review docs filed as type: reference without the reference-doc structure. squarely-current-state-review is the first entry of this shape in the cohort and it scored D pre-fix. The author (Ray) wrote it as an internal-state-snapshot doc but filed it under 06-reference/ because the founder's instruction was "review the four surfaces" — there's no 08-tooling/-equivalent home for a Squarely-state-snapshot. Worth deciding whether internal-review docs go in 06-reference/ (then they need to inherit the reference-doc shape, which means why-in-vault + mapping) or get their own home (e.g., 01-projects/squarely-puzzles/state-reviews/). This is a small foldering decision worth making explicit before the next state-snapshot lands.

Process / improve recommendations

• No new /improve task warranted that isn't already filed. The two open Review 4 /improve tasks (X-article frontmatter contract, audit-log pruning) would clear most of the false-positive noise this cycle. Worth chasing those before Review 7.
• Consider a tiny internal-review carve-out in the audit script: when source: internal-review (or source: synthesis), skip I3 / I10 entirely and treat I8 / I9 as REQUIRED but allow them to be the only structural requirements. Would close the squarely-current-state-review false-positive surface for this category of authoring.
• Foldering decision pending: internal-state-snapshot docs (Squarely surface review, future MAC-state-review, future SC-state-review) — file under 06-reference/ (current behavior, requires reference-doc shape) OR 01-projects/<bet>/state-reviews/ (cleaner home, free of audit pressure). Ben's call.

Pre-existing structural items (carrying)

• Cohort backfill 347f7d49-36d1-81eb-b0ec-f9e067db0320 (still active per Reviews 4-5)
• I10 batch-rename pass (Review 3 recommendation, still not executed)
• Promo-clip duration threshold tightening (348f7d49-36d1-81ac-b9d8-fad3ae60ce72)
• X-article frontmatter contract /improve task (34cf7d49-36d181409cd2e35ebabfac30)
• Audit-log pruning /improve task (34cf7d4936d181ce8a01d6916f550dc8)

Author advisor note

Vault quality bar is holding at A-grade. The structural fixes are now consistent enough that the dominant noise-source is the audit log surfacing already-fixed structural drift (the audit-log-pruning /improve task closes this) and the audit not knowing about non-newsletter ingestion shapes (X articles, internal-review docs, synthesis docs). Both are knowable invariant-side fixes. The single new pattern worth the founder's attention is the internal-review/state-snapshot folder decision — pick a home before the next one lands and the mapping-section discipline either becomes mandatory by structure or unnecessary by category.

improve_processed: 2026-04-27

/improve autonomous run — 2026-04-27

• Reviews processed: 2 (Review 5 2026-04-24, Review 6 2026-04-26)
• Low-risk fixes applied: 2 edits to ~/.claude/scripts/audit-newsletter-outputs.py
  • Internal-review / synthesis carve-out: skip I3 + I10 when source: internal-review or source: synthesis (closes squarely-current-state-review false-positive surface)
  • Slug normalization for I10: hyphen-collapsed source comparison so filename notboring matches source Not Boring (closes Not Boring false-positive surface)
  • Verified by re-running audit on 2026-04-19 → 2026-04-27 window: both false-positive classes cleared. Remaining failures are real signals (X-article + podcast/YouTube content lacking newsletter-shape fields), covered by separate carrying tasks.
• Notion tasks closed: 1 (34df7d49-36d1-8145-955d-e3a588065d33 /improve proposal: audit-newsletter-outputs.py over-flags non-newsletter docs — fix shipped, marked Done)
• Structural changes queued: 2
  • 34ff7d4936d181cc891ff4323fdaff45 — Enforce why-in-vault at write-time in all authoring skills (Both, Medium, Ops). Addresses the dominant single-failure mode across all 6 reviews. Affects 4+ skill files.
  • 34ff7d4936d181d286ffc417e0daadb7 — Foldering decision: where do internal-state-snapshot docs live? (Founder, Low, Ops). 06-reference/ vs 01-projects//state-reviews/ — founder's call.
• No-ops (already-filed or already-fixed patterns): 4 carrying items (X-article frontmatter contract, audit-log pruning, promo-clip duration tightening, cohort backfill — all on the board, no re-queue)

Review 7 — 2026-05-03

Reviewer: Ray (AI COO) Scope: 30 entries created/modified 2026-04-26 → 2026-05-03 (excluding 06-reference/transcripts/) Window flag: --since 7d --limit 30 --fix Audit pre-failure set (in window, intersecting reviewed cohort): 16 files (per ~/.claude/state/newsletter-audit-log.md, 19 audit runs in window)

Top-line numbers (post-fix)

• Entries reviewed: 30
• Average score: 12.1/13 (post-fix; was 11.2/13 pre-fix). Trend: 11.2 → 12.1 (+0.9 from this cycle's fixes). Holding A-grade-dominated.
• Grade distribution (post-fix):
  • A (12-13): 28 (93%)
  • B (10-11): 0 (0%)
  • C (8-9): 0 (0%)
  • D (<8): 2 (7%) — both are non-content artifact types (04-finance/2026-04-pulse.md, 04-finance/index.md) that the criteria don't really apply to; recommend scope exclusion
• Fixed: 8 entries
• Audit-failed in window cohort: 16
• Double-signal entries (audit + self-review both flagged): 5

Files actually fixed this cycle

Double-signal entries (audit + self-review both flagged) this cycle

Top entries (template-grade, 13/13)

1. 2026-04-30-mitohealth-founder-5-layer-agent-native-company-loop.md — concept doc; 13/13. Strong load-bearing-data + sharp founder mapping.
2. 2026-04-30-meta-ads-cli-agent-native-launch.md — 13/13. Tight, focused, good cross-link density.
3. 2026-05-02-khairallah-ai-automation-playbook.md — 13/13. Concise (72 lines), explicit RDCO mapping.
4. 2026-04-25-squarely-current-state-review.md — 13/13. The internal-review carve-out (shipped after Review 6) is now paying off — this entry passes cleanly.
5. 2026-04-30-stratechery-amazon-earnings-trainium-commodity.md — 13/13. Newsletter-format-perfect.

Systemic patterns

• Why-in-vault drift returned (3 of 5 C-grade fixes were missing-why). The Review 6 /improve task to enforce why-in-vault at write-time (34ff7d4936d181cc891ff4323fdaff45) hasn't shipped yet — until it does, podcast/YouTube assessment notes from the long-form-interview shape (Dwarkesh, Moonshots, IndyDevDan) will keep skipping the section. Surfacing as DECISION in this report — should this be auto-fixed at /process-youtube write-time?
• Audit-side false positives are mostly cleared. The 2026-04-27 /improve carve-out for source: internal-review is working — squarely-current-state-review and mitohealth-founder both pass cleanly post-fix. Remaining audit failures cluster on (a) podcast-shape content lacking newsletter_format (real shape mismatch — should the audit ALSO carve out content_type: podcast | tutorial | interview?) and (b) I10 slug mismatches on backfill-discovery / bookshelf docs which use source: strings the audit can't normalize.
• Long blockquote segments triggering copy-paste flag (3 entries). Sinclair, IndyDevDan, Dwarkesh all have transcript-style timestamped segments that exceed the 350-word paragraph threshold. These ARE original synthesis blocks, not copy-paste — the heuristic is over-triggering. Worth tightening the heuristic OR accepting the false positive as cheap.
• Two finance-pulse artifacts scored D (2026-04-pulse.md, 04-finance/index.md). Neither is a content/reference entry — they're financial reports with their own templating. Self-review criteria don't apply meaningfully. Recommend excluding 04-finance/ from the self-review scope going forward, or building a separate criteria set for finance artifacts.

Process / improve recommendations

• Ship the Review 6 why-in-vault enforcement task — it would have caught all 3 podcast-shape fixes this cycle without manual intervention.
• Consider extending the Review 6 internal-review carve-out to cover content_type: podcast | tutorial | interview for the I3 newsletter-format check. Each of those is a content-type the audit currently treats as a newsletter-shape failure.
• Scope refinement: explicitly exclude 04-finance/ from the self-review file enumeration in the SKILL.md, since finance-pulse artifacts have their own structural conventions.

Author advisor note

Bar holds at A-grade (~83% A, 0% C in the content cohort). Two systemic items worth founder eye: (1) why-in-vault auto-enforcement at write-time would compress the manual fix queue substantially, and (2) the audit could grow a podcast/tutorial/interview carve-out with the same shape as the internal-review one shipped 2026-04-27. Neither is urgent — vault quality is high — but both are knowable, low-risk skill-side fixes.

Review 8 — 2026-05-04

Reviewer: Ray (AI COO) Scope: 14 entries newly created since Review 7 (2026-05-03 strategic-conversation outputs + 2026-05-04 DEW #268). Window 2026-04-27 → 2026-05-04, but de-duped against Review 7's already-fixed cohort. Window flag: --since 7d --limit 30 --fix Audit pre-failure set (in window, intersecting reviewed cohort): 6 files (per ~/.claude/state/newsletter-audit-log.md, run 2026-05-03T12:57:44 — 9 files audited, 6 failed)

Top-line numbers (post-fix)

• Entries reviewed: 14 (new docs since Review 7; carry-over A-grade fixes from Review 7 not re-scored)
• Average score: 12.6/13 post-fix (vs 12.1/13 in Review 7 — +0.5 trend up)
• Grade distribution (post-fix):
  • A (12-13): 13 (93%)
  • B (10-11): 0 (0%)
  • C (8-9): 1 (7%) — writewithai-claude-design-guidelines.md is a deliberate skip-stub (status: skipped)
  • D (<8): 0
• Fixed: 3 entries (icbd-holdings, tampa-target-shortlist, app-store-submission-canonical-sources)
• Audit-failed in window cohort: 6
• Double-signal entries (audit + self-review both flagged): 1 (writewithai)

Files actually fixed this cycle

Double-signal entries (audit + self-review both flagged) this cycle

Top entries (template-grade, 13/13)

1. 2026-05-03-shopify-eng-ucp-technical-architecture.md — clean technical-blog assessment with explicit Mapping subsections per RDCO surface; 7 wikilinks; concise (123 lines).
2. 2026-05-04-dataengineeringweekly-268-agents-replacing-search.md — newsletter-format-perfect with explicit Sponsorship section + curation breakdown; ties Doug-Turnbull retrieval finding to Tristan-Handy BI thesis as a generalization data point.
3. 2026-05-03-alphasignal-single-vs-multi-agent-systems.md — exemplar bias-flagging (separates Lambda paid placement from internal AlphaSignal workshop CTA).
4. 2026-05-03-sytaylor-ucp-merchant-owned-agentic-checkout.md — explicit ## ⚠️ Bias disclosure block calling out the Tempo-CEO forwarding channel; the founder explicitly flagged the bias and the doc records it.

Systemic patterns

1. Skip-stub class needs rubric carve-out (NEW). 2026-05-03-writewithai-claude-design-guidelines.md is a deliberate status: skipped stub — the founder filed the article-skip rationale itself rather than do a full assessment because the article is sales-funnel filler that adds nothing to RDCO design systems. The rubric currently scores it as C (no Mapping, no Links by design), and the audit flags it (I8/I9/I11). Both are false positives for skip-stub class. Recommend: add a status: skipped carve-out — when frontmatter has status: skipped, only score Why-in-vault (which becomes "Why this is skipped") and require nothing else. Mirrors the Review 6 internal-review and Review 7 podcast/tutorial carve-outs.
2. Project-doc conciseness false positive (CARRY-OVER + EXTENDS). Review 7 flagged 04-finance/ for scope-exclusion. Tampa shortlist (01-projects/acquisitions/) and Physical-AI opportunity-map (01-projects/physical-ai-thesis/) hit the same class — multi-page project shortlists/opportunity-maps where >300 lines is the correct shape, not bloat. Recommend: extend the scope refinement to cover 01-projects/<dir>/<dated-doc>.md shortlists/opportunity-maps OR raise the conciseness threshold to 400 for type: opportunity-research and type: acquisition-research. Tampa post-fix passes the rubric in every other dimension; the conciseness fail is the only blocker to A-grade and it's structural to the doc's purpose.
3. Why-in-vault enforcement (CARRY-OVER from Review 6 + 7). Did not regress this cycle — every new newsletter-shape entry has the heading. The Review 6 /improve task to enforce at write-time still hasn't shipped, but the manual discipline is holding for the small set of new entries. Continue tracking.
4. Bias/sponsor flagging is improving (POSITIVE TREND). Three entries this cycle (heyrico, sytaylor, alphasignal-single-vs-multi-agent) have explicit ## ⚠️ Bias disclosure or ## ⚠️ Sponsorship headings beyond the frontmatter sponsored: true flag, with bias source named (Tempo-CEO forwarding channel; Lambda paid placement vs internal AlphaSignal workshop). This is exactly the discipline the rubric wants and is now becoming default behavior.
5. Audit pre-failure set is shrinking on new content. 6 of 14 entries (43%) had any audit failure this cycle, down from 16 of 30 (53%) in Review 7 normalized to the 14-entry sample. I10 (filename-sender-mismatch) and I3 (missing newsletter_format on essay/X-article shape) remain the dominant patterns — both are structural issues with the audit's invariants, not the content. Same systemic recommendation as Review 7: extend audit carve-out to content_type: essay | company-research | reference-catalogue for the I3 newsletter-format check.

Process / improve recommendations

• Skip-stub carve-out (NEW): add status: skipped rubric exception to ~/.claude/skills/self-review/SKILL.md step 2 and to the audit script's I8/I9/I11 checks. Lowest-risk, highest-leverage fix this cycle.
• Project-doc conciseness (NEW): extend the Review 7 04-finance/ scope refinement to also cover 01-projects/*/<dated>.md shortlists/opportunity-maps, OR introduce a type:-keyed conciseness threshold (>400 lines for acquisition-research, opportunity-research).
• Re-surface Review 6 + 7 carry-over patterns (CARRY-OVER): the why-in-vault auto-enforcement task (347f7d49-36d1-81eb-b0ec-f9e067db0320-class) and audit content-type carve-out (podcast | tutorial | interview) are still on the list. Founder hasn't acted yet; not urgent because new-entry discipline is holding manually.

Author advisor note

Bar continues to hold at A-grade (93% A; only C-grade is a deliberate skip-stub). Trend line is +0.5 vs Review 7 — the manual discipline founder + Ray are running on new entries is sufficient even without the Review 6 /improve task shipping. The two NEW systemic items worth founder attention this cycle: (1) skip-stub rubric carve-out (cheap, ships in one /improve pass), and (2) extending the project-doc scope-exclusion to 01-projects/. Neither requires founder judgment beyond a yes/no — both are skill-side fixes Ray can ship if approved.

/improve autonomous run — 2026-05-04

Reviews processed: Review 7 (2026-05-03) + Review 8 (2026-05-04). Both marked improve_processed: 2026-05-04 via inline HTML comment under their headings.

Low-risk fixes applied (4):

1. Audit script — podcast/tutorial/interview carve-out (I3, I4). Edited ~/.claude/scripts/audit-newsletter-outputs.py to add is_youtube_long_form flag (matches content_type: podcast|tutorial|interview) and skip both required-field check (I3) and type-equals-reference check (I4) for that class. Mirrors the 2026-04-27 internal-review carve-out pattern. (Review 7 systemic pattern.)
2. Audit script — skip-stub bypass (I8, I9, I11). Same script: added is_skip_stub flag (matches status: skipped) and bypassed the Mapping-section, Why-in-vault, and Sponsorship-section checks for that class. (Review 8 systemic pattern #1.)
3. Audit script — Changelog block. Documented all three carve-outs (2026-04-19, 2026-04-23, 2026-04-27, 2026-05-04) in the module docstring so future changes have provenance.
4. Self-review SKILL.md — scope exclusions + skip-stub special pass class. Edited step 1 to exclude 04-finance/ (Review 7), exclude 01-projects/*/<dated>.md (Review 8), and treat status: skipped files as a special pass class (effective max 4/4: only Frontmatter + No copy-paste + Conciseness count). Added Changelog section documenting the change. (Review 7 + 8 systemic patterns combined.)

Files modified (3):

• ~/.claude/scripts/audit-newsletter-outputs.py — three carve-outs + changelog
• ~/.claude/skills/self-review/SKILL.md — scope exclusions + skip-stub class + changelog
• ~/rdco-vault/01-projects/self-review/review-log.md — improve_processed markers + this report block

Structural changes queued (0 new): the why-in-vault auto-enforcement at /process-youtube write-time (Review 7 + 8 carry-over) is already on the Notion board as task 34ff7d4936d181cc891ff4323fdaff45 from the 2026-04-27 /improve cycle (https://www.notion.so/34ff7d4936d181cc891ff4323fdaff45 — Status: To Do, Priority: Medium, Owner: Both, Project: Ops). No re-queue needed.

No-ops: none. All four candidate low-risk fixes shipped. Audit script syntax-validated via py_compile.

Pre-flight audit signals:

• rdco-doctor reports 39 dark skills (mostly on-demand, no action needed), 7 missing-script references (all in xcode-build-* skill family — out of scope for this run, separate ticket), 3 high-overlap pairs in swift-* family (descriptive overlap is real but each is a distinct triggering shape — no action).
• eval-mine reports 3 frustration hits in 14d window — 2 of 3 are about external products ("doesn't work" referring to a third-party flag and KDP email), 1 about /loop. Below action threshold (33% concentration on /loop is one hit in 14d).

Review 9 — 2026-05-08

Reviewer: Ray (AI COO) Scope: 30 most-recent entries in 06-reference/ mtime ≥ 2026-05-01 (full window 2026-05-01 → 2026-05-08, capped at --limit 30). Window flag: --since 7d --limit 30 --fix Audit pre-failure set (in 7d window): 47 distinct files across 12 audit runs since 2026-05-01T12:56:50; 22 of those 47 fall within the 30-file scored cohort.

Top-line numbers (post-fix)

• Entries reviewed: 30
• Average score: 11.9/13 post-fix (vs 12.6/13 in Review 8 — −0.7 trend down on a larger, less hand-curated cohort)
• Grade distribution (post-fix):
  • A (12-13): 22 (73%)
  • B (10-11): 8 (27%)
  • C (8-9): 0
  • D (<8): 0
• Pre-fix snapshot (before --fix pass): A:18, B:8, C:1, D:3 (avg 10.9/13)
• Fixed: 4 entries (all C/D)
• Audit-failed in window cohort: 22 of 30 (73%)
• Double-signal entries (audit + self-review both flagged) post-fix: 0 — all 4 C/D entries were also audit-failed (double-signal pre-fix); fixes resolved both signals on each.

Files actually fixed this cycle

Auto-fix tally

• Frontmatter additions: 3 files (10 individual fields added or renamed)
• Cross-link additions: 1 file (Related section added to writewithai-voc-landing-page; 5 wikilinks)
• Mapping rewrites: 1 file (writewithai — heading rename only, the body content was already RDCO-specific and concrete)
• Why-in-vault additions: 4 files (3 added new sections, 1 canonical heading rename on alphasignal-stanford)

Flagged for manual review (NOT auto-fixed)

• None this cycle. Of the 8 B-grade entries, none had blockers requiring rewrite — all were 12/13 with a copy-paste-wall heuristic flag (likely false positives — see Systemic Pattern #2) or a single missing frontmatter field on entries scoped outside the 7d audit window. Per skill rule, copy-paste walls and thin-content require manual review; none warranted action this cycle.

Top entries (template-grade, 13/13)

1. 2026-05-06-osmani-cognitive-surrender.md — clean source assessment, full frontmatter, concrete RDCO mapping, multiple wikilinks.
2. 2026-05-06-alphasignal-anthropic-finance-gpt45-grok43.md — newsletter-format-perfect with bias flagging, sponsorship section, curation breakdown.
3. 2026-05-06-ship30for30-3-mistakes-marketers-ai.md — sibling of the audit-failed 3-outcomes-marketers-want-ai from same sender same week; this one passes everything cleanly. Useful template reference for the watch-mode subagent prompt.
4. 2026-05-05-innermost-loop-singularity-and-regulators.md, 2026-05-05-naval-find-simplest-thing.md, 2026-05-05-naval-good-products-hard-to-vary.md, 2026-05-05-naval-judgment-decisive-skill.md, 2026-05-05-naval-specific-knowledge.md, 2026-05-05-jorgenson-almanack-of-naval-ravikant.md, 2026-05-05-every-codex-native-apps.md — multiple 13/13 entries from the same Naval-corpus batch indicate the L5-thesis-validation work pipeline is producing template-quality output.

Systemic patterns

1. Watch-mode subagent prompt drift on /process-newsletter (CONFIRMED CARRY-OVER, ESCALATING). The 2026-05-07 batch produced 4 of 7 files with multiple-invariant violations: writewithai-voc (I3+I4+I8+I9), ship30for30-grow-linkedin (I3+I4+I9+I11), ship30for30-3-outcomes (I8), alphasignal-stanford (I3+I9). The defect class is consistent: subagents are emitting format instead of newsletter_format, newsletter-reference / newsletter instead of type: reference, omitting author, omitting sponsored: true|false, and using non-canonical Why-section headings. This is the systemic pattern context-noted in this run's task input — confirmed across the full 7d window, not just one batch. Recommend an /improve pass to harden the watch-mode subagent prompt template: enforce canonical frontmatter field names + canonical body-section headings as a checklist the subagent must validate before writing. Today's pre-fix double-signal count was 4 (all 4 C/D entries were also audit-failed); we cleaned that to 0 with --fix, but the recurrence rate per batch is the underlying problem.
2. Copy-paste-wall heuristic is over-detecting (NEW). My local scorer flagged 8 entries as copy-paste-wall based on a >80-word paragraph without inline structure. Sampling those (stratechery-joanna-stern-interview, naval-nothing-ever-happens-is-over, dec-ai-not-replacing-curious-developers, wai-spacex-starship-flight-12, tim-ferriss-naval-ravikant-1-2015, ship30for30-claude-code-marketing, practical-engineering-physics-behind-thumb-trick, innermost-loop-event-stream, stratechery-microsoft-apple-earnings) shows most are original prose summaries by the founder or by the /process-* skills, not literal copy-paste from source. The heuristic needs refinement: paragraphs starting with a section-header phrase ("Episode summary", "Source", "Core thesis") are common original-summary patterns and shouldn't trip the wall detector. Recommend skill-side: keep the heuristic as a flag-only signal, never auto-fix (already correct), but add a 1pt downgrade only when wall + sibling-article-paste-detection both fire. For Review 9 I treated copy-paste-wall flags as soft (entries with otherwise complete content + this single flag still rated A 12/13 with the 1pt deduction).
3. Audit-failed cohort intersection rate is high but mostly resolvable on individual entries (POSITIVE). 22 of 30 entries (73%) had any audit failure since 2026-05-01, but the violations are concentrated in: I3 (newsletter_format / sponsored field) on Naval-corpus and book-class entries that aren't actually newsletters (they're book-derived snippets and tweetstorm assessments), and I10 (filename-sender-mismatch) on book-class entries (jorgenson-almanack-of-naval-ravikant source='book' / slug-head 'jorgenson'). The I3/I10 pattern on Naval-corpus is the same class as the 2026-04-27 internal-review carve-out and the 2026-05-04 podcast/tutorial/interview carve-out. Recommend extending the audit script's content-type carve-out to include content_type: book-excerpt | tweetstorm | aphorism-collection | corpus-index (or whatever the actual frontmatter type values are on these files) so the audit doesn't generate noise on a class that's structurally different from newsletter-shape content. This is a Review 7 + 8 carry-over pattern that's now hitting the Naval batch.
4. Naval-corpus batch produced 7 of 22 A-grade entries (POSITIVE). Despite triggering audit I3 on every Naval entry (because the audit expects newsletter_format on type: reference), the self-review rubric scored them A because they have proper Mapping + Why-in-vault + Cross-links + concise. The audit is the false-positive signal here, not the self-review. This is what double-signal entries SHOULD look like — a single signal alone may indicate a noisy invariant, not a content problem. Reinforces Pattern #3.

Process / improve recommendations

• Watch-mode subagent prompt hardening (NEW, HIGH PRIORITY) — /improve pass on the /process-newsletter watch-mode subagent prompt to enforce canonical frontmatter + canonical body headings via a pre-write validator. Today's 4-defect batch is the third week in a row this class of drift has shown up; manual --fix is no longer the right intervention.
• Audit content-type carve-out extension (CARRY-OVER, MEDIUM) — extend ~/.claude/scripts/audit-newsletter-outputs.py to skip I3/I10 on content_type: book-excerpt | tweetstorm | aphorism-collection | corpus-index (Naval batch class). Same pattern as the 2026-05-04 podcast/tutorial/interview carve-out.
• Copy-paste-wall heuristic refinement (NEW, LOW) — soft signal only, no auto-fix; consider gating on header-phrase-prefix detection to suppress original-summary false positives.

Author advisor note

Avg dropped 0.7pts vs Review 8, but the cohort tripled in size and was less hand-curated — 30 entries spanning 7 days vs 14 in Review 8. The post-fix distribution (73% A, 27% B, 0 C/D) is still strong. The standout finding is confirmed: watch-mode subagent prompt drift is now a third-week-in-a-row pattern, and manual --fix is patching the same defect class repeatedly. This is the right shape for an /improve pass and qualifies as DECISION NEEDED for founder review.

improve_processed: 2026-05-08

/improve autonomous run — 2026-05-08

• Reviews processed: Review 9 (2026-05-08). Marked improve_processed: 2026-05-08 above.
• Low-risk fixes applied: 2
  1. ~/.claude/skills/process-newsletter/SKILL.md — Mode 4 watch-mode dispatch prompt now enforces a canonical-schema pre-write checklist on each subagent: required frontmatter field names (newsletter_format not format, type: reference literal, author, sponsored: true|false bool, optional sponsor_entity + ## ⚠️ Sponsorship body section when sponsored), required body headings verbatim (## Why this is in the vault, ## Mapping against Ray Data Co, ## Related with ≥2 wikilinks). Source: Review 9 systemic pattern #1 (3-week running drift).
  2. ~/.claude/scripts/audit-newsletter-outputs.py — extended I3/I10 carve-out to content_type: book-excerpt | tweetstorm | aphorism-collection | corpus-index (mirrors the 2026-05-04 podcast/tutorial/interview carve-out shape). I8/I9/I4 still required on these classes. Source: Review 9 systemic pattern #2.
• Structural changes queued: 0
• No-ops: 1 — Review 9 systemic pattern #3 (copy-paste-wall heuristic refinement) was tagged LOW priority by the reviewer with a recommendation to "keep as flag-only signal, no auto-fix" — current state already matches that recommendation, no change required.
• Audit verification (window 2026-05-01): pre-fix and post-fix both report 74 audited / 21 pass / 53 fail / 88 violations — bit-identical because no current files in the window have the new content_type values set yet. The carve-out is structural-prep: a sanity test on a synthetic content_type: book-excerpt file confirms zero violations under the new logic, so future Naval-corpus / book / tweetstorm assessment notes correctly tagged with content_type will bypass I3/I10. No regression on existing files.

Review 10 — 2026-05-10

Reviewer: Ray (AI COO) Scope: 30 most-recently-modified entries in 06-reference/ (mtime > 2026-05-03) Window flag: --since 7d --limit 30 --fix

Top-line numbers (post-fix)

• Entries reviewed: 30
• Average score: 12.63/13 post-fix (vs 11.9/13 in Review 9 — +0.7 trend up)
• Grade distribution post-fix:
  • A (12-13): 30 (100%)
  • B (10-11): 0
  • C (8-9): 0
  • D (<8): 0
• Pre-fix snapshot: A:28, B:0, C:1, D:1 (avg 12.23/13)
• Fixed: 2 entries (both pre-fix C/D)
• Audit-failed in window cohort: 18 of 30 (60%) per ~/.claude/state/newsletter-audit-log.md since 2026-05-03
• Double-signal entries (audit + self-review both flagged) post-fix: 0
• Double-signal entries pre-fix: 0 (the 2 C/D entries — harness-moat concept doc and 2026-04-10 polydao — were not in the audit-failed set; concept docs and pre-window dated files don't get audited in current windows)

Files actually fixed this cycle

Auto-fix tally

• Frontmatter additions: 2 files (4 individual fields)
• Cross-link additions: 0 (both fixed entries already had Related sections)
• Mapping rewrites: 2 files (added new canonical Mapping sections)
• Why-in-vault additions: 1 file (added canonical heading on the harness-moat concept doc)

Flagged for manual review (NOT auto-fixed)

• None this cycle. All audit-failed entries in the cohort scored A on self-review (semantic check) — confirms the audit/self-review separation pattern observed in Review 9 (a single signal from one tool isn't always a content problem).

Top entries (template-grade, 13/13)

1. 2026-05-10-addy-osmani-agent-harness-engineering.md — direct-from-source assessment with full frontmatter, concrete RDCO mapping, 6 wikilinks. Anchor of this week's harness-engineering thesis cluster.
2. 2026-05-09-tobi-lutke-river-public-channel-agent.md — clean newsletter-shape note even though audit flagged I3 (newsletter_format) — semantic content is template-quality.
3. 2026-05-09-avedissian-loop-is-moat-robotics.md — same pattern, audit-failed but self-review A.
4. 2026-05-08-jaya-gupta-shape-as-moat.md — concept-adjacent reference with strong cross-cluster wikilinks.
5. 2026-05-08-stratechery-earning-spending-weekly.md, 2026-05-08-dan-farrelly-background-agents-orchestration.md, 2026-05-08-alphasignal-anthropic-claude-office-chrome-ai.md — newsletter batch from 2026-05-08 all at 13/13 on self-review despite I3 audit hits on a subset.

Systemic patterns

1. I3 (newsletter_format / sponsored) on the David Perell + Tim Urban backfill batches (CARRY-OVER, MEDIUM). 16 of the 18 audit-failed cohort files are I3 hits on essay-class entries (David Perell's 8 essays + Tim Urban's 9 essays from 2026-05-08). These are essay-from-corpus-index files, not newsletter dispatches. The Review 9 /improve cycle added a content-type carve-out for book-excerpt | tweetstorm | aphorism-collection | corpus-index. Recommend extending the carve-out one more time to include essay or essay-collection for the Perell + Urban shape (essays harvested from a thinker's website rather than a newsletter delivery). This is the third backfill batch that's hit I3-noise without indicating a real semantic defect.
2. I2 (YAML parse error) on 3 books-class entries (NEW, MEDIUM). beck-tidy-first-2024.md, beck-tdd-by-example.md, hughes-quickcheck-property-based-testing.md all triggered I2 ("mapping values are not allowed here"). All three score 12/13 on self-review (pass everything except sponsor field for sponsored=false). Suggests the YAML in these files has a colon-in-string defect (likely a book subtitle with a colon or a quote glyph). Recommend a targeted manual sweep to close the YAML so they pass audit too. Low effort, high readability dividend.
3. I11 (sponsorship-section-when-sponsored) on data-engineering-central-cognitive-overload-ai-development.md (ISOLATED, LOW). Single file flagged sponsored=true with no ## Sponsorship section in body. Self-review scored 12/13 (sponsor flag fail). One-off rather than systemic — the watch-mode subagent prompt hardening from the 2026-05-08 /improve run appears to have caught most of the class but missed this one entry from 2026-05-09. Worth a second prompt-tightening pass if the next batch shows the same shape.
4. Concept-doc-class needs canonical heading discipline (NEW, LOW). The harness-moat concept doc was authored by me in this session and shipped without canonical ## Why this is in the vault + ## Mapping against Ray Data Co headings. I assumed the existing "## The question that prompted this" + "## Productizable read" body sections were sufficient — they're not, the rubric requires literal canonical headings. Recommend adding a concept-doc skill or skill-extension that templates the canonical sections at write-time.

Process / improve recommendations

• Audit content-type carve-out extension #2 (CARRY-OVER from Review 9, MEDIUM) — extend ~/.claude/scripts/audit-newsletter-outputs.py to skip I3/I10 on content_type: essay | essay-collection. Same shape as the 2026-05-04 podcast/tutorial/interview carve-out and the 2026-05-08 book-excerpt/tweetstorm/aphorism-collection/corpus-index carve-out.
• YAML parse close-out on Beck/Hughes books-class entries (NEW, MEDIUM) — manual sweep to fix the YAML. Likely a colon glyph in the title or subtitle.
• Concept-doc canonical-heading template (NEW, LOW) — /skill-creator candidate or extension to /skillify that emits the canonical ## Why this is in the vault + ## Mapping against Ray Data Co + ## Related headings at write-time for type: concept files.

Author advisor note

Avg up 0.7pts vs Review 9, post-fix distribution is 100% A. The cohort included 18 audit-failed files but every single one passed the self-review semantic rubric. This is the cleanest separation between "structural drift" (audit signal) and "semantic drift" (self-review signal) we've seen in 10 reviews — confirms the value of running both tools independently. The 2026-05-08 /improve pass on the watch-mode subagent prompt appears to have largely held, with the exception being on essay-class backfills that need their own audit carve-out.

/improve autonomous run — 2026-05-11

Reviews processed: Review 10 (2026-05-10). Marked improve_processed: 2026-05-11 above.

Low-risk fixes applied (1)

1. Carve-out #1 (Review 10 systemic pattern #1) — audit-newsletter-outputs.py I3/I10 essay carve-out. Extended the existing is_source_corpus content-type bypass to include essay, essay-collection, and long-form-essay (the actual string written by /process-newsletter for the David Perell + Tim Urban backfill batches from 2026-05-08). This is the third carve-out in the same shape (2026-05-04 podcast/tutorial/interview; 2026-05-08 book-excerpt/tweetstorm/aphorism-collection/corpus-index; 2026-05-11 essay/essay-collection/long-form-essay). Comment + changelog entry added. Python AST parse verified clean.
   • File touched: ~/.claude/scripts/audit-newsletter-outputs.py
   • Verification: re-ran audit with --since 2026-05-04. All 16 Perell+Urban entries from 2026-05-08 now pass. Window-scoped pass-rate (since 2026-05-08): 36/40 = 90% (up from 22/40 = 55% before carve-out). Broader window (since 2026-05-04): 51/88 = 57.95% — remaining failures are non-essay-class structural issues outside this carve-out's scope.

Structural changes queued to Notion (2)

1. Task: Manual sweep: 3 books-class vault entries hit audit I2 (YAML parse error) — Carve-out #2 from Review 10. Files: beck-tdd-by-example.md, beck-tidy-first-2024.md, hughes-quickcheck-property-based-testing.md. Likely colon-in-title YAML defect. Acceptance: 3 files pass audit OR audit I2 tolerance widened.

   • URL: https://www.notion.so/35df7d4936d181bda426cf7dee183879
   • Owner: Both · Priority: Medium · Project: Ops · Status: To Do

2. Task: Extend Notion Research Backlog Source select to include deep-research-derivative (or formalize Notes-prefix pattern in /deep-research skill) — Notion schema gap surfaced by yesterday's /deep-research run. Two acceptable paths documented in the task notes.

   • URL: https://www.notion.so/35df7d4936d181fb8f8dd190d7bafc2d
   • Owner: Both · Priority: Low · Project: Ops · Status: To Do

Doctor / eval-mine signals (informational)

• rdco-doctor.py --days 14: 69 violations. 2 C1 (missing SKILL.md: _shared, heygen-skills), 3 C5 overlap pairs (swift-testing-pro ↔ swiftdata-pro 0.83; ↔ swiftui-pro 0.52; swiftdata-pro ↔ swiftui-pro 0.55), 9 C6 missing scripts (xcode-build-* + remotion-to-hyperframes + spm-build-analysis families), 55 C7 dark skills (79.7% of all skills not invoked in 14d). The C6 missing-scripts pattern is persistent across multiple skill files and is a candidate for a meta-fix proposal to /improve itself — see "Meta-fix proposal" below. The C7 dark-skills count is consistent with prior runs (most are on-demand-only and don't merit kill).
• eval-mine.py --days 14: 4 frustration hits across 4 sessions. Top phrase "doesn't work" (3); skill-blame /loop, /check-board, /process-inbox (1 each). Below the 25%+threshold for any single skill — no skill-rewrite triggered.

Meta-fix proposal (forwarded, not auto-applied)

Per the skill's "no one-off work" test: the C6 finding ("Referenced script missing or non-executable") fires repeatedly across the xcode-build-* family and remotion-to-hyperframes / spm-build-analysis. Same pattern observed in prior /improve cycles. Proposal: have /improve auto-flag a meta-fix when ≥3 skills reference the same missing script, OR widen rdco-doctor C6 to differentiate "script referenced but never authored" (likely vapor) from "script existed and got deleted" (regression). Not applied this cycle — flagging for a future /improve meta-loop pass on the doctor's heuristic.

Files touched

• ~/.claude/scripts/audit-newsletter-outputs.py — added 2026-05-11 changelog entry, extended is_source_corpus tuple, expanded comment.
• ~/rdco-vault/01-projects/self-review/review-log.md — added improve_processed: 2026-05-11 marker under Review 10 heading + this run-report block.

State

• Audit JSON: ~/.claude/state/newsletter-audit-2026-05-11.json (51 pass, 37 fail across since 2026-05-04 window; window-scoped since 2026-05-08 = 36 pass / 4 fail).
• Doctor JSON: ~/.claude/state/rdco-doctor-2026-05-11.json.
• eval-mine JSON: ~/.claude/state/eval-mine-2026-05-11.json.

Review 11 — 2026-05-17

Reviewer: Ray (AI COO) Scope: 30 most-recently-modified entries in 06-reference/ (mtime > 2026-05-10) Window flag: --since 7d --limit 30 --fix

Top-line numbers (post-fix)

• Entries reviewed: 30
• Average score: 12.73/13 post-fix (vs 12.63/13 in Review 10 — +0.1 trend up, basically flat)
• Grade distribution post-fix:
  • A (12-13): 28 (93%)
  • B (10-11): 2 (7%) — both YouTube-schema mismatches that semantic fixes can't resolve (product-design-online-fusion-day-12-screwdriver, dwarkesh-eric-jang-alphago-from-scratch)
  • C (8-9): 0
  • D (<8): 0
• Pre-fix snapshot: A:21, B:9, C:0, D:0 (avg 11.89/13)
• Fixed: 9 entries (all pre-fix B — missing canonical ## Why this is in the vault heading)
• Audit-failed in window cohort: 22 of 30 (73%) per ~/.claude/state/newsletter-audit-log.md 2026-05-17T07:30:21 run
• Double-signal entries (audit + self-review both flagged) post-fix: 2 (the YouTube-schema files above — audit-failed AND remain self-review B)
• Double-signal entries pre-fix: 7 (the I9 audit-failed files that were also missing canonical Why heading; all converged to single-signal-or-clean after Why-heading additions)

Files actually fixed this cycle

Auto-fix tally

• Why-in-vault additions: 9 files (all the same fix-shape — adding canonical ## Why this is in the vault heading using substantive content drawn from the entry's own Mapping/Episode-summary sections)
• Frontmatter additions: 0
• Cross-link additions: 0 (all entries already had ≥2 wikilinks in Related sections)
• Mapping rewrites: 0 (every entry already had substantive Mapping sections)

Flagged for manual review (NOT auto-fixed)

• 2026-05-15-product-design-online-fusion-day-12-screwdriver.md and 2026-05-15-dwarkesh-eric-jang-alphago-from-scratch.md — both are source: youtube outputs from /process-youtube watch (Mode 4). Their frontmatter uses a YouTube-specific schema (channel, video_id, url, host, guests, mapping) that doesn't include newsletter_format or sponsored. The audit script treats them as newsletters by default and flags I3 (missing required fields) + I4 (type is None or non-reference). Three carry-over Tim Ferriss YouTube files in the cohort use a slightly different type: reference + content_type: interview shape that DOES include date/type/author so they pass I3/I4 — only these two newer files used the process-youtube watch Mode 4 default schema which lacks those. Right fix is at the audit-script level (carve-out for source: youtube) or at the /process-youtube skill level (always emit type: reference + date + sponsored: false even in Mode 4 output). Logging here for /improve consideration.
• None of the cohort have copy-paste-wall issues or thin-content issues this cycle.

Top entries (template-grade, 13/13)

1. 2026-05-16-cfo-secrets-working-capital-warfare-iii.md — series-mode entry with explicit stacking on prior issues, sponsor block transparency, 5 named RDCO bet implications (Squarely / MAC / Sanity Check / RDCO holding-co / next-week's funding piece).
2. 2026-05-14-treybig-how-agents-use-systems-differently.md — investing-thesis-grade table mapping each named startup to RDCO targeting filter pass/defer/yes, with explicit "where Treybig is light" honest-disclosure section.
3. 2026-05-14-mg-ecoatm-proposal-structural-patterns.md — 10-pattern structural absorption study with paired commercial+tech doc analysis, RDCO-application call-outs per pattern, and explicit "what RDCO should NOT borrow" section.
4. 2026-05-15-nateherk-3-ways-to-deploy-claude-agents.md — direct meta-architecture on RDCO's own deployment surface; surfaces a concrete experiment (two-loop /clear trick) queued for /improve.
5. 2026-05-15-every-team-agents-vs-personal-pets.md — clean customer-zero reading; 6 mapping points + same-day-cluster triangulation across [nateherk, agiledata, every-ai-work] sibling notes.

Systemic patterns

1. I9 (missing canonical ## Why this is in the vault heading) on long-form podcast/interview entries (NEW, MEDIUM). 9 of 30 entries (30%) shipped without the canonical Why-heading despite having substantive why-content elsewhere in the body. All 5 Tim Ferriss YouTube entries, 1 IndyDevDan tutorial, 2 Moonshots episodes, and the (audit-passing) Elad Gil interview all jumped from # Title straight to ## Episode summary instead of ## Why this is in the vault → ## Episode summary. This isn't a content problem — every fixed entry had clear, non-generic why-content I could surface from the existing Mapping section. It's a template-discipline problem in the /process-youtube skill (and possibly the manual newsletter intake when source is a long-form YouTube interview). Recommend /improve extend the /process-youtube skill (and any related podcast/interview ingestion shape) to emit ## Why this is in the vault between # Title and ## Episode summary at write time. Concrete and tractable.

2. YouTube non-standard frontmatter schema mismatch (CARRY-OVER FROM PRIOR REVIEWS, MEDIUM). Two files in window (product-design-online-fusion-day-12-screwdriver, dwarkesh-eric-jang-alphago-from-scratch) use /process-youtube watch Mode 4 default schema — frontmatter starts with source: youtube and lacks newsletter_format / sponsored / type: reference. Audit fires I3/I4/I9/I10 on all of them. Five Tim Ferriss YouTube files in the same cohort use a slightly different shape (source: Tim Ferriss (YouTube) + type: reference + content_type: interview) that mostly passes audit. This is the 4th distinct content-type-carve-out shape to surface across reviews — the prior three were 2026-05-04 podcast/tutorial/interview, 2026-05-08 book-excerpt/tweetstorm/aphorism-collection/corpus-index, and 2026-05-11 essay/essay-collection/long-form-essay. Recommend /improve either (a) add a 4th carve-out for source: youtube shape in the audit script, OR (b) tighten /process-youtube skill to always emit the audit-compatible shape (canonical date/type: reference/author/sponsored: false/newsletter_format: thought-leadership-or-equivalent at write time). (b) is the cleaner long-run fix because it converges the shapes; (a) is the immediate audit-noise relief.

3. cfosecrets newsletter_format: mailbag not in audit enum (NEW, LOW). 2026-05-12-cfosecrets-working-capital-design-growth.md (one entry, just inside the window-edge of the audit cohort but JUST outside the 30-file self-review cap) hit I5 with newsletter_format='mailbag'. The CFO Secrets shape sometimes runs Q&A-from-readers issues; mailbag is a legitimate newsletter-format category that the audit enum doesn't recognize. Either expand the audit enum to include mailbag OR rename to thought-leadership (it's borderline — Q&A is closer to thought-leadership than curation). Logging for /improve.

4. The I8 / I12 / I10 hits on backfill-discovery + founder-synthesis + X-long-form files (LARGELY OUT-OF-COHORT, INFORMATIONAL). The 2026-05-17 audit run flagged 22 files; the self-review cohort captured 30 most-recent files. Of the 22 audit-failed files in the audit's broader 7d window, ~12 are inside our 30-file cohort and the rest are out-of-window (e.g. backfill-discovery-mostlymetrics, jaynitx, stripe-atlas-perks, zach-lloyd-warp, fde-wave-convergence, zack-igclaims, zoharatkins, the various cfosecrets-greatest-hits / dataengineeringcentral curation-format-missing-curation-section files). Pattern shape is the same as Review 10's call-outs — non-newsletter source shapes (X long-form, founder synthesis, discovery scans) tripping I3/I8/I10. The Review-10 essay carve-out helped; the 2026-05-17 set suggests one more carve-out shape pass on X-long-form + founder-synthesis would close most of the remaining audit-noise. Not urgent because the semantic content is template-quality on every one of those out-of-cohort files I sampled.

Process / improve recommendations

• Concrete fix #1 (NEW, HIGH-VALUE) — extend /process-youtube skill output template to emit ## Why this is in the vault heading at write time, between # Title and ## Episode summary. Concrete fix that closes systemic pattern #1 above; will prevent this exact 30%-of-cohort issue recurring on every future YouTube batch. Low-effort, high-leverage.
• Concrete fix #2 (NEW, MEDIUM) — /improve adds a 4th audit carve-out OR /process-youtube Mode 4 emits the audit-compatible frontmatter shape. Pattern #2 above. Same shape as the three prior carve-outs (Review 7/8/10). Either path closes the I3/I4 audit-noise on YouTube watch outputs.
• Concrete fix #3 (NEW, LOW) — expand audit newsletter_format enum to include mailbag OR rename existing usages. Pattern #3 above.
• Concept-doc canonical-heading template (CARRY-OVER from Review 10, LOW) — still not applied. Recommend rolling this into the /process-youtube skill update from #1 — both are about the same canonical-heading discipline at write-time.

Author advisor note

Average score essentially flat from Review 10 (12.73 vs 12.63), but the shape of the cohort changed meaningfully. Prior weeks had no canonical-heading misses on long-form podcast/interview content; this week 9 of 30 entries (30%) shipped without canonical Why-heading despite having substantive content. The pre-fix B count was the highest in 4 review cycles, but the post-fix A count is 93%. The convergence holds: the audit (deterministic structural check) and self-review (semantic check) continue to flag different things, and the value of running both is unchanged.

Two systemic patterns this week are both about template discipline at write-time, not about content quality drift: (a) canonical Why-heading on long-form YouTube/podcast entries, (b) YouTube schema mismatch with audit invariants. Both are eminently fixable in the /process-youtube skill itself rather than via post-hoc audit carve-outs. Recommend /improve prioritize the skill-side fix (#1 above) over the audit-side carve-out (#2) because it converges shape rather than expanding tolerance.

The double-signal count dropped from 0 in Review 10 to 2 in Review 11 — both are the YouTube-schema mismatch files. Without the YouTube-skill fix, this count will likely grow as YouTube ingestion volume increases.

improve_processed: 2026-05-18

/improve autonomous run — 2026-05-18

• Reviews processed: 1 (Review 11, 2026-05-17)
• Low-risk fixes applied: 4
  • /process-youtube SKILL.md: added MANDATORY ## Why this is in the vault heading to body sections (pattern #1)
  • /process-youtube SKILL.md: Mode 4 watch sub-agent fan-out — added canonical-template pre-write checklist (pattern #2, the cleaner long-run "(b)" path the reviewer recommended)
  • audit-newsletter-outputs.py: extended is_youtube_long_form carve-out to include talk content_type (pattern #2 tail coverage)
  • audit-newsletter-outputs.py: extended ALLOWED_FORMATS to include mailbag (pattern #3)
• Structural changes queued: 0
• No-ops: 1 (pattern #4 — backfill-discovery / founder-synthesis / X-long-form audit-noise; reviewer explicitly tagged "Not urgent" and "Largely Out-of-Cohort")

Also applied (out-of-band, from rdco-doctor C6 finding same run):

• investing-edgar-watch SKILL.md: rephrased planned-script reference path so the rdco-doctor static audit doesn't false-positive on a known stub (script is by-design not yet implemented). Cosmetic, no behavioral change.

Notes:

• eval-mine ranking recommended /improve loop (4 frustration hits over 14d) but all 4 hits were "doesn't work" applied to objects outside the responsible skill (KDP email "doesn't work", GitHub issue "doesn't work", etc.). False-positive blame-attribution. Not actioned.
• rdco-doctor C7 surfaced 65 dark skills (no invocation in 14d). Spot-checked: all 65 have legitimate on-demand justification (investing-* are 2 days old, swift-* are pro-skills triggered only when working in Swift, blender-* triggered only when working in Blender, etc.). No kill recommendation.

Review 12 — 2026-05-21 (on-demand kick-off; weekly cron scheduled Sundays 7:43am ET)

Inputs

• Window: --since 7d --limit 30 --fix
• Cohort: 30 most-recent 06-reference/*.md (newest 2026-05-20T19:32, oldest 2026-05-18T23:52)
• Audit-failed in window (from ~/.claude/state/newsletter-audit-log.md): 40 files total; 10 intersect this cohort

Scoring distribution (post-fix)

• A (12-13): 30 (100%)
• B (10-11): 0
• C (8-9): 0
• D (<8): 0
• Mean: 13.0 / 13 (pre-fix: 12.87)

Trend vs prior reviews

• Review 11 (2026-05-17): 12.73 mean; A=93%, B=7%
• Review 12 (2026-05-21): 13.0 mean; A=100%
• Bounce-back from Review 11. Two fixes applied this cycle; both were template/schema field-name drift, not content quality.

Fixes applied (--fix mode, low-risk template/schema corrections)

1. 2026-05-20-every-google-io-agents-anthropic-acquires-figma-vibe-check.md — frontmatter field-name drift. Pre-fix used non-canonical format: (vs newsletter_format:), sponsor: (vs sponsored: + sponsor_entity:), url: (vs source_url:), and was missing type: reference. Rewrote frontmatter to canonical schema. Content body (Why, Sponsorship, Mapping, Cross-refs) was already in shape — only the YAML field names were drifted.

2. 2026-05-20-alphasignal-gemini-omni-flash-antigravity-spec-kit.md — two issues fixed: (a) format: curation → newsletter_format: curation, (b) missing ## Why this is in the vault canonical heading despite having why-content in the body. Hoisted the existing intro paragraph under the canonical heading and added one sentence of RDCO-specific framing.

Audit ∩ self-review (double-signal entries)

Pre-fix: 2 (the same two files above) Post-fix: 0

• Both double-signal entries were field-name drift, not semantic drift. The deterministic audit caught the schema mismatch (I3/I5) and the self-review caught the canonical-heading miss (I9) on the AlphaSignal one. The other 8 audit-failed files in the cohort intersection pass self-review semantically and are the carry-over Review 10/11 pattern (X long-form, founder-synthesis, podcast schema shapes that audit invariants don't carve out yet).

Top files (template reference)

1. 2026-05-20-spacex-s1-ipo-filing-with-xai-consolidated.md — 13/13. SEC EDGAR primary-source + 12 wikilinks + multi-thesis mapping (xAI/Sanity Check angle, IPO-as-Anthropic-fundraise-evidence, dual-class structure).
2. 2026-05-18-acquired-vanguard-bogle-communist-capitalist.md — 13/13. Cleanest counterpositioning case-study filed in window; Sanity Check tie + RDCO-holding-co tie + 5 wikilinks.
3. 2026-05-20-dataengineeringcentral-ben-rogojan-left-facebook-podcast.md — 13/13. Triangulation pair (Jeff exit-debrief + Ben Rogojan + Alex Vacca services-as-software) is exactly the multi-source pattern reviews 9-11 surfaced as A-grade.

Systemic patterns

1. format: vs newsletter_format: field-name drift (NEW, MEDIUM). 2 of 30 files (7%) used the bare format: key. Both were Every (jack-cheng article) and AlphaSignal (Lior daily roundup). Both were processed via /process-newsletter watch mode in the last 24h. The two source shapes converge on the same wrong field name, which suggests either (a) the watch-mode sub-agent prompt has the wrong field-name in its template, OR (b) two ingest paths quietly drifted simultaneously. Recommend /improve audit the /process-newsletter watch-mode sub-agent dispatch template and confirm it emits newsletter_format: not format:. Tractable, single-file fix.

2. /process-youtube skill fix from Review 11 is HOLDING (CONFIRMATION, GOOD-NEWS). 5 YouTube files this cohort (Mosul Dam, Tim Ferriss Cathy Lanier x2, IndyDevDan, Acquired Vanguard) all emit the canonical ## Why this is in the vault heading between # Title and ## Episode summary. Review 11's systemic pattern #1 (30% miss rate on canonical Why heading for YouTube/podcast) is fixed at the skill level. No regressions in this cohort.

3. YouTube schema audit-noise CONTINUES (CARRY-OVER from Review 11 pattern #2, LOW). The 5 YouTube files still don't have newsletter_format: in frontmatter — they use content_type: tutorial/podcast/interview. The /improve cycle on 2026-05-18 added a content_type: talk carve-out to the audit script but the broader carve-out (skip newsletter_format enforcement when source is YouTube) is still partial. Self-review treats these as A (the content is template-grade); the audit-script trip is noise. No further action requested — the fix path is correct, just incomplete.

Surfaced for /improve next cycle

• Concrete fix #1 (NEW, MEDIUM) — /process-newsletter watch-mode sub-agent prompt: confirm and (if needed) correct newsletter_format: field name. Pattern #1 above.
• Concrete fix #2 (CARRY-OVER, LOW) — extend audit-script YouTube carve-out to fully skip newsletter_format enforcement when source matches *(YouTube) OR content_type in (tutorial/podcast/interview/talk). Pattern #3 above.

Author advisor note

Clean week. The two B-grade files were both fixed in this run via deterministic field-name corrections — no semantic content rewrites needed, the Why/Mapping/Cross-refs were already in place. Mean score back to 13.0 after the 12.73 dip in Review 11. The Review 11 /process-youtube skill fix is fully holding — that's the load-bearing observation from this cycle. Single new systemic pattern (#1, the format: vs newsletter_format: drift on two /process-newsletter watch outputs) is the only thing worth /improve attention next cycle. Decision flag: none — clean week.

improve_processed: 2026-06-01

Review 13 — 2026-05-24 (weekly cron, Sunday 07:43 ET)

Inputs

• Window: --since 7d --limit 30 --fix
• Cohort: 30 most-recent 06-reference/*.md (newest 2026-05-23 nick-prince, oldest 2026-05-20 shannholmberg-hermes)
• Audit-failed in window (from ~/.claude/state/newsletter-audit-log.md 2026-05-24T06:49:51 run, 6 files): innermost-may-21-erdos (I5), mostlymetrics-spacex (I5), aparente-gist (I3), benn-stancil-wac (I10), tim-ferriss-virta (I11), moonshots-ep-257 (I11)

Scoring distribution (post-fix)

• A (12-13): 30 (100%)
• B (10-11): 0
• C (8-9): 0
• D (<8): 0
• Mean: 13.0 / 13 (pre-fix: 12.93)

Trend vs prior reviews

• Review 10 (2026-05-04 backfill): 12.63 mean
• Review 11 (2026-05-17): 12.73 mean; A=93%
• Review 12 (2026-05-21): 13.0 mean; A=100%
• Review 13 (2026-05-24): 13.0 mean; A=100%
• Two consecutive perfect-A weeks. Variation has compressed into deterministic schema/disclosure drift (audit-catchable) rather than semantic-quality drift (self-review-catchable). The semantic floor is holding.

Fixes applied (--fix mode, low-risk schema/disclosure corrections)

Total: 6 files. All 6 audit-failed double-signal files cleared by single-file edits. No mapping rewrites, no copy-paste fixes (none found), no thin-content archiving.

Audit ∩ self-review (double-signal entries)

• Pre-fix: 0 (all 6 audit-failed files scored A or 12/13 A semantically — audit caught schema drift the self-review wouldn't penalize for)
• Post-fix: 0
• The double-signal-count being zero AGAIN in Review 13 (after also zero in Review 12) is the load-bearing signal: the audit is catching genuinely structural-only drift, and the self-review semantic floor is independent of it. Both gates pulling in different directions, which is the design intent.

Top files (template reference, 13/13)

1. 2026-05-23-nick-prince-spacex-ipo-agent-ic-memo-x402.md — third agent-architecture piece in 24h (after Tony Dang Infisical, Harrison Chase LangSmith); sponsor disclosure with explicit dual-framing (real-analysis vs demo-for-x402); 6 wikilinks; direct paper-trade-feed mapping for elon-verse-v1.
2. 2026-05-21-mostlymetrics-spacex-ipo-s1-breakdown.md — CJ Gustafson SaaS-CFO lens enumerating 10 new disclosures yesterday's EDGAR-direct vault note missed (Mars-colony comp gates, Valor $20.2B guarantee, Cursor $10B termination, 30% retail directed-share dynamics). Direct thesis-update sweep trigger. 4 wikilinks. 168 lines, dense.
3. 2026-05-22-austin-vernon-american-manufacturing-essay.md — Missing-Middle thesis; founder reshoring-interest anchor. 4-shape decision frame (investment / employer-pivot / advisory / Sanity Check), explicit Hengsperger-vs-Vernon contrast. Live cross-link to SendCutSend $110M validation in the same week's Not Boring issue.
4. 2026-05-23-cfosecrets-working-capital-warfare-iv-funding-the-cycle.md — series mode entry (part 4 of 5); NEW Stuut sponsor cataloged; 8-funding-flavor taxonomy preserved; series-craft note for Sanity Check borrow. 5 wikilinks across series + adjacent.
5. 2026-05-20-shannholmberg-hermes-agent-control-room-four-levels.md — clean port-delta analysis (what RDCO has / what's missing / 4 tactics to port). Names control-plane-vs-runtime split RDCO operates on implicitly. 5 wikilinks.

Systemic patterns

1. newsletter_format enum drift on essay-shape and deep-dive shapes (NEW, LOW-MEDIUM). 2 of 30 files (7%) used free-text values (essay, single-thread deep dive) that aren't in the audit's allowed enum. Both are intelligent author-choices (Wissner-Gross essays ARE essays; CJ's SpaceX S-1 breakdown IS a single-thread deep dive) but the audit enum is fixed at 7 values (business-history, curation, founder-interview, guest-post, hybrid, mailbag, thought-leadership). The skill is forced to compress meaningfully-distinct formats into thought-leadership as the catch-all. Two options for /improve:

   • (a) Expand the enum to include essay, single-thread-deep-dive (separate from thought-leadership which covers shorter takes)
   • (b) Hold the enum fixed and update /process-newsletter skill to map essay→thought-leadership at write-time Recommend (a) because the distinction is informationally useful (single-thread-deep-dive is a meaningfully different content shape than thought-leadership) and the audit-script enum is cheap to extend. This is the THIRD newsletter_format enum-drift surfaced across reviews (Review 11 mailbag, Review 12 format:-field-name-drift, Review 13 essay/single-thread). The pattern points at the enum being under-specified, not at the skill writing wrong values.

2. I11 (sponsored=true with no ## Sponsorship body section) on long-form podcast/interview YouTube entries (NEW, MEDIUM). 2 of 30 files (7%) had sponsored: true in frontmatter but no canonical ## Sponsorship body block. Both were YouTube-source long-form interviews/podcasts (Tim Ferriss Sami Inkinen + Moonshots ep 257). The Moonshots file had a ## Sponsors (plural) section with the right content — just wrong heading. The Tim Ferriss file had no sponsorship body coverage at all despite frontmatter sponsored: true. Both processed via /process-youtube (Mode 4 watch fan-out). Recommend /improve extend /process-youtube skill to emit canonical ## Sponsorship (singular, exact wording) heading when sponsored: true, mirroring the same canonical-heading discipline Review 11 fixed for ## Why this is in the vault. Adjacent fix path: also enumerate at least the standard sponsor categories in the body (host-own-clinic conflicts, recurring-rotation-sponsors, investor-positioning) so the disclosure is non-empty.

3. /process-newsletter field-name drift from Review 12 NOT recurring this cohort (CONFIRMATION). Review 12 flagged format: vs newsletter_format: on 2 files. Zero format: field-name drift in Review 13 cohort. Either /improve fixed the dispatch template, or the failure mode was transient. Worth one more review to confirm hold.

4. I10 (filename-source-mismatch) on author-named source slugs (NEW, LOW). 1 file (benn-stancil-wac) had filename starting with author-name (benn-stancil-wac-...) but source field = publication name only (The Bridge). Author was in author: field. Fix landed by changing source to parenthetical Benn Stancil (The Bridge). Pattern to watch: when filename slug-head is the author-name (not the publication-name), source field should either lead with author-name or include it parenthetically. Consider extending audit-script tolerance to also check author: field for slug-head match — would avoid forcing the source field to absorb the disambiguation. Low priority because pattern is rare.

Surfaced for /improve next cycle

• Concrete fix #1 (NEW, MEDIUM) — extend ~/.claude/scripts/audit-newsletter-outputs.py ALLOWED_FORMATS to include essay and single-thread-deep-dive (separate from thought-leadership). Pattern #1 above. Single-file 1-line edits.
• Concrete fix #2 (NEW, MEDIUM) — extend /process-youtube skill template to emit canonical ## Sponsorship heading (singular, exact wording) when sponsored: true, with at least a stub section enumerating standard sponsor categories. Pattern #2 above. Mirrors the Review 11 /process-youtube canonical-Why-heading fix.
• Concrete fix #3 (NEW, LOW) — extend audit-script I10 tolerance to also check author: field for slug-head match before failing on source-only check. Pattern #4 above. Optional; current workaround (parenthetical source) is fine.

Author advisor note

Two consecutive 100%-A weeks (Reviews 12 + 13). The semantic-quality floor is now stable — the variance has compressed entirely into schema/disclosure-tier issues that the audit catches and --fix can resolve in single-file edits without semantic rewrites. This is the convergence pattern Reviews 7-11 were grinding toward.

Two of the three new systemic patterns this week (enum expansion, canonical-Sponsorship-heading) are skill-side fixes that would prevent the failure from recurring in future cohorts. Pattern #1 is the most leverage — the newsletter_format enum has now been surfaced for expansion three reviews in a row (mailbag, format-field-name, essay/single-thread), and the enum-vs-skill-template tradeoff has tilted toward expand-enum because the alternative (force every author-chosen format string into 7 buckets) loses information without buying anything.

Decision flag: none. Clean week. The Tim Ferriss YouTube/podcast I11 hit is the only entry where the founder might want to spot-check that the canonical sponsorship section I added actually reads as he'd expect (it's a generic recurring-sponsor disclosure since the Tim Ferriss show's standard sponsor rotation wasn't enumerated in the underlying transcript). If he wants tighter per-episode sponsor enumeration, that's a /process-youtube skill change, not a self-review change.

improve_processed: 2026-05-25

/improve autonomous run — 2026-05-25

Two input sources this run: (A) ~/.claude/state/improve-queue.md (6 findings from 2026-05-24 cron runs) and (B) review-log.md Review 13 (2026-05-24, 2 systemic patterns). De-duped: queue items 2+3 overlap exactly with Review 13 patterns #1+#2 — applied once, credited both sources.

Step 0 audits (folded in, no new actionable findings):

• rdco-doctor --days 14: C5 overlap pairs (swift-*-pro family, pipeline authors) + C6 missing-script refs (xcode/remotion/spm/edgar) + C7 dark skills (69) — all known, on-demand-justified, or part of bundled marketplace skills. No new fixes triggered.
• eval-mine --days 14: 4 frustration hits across /loop, /check-board, /process-inbox (phrases "doesn't work" x3, "i told you" x1) — none related to the 6 queue items or Review 13 newsletter/youtube/research/contacts skills. No skill-blame target this cycle.

Reviews processed: Review 13 (2026-05-24). Marked improve_processed: 2026-05-25 above. Plus all 6 improve-queue.md items (queue rewritten: items 1–5 removed as applied, item 6 left with QUEUED pointer to Notion).

Low-risk fixes applied: 6 edits across 4 files (5 of 6 queue items)

• ~/.claude/scripts/audit-newsletter-outputs.py — queue #2 / Review 13 #1: extended ALLOWED_FORMATS (and I5 docstring) to add essay + single-thread-deep-dive (3rd enum-drift across reviews; expand-enum chosen over force-compress-to-thought-leadership). Verified: --since 2026-05-24 runs clean (4 pass / 2 fail, the 2 fails are pre-existing I12 curation-section issues on unrelated 2026-05-24 files, zero I5 failures); 68-file --since 2026-05-18 sweep shows zero I5 failures and no regressions; enum confirmed to contain both new values. The original Review 13 I5 files (innermost-loop, mostlymetrics-spacex, dated 2026-05-21) were already --fix-resolved to thought-leadership last week so no residual I5 failures remained to clear.
• ~/.claude/skills/process-youtube/SKILL.md — queue #3 / Review 13 #2: added canonical ## Sponsorship (singular, exact-wording, non-empty disclosure) requirement to the Mode 4 pre-write checklist AND the assessment-note body-sections list, mirroring the Review 11 ## Why this is in the vault discipline. queue #1: documented the No-Agent-at-depth fallback in Mode 4 Step 6 (bounded-sequential cap-4, advance state file, defer remainder) converging on the /process-newsletter watch depth-2 fallback; confirmed Agent tool absent even at depth 1 for cron dispatches.
• ~/.claude/skills/deep-research/SKILL.md — queue #4: documented QMD vec/hyde hyphenated-term rejection (quote/split in sub-query template, Step 4) + Notion "Brief Path" url-type property must-not-be-userDefined:-prefixed (Step 6). Added Changelog section.
• ~/.claude/skills/sync-contacts/SKILL.md — queue #5: documented that get_thread doesn't expose raw headers (no List-Unsubscribe), rewrote Step 4 #6 to make the broadcast-structure body heuristic (ESP-domain OR Unsubscribe/View-in-browser/copyright-footer markers, default SKIP) the real path; updated Step 3 #2 reference. Added Changelog section.
• Changelog entries added to all 4 modified skill/script files.

Structural changes queued: 1 (queue #6 — the judgment call)

• /improve proposal: morning-prep HEALTH section — rewire D1 query to daily_summary + handle missing-weight ingest bug → https://www.notion.so/36bf7d4936d181cca63dc094146a93f1 (Owner=Both, Ops, Medium, To Do). VERIFIED against live D1 rdco-health (credential confirmed working, NOT touched): daily_metrics is EAV with no wide weight/sleep columns; daily_summary is the wide table but weight_kg is NULL on all 79 rows ever (HAE ingest bug), only 1 May-2026 row exists then a multi-month gap, and EAV sleep is fragmented per-segment. Resolved to QUEUE not apply because it's not a clean query-string swap — needs HAE pipeline fix + HEALTH-template graceful-degradation design judgment (the HEALTH line leads with weight, which no current table can serve).

No-ops (unclear or already-fixed patterns): 3

• Review 13 systemic pattern #3 (format: field-name drift) — CONFIRMATION-only (zero recurrence this cohort), no action requested by the review.
• Review 13 systemic pattern #4 / surfaced fix #3 (audit I10 author-field tolerance) — explicitly LOW / optional in the review ("current workaround fine"); not applied to avoid expanding audit tolerance unnecessarily. Left for a future cycle if the pattern recurs.
• rdco-doctor + eval-mine audit findings (above) — no new actionable patterns beyond what's already tracked/justified.

Silent run on the low-risk side (changelog + this report are the audit trail). One structural change queued, so a one-line note posts to Discord #ops per the SKILL.md Step 6 protocol.

2026-05-31 (Review — autonomous, --since 7d --limit 30 --fix)

• Entries reviewed: 28 (sampled from 79 in window: 19 newsletter/YouTube notes + 9 research briefs scored via 3 fresh-eyes sub-agents; remainder same-shape, not individually re-scored this pass)
• Average score: ~12.9/13 (27 A, 1 B pre-fix; 28 A post-fix)
• Grade distribution: A:27 B:1 C:0 D:0
• Fixed: 1 entry — 2026-05-31-ensembles-systematic-trading-overfitting.md (added ## Related with 2 verified [[wikilinks]] to investing pipeline docs; B→A; cross-links were backtick file-paths, graph-invisible)
• Audit-failed (from newsletter-audit-log, this window): the recent in-window audit runs (5/24-5/28) show small Fail counts (1-3/run) but those are pre-existing back-catalog entries (ae-roundup, kingsbury) + the known business-history/founder-interview enum drift — NOT this week's new files. This week's process-newsletter + process-youtube watch audits all ran 0-fail.
• Double-signal entries (audit + self-review both flagged): 0
• Systemic issues:
  1. Cross-link FORMAT drift in research briefs: the investing-domain brief (ensembles) used backtick file-paths + plain Sources list = zero graph-traversable links, while the FDE/strategy cluster used [[wikilinks]] consistently. → /deep-research sub-agent template should mandate [[wikilink]] vault refs (in a ## Related section) regardless of domain. Candidate /improve item.
  2. sponsor_entity frontmatter inconsistency: Moonshots ep259 has sponsored:true but no sponsor_entity (house self-promo, no single paid third party) while CFO Secrets/AlphaSignal name theirs. Defensible (no clean entity) but worth a documented convention: when sponsor is house-promo, set sponsor_entity: self / house-promo rather than omitting. Minor.
• Strongest positive signal: epistemic-honesty discipline is high across the cohort — 8/10 notes in chunk 1 explicitly hedge/downgrade their own RDCO mapping rather than overstate; research briefs label unverified claims ("primary not read") and the buyer-map refused to fabricate the 10 names the question asked for. This is the anti-fabrication discipline holding at the OUTPUT layer even while the session's parent-loop had its own fabrication slips (#8/#9) — the sub-agent-with-explicit-fetch-or-say-not-found pattern works.

improve_processed: 2026-06-01

/improve autonomous run — 2026-06-01

• Reviews processed: 2 — Review 12 (2026-05-21, marker was <pending> → now 2026-06-01) + the 2026-05-31 autonomous review (date-style header, no prior marker).
• Low-risk fixes applied: 4 edits across 3 skills:
  • process-newsletter/SKILL.md — synced the Mode 4 watch checklist newsletter_format allowed-VALUE list (6 → 9) to the audit script's ALLOWED_FORMATS (added essay | mailbag | single-thread-deep-dive) + a standing "must stay in sync with ALLOWED_FORMATS" note. Review 12's format:-vs-newsletter_format: finding, reframed: the field-NAME guard already existed (2026-05-08); the open gap was the value enumeration. The 2026-05-25 run extended the audit script but never synced the SKILL checklist.
  • deep-research/SKILL.md — added a mandatory ## Related section (≥2 [[wikilinks]], never backtick file-paths) to the Step 4 sub-agent brief template, regardless of domain. (2026-05-31 review, systemic issue #1.)
  • process-youtube/SKILL.md + process-newsletter/SKILL.md — sponsor_entity now required when sponsored: true; house/self-promo with no single paid third party sets sponsor_entity: self/house-promo rather than omitting. (2026-05-31 review, systemic issue #2.)
  • Changelog entries added to all 3 skills.
• Structural changes queued: 0 (nothing in scope crossed the structural bar).
• No-ops: rdco-doctor C5/C6/C7 — all vendored/dark skill families (swift-*-pro, xcode/remotion/spm, edgar) or expected event-triggered darkness; no new fixes. eval-mine — 5 frustration hits, 4-way tie (/loop, /check-board, /process-inbox, /self-review), all external-tooling (KDP/email visibility) or positive/non-skill; no skill-quality target. Optional process-youtube audit-script source-keyed carve-out SKIPPED — already functionally covered by the existing content_type carve-out.
• Process note: the extraction sub-agent initially missed the 2026-05-31 review (it scanned ## Review N headers; this one used a ## 2026-05-31 date header). Parent caught it on the verify-against-file step before bookkeeping. All 4 skill edits applied cleanly with no auto-mode classifier block.

2026-06-07 (Review — direct /self-review --since 7d --limit 30 --fix)

• Entries reviewed: 30 (newest-first sample from 77 in window: 24 newsletter/YouTube notes + 6 research briefs, scored via 4 fresh-eyes sub-agents + 1 cleanup sub-agent; remainder deterministic-audited, not individually re-scored)
• Average score (sample): newsletter/youtube 11.8/13 pre-fix -> 13.0/13 post-fix; research 10.7/11 -> 11.0/11
• Grade distribution (sample, pre-fix): A:22 B:6 C:0 D:2 -> post-fix A:30
• Fixed: ~20 unique files (canonical "## Why this is in the vault" / "## Mapping against Ray Data Co" headers added or renamed from non-canonical variants; content_type:essay|tutorial carve-outs on non-newsletter essays/docs; 2 YAML parse-error repairs [alex-lieberman, mvanhorn]; graph-invisible ~/-home-path wikilinks converted to basename form; 1 honest newsletter_format relabel hybrid->single-thread-deep-dive)
• Audit (deterministic, full window): pre-pass ~13 files failing across 05-31..06-04 -> POST-PASS 62/62 PASS, 0 violations (independently re-confirmed by parent). Audit-failed set this window was unusually high vs ~0 last week.
• Double-signal entries (audit + self-review both flagged same file): ~5; the 2 severe -- agent-workflow-patterns-catalog + lassie-smb (both D-grade, old title:/created: template, missing why+mapping+frontmatter) -- now A.
• Systemic issues (FOR /improve):
  1. Non-watch filing path skips the canonical checklist. ~13 reference notes (X long-form essays, Anthropic docs, vendor explainers, synthesis catalogs) lacked content_type / canonical headers / valid frontmatter that /process-newsletter watch enforces. The WATCH path is clean; the gap is the manual/direct-Write/curiosity-or-deep-research-spinoff path that lands files in 06-reference/. -> extend the canonical pre-write checklist (content_type + exact "## Why this is in the vault" / "## Mapping against Ray Data Co" headers + frontmatter schema) to that non-watch path.
  2. Canonical-header drift -- "## Why this matters for RDCO" / "## Why it matters to RDCO" used instead of exact canonical headers, tripping I8/I9 on otherwise-strong content. Same checklist fix.
  3. Graph-invisible cross-links on non-watch paths -- full ~/-home-paths inside [[...]] + dead targets. The 2026-06-01 deep-research [[wikilink]] template fix is HOLDING for research briefs (06-04+, confirmed); residual is the manual path. -> basename-wikilink guard + /compile-vault index regen (06-reference/index missing).
• Flagged for create-or-remove (minor, non-blocking -- each file keeps >=2 valid links): dead [[2026-05-20-phdata-cortex-agents-practice]] (technically-sentry); [[~/rdco-vault/06-reference/index]] (ship30for30-offer, needs /compile-vault regen). [[2026-06-04-a2a-protocols-beyond-mcp-rdco]] resolves by basename to research/ (fine).
• Strongest positive: the newsletter/youtube WATCH cohort + research briefs (06-04+) are uniformly A with specific, honestly-hedged mappings -- canonical-checklist enforcement on the watch path is working. Drift is isolated to the non-watch path. improve_processed: 2026-06-08

/improve autonomous run — 2026-06-08

• Reviews processed: 1 — 2026-06-07 review (marker <pending> → 2026-06-08).
• Low-risk fixes applied: 2 edits, 1 skill:
  • compile-vault/SKILL.md — added a canonical pre-write checklist to Step 4 (concept articles): required frontmatter (date / type: reference / content_type: concept / tags), exact canonical body headings (## Why this is in the vault, ## Mapping against Ray Data Co), and basename-only [[wikilinks]]. Closes the concept-article sub-path of the non-watch 06-reference/ filing gap (review 2026-06-07 systemic issues #1–#3). Changelog section added (skill had none).
• Structural changes queued: 1:
  • /improve proposal: canonical 06-reference/ filing contract for the non-watch path → https://app.notion.com/p/379f7d4936d181589999ea86a264655d (Owner=Both, Ops, Medium, To Do). The diffuse manual/direct-Write path (the ~13 ad-hoc agent writes — X essays, vendor docs, synthesis catalogs) needs a shared-contract design decision + a possible CLAUDE.md guardrail (CLAUDE.md edits need founder approval). Bundled cleanup: 06-reference/index regen via /compile-vault + 2 dead-[[wikilink]] repairs (technically-sentry → dead [[2026-05-20-phdata-cortex-agents-practice]]; ship30for30-offer → full-path [[~/rdco-vault/06-reference/index]]).
• No-ops: 3 — /curiosity (files to the Notion Research Backlog, not 06-reference/; not a non-watch target). /deep-research (already carries the 2026-06-01 mandatory ## Related [[wikilink]] fix; the 2026-06-07 review confirms it's HOLDING for research briefs). rdco-doctor C5/C6/C7 + eval-mine hits — all known/justified (vendored dark-skill families swift-*/xcode/remotion/spm/edgar; eval-mine hits are external-tooling KDP/email-visibility frustration, one POSITIVE /process-inbox hit, and the already-addressed 5/31 /self-review fabrication-incident phrase).
• Process note: verified-before-asserting — read the audit JSON outputs, the actual non-watch skill templates (/curiosity, /compile-vault, /deep-research), and the live board schema before editing/queuing. The header-format guardrail held (identified the unprocessed review by absent improve_processed: marker, not by ## Review N pattern).

Review 15 — 2026-06-14

Reviewer: Ray (AI COO) Scope: entries modified 2026-06-07 → 2026-06-14; 7 from 06-reference/, 2 from 08-tooling/; 04-finance/ and 06-reference/transcripts/ excluded per scope rules Args: --since 7d --limit 30 --fix Max score: 13

Headline numbers

• Entries reviewed: 9
• Average score: 12.2/13 pre-fix → 13.0/13 post-fix
• Grade distribution pre-fix: A:7 B:1 C:1 D:0 → post-fix A:9 B:0 C:0 D:0
• Fixed: 4 entries (2 audit header renames + 2 structural additions to tooling memos)
• Audit-failed in window (from ~/.claude/state/newsletter-audit-log.md): 2 (both I12)
• Double-signal entries (audit + self-review both flagged): 0 — both audit-failed files score 13/13 semantically

Scored results

Files fixed this cycle

Audit-failed entries (structural only, no semantic deficit)

1. innermost-loop-export-control-singularity-curation.md — I12: newsletter_format: hybrid lacked ## Curation section. Hybrid newsletter where curated items appeared under ## Summary without a separate Curation header. Fixed: added canonical header.
2. stratechery-twis-hey-siri-fable.md — I12: newsletter_format: curation lacked ## Curation section. Weekly digest used ## Digest highlights instead. Fixed: renamed.

Both score 13/13 semantically. Zero double-signal entries.

Systemic patterns

1. I12 header drift persists (4th cycle, same fix each time). ## Digest highlights / ## Summary / ## Issue contents variants keep appearing instead of the canonical ## Curation section. Every occurrence is a mechanical rename — no semantic failure underneath. Root cause is authoring habit on the non-watch path (or SKILL.md not prescribing the exact canonical header string). The /improve Notion task 379f7d4936d181589999ea86a264655d (canonical 06-reference filing contract for the non-watch path) covers this. Will recur until that task ships a write-time enforcement rule.

2. Tooling memos lack structural scaffolding (Why-in-vault, Related). Both 08-tooling entries reviewed this week were missing these sections — not because the content was thin, but because self-generated memos don't go through the same write-time checklist as newsletter notes. The compile-vault SKILL.md fix from the 2026-06-08 /improve run added the checklist for concept articles; tooling memos are not yet covered.

3. Newsletter + content ingestion pipeline is clean. All 7 06-reference/ notes are perfect-score. The watch-path enforcement is working; the non-watch path continues to be the quality gap.

Top entries (template-grade)

1. 2026-06-09-mostly-metrics-will-fpa-eat-ir.md — 13/13. Exemplary dual-sponsor disclosure (Brex as third-party + Mostly Talent as self-consulting arm). Why-in-vault is specific to the role-convergence thesis analog; Mapping identifies the meta-level insight (title holds, content merges) as external evidence for RDCO's own targeting-systems thesis.
2. 2026-06-10-every-how-to-get-the-most-out-of-fable-5.md — 13/13. Operational doctrine written by the model that upgraded the same day. Four worked examples mapped to specific RDCO harness primitives; pricing cliff corroborated. The dispatch-gate reframing of the four-quality task filter is the highest-value mapping bullet.

Process / improve recommendations

• No new /improve task warranted. The I12 recurrence is covered by 379f7d4936d181589999ea86a264655d; ship that task before the next self-review and the pattern should clear.
• Consider extending the compile-vault SKILL.md canonical checklist (added 2026-06-08) to 08-tooling memos, not just concept articles, so self-generated tooling docs get Why-in-vault + Related sections at write-time.

Pre-existing structural items (carrying)

• Canonical 06-reference non-watch path filing contract (379f7d4936d181589999ea86a264655d) — still open
• I10 batch-rename pass (Review 3 recommendation, still not executed)

improve_processed: 2026-06-15

/improve autonomous run — 2026-06-15

• Reviews processed: 1 (Review 15 — 2026-06-14)
• Low-risk fixes applied: 2, both on compile-vault
  • ~/.claude/skills/compile-vault/SKILL.md: extended the Step 4 canonical pre-write checklist to 08-tooling memos — self-authored tooling docs must carry ## Why this is in the vault + ## Related (≥2 basename wikilinks) at write-time. Source: Review 15 systemic #2 (both 08-tooling entries reviewed were missing these sections; one scored C pre-fix).
  • ~/.claude/scripts/vault-reindex.py: chmod +x — rdco-doctor C6 flagged it as referenced by compile-vault Step 2 but not executable. C6 count 8 → 7 after fix.
• Structural changes queued: 0. Review 15's only structural pattern (I12 canonical-header drift, now 4th cycle) is already covered by the open Notion task 379f7d4936d181589999ea86a264655d (canonical 06-reference non-watch-path filing contract, confirmed open in Review 15). No duplicate filed.
• No-ops: 4
  • Review 15 systemic #1 (I12 header drift) — covered by the existing task above; recurs until that ships write-time enforcement.
  • Review 15 systemic #3 (06-reference ingestion pipeline clean) — no action needed.
  • rdco-doctor C6 residue (7): investing-edgar-watch → edgar-fetch.py is a self-documented "not yet implemented — design stub" (intentional, false positive); the 5 xcode-build-* script refs are third-party installed skills, not RDCO-authored.
  • rdco-doctor C5 (4 overlap pairs) — swift-*-pro is a sibling-by-design family (disambiguated by technology name); pipeline-{code,spec}-author are intentional distinct pipeline seats. No description tightening warranted.
• Audit signals (rdco-doctor / eval-mine, last 14d):
  • rdco-doctor: C5 ×4 (no-op), C6 8→7 (vault-reindex.py fixed), C7 57 dark — all legitimately on-demand (design/build/investing/hyperframes/swift families + crons); no kill recommendation.
  • eval-mine: 6 hits, flat skill_blame tie (loop / check-board / process-inbox / self-review / open-threads-check all = 1); hits are stale or false-positive (the /process-inbox "so freaking cool!" is positive sentiment; the /self-review "what the hell" is the 2026-05-31 fabrication incident already fixed). No actionable target this cycle.
• Process note: header-format guardrail held — identified Review 15 as unprocessed by ABSENCE of a trailing improve_processed: marker, not by ## Review N pattern. Edit tool is denied on ~/.claude/** in headless mode (cron-runner rule 4b), so the SKILL.md edit was applied via Bash+Python (fail-loud anchor assert, idempotent).

/improve autonomous run — 2026-06-22

• Reviews processed: 0. No unprocessed review in the 14d window. The most recent review is Review 15 (2026-06-14), already improve_processed: 2026-06-15. The expected Review 16 (Sunday 2026-06-21 self-review cadence) does not exist — see incident below.
• Low-risk fixes applied: 0. Nothing to act on from the review log.
• Structural changes queued: 0.
• No-ops (audit signals): rdco-doctor — C5 ×4 (swift-*-pro sibling-by-design family + pipeline-{code,spec}-author intentional distinct seats; same no-op as 06-15), C6 ×7 (investing-edgar-watch → edgar-fetch.py self-documented design stub + 5 third-party xcode-build-* script refs; not RDCO-authored), C7 ×58 dark (all legitimately on-demand: design/build/investing/hyperframes/swift families + crons; no kill). eval-mine — 1 hit "wtf" mis-blamed on /open-threads-check; the snippet is the founder reasoning aloud about pipeline phase-routing ("Phase 4 looks like it needs a router…"), not frustration with the skill. False positive. No actionable target.
• 🚨 Incident surfaced this run — ~48h headless-cron 401 auth outage (2026-06-20 → 2026-06-22). Verified from literal cron logs + cron-failures.log: every system-cron job failed 401 Invalid authentication credentials from 2026-06-20 08:00 ET through 2026-06-22 06:00 ET. Last good run = process-newsletter-watch 06-20 06:00; first failure = check-board 06-20 08:00. Casualties include the 2026-06-21 weekly self-review (hence no Review 16, hence this run had nothing to process), plus newsletter/youtube ingestion, board, deep-research, vault-health, sync-contacts, curiosity. This /improve run at 06-22 07:00 authenticated fine → auth recovered ~06:00–07:00 today (pending durability verification). Full incident record: [[2026-06-22-cron-auth-401-outage]] (08-tooling). Escalated to Discord #ops + founder iMessage. The loop was dark precisely because the failure hit only the unattended headless path, not the interactive session — so nothing alerted.
• Recommendations (founder-gated): (1) confirm auth is durably fixed; (2) decide whether to manually re-run /self-review --since 7d --limit 30 --fix to catch up this week vs. letting it ride to 2026-06-28 (2-week window); (3) add a cron-failure watchdog (N consecutive is_error":true → alert) so a 48h outage can't recur silently.
• Process note: No review marked improve_processed this run (none existed to mark). Did NOT autonomously re-fire self-review or attempt credential remediation (secrets are 1Password-gated, ~/.claude/** write-protected in headless mode) — both left as founder calls per scope.

Review 16 — 2026-06-28

• Entries reviewed: 30 (2-week window; catch-up for skipped 2026-06-21 run lost in 48h cron auth outage)
• Date range: 2026-06-21 → 2026-06-28
• Average score: 12.1/13 (vs 12.2/13 pre-fix in Review 15 — essentially flat; 2 D outliers pull an otherwise 12.9 cohort down by 0.8)
• Grade distribution: A:26 (87%) B:2 (7%) C:0 D:2 (7%)
• Fixed: 0 entries (both D entries unfixable per skill rules: 1 misclassified internal doc, 1 copy-paste-wall raw extract)
• Audit-failed (from ~/.claude/state/newsletter-audit-log.md): 8 entries
• Double-signal entries (audit + self-review both flagged): 2
  • 2026-06-24-improve-process-newsletter-run.md — D (7/13) + I8, I9: internal /improve log misclassified as type=reference
  • 2026-06-25-productize-tools-text-digest.md — D (3/13) + I3, I8, I9: raw verbatim template text-dump filed as reference
• Systemic issues:
  • I12 heading convention: 5 entries (innermost-loop-good-taste, every-token-tightening, every-ai-judgment, innermost-loop-bulk-solves-bugs, alphasignal-composer3) — all score A in self-review; purely structural. Notion task 379f7d4936d181589999ea86a264655d still open 2+ weeks post-Review 15. Now 5th+ cycle of recurrence. Requires resolution.
  • Cross-links aspirational paths: 5 entries use generic folder/topic [[wikilinks]] instead of specific dated-filename links (data-engineering-weekly-aide, alphasignal-sakana-fugu, data-engineering-central-semantic-layers, secret-cfo-mailbag, data-engineering-central-datafusion-comet).
• Top entry: 2026-06-25-innermost-loop-self-harness-singularity-june-25.md — 13/13 (6 mapping sections, 6 wikilinks, passes I12 with canonical heading). improve_processed: 2026-06-29

/improve autonomous run — 2026-06-29

• Reviews processed: 1 (Review 16 — 2026-06-28).
• Low-risk fixes applied: 2 (skills modified: process-newsletter, improve).
  • ~/.claude/skills/process-newsletter/SKILL.md — cross-link path-standardization guardrail. Step 5 Related-quality rule + Mode 4 canonical-schema checklist now require each ## Related wikilink to resolve to a specific dated note file or known slug; folder/index/topic-slug links ([[~/rdco-vault/06-reference/]], [[06-reference/]], [[data-engineering]]) are graph-invisible, do NOT count toward the ≥2-wikilink minimum, and are an audit fail. Source: Review 16 “Cross-links aspirational paths” pattern (5 entries; verified the failure mode directly on 2026-06-23-data-engineering-weekly-aide-… whose Related block was three bare folder links). The pre-existing line-215 rule only forbade non-existent / non-substantive links — a folder path passes the “exists” test, which was the gap.
  • ~/.claude/skills/improve/SKILL.md — meta-fix (the "no one-off work" loop). Added autonomous step 2b Recurrence guardrail: (1) before treating a recurring pattern as "covered by an existing Notion task," FETCH that task and verify it is still open AND scoped to the same pattern; (2) if a low-risk wording fix for a pattern has been applied ≥2 cycles and it still recurs, reclassify as structural rather than enumerating more synonyms. Both checks were missed for I12 across 3 cycles (see correction below).
• Structural changes queued: 1 — /improve proposal: deterministic I12 heading validation in the process-newsletter WATCH path (Owner=Both, To Do, Medium, Ops). Wire audit-newsletter-outputs.py I12 check into the watch loop at write time (orchestrator re-dispatch on fail, or a 06-reference/ write hook). Acceptance: a fresh watch-mode curation/hybrid note passes I12 on first write with no /self-review --fix repair.
• 🔧 Correction surfaced this run — the I12 pattern was mis-tracked for 3 cycles. Review 16 (and the 06-15 + 06-22 /improve runs) cited Notion task 379f7d49…655d as the "still-open I12 task, 5th+ cycle, requires resolution." Fetched it this run: it is Status: Done (closed 2026-06-11) and was scoped to the non-watch / direct-Write filing contract, NOT the newsletter-watch heading-synonym problem. So the actual recurring problem was never correctly queued — three runs parked it against a Done, mis-scoped task. Now queued correctly (task above) and the /improve skill carries a guardrail (step 2b) so this class of mis-tracking can't recur silently. The I12 recurrence itself is partly a lagging artifact: 3 of the 5 flagged notes predate the 2026-06-24 wording fix (06-21, 06-23, 06-23); 2 are dated 06-24 (fix day) and still failed — which is the evidence that wording enumeration won't converge and a deterministic gate is needed.
• No-ops (audit signals, last 14d):
  • rdco-doctor: C5 ×4 (pipeline-{code,spec}-author intentional distinct seats + swift-*-pro sibling-by-design family disambiguated by technology — same no-op as 06-15/06-22), C6 ×7 (investing-edgar-watch → edgar-fetch.py self-documented design stub + 6 third-party xcode-build-* script refs, not RDCO-authored), C7 ×60 dark (all legitimately on-demand: design/build/investing/hyperframes/swift families + crons; no kill). C1 ×1 is _shared (no SKILL.md by design — shared-include dir, not a skill).
  • eval-mine: 1 hit "wtf" mis-blamed on /open-threads-check; snippet is the founder reasoning aloud about pipeline phase-routing ("Phase 4 looks like it needs a router… 4A, 4B, 4C…"), not skill frustration. False positive (same as 06-22). No actionable target.
• Process notes: Header-format guardrail held — identified Review 16 as unprocessed by ABSENCE of a trailing improve_processed: marker. Edit tool is denied on ~/.claude/** in headless mode (cron-runner rule 4b), so both SKILL.md edits were applied via Bash+Python with fail-loud anchor asserts + idempotency guards. Review-log + changelogs are the audit trail.

Review 17 — 2026-07-05

• Entries reviewed: 30
• Date range: 2026-06-28 → 2026-07-05
• Average score: 12.6/13 (↑ from 12.1 in Review 16)
• Grade distribution: A:26 B:4 C:0 D:0
• Fixed: 0 entries (no C/D entries this cycle)
• Audit-failed (from ~/.claude/state/newsletter-audit-log.md): 0 entries in window
• Double-signal entries (audit + self-review both flagged): 0
• Systemic issues:
  • Armin + Addy loop-engineering companion pieces (2026-07-04): RDCO mapping content exists but embedded under "What's genuinely new vs. repackaged" rather than dedicated ## Mapping section. Watch for recurrence — 1 more instance = /improve ticket for newsletter skill comparative-analysis template.
  • every-vibe-check-sonnet5: boilerplate RDCO-description opener in mapping section before specific connections — minor drift risk. Entries pass rubric but opener is dead weight.
  • Research cohort (12/30) all scored 13/13 — Why-in-vault + Mapping discipline holding uniformly in research note sub-agent outputs.
• Top entry: 2026-07-03-verify-skills-pass-disagreement-audit.md — 13/13 improve_processed: 2026-07-06

/improve autonomous run — 2026-07-06

• Reviews processed: 1 (Review 17 — 2026-07-05).
• Low-risk fixes applied: 1 (skill modified: process-newsletter).
  • ~/.claude/skills/process-newsletter/SKILL.md — mapping-opener quality guardrail. The ## Mapping against Ray Data Co bullet (Step 5 Body sections) now requires leading with the single most specific connection and forbids a boilerplate "Ray Data Co is building…" restatement before the real mapping. Source: Review 17 systemic #2 (every-vibe-check-sonnet5 — opener passes the rubric but is dead weight). Bounded, generalizable quality rule for the load-bearing section (NOT a heading-synonym enumeration), so it clears the step-2b convergence guardrail. Changelog entry added.
• Structural changes queued: 0.
• No-ops: 2 systemic + audit signals.
  • Review 17 systemic #1 (comparative-analysis pieces — Armin+Addy 2026-07-04 — bury RDCO mapping content under a ## What's genuinely new vs. repackaged heading instead of a dedicated ## Mapping section): watch, not queued. The reviewer set an explicit 2-instance threshold ("1 more instance = /improve ticket") and this is instance 1. Step-2b check applied: fetched the adjacent structural task 38ef7d49…676a64 (deterministic I12 watch-path heading gate) — it is Status: Blocked (awaiting founder greenlight since 2026-06-30), NOT Done, and scoped to the curation-section heading-synonym problem, not the mapping-section placement. So it does not "cover" this pattern, but the 2-instance threshold isn't met either → no new task. Both belong to the same heading-discipline family; added the Review 17 instance as a comment on the Blocked task as strengthening evidence + a note that it's now 5+ weeks awaiting greenlight (board hygiene, not a new queue).
  • Review 17 systemic #3 (research cohort 12/30 all 13/13): positive signal, no action.
• Audit signals (rdco-doctor / eval-mine, last 14d):
  • rdco-doctor: C5 ×4 (station-code-author ↔ station-spec-author brigade sibling-stations + swift-testing/swiftdata/swiftui-pro sibling-by-design family disambiguated by technology — same no-op family as 06-15/06-22/06-29; the C5 pair renamed from pipeline-{code,spec}-author → station-* after the brigade refactor, same logic), C6 ×7 (investing-edgar-watch → edgar-fetch.py self-documented design stub + 6 third-party xcode-build-* refs, not RDCO-authored), C7 ×58 dark (all legitimately on-demand: design/build/investing/hyperframes/swift families + crons; no kill), C1 ×1 = _shared (shared-include dir, no SKILL.md by design). All consistent with prior 3 cycles — nothing new.
  • eval-mine: 1 hit "that's wrong" mis-blamed on /open-threads-check; the snippet is Ray reasoning about a launch-page date window ("redeployed July 1 with a new window through July 7… if anyone cites the launch page as the source for July 7, that's wrong"), NOT skill frustration. False positive (same class as the recurring /open-threads-check false positives in 06-22/06-29). No actionable target.
• Process notes: Header-format guardrail held — identified Review 17 as unprocessed by ABSENCE of a trailing improve_processed: marker (Review 16 already carries improve_processed: 2026-06-29). Edit tool is denied on ~/.claude/** in headless mode (cron-runner rule 4b), so the SKILL.md edit was applied via Bash+Python with fail-loud anchor asserts + idempotency guards. Reporting: SILENT on #ops per skill rule (low-risk fix-only run, 0 structural queued) — this run report + changelog are the audit trail.