08-tooling

anthropic skill guide vs brigade comparison

2026-06-30·reference·status: active
skillsagent-brigadeskill-dev-pipelineanthropiccomparisoncaf

Anthropic's "Complete Guide to Building Skills" vs. our Agent Brigade

Founder shared Anthropic's The Complete Guide to Building Skills for Claude (33pp, last modified 2026-01-26) and asked how it compares to our brigade framing, especially the skill-building brigade. This is that comparison.

TL;DR — they're at different altitudes, and they slot together

Anthropic's guide is how to author one good skill. Our brigade is how to manufacture vetted skills at scale. The guide is a spec-for-the-artifact plus a lightweight, mostly-manual authoring process. The brigade is an automated, quality-gated production line that bakes the guide's rules into its spec + critic stations and then adds the three things the guide explicitly does not have: automated lift measurement, a kill (86) decision, and scale (orchestration + fleet + rail + nesting).

The sharpest tell: the guide is candid that its evaluation story is immature — it admits measurement is "vibes-based assessment," and states twice that skill-creator "does not execute automated test suites or produce quantitative evaluation results." That is precisely the gap our execution-eval station was built to fill. We built the thing they said they haven't.

Reframe: Anthropic uses the kitchen analogy too — but only at the runtime layer ("MCP is the professional kitchen, skills are the recipes"). We took the kitchen-brigade to the production layer. The two uses of "kitchen" are complementary. Our brigade is the missing production half of their picture.

What each one is

Anthropic guide Our brigade
Altitude author one skill manufacture many, gated
Process manual, Claude-assisted (skill-creator drafts; you iterate) automated stations + an expo convergence loop + fleet fan-out
Unit a SKILL.md folder a ticket on the rail (order → markup → build record)
Eval three test areas, "aim for rigor, accept vibes" static critics (fast inner loop) + execution-eval A/B ablation (lift over base, regression gate)
Decision (assumes you've decided to build it) kill (86) if lift ≈ 0 — evidence-gated existence
Scale single skill; Ch4 = distribution fleet over a backlog; the rail; the brigade-builds-brigades nesting

Where we AGREE (validation — we independently landed on their model)

Where the BRIGADE goes beyond the guide

  1. Automated measurement (the headline). They admit eval is vibes-based and skill-creator doesn't produce quantitative results. Our execution-eval station: N-sample A/B with lift ± stddev, per-fixture lift attribution, and regression baselines persisted to the rail. Our own refinement — two kinds of lift (judgment vs convention), distinguished by the tier curve — is sharper than even their performance-comparison sketch.
  2. The kill (86) decision. The guide assumes the skill is worth building. We make that evidence-gated: lift ≈ 0 → 86 the ticket. This is the anti-slop mechanism the guide has no concept of.
  3. Blind test authoring. Their testing is author-driven (you write your own cases). Our test station is blind to the implementation — the author can't grade its own homework.
  4. The expo + convergence loop. Their "iterative refinement" is a pattern you hand-write into a skill. Our orchestrator is an external control loop with explicit routing (advance / refire-to-author / reroute-to-spec / escalate), a max_rounds budget, and phase state. The guide has nothing at this layer.
  5. Fleet + rail. Manufacturing across a whole departmental grid (Andrew's ~60-skill grid). The guide is single-skill; Ch4 is distribution, not a production queue.
  6. Russian-doll nesting. The skill-dev brigade builds other brigades (the factory). No analog in the guide.
  7. Type taxonomy drives eval. Their "three use-case categories" drive technique choice; our 5-type taxonomy drives the fixture shape and eval harness (computational → synthetic known-answers, etc.). Tighter coupling.

Where the GUIDE is sharper — things to ADOPT

(The honest half. These are real, and cheap to fold in.)

Synthesis — they compose, they don't compete

The guide is the spec for a good skill + the lightweight manual path. The brigade is the automated production system that:

  1. bakes the guide's rules into its spec + critic stations (adopt Reference A as lint),
  2. adds the three things the guide lacks (automated lift, the kill decision, scale), and
  3. uses the guide's distribution chapter as the productization blueprint.

The guide validates our biggest bet (lift-over-baseline) and admits it hasn't automated it — so the brigade reads as the guide's natural extension into manufacturing, not a competing philosophy.

Concrete next actions (when the brigade work un-parks behind cert):

Related