06-reference/research

five pillars incompleteness mac

2026-06-26·research-brief·source: deep-research

The Five Pillars Tell You The Data Changed. They Can't Tell You It's Right.

The question

Sanity Check piece on why the "five pillars" (freshness/volume/schema/distribution/lineage) industry consensus is structurally incomplete — gives MAC a platform to introduce the 2D matrix framing. (Derivative of the 2026-05-11 acceptance-frameworks brief; the deliverable is the argument + evidence for an original re-frame, not a restatement of the pillars.)

What we already know (from the vault)

What the web says

Convergences and contradictions

Synthesis for RDCO

The re-frame, in one sentence: The five pillars answer "did the data change?" — a monitoring question — and the industry has quietly mistaken that for the data-quality question, which is "is the data right?" — an acceptance question the pillars are structurally unable to ask.

The piece works because the incompleteness is conceded by the category itself, not asserted by us. Monte Carlo's own materials say the pillars detect "unknown unknowns" via ML anomaly detection; Atlan's own comparison says "a pipeline can run smoothly while producing incorrect results." Freshness, volume, schema, and distribution are all the same shape of check — watch one metric over time, alarm when it deviates from a learned norm. Lineage is the map of where the alarm propagates. None of them encodes a business rule (ending_arr = starting + new + expansion - contraction - churn), reconciles to an external ledger (warehouse vs Stripe), or asks a human to look. They detect that a number moved; they are silent on whether it was supposed to. A revenue model can pass all five pillars every night — fresh, normal volume, stable schema, in-distribution — and still double-count a fan-out join into a number no human ever sanity-checked. The pillars would never flinch.

The honest framing — and the one that keeps the piece from being a strawman — is that the five pillars are an excellent monitoring taxonomy and a terrible acceptance taxonomy, and the industry has been using a monitoring taxonomy as its entire definition of data quality. That's the structural incompleteness: not that the pillars fail at their job, but that they only have one axis. They vary what surface gets watched (and even that mostly collapses to the aggregate/dataset level), but they have no axis at all for what you're checking against. Every pillar checks against the same thing — the data's own recent history. That is exactly one cell of MAC's matrix (Aggregate × Temporal), dressed up four ways.

That gap is MAC's platform. MAC's load-bearing move is adding the second axis — Basis: what are you evaluating against? Absolute (a fixed rule), Relative:Source (the upstream layer), Relative:Production (the existing report/ledger), Relative:Reconciliation (an external system), Temporal (history — this is the only basis the five pillars cover), and Human (someone who knows the business). Cross that against three Scopes (Column / Row / Aggregate) and you get 18 cells. The five pillars occupy roughly one of them. The piece should end not by claiming MAC has better checks — most individual checks exist somewhere in the vendor landscape — but by claiming MAC makes the missing axis visible, the way Kimball's bus matrix made dimensional-modeling gaps visible without inventing a single new primitive. The reader's takeaway: "I've been buying a smoke detector and calling it a building inspection."

Arc for the issue: (1) open with the failure mode — the model that passes all five pillars and is still wrong; (2) name the quiet category error — observability ("did it change?") masquerading as quality ("is it right?"), citing the vendors' own words; (3) introduce the missing axis (Basis) and the 18-cell matrix as the fix; (4) land on the four cells a learned baseline can never produce (the three reconciliations + Human) as proof the gap is structural, not incremental. Avoid the strawman by explicitly granting that the pillars are great at what they do — the indictment is what the market did with them.

Open follow-ups

Related

Sources

Vault:

Web: