06-reference

data engineering central modern cdp manifesto

2026-10-14·reference·source: Data Engineering Central·by Daniel Beach
customer-data-platformagentic-dataidentity-resolutiondata-governancemcpdata-contracts

"The Modern CDP Manifesto" — Daniel Beach, Data Engineering Central (Oct 14 2026)

Why this is in the vault

Opening essay of a new sponsored series (partnered with Rudderstack) defining what a Customer Data Platform is and arguing it must become "code-based," machine-readable, and agent-boundaried rather than UI-driven — a direct, named statement of the data-infrastructure preconditions an agent needs before it can safely touch customer data.

The core argument

⚠️ Sponsorship

sponsored: true, sponsor_entity: Rudderstack. Pattern break from this sender's established sponsor: Data Engineering Central's confirmed standing sponsor is Delta Lake (logged across 9+ prior issues per the project README), but this issue carries no Delta Lake mention at all. Instead it opens a new sponsored series explicitly "in partnership with [[Rudderstack, Snowplow and Open-Source CDP Alternatives to Segment — Rittman Analytics|Rudderstack]]" (a CDP vendor) and closes with "Thanks to Rudderstack for partnering with Data Engineering Central!" Bias implication is direct and structural, not incidental: this is the first installment of a multi-month CDP series bankrolled by a CDP vendor, so the entire thesis — that CDPs are essential, must modernize, and must become the agent interface — has a built-in commercial incentive to argue for buying/building more CDP infrastructure rather than questioning whether a lighter-weight approach (e.g., an agent reading warehouse tables directly with good contracts) could substitute. Treat the series' framing as vendor-aligned by default going forward, not just this issue.

Mapping against Ray Data Co

Medium-strong: Beach's seven tenets are effectively a checklist for RDCO's agent-deployer thesis applied to a specific data domain (customer data) — "code-based interfaces, machine-readable infrastructure, deterministic identity resolution, explicit agentic boundaries" is the same demand RDCO makes of any system before deploying an agent against it in production. The "explicit agentic boundaries" and "agents must be able to take action, not just chat" points directly reinforce [[2026-08-10-data-engineering-central-quasi-agentic-pipelines-databricks-airflow]]'s field-report finding that non-deterministic agent steps need hard scaffolding bolted onto deterministic pipelines, not a wholesale new platform. It also extends [[2026-06-24-data-engineering-central-semantic-layers-agents]]'s argument that agents need a stable semantic/contract layer to query against — Beach here names customer identity resolution specifically as the piece of that contract layer that doesn't get solved by a better foundation model. Gap exposed: this is a vendor-sponsored opening manifesto with no architecture diagram or working system yet (explicitly "part history lesson, part speculation") — worth tracking the series for whether later installments deliver concrete, non-vendor-captured patterns RDCO could reuse, versus staying at the level of principle.

Related