DEDP Book Ingestion Plan

Source: Patterns of Data Engineering by the DEDP author. Book is published incrementally — not all chapters are live yet. Current inventory: 20 content chapters across 2 parts (Part 3 not yet published).

Full Table of Contents

Front Matter

Part 1 — Foundations (History, State, and Design Pattern Concepts)

Chapter 1: Introduction to Data Engineering

Chapter 2: Overview of DEDP

Part 2 — Mastering the Patterns

Chapter 4: Convergent Evolution Examples

Chapter 5: Data Engineering Patterns (DEP)

Chapter 6: Data Engineering Design Patterns (DEDP)

Appendix

Not ingested (utility pages)

• Login, Signup, Subscription pages — no content value.

Suggested Processing Order

Priority based on relevance to active projects (phData consulting, data marketplace, newsletter content).

Batch 1 — Highest priority (architecture & modeling patterns) ✅ Complete (2026-04-04)

Direct fuel for phData consulting engagements and newsletter thought pieces.

1. ✅ 4.4 — DWH, MDM, Data Lake, Reverse ETL, CDP → 06-reference/2026-04-04-dedp-dwh-mdm-datalake-reverse-etl-cdp
2. ✅ 4.5 — Materialized View vs. OBT vs. dbt Table vs. OLAP Cube vs. DWA → 06-reference/2026-04-04-dedp-mv-obt-dbt-olap-dwa
3. ✅ 4.6 — Semantic Layer, BI, Modern OLAP, Data Virtualization → 06-reference/2026-04-04-dedp-semantic-layer-bi-olap-virtualization
4. ✅ 5.3 — Data-Asset Reusability Pattern → 06-reference/2026-04-04-dedp-data-asset-reusability-pattern

Batch 2 — Design patterns and evolution examples ✅ Complete (2026-04-04)

Core pattern thinking that differentiates our consulting and newsletter POV.

1. ✅ 6.1 — Data Engineering Design Patterns (Intro) → 06-reference/2026-04-04-dedp-design-patterns-intro
2. ✅ 6.2 — Dynamic Query Design Pattern → 06-reference/2026-04-04-dedp-dynamic-queries
3. ✅ 4.2 — Bash vs. Stored Proc vs. ETL vs. Python → 06-reference/2026-04-04-dedp-etl-tool-comparisons
4. ✅ 4.3 — Data Contracts, Schema Evolution, NoSQL → 06-reference/2026-04-04-dedp-data-contracts-schema-evolution
5. ✅ 5.2 — Cache Pattern → 06-reference/2026-04-04-dedp-cache-pattern

Batch 3 — Foundations and frameworks ✅ Complete (2026-04-04)

Important for grounding but less immediately actionable.

1. ✅ 2.1 — Intro to DEDP → 06-reference/2026-04-04-dedp-intro-dedp
2. ✅ 2.2 — Understanding Convergent Evolution → 06-reference/2026-04-04-dedp-convergent-evolution
3. ✅ 4.1 — Convergent Evolution and its Patterns (Intro) → 06-reference/2026-04-04-dedp-ce-intro
4. ✅ 5.1 — Data Engineering Patterns (Intro) → 06-reference/2026-04-04-dedp-dep-intro
5. ✅ 5.4 — DE Workspace Packaging Pattern → 06-reference/2026-04-04-dedp-de-workspace-packaging

Batch 4 — History, context, and front matter ✅ Complete (2026-04-04)

Background context; ingest last.

1. ✅ FM-1 — About This Book → 06-reference/2026-04-04-dedp-about-this-book
2. ✅ FM-2 — Introduction → 06-reference/2026-04-04-dedp-introduction
3. ✅ FM-3 — Terminologies → 06-reference/2026-04-04-dedp-terminologies
4. ✅ 1.1 — Intro to the Field of Data Engineering → 06-reference/2026-04-04-dedp-intro-data-engineering
5. ✅ 1.2 — History and State of Data Engineering → 06-reference/2026-04-04-dedp-history-state-de
6. ✅ 1.3 — Challenges in Data Engineering → 06-reference/2026-04-04-dedp-challenges-de

Batch 5 — Appendix (optional)

Only if useful for attribution or context.

1. A-1 — Changelog
2. A-2 — Author

Batch Summary

Notes

• Book is a living document — Part 3 (real-world applications, open data architectures) is not yet published. Re-inventory when new chapters drop.
• Chapter 3 appears to be skipped in the URL structure (jumps from Part 1 Ch 2 to Part 2 Ch 4) — may be unpublished or restructured.
• Monitor the changelog for new content.