01-projects / newsletter

sc 012 were so back

Wed Aug 02 2023 20:00:00 GMT-0400 (Eastern Daylight Time) ·newsletter ·source: https://sc.raydata.co/p/were-so-back-the-analytics-engineering ·by Mr. Ben / Ray Data Co

SC 012 — “We’re So Back” — The Analytics Engineering Angle

Summary

After a year of community stagnation, identifies five emerging capabilities signaling analytics engineering’s resurgence:

  1. The Ultimate Rubber Duck — GitHub Copilot Chat as LLM-enabled development, maintaining workflow continuity without context-switching
  2. Modular Analytics — using synthetic datasets (Faker, Factory Boy) to make analytics work portable, shareable, and portfolio-worthy
  3. dbt Unchained — Josh Wills’ dbt-duckdb adapter extending dbt beyond transformation into ingest and serve, reducing vendor dependencies
  4. BI-as-Code — Evidence.dev combining Markdown with SQL-powered charts; version control, deployment environments, and LLM integration
  5. Paved Path to Prod — MotherDuck streamlining production deployment via connection string changes (main.duckdb to md:main.duckdb)

Key Arguments

Writing Style Notes

Optimistic and energized — “We’re So Back” captures the vibe perfectly. Each capability gets a memorable label. The enthusiasm is genuine, grounded in specific tools rather than vague trends. Recommends Fundamentals of Data Engineering for its lifecycle-based framework.

Connections