my goal is to take a look at the modern data stack during three different timeframes:
Cambrian explosion I, from 2012 - 2016
Deployment, from 2016 - 2020
Cambrian explosion II, from 2020 - 2025 (View Highlight)
Data was transformed prior to loading into the data warehouse because the warehouse was too slow (and constrained) to do this heavyweight processing itself. (View Highlight)
Note: Good way to say why analytics workflows started as ETL
Overnight, all of these problems just went away. Redshift was fast, and cheap enough for everyone. This meant that the BI and ETL products who had built businesses around solving them immediately became legacy software and new vendors arose to build products more suited for the new world. Entrepreneurs saw opportunity and flocked to the space, and these products are the ones that largely define the world that we live in today. (View Highlight)
Each technology individually goes through its own “S” curve, from development to deployment, and as each round of technologies begins to mature it both attracts new customers and becomes more technologically mature. (View Highlight)
