An Engineering Guide to Data Quality - A Data Contract Perspective - Part 2

An Engineering Guide to Data Quality - A Data Contract Perspective - Part 2

Metadata

• Author: Ananth Packkildurai
• Full Title: An Engineering Guide to Data Quality - A Data Contract Perspective - Part 2 An Engineering Guide to Data Quality - A Data Contract Perspective - Part 2
• Category: #articles
• Summary: By Ananth Packkildurai
• URL: https://open.substack.com/pub/dataengineeringweekly/p/an-engineering-guide-to-data-quality?r=1ppi38&utm_medium=ios&utm_campaign=post

Highlights

• • he Write phase writes the data into a staging environment. • The Audit step then kicks in, which runs through all the data contract checks. • If the Audit step succeeds, the data in the staging environment gets copied to the production. The staging environment then gets cleaned up as part of the pipeline or as a scheduled clean-up job. (View Highlight)