How to Test Data Pipelines in CI/CD
getbruin.com
This is what was read here when it was published. Kateryna Kozachenko no longer carries it in what it publishes now.
Listen to this summary
The four kinds of tests a data pipeline needs in CI/CD, cheapest first: validation, unit tests on mocked rows, data quality checks in a dev environment, and a data diff against production. What each one catches, when to run it, and how to set it up with Bruin, dbt, Great Expectations, Soda and GitHub Actions.
More ways to use this
Open on another device
Scan to open this page. Your saved notes and account access are not included.