Discover · getbruin.com

No picture published by getbruin.com

How to Test Data Pipelines in CI/CD

Bruin Data Blog getbruin.com

The four kinds of tests a data pipeline needs in CI/CD, cheapest first: validation, unit tests on mocked rows, data quality checks in a dev environment, and a data diff against production. What each one catches, when to run it, and how to set it up with Bruin, dbt, Great Expectations, Soda and GitHub Actions.

More ways to use this
Open on another device
Scan this QR code to open the same public page

Scan to open this page. Your saved notes and account access are not included.

Download QR code

Open the page link

Names and references

  1. Test — person

Keep going

Each of these is read from what this estate already kept: the feed a piece came through, the publisher behind it, the credits and topics the publisher printed. None of it is a recommendation, an identity or a record kept anywhere else.

Also from Bruin Data Blog

  1. Launching Bruin Cloud Streams: database CDC without KafkaKateryna Kozachenko getbruin.com
  2. How to enable Postgres logical replication for CDC (2026)Kateryna Kozachenko getbruin.com
  3. How to stop CDC from filling your Postgres disk with WALKateryna Kozachenko getbruin.com
  4. How to Get Automatic Data Lineage Across PipelinesKateryna Kozachenko getbruin.com
  5. How to Enforce Data Contracts in a PipelineKateryna Kozachenko getbruin.com
  6. How to Set Up a Modern Data Warehouse QuicklyKateryna Kozachenko getbruin.com