🧙 Build, run, and manage data pipelines for integrating and transforming data.

Compare tables within or across databases

Scalable and efficient data transformation framework - backwards compatible with dbt.

⚡ Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io

dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning models.

A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!

🎣 List of `pre-commit` hooks to ensure the quality of your `dbt` projects.

Provides automated YAML management and a streamlit workbench. Designed to optimize dev workflows.

dbt + Metabase integration

Code review for data in dbt

sqlfmt formats your dbt SQL files so you don't have to

dbt package that is part of Elementary, the dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

Apache Airflow integration for dbt

Example DAGs using hooks and operators from Airflow Plugins

The Clickhouse plugin for dbt (data build tool)

🎨 UI for the Free Data Engineering Zoomcamp Course provided by DataTalksClub

⚽️ Extract, prepare and publish Transfermarkt datasets.