Alternatives and similar repositories for awesome-data-engineering

Users that are interested in awesome-data-engineering are comparing it to the libraries listed below

• danielvdende / data-testing-with-airflow
  ☆201Updated 2 years ago
• gtoonstra / etl-with-airflow
  ETL best practices with airflow, with examples
  ☆1,353Updated last year
• airflow-plugins / Example-Airflow-DAGs
  Example DAGs using hooks and operators from Airflow Plugins
  ☆348Updated 7 years ago
• gocardless / airflow-dbt
  Apache Airflow integration for dbt
  ☆411Updated last year
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆261Updated 3 years ago
• Interana / eventsim
  Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.
  ☆534Updated 2 weeks ago
• dbt-labs / corp
  Assets related to the operation of Fishtown Analytics.
  ☆419Updated last year
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆168Updated 2 years ago
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆682Updated 11 months ago
• hgrif / airflow-tutorial
  Airflow basics tutorial
  ☆397Updated 4 years ago
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆204Updated last year
• soggycactus / airflow-repo-template
  The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.
  ☆258Updated 4 years ago
• astronomer / astronomer
  Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes
  ☆488Updated last week
• astronomer / dag-factory
  Construct Apache Airflow DAGs Declaratively via YAML configuration files
  ☆1,415Updated this week
• dbt-labs / dbt-spark
  This repository has moved into https://github.com/dbt-labs/dbt-adapters
  ☆443Updated 6 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆271Updated last year
• ekampf / PySpark-Boilerplate
  A boilerplate for writing PySpark Jobs
  ☆395Updated 2 years ago
• GoogleCloudDataproc / spark-bigquery-connector
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
  ☆420Updated last week
• teamclairvoyant / airflow-maintenance-dags
  A series of DAGs/Workflows to help maintain the operation of Airflow
  ☆1,766Updated last year
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆752Updated 3 weeks ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 7 years ago
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆64Updated 5 years ago
• erika-e / dbt-tips
  Collection of dbt Tips and Tricks
  ☆399Updated 3 years ago
• dbt-labs / redshift
  Redshift package for dbt (getdbt.com)
  ☆102Updated last year
• teamclairvoyant / airflow-rest-api-plugin
  A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
  ☆326Updated 5 years ago
• great-expectations / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆170Updated 2 weeks ago
• awslabs / python-deequ
  Python API for Deequ
  ☆810Updated 3 weeks ago
• stumelius / howtheydbt
  A curated collection of publicly available resources on dbt best practices and how data-driven organizations around the world utilize dbt
  ☆115Updated 3 years ago
• mumoshu / kube-airflow
  A docker image and kubernetes config files to run Airflow on Kubernetes
  ☆655Updated 6 years ago
• airflow-plugins / redshift_plugin
  ☆22Updated 5 years ago