Alternatives and similar repositories for awesome-data-engineering:

Users that are interested in awesome-data-engineering are comparing it to the libraries listed below

• astronomer / airflow-guides
  Guides and docs to help you get up and running with Apache Airflow.
  ☆804Updated 2 years ago
• gtoonstra / etl-with-airflow
  ETL best practices with airflow, with examples
  ☆1,313Updated 3 months ago
• danielvdende / data-testing-with-airflow
  ☆196Updated last year
• astronomer / astronomer
  Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes
  ☆467Updated this week
• airflow-plugins / Example-Airflow-DAGs
  Example DAGs using hooks and operators from Airflow Plugins
  ☆334Updated 6 years ago
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆256Updated 2 years ago
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆205Updated 10 months ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆648Updated this week
• astronomer / dag-factory
  Dynamically generate Apache Airflow DAGs from YAML configuration files
  ☆1,231Updated this week
• gocardless / airflow-dbt
  Apache Airflow integration for dbt
  ☆400Updated 8 months ago
• GoogleCloudDataproc / spark-bigquery-connector
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
  ☆381Updated 3 weeks ago
• hgrif / airflow-tutorial
  Airflow basics tutorial
  ☆398Updated 3 years ago
• teamclairvoyant / airflow-maintenance-dags
  A series of DAGs/Workflows to help maintain the operation of Airflow
  ☆1,697Updated 7 months ago
• dbt-labs / corp
  Assets related to the operation of Fishtown Analytics.
  ☆419Updated 2 months ago
• soggycactus / airflow-repo-template
  The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.
  ☆242Updated 3 years ago
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆657Updated last month
• amundsen-io / amundsenfrontendlibrary
  Front-end service library for Amundsen
  ☆280Updated 7 months ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆261Updated last year
• ericxiao251 / spark-syntax
  This is a repo documenting the best practices in PySpark.
  ☆462Updated 2 years ago
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆66Updated 4 years ago
• mrpowers-io / spark-daria
  Essential Spark extensions and helper methods ✨😲
  ☆753Updated 2 months ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆104Updated 6 years ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆195Updated last month
• ekampf / PySpark-Boilerplate
  A boilerplate for writing PySpark Jobs
  ☆395Updated 11 months ago
• awesome-spark / spark-gotchas
  Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks
  ☆363Updated 7 years ago
• teamclairvoyant / airflow-rest-api-plugin
  A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
  ☆325Updated 4 years ago
• mumoshu / kube-airflow
  A docker image and kubernetes config files to run Airflow on Kubernetes
  ☆655Updated 5 years ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆257Updated 3 months ago
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆585Updated 11 months ago