Alternatives and similar repositories for awesome-data-pipeline

Users that are interested in awesome-data-pipeline are comparing it to the libraries listed below

• mikeroyal / Apache-Spark-Guide
  Apache Spark Guide
  ☆31Updated 3 years ago
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆28Updated last week
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆53Updated 4 years ago
• karenbajador / pyspark_greatexpectations
  ☆12Updated 3 years ago
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆137Updated 5 years ago
• datacoon / awesome-dataops
  Awesome list of dataops products, open source and resources
  ☆24Updated 3 years ago
• awesome-mlops / awesome-data-management
  A curated list of awesome open source tools and commercial products to catalog, version, and manage data 🚀
  ☆33Updated 3 years ago
• dlt-hub / dlt-dagster-demo
  dlt-dagster-demo
  ☆11Updated last year
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆58Updated last year
• Stefen-Taime / modern-data-pipeline
  reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
  ☆14Updated 2 years ago
• kelvins / awesome-dataops
  A curated list of awesome DataOps tools
  ☆190Updated 8 months ago
• manuzhang / awesome-lakehouse
  a curated list of awesome lakehouse frameworks, applications, etc
  ☆32Updated 4 months ago
• danielbeach / DataEngineeringProjects
  Some example projects for Data Engineers to build, end-to-end.
  ☆30Updated last year
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆84Updated 2 years ago
• victorcouste / data-tools
  Data Tools Subjective List
  ☆83Updated last year
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆35Updated last year
• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆28Updated 2 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆77Updated 2 years ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆69Updated 3 years ago
• ssp-data / awesome-dagster
  A curated list of dagster code snippets for data engineers
  ☆55Updated last year
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆178Updated 3 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆102Updated last year
• chen1649chenli / dataOpsResource
  Awesome List for Data Operations
  ☆24Updated 4 years ago
• 1997mahadi / dbt-dlt-ingestion-pipeline
  ☆18Updated 10 months ago
• dacort / modern-data-lake-storage-layers
  Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work
  ☆47Updated 2 years ago
• chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCP
  This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. Ther…
  ☆24Updated this week
• lelouvincx / goodreads-elt-pipeline
  This project implements an ELT (Extract - Load - Transform) data pipeline with the goodreads dataset, using dagster (orchestration), spar…
  ☆35Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆41Updated 11 months ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆119Updated 3 months ago
• databand-ai / awesome-apache-airflow
  Curated list of resources about Apache Airflow
  ☆19Updated 4 years ago