Alternatives and similar repositories for awesome-data-pipeline

Users that are interested in awesome-data-pipeline are comparing it to the libraries listed below

• kelvins / awesome-dataops
  A curated list of awesome DataOps tools
  ☆211Updated 5 months ago
• datacoon / awesome-dataops
  Awesome list of dataops products, open source and resources
  ☆24Updated 3 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆57Updated 4 years ago
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆139Updated 5 years ago
• ColinEberhardt / awesome-public-streaming-datasets
  A list of free datasets that provide streaming data
  ☆426Updated last year
• zsvoboda / ngods
  New generation opensource data stack
  ☆76Updated 3 years ago
• sspaeti / data-engineer-handbook
  This is a repo with links to everything you'd ever want to learn about data engineering
  ☆10Updated last year
• pracdata / awesome-open-source-data-engineering
  A curated list of open source tools used in analytics platforms and data engineering ecosystem
  ☆406Updated 9 months ago
• mikeroyal / Apache-Spark-Guide
  Apache Spark Guide
  ☆33Updated 3 years ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 3 years ago
• natbusa / data-engineering
  How to build an awesome data engineering team
  ☆100Updated 6 years ago
• mikeroyal / Apache-Airflow-Guide
  Apache Airflow Guide
  ☆31Updated last year
• awesome-mlops / awesome-data-management
  A curated list of awesome open source tools and commercial products to catalog, version, and manage data 🚀
  ☆38Updated 3 years ago
• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆28Updated 3 years ago
• san089 / Optimizing-Public-Transportation
  A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.
  ☆32Updated 2 years ago
• garystafford / aws-airflow-demo
  Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…
  ☆41Updated 3 years ago
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆44Updated last year
• carterchene / flink-streaming-demo
  This is a demo streaming project simulating a music streaming service.
  ☆34Updated last year
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆30Updated this week
• Wittline / data-engineer-challenge
  Challenge Data Engineer
  ☆25Updated 3 years ago
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆91Updated 2 years ago
• AltimateAI / awesome-data-contracts
  A curated list of awesome blogs, videos, tools and resources about Data Contracts
  ☆180Updated last year
• aws / amazon-mwaa-docker-images
  ☆75Updated 2 weeks ago
• opendatadiscovery / awesome-data-catalogs
  📙 Awesome Data Catalogs and Observability Platforms.
  ☆952Updated 3 months ago
• feluelle / airflow-diagrams
  Auto-generated Diagrams from Airflow DAGs. 🔮 🪄
  ☆354Updated this week
• viirya / eventsim
  Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.
  ☆91Updated last year
• karenbajador / pyspark_greatexpectations
  ☆12Updated 3 years ago
• airbytehq / glossary
  Data Glossary 🧠: An interactive digital garden for deeper data exploration. Learn through a graph and backlinks, enabling layered knowle…
  ☆113Updated 2 years ago
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆124Updated last month
• pyxelr / recommendations-for-engineers
  All of my recommendations for aspiring engineers in a single place, coming from various areas of interest.
  ☆158Updated 3 weeks ago