Alternatives and similar repositories for data-engineering

Users that are interested in data-engineering are comparing it to the libraries listed below

• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆75Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆296Updated last week
• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆144Updated 11 months ago
• iobruno / data-engineering-examples
  Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…
  ☆68Updated last month
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆353Updated 2 months ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆281Updated last year
• mrn-aglic / pyspark-playground
  ☆92Updated 10 months ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆165Updated 3 months ago
• longbuivan / dotfile
  My Setup Development Environment as Data Engineer
  ☆33Updated 4 months ago
• pracdata / awesome-open-source-data-engineering
  A curated list of open source tools used in analytics platforms and data engineering ecosystem
  ☆412Updated 9 months ago
• ssp-data / practical-data-engineering
  Practical Data Engineering: A Hands-On Real-Estate Project Guide
  ☆730Updated last year
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆204Updated last year
• thanhENC / e2e-data-platform
  End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…
  ☆47Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 3 years ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆80Updated this week
• surfalytics / data-projects
  Surfalytics projces on Data Engineering and Analytics
  ☆114Updated 3 weeks ago
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆125Updated last month
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆262Updated 2 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆47Updated last year
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆107Updated 9 months ago
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆225Updated 7 months ago
• DataTalksClub / course-management-platform
  Django-based course management platform for Zoomcamps
  ☆76Updated last week
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆73Updated 3 months ago
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆92Updated last year
• cartershanklin / pyspark-cheatsheet
  PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
  ☆483Updated last year
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆143Updated 2 years ago
• ongxuanhong / de02-pyspark-optimization
  ☆14Updated 2 years ago
• EcZachly / microbatch-hourly-deduped-tutorial
  ☆120Updated 5 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆235Updated last year