Alternatives and similar repositories for data-engineering

Users that are interested in data-engineering are comparing it to the libraries listed below

• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆143Updated 8 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆103Updated last year
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆151Updated 5 months ago
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆336Updated 3 months ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆159Updated 2 months ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆197Updated last year
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated last year
• thanhENC / e2e-data-platform
  End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…
  ☆44Updated 10 months ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆274Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 2 years ago
• iobruno / data-engineering-examples
  Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…
  ☆66Updated 2 months ago
• surfalytics / data-projects
  Surfalytics projces on Data Engineering and Analytics
  ☆111Updated this week
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆74Updated 2 years ago
• DataTalksClub / course-management-platform
  Django-based course management platform for Zoomcamps
  ☆68Updated 3 weeks ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆72Updated last year
• EcZachly / microbatch-hourly-deduped-tutorial
  ☆119Updated last month
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆148Updated last year
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆58Updated last year
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆102Updated 5 months ago
• dlt-hub / dlthub-education
  In this repository we store all materials for dlt workshops, courses, etc.
  ☆221Updated last week
• mrn-aglic / pyspark-playground
  ☆90Updated 7 months ago
• ongxuanhong / de03-trino-dbt-spark-everything-everywhere-all-at-once
  ☆17Updated last year
• akarce / e2e-structured-streaming
  End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to schedule scripts that fetch data from an API…
  ☆20Updated last year
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆83Updated 3 months ago
• dagster-io / project-dagster-university
  Dagster University courses
  ☆109Updated last week
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆261Updated 2 years ago
• coder2j / airflow-docker
  Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)
  ☆315Updated last year
• raashidsalih / churn-pipeline
  A custom end-to-end analytics platform for customer churn
  ☆12Updated 3 months ago
• le-oasis / docker-airflow-spark
  Building a Modern Data Lake with Minio, Spark, Airflow via Docker.
  ☆21Updated last year
• ssp-data / practical-data-engineering
  Practical Data Engineering: A Hands-On Real-Estate Project Guide
  ☆692Updated last year