Alternatives and similar repositories for data-engineering

Users that are interested in data-engineering are comparing it to the libraries listed below

• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆275Updated 8 months ago
• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆143Updated 11 months ago
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆347Updated last month
• iobruno / data-engineering-examples
  Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…
  ☆68Updated 2 weeks ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆75Updated 2 years ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆200Updated last year
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆165Updated 2 months ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆281Updated last year
• mrn-aglic / pyspark-playground
  ☆92Updated 9 months ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆262Updated 2 years ago
• surfalytics / data-projects
  Surfalytics projces on Data Engineering and Analytics
  ☆114Updated last month
• longbuivan / dotfile
  My Setup Development Environment as Data Engineer
  ☆31Updated 3 months ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆106Updated 8 months ago
• dlt-hub / dlthub-education
  In this repository we store all materials for dlt workshops, courses, etc.
  ☆238Updated this week
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆47Updated last year
• ssp-data / practical-data-engineering
  Practical Data Engineering: A Hands-On Real-Estate Project Guide
  ☆719Updated last year
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆92Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 3 years ago
• trannhatnguyen2 / NYC_Taxi_Data_Pipeline
  Nyc_Taxi_Data_Pipeline - DE Project
  ☆129Updated last year
• nenalukic / free-datasets-APIs
  ☆145Updated last year
• DataTalksClub / course-management-platform
  Django-based course management platform for Zoomcamps
  ☆77Updated this week
• pracdata / awesome-open-source-data-engineering
  A curated list of open source tools used in analytics platforms and data engineering ecosystem
  ☆400Updated 8 months ago
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆223Updated 7 months ago
• josephmachado / sde_de101_josephmachado
  Sample repo for startdataengineering DE 101 free course
  ☆71Updated last year
• mage-ai / mage-zoomcamp
  This repository will contain all of the resources for the Mage component of the Data Engineering Zoomcamp: https://github.com/DataTalksCl…
  ☆101Updated last year
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆77Updated last week
• le-oasis / docker-airflow-spark
  Building a Modern Data Lake with Minio, Spark, Airflow via Docker.
  ☆22Updated last year
• raashidsalih / churn-pipeline
  A custom end-to-end analytics platform for customer churn
  ☆11Updated 6 months ago
• tylerwmarrs / data-engineering-project-doc-templates
  This is project documentation templates derived from CRISP-DM to be used for Data Engineering projects.
  ☆58Updated 4 years ago