Alternatives and similar repositories for data-engineering

Users that are interested in data-engineering are comparing it to the libraries listed below

• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆143Updated 11 months ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆294Updated 9 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆204Updated last year
• longbuivan / dotfile
  My Setup Development Environment as Data Engineer
  ☆32Updated 4 months ago
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆350Updated 2 months ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆165Updated 3 months ago
• trannhatnguyen2 / NYC_Taxi_Data_Pipeline
  Nyc_Taxi_Data_Pipeline - DE Project
  ☆130Updated last year
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆75Updated 2 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆47Updated last year
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆280Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 3 years ago
• ongxuanhong / de03-trino-dbt-spark-everything-everywhere-all-at-once
  ☆16Updated last year
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆125Updated last month
• iobruno / data-engineering-examples
  Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…
  ☆68Updated last month
• surfalytics / data-projects
  Surfalytics projces on Data Engineering and Analytics
  ☆114Updated 2 weeks ago
• mrn-aglic / pyspark-playground
  ☆92Updated 10 months ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆73Updated 3 months ago
• josephmachado / docker_for_data_engineers
  Code for blog at: https://www.startdataengineering.com/post/docker-for-de/
  ☆40Updated last year
• airscholar / SparkingFlow
  This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…
  ☆46Updated last year
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆225Updated 7 months ago
• ongxuanhong / de02-pyspark-optimization
  ☆14Updated 2 years ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆60Updated last year
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆107Updated 8 months ago
• nenalukic / free-datasets-APIs
  ☆146Updated last year
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆49Updated last year
• Amrit-Hub / Databricks-Certified-Data-Engineer-Professional-Questions
  This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.
  ☆125Updated last year
• dlt-hub / dlthub-education
  In this repository we store all materials for dlt workshops, courses, etc.
  ☆245Updated last week
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆79Updated this week
• dagster-io / project-dagster-university
  Dagster University courses
  ☆117Updated this week