Alternatives and similar repositories for data-engineering:

Users that are interested in data-engineering are comparing it to the libraries listed below

• ongxuanhong / de03-trino-dbt-spark-everything-everywhere-all-at-once
  ☆15Updated 11 months ago
• iobruno / data-engineering-zoomcamp
  Data Engineering examples for Airflow, Prefect, and Mage.ai; dbt for BigQuery, Redshift, ClickHouse, PostgreSQL; Spark/PySpark for Batch …
  ☆54Updated last week
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆131Updated last year
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 6 months ago
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆30Updated 10 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆94Updated 7 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆53Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆49Updated last week
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆174Updated 10 months ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆24Updated last year
• raashidsalih / churn-pipeline
  A custom end-to-end analytics platform for customer churn
  ☆10Updated 3 weeks ago
• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆120Updated 2 weeks ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆43Updated 5 months ago
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆61Updated 7 months ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆253Updated 6 months ago
• MikhailKuklin / data-pipeline-COVID19-monitoring
  Data pipeline for uploading, preprocessing, and visualising COVID19 data
  ☆18Updated last year
• abeltavares / real-time-data-pipeline
  📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.
  ☆31Updated last week
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆269Updated 3 months ago
• PacktPublishing / Data-Engineering-with-Google-Cloud-Platform
  Data Engineering with Google Cloud Platform, published by Packt
  ☆111Updated last year
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆205Updated this week
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆149Updated 7 months ago
• mrn-aglic / pyspark-playground
  ☆75Updated 7 months ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆58Updated last year
• mrn-aglic / spark-standalone-cluster
  This repo contains a spark standalone cluster on docker for anyone who wants to play with PySpark by submitting their applications.
  ☆28Updated last year
• coder2j / pyspark-tutorial
  PySpark Tutorial for Beginners - Practical Examples in Jupyter Notebook with Spark version 3.4.1. The tutorial covers various topics like…
  ☆93Updated last year
• Amrit-Hub / Databricks-Certified-Data-Engineer-Professional-Questions
  This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.
  ☆55Updated 5 months ago
• DataTalksClub / course-management-platform
  Django-based course management platform for Zoomcamps
  ☆57Updated last month
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆135Updated 4 years ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆62Updated 3 months ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆54Updated 5 months ago