Alternatives and similar repositories for Awesome-Data-Engineering

Users that are interested in Awesome-Data-Engineering are comparing it to the libraries listed below

• KennethanCeyer / awesome-data-pipeline
  Awesome list for datapipeline
  ☆35Updated 2 years ago
• keon / data-engineering
  ☆83Updated 2 years ago
• jaypark72 / bigquery_style_guide
  ☆28Updated 3 years ago
• mjs1995 / muse-data-engineer
  데이터 엔지니어 기술 정리
  ☆18Updated last year
• mincloud1501 / BigData
  빅데이터 pipeline 구성 요소 기술들에 관한 coding 실습 및 연구
  ☆41Updated 5 years ago
• hfhoffman1144 / smartphone_sensor_stream
  Stream smartphone data with FastAPI, Kafka, QuestDB, and Docker.
  ☆26Updated 2 years ago
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆61Updated 2 years ago
• K9Ns / data-pipelines-with-apache-airflow
  ☆114Updated 2 years ago
• san089 / Optimizing-Public-Transportation
  A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.
  ☆31Updated 2 years ago
• kelvins / awesome-dataops
  A curated list of awesome DataOps tools
  ☆204Updated 2 months ago
• astronomer / webinar-dag-writing-best-practices
  ☆48Updated 3 years ago
• MLOpsKR / Awesome-MLOps-Contents
  DataOps(Data Operation), MLOps(Machine Learning Operation) Contents
  ☆131Updated 4 years ago
• sspaeti / data-engineer-handbook
  This is a repo with links to everything you'd ever want to learn about data engineering
  ☆10Updated 10 months ago
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆64Updated 5 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆207Updated 6 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆44Updated last year
• deep-diver / ml-deployment-k8s-tfserving
  This project shows how to serve an TF based image classification model as a web service with TFServing, Docker, and Kubernetes(GKE).
  ☆125Updated 3 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆152Updated 7 months ago
• keeyong / beginner-spark-programming-with-pyspark
  ☆14Updated 11 months ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆63Updated 2 years ago
• PacktPublishing / Apache-Airflow-Best-Practices
  Apache Airflow Best Practices, published by Packt
  ☆49Updated 11 months ago
• 1ambda / practical-data-pipeline
  Gitbook Repo for Practical Data Pipeline
  ☆25Updated 3 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• datastacktv / apache-beam-batch-processing
  Public source code for the Batch Processing with Apache Beam (Python) online course
  ☆18Updated 5 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆56Updated 4 years ago
• MBKraus / incremental_training
  Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'
  ☆121Updated 2 years ago
• Aiven-Labs / python-fake-data-producer-for-apache-kafka
  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …
  ☆85Updated last year
• abhishek-ch / snowflakeGPT
  A Snowflake GPT Demo using SqlAlchemy
  ☆23Updated 2 years ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆88Updated 4 years ago