Alternatives and similar repositories for Awesome-Data-Engineering

Users that are interested in Awesome-Data-Engineering are comparing it to the libraries listed below

• keon / data-engineering
  ☆83Updated 2 years ago
• mincloud1501 / BigData
  빅데이터 pipeline 구성 요소 기술들에 관한 coding 실습 및 연구
  ☆41Updated 5 years ago
• jaypark72 / bigquery_style_guide
  ☆28Updated 2 years ago
• mjs1995 / muse-data-engineer
  데이터 엔지니어 기술 정리
  ☆18Updated last year
• K9Ns / data-pipelines-with-apache-airflow
  ☆110Updated 2 years ago
• hfhoffman1144 / smartphone_sensor_stream
  Stream smartphone data with FastAPI, Kafka, QuestDB, and Docker.
  ☆26Updated last year
• san089 / Optimizing-Public-Transportation
  A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.
  ☆31Updated last year
• MLOpsKR / Awesome-MLOps-Contents
  DataOps(Data Operation), MLOps(Machine Learning Operation) Contents
  ☆131Updated 4 years ago
• KennethanCeyer / awesome-data-pipeline
  Awesome list for datapipeline
  ☆34Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆63Updated 5 years ago
• psyoblade / data-engineer-advanced-training
  data engineer advanced training course
  ☆9Updated 2 months ago
• keeyong / beginner-spark-programming-with-pyspark
  ☆14Updated 8 months ago
• dhkdn9192 / data_engineer_career
  DE직무에 필요한 모든 것
  ☆202Updated 2 months ago
• 1ambda / practical-data-pipeline
  Gitbook Repo for Practical Data Pipeline
  ☆25Updated 3 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆132Updated 4 months ago
• kakao / kafka-sink-connector
  Kafka Connect connector that reads JSON data from Apache Kafka and send JSON record to Another Kafka topic.
  ☆51Updated last year
• spark-korea / docs
  Spark 공식 문서 한국어판 번역
  ☆16Updated 3 years ago
• kakao / kafka-connect-web
  Web tool for operating kafka connect https://hub.docker.com/r/officialkakao/kafka-connect-web
  ☆115Updated last year
• SourabhSinghRana / real-time_crypto_data_pipeline_using_kafka
  I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…
  ☆29Updated 2 years ago
• playinpap / awesome-data-and-analytics-governance
  데이터 & 분석 거버넌스 제고를 위한 양질의 레퍼런스들을 수집하고 생각을 나눌 수 있습니다.
  ☆73Updated 2 years ago
• deep-diver / ml-deployment-k8s-tfserving
  This project shows how to serve an TF based image classification model as a web service with TFServing, Docker, and Kubernetes(GKE).
  ☆125Updated 2 years ago
• astronomer / webinar-dag-writing-best-practices
  ☆48Updated 3 years ago
• synabreu / awskrusergroup
  AWS SageMaker를 이용한 MLOps와 LLMOps
  ☆32Updated last year
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆137Updated 5 years ago
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆59Updated last year
• abhishek-ch / snowflakeGPT
  A Snowflake GPT Demo using SqlAlchemy
  ☆23Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆41Updated last year
• chulminkw / fastapi_pguide
  ☆19Updated 9 months ago
• mahmoudparsian / data-algorithms-with-spark
  O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
  ☆216Updated 2 years ago