yahwang / Awesome-Data-Engineering
π(GitBook) A curated list of awesome Data Engineering resources
β34Updated 3 weeks ago
Related projects β
Alternatives and complementary repositories for Awesome-Data-Engineering
- β79Updated last year
- λΉ λ°μ΄ν° pipeline κ΅¬μ± μμ κΈ°μ λ€μ κ΄ν coding μ€μ΅ λ° μ°κ΅¬β41Updated 4 years ago
- β28Updated 2 years ago
- λ°μ΄ν° μμ§λμ΄ κΈ°μ μ 리β15Updated 10 months ago
- Repository for Practical Data Pipeline Codeβ11Updated 2 years ago
- Gitbook Repo for Practical Data Pipelineβ25Updated 2 years ago
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)β44Updated last year
- This project shows how to serve an TF based image classification model as a web service with TFServing, Docker, and Kubernetes(GKE).β120Updated 2 years ago
- β98Updated last year
- Apache Airflow μ λ¬Έμλ₯Ό μν νν λ¦¬μΌ λ¬Έμμ λλ€.β27Updated last year
- Code repository for the O'Reilly publication "Building Machine Learning Pipelines" by Hannes Hapke & Catherine Nelsonβ20Updated 3 years ago
- Stream smartphone data with FastAPI, Kafka, QuestDB, and Docker.β25Updated last year
- Spark 곡μ λ¬Έμ νκ΅μ΄ν λ²μβ16Updated 2 years ago
- Weekly Data Engineering Newsletterβ93Updated 4 months ago
- DataOps(Data Operation), MLOps(Machine Learning Operation) Contentsβ128Updated 3 years ago
- Data engineering interviews Q&A for data community by data communityβ61Updated 4 years ago
- β10Updated 3 weeks ago
- Kafka Connect connector that reads JSON data from Apache Kafka and send JSON record to Another Kafka topic.β47Updated last year
- A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.β29Updated last year
- Dockerizing an Apache Spark Standalone Clusterβ43Updated 2 years ago
- data engineering 100 days π€ 𧲠𦾠| #DEβ37Updated last year
- Code snippets for Data Engineering Design Patterns bookβ40Updated last week
- Spark StreamingμΌλ‘ νμ¬ μ£Όκ° μ°¨νΈμ μ μ¬ν κ³Όκ±° ν¨ν΄ μ€μκ°μΌλ‘ μ°ΎκΈ°β14Updated 4 years ago
- Design/Implement stream/batch architecture on NYC taxi data | #DEβ26Updated 3 years ago
- AB Testing π related articlesβ37Updated last year
- Elastic Stack Data Pipeline κ΅¬μΆ μ€μ΅β19Updated 3 years ago
- Awesome list for datapipelineβ28Updated last year
- Projects done in the Data Engineer Nanodegree Program by Udacity.comβ94Updated last year
- λ°μ΄ν° & λΆμ κ±°λ²λμ€ μ κ³ λ₯Ό μν μμ§μ λ νΌλ°μ€λ€μ μμ§νκ³ μκ°μ λλ μ μμ΅λλ€.β75Updated last year
- λΉ μΏΌλ¦¬λ₯Ό νμ©ν λΉ λ°μ΄ν° λΆμ κ°μ μλ£β10Updated last year