A comprehensive collection of Data Engineering System Design concepts, architectures, best practices, and interview-ready designs using AWS, Azure, Spark, Databricks, Airflow, Kafka, SQL, and Python.
☆20Jul 18, 2026Updated 3 months ago
Alternatives and similar repositories for data-engineering-system-design
Users that are interested in data-engineering-system-design are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Data Engineer Roadmap 2026. This repository collects the best 100% FREE video tutorials and documentation to help you master data enginee…☆24Dec 23, 2025Updated 10 months ago
- End to End Data Engineering Projects☆15May 13, 2024Updated 2 years ago
- Online-adaptive multi-agent framework for enterprise API orchestration. Adaptive circuit breakers, SLA-driven routing, hybrid LLM+rule in…☆126Sep 20, 2026Updated last month
- Data Engineering Bootcamp☆38Sep 19, 2026Updated last month
- PipeRider dbt workshop for DataTalksClub DE Zoomcamp☆18Nov 30, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Challenge Data Engineer☆25Jun 13, 2022Updated 4 years ago
- Learn Leetcode from Zero. Categorized tutorial, Practical Skills, Recommended Problems☆10Jun 14, 2023Updated 3 years ago
- ☆14Updated this week
- Green Tunnel Alternative for JVM Languages☆19Updated this week
- Repositorio de ejemplo para consumir las distintas API's de Portal de API Mercantil.☆20Mar 21, 2025Updated last year
- Collection and Roadmap for everyone who wants DevSecOps, contains list of tools and methodologies☆18Jul 3, 2022Updated 4 years ago
- ☆16Oct 26, 2026Updated 2 weeks ago
- A design for TinyTapeout☆18Sep 23, 2022Updated 4 years ago
- An open-source project that uses cutting-edge NLP models and real-time web search to provide dynamic voice query responses. Features incl…☆20May 24, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Repository of different Data sets for Machine Learning and Data Science Algorithms☆22Sep 17, 2025Updated last year
- Compressão de embeddings RAG: Uniform → Lloyd-Max → TurboQuantMSE → TurboQuantProd. Mede impacto no retrieval (Recall@k, MRR) com 4× a 16…☆11Apr 14, 2026Updated 7 months ago
- My Study Collection data science courses, Article etc.☆30Sep 26, 2019Updated 7 years ago
- Preparing for system design interview questions☆18Nov 2, 2017Updated 9 years ago
- A benchmark-agnostic framework for automatically optimizing LLM agent harnesses☆14Aug 31, 2026Updated 2 months ago
- ☆18Oct 19, 2026Updated 3 weeks ago
- PantheonSim: GPU simulator for CUDA and ROCm. Run CUDA and HIP programs unmodified on a CPU, no GPU needed: simulated NVIDIA and AMD GPUs…☆34Updated this week
- Code for DE101 book at https://de101.startdataengineering.com/☆137Feb 22, 2026Updated 8 months ago
- AgentOps Accelerator is an open source framework and CLI for adding continuous evaluation and observability to enterprise AI agents. It s…☆17Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Leetcode python solutions and notes by Zhengyuan Zhu☆20Apr 9, 2026Updated 7 months ago
- How modern AI systems get built — curriculum, knowledge map, and reading guides☆18Sep 8, 2026Updated 2 months ago
- set of scripts for crawling newspaper websites.☆31Dec 8, 2022Updated 3 years ago
- Open-source Android companion for competitive programming: contest reminders, coding profiles and daily practice☆18Updated this week
- cpu inference for ternary neural nets. no deps. just c++ and simd.☆23Oct 18, 2026Updated 3 weeks ago
- How to fix Netflix Error 15001 on Magisk rooted Phones☆20Oct 20, 2026Updated 3 weeks ago
- ai_offline_wellbeing_chatbot☆19Apr 11, 2026Updated 7 months ago
- ☆10May 3, 2024Updated 2 years ago
- Workshop for learning how to use TanStack AI to build fully AI enhanced web apps!☆12Oct 22, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Automatically monitor the GitHub AI Trends project☆18Oct 30, 2026Updated 2 weeks ago
- Claude agent for Deep AI Research☆32Dec 9, 2025Updated 11 months ago
- Code repository of Udemy course on Amazon Bedrock AgentCore☆12Oct 18, 2026Updated 3 weeks ago
- Android work profile isolation - fork of Shelter☆33Jul 30, 2026Updated 3 months ago
- This repository contains all the problems that I've solved as part of the Scaler Academy curriculum.☆13Oct 5, 2024Updated 2 years ago
- adaptive database query systems that fix their own mistakes and optimize performance automatically using Stanford's Agentic Context Engin…☆14Oct 17, 2025Updated last year
- A practice repo for Tool School: GitHub 101 - learn GitHub from scratch with an AI coding agent as your instructor.☆17May 6, 2026Updated 6 months ago
Are these results useful?