100+ data engineering projects from scratch — streaming, CDC, table formats, query engines, consensus, governance. 2,500+ tests, mypy strict.
☆55Jun 12, 2026Updated 3 months ago
Alternatives and similar repositories for data-engineering
Users that are interested in data-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Dec 28, 2020Updated 5 years ago
- ☆17Dec 12, 2024Updated last year
- ChronosTrade is an enterprise-grade quantitative trading and analytics platform. Engineered for high performance, it delivers a unified p…☆19Jun 9, 2026Updated 3 months ago
- The result of Vietnam's high school graduation exam 2018☆10Jul 22, 2018Updated 8 years ago
- Đồ án tốt nghiệp | Data Lakehouse☆48Feb 9, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An end-to-end, containerized data pipeline for near-real-time user event analytics using Kafka, ClickHouse, Airflow, and PySpark. Made to…☆80Sep 12, 2025Updated last year
- Dockerized analytics pipeline where Airflow moves mock-API data into Postgres, runs dbt transformations, and serves clean tables for Powe…☆84Oct 18, 2025Updated 10 months ago
- 🤖 CI/CD pipeline tutorial using GitHub Actions — covering automated build, test, and deployment workflows for modern web applications.☆111Apr 8, 2026Updated 5 months ago
- Path finding model using the A-star algorithm in Netlogo☆16Nov 15, 2019Updated 6 years ago
- End-to-end real-time analytics pipeline with Kafka, Spark micro-batch/Spark Streaming/Flink, ClickHouse, and live dashboards.☆19Mar 2, 2026Updated 6 months ago
- A modern full-stack boilerplate with authentication, built with NestJS and Next.js. A modern Next.js frontend boilerplate with authentica…☆21Jan 29, 2026Updated 7 months ago
- A full-featured CRM with zero cloud costs and complete privacy. Demo: https://realtimex-crm.vercel.app☆15Feb 19, 2026Updated 6 months ago
- Patterns and concepts for building resilient data pipelines in Python and Scala☆16Aug 27, 2024Updated 2 years ago
- Model zoo (in Netlogo) for Spatial Simulation: Exploring Pattern and Process☆16Sep 23, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🔍 Search Engine from scratch — full-text search, indexing, ranking & real-world patterns using Elasticsearch / Typesense for backend dev…☆17Apr 9, 2026Updated 5 months ago
- ☆17Oct 25, 2018Updated 7 years ago
- Chat Quality Agent - Agent phân tích chất lượng CSKH bằng AI☆295Mar 30, 2026Updated 5 months ago
- ☆11Sep 20, 2024Updated last year
- Personal research notes and experiments on agentic coding, autonomous agents, and AI-driven software development.☆15Apr 3, 2026Updated 5 months ago
- Within this Repository there are a collection of end of semester projects created by students from various classes I have given over the …☆17May 26, 2021Updated 5 years ago
- ☆26Jan 31, 2023Updated 3 years ago
- A curated list of awesome Databricks resources, including Spark☆22Jun 28, 2024Updated 2 years ago
- A demo of the Mito Streamlit Spreadsheet☆18Aug 3, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Jan 5, 2023Updated 3 years ago
- 🐋 A structured, hands-on curriculum for mastering Docker in real-world production environments — from fundamentals to full CI/CD automa…☆287May 14, 2026Updated 3 months ago
- Some outlook.live.com modules☆12Aug 15, 2021Updated 5 years ago
- Tutorials for Python in Vietnamese☆291Nov 8, 2025Updated 10 months ago
- Auto download Facebook Emoji☆13Nov 2, 2020Updated 5 years ago
- mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local☆28Apr 8, 2026Updated 5 months ago
- This multi-agent template is support Vietnam stock☆25Jun 21, 2026Updated 2 months ago
- A NetLogo simulation of crowd evacuation from a hypothetical fire emergency at The Float @ Marina Bay, Singapore.☆22Apr 15, 2019Updated 7 years ago
- ☆59Feb 1, 2026Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A high-performance, distributed in-memory cache library for Go that synchronizes local LFU/LRU caches across multiple service instances u…☆67Aug 16, 2026Updated 3 weeks ago
- ☆218Feb 19, 2026Updated 6 months ago
- A simple Python/Mesa model of COVID-19 contagion and possible measures☆31Aug 14, 2023Updated 3 years ago
- Teach your AI to draw correct, beautiful draw.io diagrams — declarative layout engine, ground-truth stencils, structural validator, visio…☆640Updated this week
- Sentiment analysis with Vietnamese reviews from Shopee online market☆15Nov 21, 2022Updated 3 years ago
- 🥪🦘 An open source sandbox project exploring dbt workflows via a fictional sandwich shop's data.☆356Aug 28, 2026Updated 2 weeks ago
- Agent Based Fire Evacuation Model built using Project Mesa☆41Mar 6, 2023Updated 3 years ago