System Design, Solution Architecture, Data Systems Practice
☆73Aug 14, 2025Updated 8 months ago
Alternatives and similar repositories for data-systems-design
Users that are interested in data-systems-design are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- adidas Data Mesh implementation☆12May 13, 2022Updated 3 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Apr 26, 2026Updated last week
- Support for multiple broker hosts and basic "failover" on the client side.☆23Feb 20, 2013Updated 13 years ago
- Collection of Python utility scripts & OOP basic demo | #SE☆14Jan 8, 2025Updated last year
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆14Apr 15, 2026Updated 2 weeks ago
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated 8 months ago
- Try and measure tokio task overhead☆11Dec 20, 2021Updated 4 years ago
- Data Engineer with Python lecture notes from #datacamp.☆51May 21, 2021Updated 4 years ago
- Clickstream Faker Provider for Python.☆11Apr 2, 2022Updated 4 years ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 2 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆12May 25, 2023Updated 2 years ago
- Clusterless is a tool for scheduling decentralized, scalable, and secure data pipelines for continuously arriving data, across clouds.☆15Dec 22, 2025Updated 4 months ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆111Jan 8, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Incan: a modern, Pythonic language that compiles to Rust! Type-safe, async-friendly, with fixtures, testing, and web/inter-op built in.☆16Updated this week
- ☆12Apr 17, 2024Updated 2 years ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 2 years ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10May 12, 2023Updated 2 years ago
- Analytics Engineer Course☆20May 17, 2023Updated 2 years ago
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 2 years ago
- A data pipeline with Kafka, Spark Streaming, dbt, Docker, Airflow, and GCP!☆12Jul 6, 2023Updated 2 years ago
- Python wrapper for lsm1 extension for sqlite4☆15Feb 27, 2025Updated last year
- capstone project for Dataengineer.io bootcamp Public Repo☆12Feb 20, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- End-to-end ELT data engineering project☆23Dec 24, 2022Updated 3 years ago
- ☆22Jan 22, 2018Updated 8 years ago
- Pet project for deliverypipeline test with Cloud CI + Ansible + AWS Elastic Beanstalk + Docker☆15Mar 22, 2015Updated 11 years ago
- This repository will provde code to build end-to-end IAC code to build an intelligent GenAI chatbot based on Amazon Bedrock☆12Jun 13, 2025Updated 10 months ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Aug 12, 2025Updated 8 months ago
- Realtime Thermal Solar Plant Dataset for Machine Learning☆11Jan 20, 2021Updated 5 years ago
- 🟣 Apache Spark interview questions and answers to help you prepare for your next machine learning and data science interview in 2026.☆35Jan 4, 2026Updated 4 months ago
- 基于pomelo/nodejs的go重写☆12Aug 14, 2015Updated 10 years ago
- Spark SQL Macros provides a mechanism similar to Spark User-Defined function registration; with the key enhancement being that custom cod…☆16Mar 17, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code files for Mastering JBoss Drools 6, published by Packt☆11Sep 12, 2023Updated 2 years ago
- A dbt package with a POC implementation of an interface to query activity streams that adhere to the Activity Schema 2.0 spec.☆16Jan 6, 2026Updated 3 months ago
- The DBT package to support Snowflake Semantic View as a new materialization.☆63Nov 6, 2025Updated 5 months ago
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆23Nov 19, 2024Updated last year
- Celery Task Routing☆19Dec 20, 2023Updated 2 years ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆24Apr 27, 2023Updated 3 years ago
- Efficient streaming data ingestion, transformation & activation☆28May 1, 2023Updated 3 years ago