System Design, Solution Architecture, Data Systems Practice
☆85Aug 14, 2025Updated last year
Alternatives and similar repositories for data-systems-design
Users that are interested in data-systems-design are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- adidas Data Mesh implementation☆12May 13, 2022Updated 4 years ago
- Lecture Notes for DSML Jun22 Beginner's Intermediate module☆13Oct 14, 2022Updated 3 years ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆26Apr 27, 2023Updated 3 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Updated this week
- ☆18Feb 1, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆120Jan 8, 2026Updated 9 months ago
- More than 2000+ Data engineer interview questions.☆1,788Jan 13, 2026Updated 9 months ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated last year
- Contains spark dataframe solutions of leetcode questions☆24Dec 13, 2022Updated 3 years ago
- Full-stack OpenTelemetry observability for Apache Spark☆20Updated this week
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆14May 25, 2023Updated 3 years ago
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆14Oct 6, 2026Updated last week
- My personal page, CV and blog☆14May 8, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Streaming analytics project with eventsim and Kafka☆14Dec 23, 2022Updated 3 years ago
- Data Engineer with Python lecture notes from #datacamp.☆54May 21, 2021Updated 5 years ago
- Here lies all the pieces of portfolio projects and documents that I have been harvesting throughout the journey of learning Data Analysis…☆11Nov 22, 2023Updated 2 years ago
- ☆13Sep 23, 2023Updated 3 years ago
- A custom AWS credential provider that allows your Hadoop or Spark application access S3 file system by assuming a role☆10Jan 9, 2026Updated 9 months ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 3 years ago
- Data engineering interview prep - PySpark notebooks, theory docs, quizzes, and company-specific patterns. Built around Zephyr Coffee Co.,…☆88Jul 7, 2026Updated 3 months ago
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆17Mar 14, 2024Updated 2 years ago
- Analytics Engineer Course☆20May 17, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A handy package to load Google Sheets to your database right from the CLI and with easy configuration via YAML files.☆15Oct 5, 2026Updated last week
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆25Nov 19, 2024Updated last year
- 🟣 Apache Spark interview questions and answers to help you prepare for your next machine learning and data science interview in 2026.☆40Jan 4, 2026Updated 9 months ago
- ☆12Apr 17, 2024Updated 2 years ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10May 12, 2023Updated 3 years ago
- https://www.distributedpython.com/2018/05/01/unit-testing-celery-tasks☆13Jun 26, 2018Updated 8 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- Library to convert DBT manifest metadata to Airflow tasks☆51Dec 23, 2025Updated 9 months ago
- capstone project for Dataengineer.io bootcamp Public Repo☆12Feb 20, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Python wrapper for lsm1 extension for sqlite4☆15Feb 27, 2025Updated last year
- Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake☆356Jun 27, 2025Updated last year
- preparation guide for aws big data / data analytics – specialty exam☆17Nov 23, 2020Updated 5 years ago
- ☆30Aug 14, 2026Updated last month
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 3 years ago
- This is the code repository for the code in "Object-Orientation, Abstraction, and Data Structures Using Scala".☆25Feb 11, 2018Updated 8 years ago
- ☆17Feb 17, 2024Updated 2 years ago