System Design, Solution Architecture, Data Systems Practice
☆82Aug 14, 2025Updated 11 months ago
Alternatives and similar repositories for data-systems-design
Users that are interested in data-systems-design are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- adidas Data Mesh implementation☆12May 13, 2022Updated 4 years ago
- Lecture Notes for DSML Jun22 Beginner's Intermediate module☆11Oct 14, 2022Updated 3 years ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆25Apr 27, 2023Updated 3 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Jul 17, 2026Updated 3 weeks ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆118Jan 8, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- More than 2000+ Data engineer interview questions.☆1,705Jan 13, 2026Updated 6 months ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 2 years ago
- Clickstream Faker Provider for Python.☆11Apr 2, 2022Updated 4 years ago
- Contains spark dataframe solutions of leetcode questions☆24Dec 13, 2022Updated 3 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆50Dec 2, 2023Updated 2 years ago
- 170+ curated resources every Databricks Data Engineer should bookmark - tools, courses, creators, labs, and communities☆42Jul 13, 2026Updated 3 weeks ago
- Data Structures and Algos☆17Apr 8, 2023Updated 3 years ago
- My personal page, CV and blog☆14May 8, 2026Updated 3 months ago
- Streaming analytics project with eventsim and Kafka☆13Dec 23, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- End-to-end Azure DE project with Australia Health Expenditure dataset. Services used include Azure Data Factory, DataBricks, Data Lake, K…☆13Feb 25, 2024Updated 2 years ago
- Try and measure tokio task overhead☆11Dec 20, 2021Updated 4 years ago
- Data Engineer with Python lecture notes from #datacamp.☆53May 21, 2021Updated 5 years ago
- Here lies all the pieces of portfolio projects and documents that I have been harvesting throughout the journey of learning Data Analysis…☆11Nov 22, 2023Updated 2 years ago
- Clusterless is a tool for scheduling decentralized, scalable, and secure data pipelines for continuously arriving data, across clouds.☆15Dec 22, 2025Updated 7 months ago
- ☆14Dec 10, 2024Updated last year
- A custom AWS credential provider that allows your Hadoop or Spark application access S3 file system by assuming a role☆10Jan 9, 2026Updated 7 months ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 2 years ago
- Data engineering interview prep - PySpark notebooks, theory docs, quizzes, and company-specific patterns. Built around Zephyr Coffee Co.,…☆74Jul 7, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The DBT package to support Snowflake Semantic View as a new materialization.☆71Jul 22, 2026Updated 2 weeks ago
- Pet project for deliverypipeline test with Cloud CI + Ansible + AWS Elastic Beanstalk + Docker☆15Mar 22, 2015Updated 11 years ago
- Analytics Engineer Course☆20May 17, 2023Updated 3 years ago
- A handy package to load Google Sheets to your database right from the CLI and with easy configuration via YAML files.☆15Jul 13, 2026Updated 3 weeks ago
- 🟣 Apache Spark interview questions and answers to help you prepare for your next machine learning and data science interview in 2026.☆39Jan 4, 2026Updated 7 months ago
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆25Nov 19, 2024Updated last year
- ☆12Apr 17, 2024Updated 2 years ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10May 12, 2023Updated 3 years ago
- https://www.distributedpython.com/2018/05/01/unit-testing-celery-tasks☆13Jun 26, 2018Updated 8 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code snippets used in demos recorded for the blog.☆42Apr 30, 2026Updated 3 months ago
- A data pipeline with Kafka, Spark Streaming, dbt, Docker, Airflow, and GCP!☆12Jul 6, 2023Updated 3 years ago
- Library to convert DBT manifest metadata to Airflow tasks☆50Dec 23, 2025Updated 7 months ago
- capstone project for Dataengineer.io bootcamp Public Repo☆12Feb 20, 2024Updated 2 years ago
- Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake☆346Jun 27, 2025Updated last year
- Demonstration of using Files in Repos with Databricks Delta Live Tables☆36Jul 9, 2024Updated 2 years ago
- ☆16Jun 30, 2026Updated last month