System Design, Solution Architecture, Data Systems Practice
☆84Aug 14, 2025Updated last year
Alternatives and similar repositories for data-systems-design
Users that are interested in data-systems-design are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- adidas Data Mesh implementation☆12May 13, 2022Updated 4 years ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆25Apr 27, 2023Updated 3 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Aug 20, 2026Updated last week
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆118Jan 8, 2026Updated 7 months ago
- More than 2000+ Data engineer interview questions.☆1,721Jan 13, 2026Updated 7 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Clickstream Faker Provider for Python.☆11Apr 2, 2022Updated 4 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆13May 25, 2023Updated 3 years ago
- Computational Experiment Scheduling System (for Machine Learning) using Google Spreadsheets as a dashboard.☆17Apr 17, 2020Updated 6 years ago
- Data Structures and Algos☆18Apr 8, 2023Updated 3 years ago
- My personal page, CV and blog☆14May 8, 2026Updated 3 months ago
- Streaming analytics project with eventsim and Kafka☆13Dec 23, 2022Updated 3 years ago
- A template for building pytorch projects and packages including an optional REST API☆16Aug 17, 2019Updated 7 years ago
- Data Engineer with Python lecture notes from #datacamp.☆53May 21, 2021Updated 5 years ago
- Here lies all the pieces of portfolio projects and documents that I have been harvesting throughout the journey of learning Data Analysis…☆11Nov 22, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Sep 23, 2023Updated 2 years ago
- ☆14Dec 10, 2024Updated last year
- A custom AWS credential provider that allows your Hadoop or Spark application access S3 file system by assuming a role☆10Jan 9, 2026Updated 7 months ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 3 years ago
- Data engineering interview prep - PySpark notebooks, theory docs, quizzes, and company-specific patterns. Built around Zephyr Coffee Co.,…☆84Jul 7, 2026Updated last month
- The DBT package to support Snowflake Semantic View as a new materialization.☆72Aug 11, 2026Updated 2 weeks ago
- Pet project for deliverypipeline test with Cloud CI + Ansible + AWS Elastic Beanstalk + Docker☆15Mar 22, 2015Updated 11 years ago
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆17Mar 14, 2024Updated 2 years ago
- Analytics Engineer Course☆20May 17, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A handy package to load Google Sheets to your database right from the CLI and with easy configuration via YAML files.☆15Aug 17, 2026Updated last week
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆25Nov 19, 2024Updated last year
- 🟣 Apache Spark interview questions and answers to help you prepare for your next machine learning and data science interview in 2026.☆40Jan 4, 2026Updated 7 months ago
- Code snippets used in demos recorded for the blog.☆42Apr 30, 2026Updated 4 months ago
- Репозиторий курса "Modern Storages and Data Warehousing", ПИ, НИУ ВШЭ, 2024☆15Apr 13, 2025Updated last year
- A data pipeline with Kafka, Spark Streaming, dbt, Docker, Airflow, and GCP!☆12Jul 6, 2023Updated 3 years ago
- An easy way to figure out dependencies between cells in excel on python☆16Nov 11, 2024Updated last year
- Library to convert DBT manifest metadata to Airflow tasks☆50Dec 23, 2025Updated 8 months ago
- Python wrapper for lsm1 extension for sqlite4☆15Feb 27, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake☆350Jun 27, 2025Updated last year
- Demonstration of using Files in Repos with Databricks Delta Live Tables☆36Jul 9, 2024Updated 2 years ago
- ☆25Aug 14, 2026Updated 2 weeks ago
- ☆37Feb 22, 2026Updated 6 months ago
- ☆16Jun 30, 2026Updated 2 months ago
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 3 years ago
- This is the code repository for the code in "Object-Orientation, Abstraction, and Data Structures Using Scala".☆25Feb 11, 2018Updated 8 years ago