yranjan06 / mini_kafkaLinks
A from scratch Python implementation of Apache Kafka concepts including producers, brokers, topics, consumers, and offset management, built to learn distributed messaging without external dependencies.
☆23Updated 4 months ago
Alternatives and similar repositories for mini_kafka
Users that are interested in mini_kafka are comparing it to the libraries listed below
Sorting:
- Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake☆245Updated 5 months ago
- Code for "Efficient Data Processing in Spark" Course☆350Updated 2 months ago
- The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.☆257Updated 4 years ago
- In this repository we store all materials for dlt workshops, courses, etc.☆245Updated last week
- ☆169Updated 3 months ago
- Dagster University courses☆117Updated this week
- Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.☆140Updated 5 years ago
- Run your dbt Core or dbt Fusion projects as Apache Airflow DAGs and Task Groups with a few lines of code☆1,106Updated this week
- A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.☆251Updated last year
- Project utilising data from the Age of Empires api at 'https://aoestats.io'☆54Updated last year
- Slow & local data allows you to move fast and deliver business value for the 99.9% of the data challenges.☆337Updated 2 months ago
- ☆10Updated 2 years ago
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆377Updated 7 months ago
- Streaming analytics project with eventsim and Kafka☆12Updated 2 years ago
- A dbt package for modelling dbt metadata. https://brooklyn-data.github.io/dbt_artifacts☆376Updated 5 months ago
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆123Updated 8 months ago
- Snowflake Connector for Python☆701Updated this week
- Snowflake Snowpark Python API☆320Updated last week
- ☆18Updated 3 weeks ago
- Local Environment to Practice Data Engineering☆143Updated 11 months ago
- PySpark test helper methods with beautiful error messages☆739Updated 2 weeks ago
- Port(ish) of Great Expectations to dbt test macros☆1,205Updated last year
- A dbt package from SELECT to help you monitor Snowflake performance and costs☆251Updated last month
- The next-generation engine for dbt☆583Updated last week
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆225Updated 7 months ago
- dbt + Metabase integration☆562Updated 3 weeks ago
- A Database Change Management tool for Snowflake☆615Updated 3 weeks ago
- A lightweight Python-based tool for extracting and analyzing data column lineage for dbt projects☆193Updated 8 months ago
- Template for Data Engineering and Data Pipeline projects☆115Updated 2 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆257Updated last week