TJaniF / airflow-kafka-quickstartLinks
A self-contained, ready to run Airflow and Kafka project. Can be run locally or within codespaces.
☆18Updated 2 years ago
Alternatives and similar repositories for airflow-kafka-quickstart
Users that are interested in airflow-kafka-quickstart are comparing it to the libraries listed below
Sorting:
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆74Updated last year
- End to end data engineering project☆57Updated 2 years ago
- Delta Lake examples☆226Updated 9 months ago
- Code snippets for Data Engineering Design Patterns book☆128Updated 3 months ago
- Stream processing with Azure Databricks☆140Updated 7 months ago
- ☆134Updated 5 months ago
- Project for "Data pipeline design patterns" blog.☆45Updated 11 months ago
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆38Updated last year
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆33Updated last year
- Notebooks to learn Databricks Lakehouse Platform☆32Updated 2 weeks ago
- Spark data pipeline that processes movie ratings data.☆29Updated 2 weeks ago
- ☆41Updated 3 years ago
- Unit testing using databricks connect☆31Updated 3 years ago
- Course notes for the Astronomer Certification DAG Authoring for Apache Airflow☆53Updated last year
- Sample project to demonstrate data engineering best practices☆194Updated last year
- ☆184Updated 4 years ago
- Apache Airflow Best Practices, published by Packt☆43Updated 8 months ago
- The resources of the preparation course for Databricks Data Engineer Professional certification exam☆124Updated 3 weeks ago
- Docker with Airflow and Spark standalone cluster☆261Updated last year
- Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution☆69Updated 4 years ago
- Companion repository that goes along with Snowflake's "Introduction to Modern Data Engineering with Snowflake" course on Coursera☆65Updated 4 months ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆42Updated last year
- The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…☆255Updated 2 weeks ago
- Materials of the Official Helm Chart Webinar☆27Updated 4 years ago
- ☆28Updated last year
- Code for dbt tutorial☆156Updated last month
- ☆39Updated 2 years ago
- DBSQL SME Repo contains demos, tutorials, blog code, advanced production helper functions and more!☆66Updated 3 months ago
- This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…☆44Updated last year
- Azure Databricks Cookbook, Published by Packt☆60Updated 2 years ago