TJaniF / airflow-kafka-quickstart

Related projects ⓘ

Alternatives and complementary repositories for airflow-kafka-quickstart

• josephmachado / online_store
  End to end data engineering project
  ☆51Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆40Updated last week
• marclamberti / webinar-airflow-chart
  Materials of the Official Helm Chart Webinar
  ☆27Updated 3 years ago
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆21Updated 2 years ago
• yTek01 / docker-spark-airflow
  ☆32Updated last year
• delta-io / delta-examples
  Delta Lake examples
  ☆208Updated last month
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆58Updated last year
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 5 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆38Updated 4 months ago
• tj--- / iceberg-demo
  A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino
  ☆16Updated 2 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆28Updated 8 months ago
• astronomer / airflow-provider-kafka
  A provider package for kafka
  ☆37Updated last year
• PacktPublishing / Data-Engineering-with-Apache-Spark-Delta-Lake-and-Lakehouse
  Data Engineering with Spark and Delta Lake
  ☆89Updated last year
• apache / spark-docker
  Official Dockerfile for Apache Spark
  ☆107Updated 3 weeks ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆32Updated 4 years ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆62Updated last month
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆21Updated 5 months ago
• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆39Updated 3 years ago
• sarahmk125 / airflow-docker-metrics
  ☆43Updated 2 years ago
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆92Updated this week
• itversity / data-engineering-spark
  ☆86Updated 2 years ago
• marclamberti / airflow-materials-aws
  Materials for the next course
  ☆22Updated last year
• astronomer / airflow-testing-guide
  ☆20Updated 3 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆44Updated 2 years ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆29Updated 3 weeks ago
• PacktPublishing / Apache-Airflow-Best-Practices
  Apache Airflow Best Practices, published by Packt
  ☆20Updated 2 weeks ago
• garystafford / streaming-sales-generator
  Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python
  ☆44Updated last year