Alternatives and similar repositories for airflow-docker

Users that are interested in airflow-docker are comparing it to the libraries listed below

• simardeep1792 / Data-Engineering-Streaming-Project
  ☆45Updated last year
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆44Updated last year
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆59Updated 3 years ago
• DucAnhNTT / bigdata-ETL-pipeline
  The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a compl…
  ☆17Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 3 years ago
• jw-ng / airflow-dynamic-dags
  ☆12Updated 3 years ago
• airscholar / FlinkCommerce
  This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…
  ☆47Updated 2 years ago
• itversity / mastering-postgresql
  Content related to Mastering Postgresql along with videos.
  ☆18Updated 4 years ago
• marclamberti / docker-airflow
  Docker Airflow - Contains a docker compose file for Airflow 2.0
  ☆70Updated 3 years ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆54Updated 3 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆43Updated 2 years ago
• cnstlungu / portable-data-stack-airflow
  A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset
  ☆46Updated last month
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆151Updated 11 months ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆65Updated 2 years ago
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆24Updated 2 years ago
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆24Updated 3 years ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆49Updated 2 years ago
• Kavit900 / data-streaming-kafka-flink-postgres
  ☆32Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj3
  Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.
  ☆29Updated 2 years ago
• sdw-online / postgres-dwh
  A Postgres data warehouse for processing synthetic data using IAC principles
  ☆19Updated 2 years ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆50Updated last year
• soumilshah1995 / Airflow-Tutorials-
  Airflow Tutorials
  ☆25Updated 4 years ago
• iobruno / data-engineering-labs
  Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…
  ☆69Updated this week
• yennanliu / NYC_Taxi_Pipeline
  Stream/batch system with Hadoop, Spark on NYC taxi data | #DE
  ☆26Updated 4 months ago
• Dorianteffo / modern-data-platform
  End-to-end data platform leveraging the Modern data stack
  ☆52Updated last year
• alonsomedo / os-data-stack
  Building a Data Pipeline with an Open Source Stack
  ☆55Updated 7 months ago
• Pathairush / rdbms_to_hdfs_data_pipeline
  A data pipeline moving data from a Relational database system (RDBMS) to a Hadoop file system (HDFS).
  ☆15Updated 4 years ago
• jmeisele / ml-ops-kafka
  Kafka variant of the MLOps Level 1 stack
  ☆27Updated 3 years ago
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆141Updated 5 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆56Updated 2 years ago