Alternatives and similar repositories for airflow-docker:

Users that are interested in airflow-docker are comparing it to the libraries listed below

• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆50Updated 4 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj3
  Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.
  ☆29Updated last year
• DucAnhNTT / bigdata-ETL-pipeline
  The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a compl…
  ☆13Updated last year
• jmeisele / ml-ops-kafka
  Kafka variant of the MLOps Level 1 stack
  ☆24Updated 2 years ago
• cnstlungu / portable-data-stack-airflow
  A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset
  ☆39Updated 4 months ago
• Wittline / pyspark-on-aws-emr
  The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…
  ☆27Updated 2 years ago
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆23Updated 2 years ago
• datakickstart / databricks-notebooks
  ☆10Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• sdw-online / postgres-dwh
  A Postgres data warehouse for processing synthetic data using IAC principles
  ☆16Updated 2 years ago
• Wittline / data-engineer-challenge
  Challenge Data Engineer
  ☆25Updated 2 years ago
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆25Updated 3 years ago
• indiacloudtv / pyspark_on_google_colab
  PySpark Tutorial for Beginners on Google Colab: Hands-On Guide
  ☆16Updated 4 years ago
• alonsomedo / os-data-stack
  Building a Data Pipeline with an Open Source Stack
  ☆50Updated 9 months ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆45Updated last year
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆43Updated 5 months ago
• MBKraus / dockerized_data_science_playground
  Multi-docker container data science / engineering playground (w/ Kafka, Airflow, MLFlow, Tensorflow-Keras / SKLearn) for simulating a mic…
  ☆11Updated last year
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆74Updated 2 years ago
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆30Updated 4 years ago
• feluelle / finance-data-builder
  Finance 🏦 Data Builder 🛠️ @ postgres 🐘
  ☆21Updated 4 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆66Updated last year
• uplimit / course-dbt
  Analytics engineering with dbt - projects and developer environment
  ☆18Updated 6 months ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆65Updated 2 years ago
• kuutsav / mlops
  Template for data pipelines, ML workflows, API dev and monitoring
  ☆45Updated last year
• deliveryhero / pyconde2019-airflow-ml-workshop
  PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.
  ☆47Updated last year
• masfworld / cdc_deltaLake
  Docker compose and Google Colab demo to build a CDC with Delta Lake
  ☆15Updated 2 years ago
• Pathairush / rdbms_to_hdfs_data_pipeline
  A data pipeline moving data from a Relational database system (RDBMS) to a Hadoop file system (HDFS).
  ☆15Updated 3 years ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆51Updated 8 months ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago