Alternatives and similar repositories for airflow-docker:

Users that are interested in airflow-docker are comparing it to the libraries listed below

• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆45Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj3
  Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.
  ☆28Updated last year
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆29Updated 4 years ago
• jw-ng / airflow-dynamic-dags
  ☆13Updated 2 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆47Updated 3 years ago
• Pathairush / rdbms_to_hdfs_data_pipeline
  A data pipeline moving data from a Relational database system (RDBMS) to a Hadoop file system (HDFS).
  ☆15Updated 3 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆35Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• Wittline / data-engineer-challenge
  Challenge Data Engineer
  ☆25Updated 2 years ago
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆26Updated 3 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆62Updated last year
• Wittline / pyspark-on-aws-emr
  The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…
  ☆26Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 6 months ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆41Updated last year
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆57Updated 2 years ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆33Updated 2 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆53Updated 2 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆45Updated last year
• jaumpedro214 / ml-streming-kafka-cdc
  Deploying a Machine Learning model streaming application with Apache Kafka
  ☆10Updated 2 years ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆154Updated last year
• jacobceles / intro-to-colab-pyspark-emr
  A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …
  ☆20Updated 3 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆39Updated last year
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆21Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆24Updated last year
• laudio / airflow-etl-mssql-sample
  Airflow ETL MS SQL Sample Project
  ☆24Updated 6 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• guoliveira / data-engineer-zoomcamp-project
  ☆37Updated last year