Alternatives and similar repositories for prod-airflow:

Users that are interested in prod-airflow are comparing it to the libraries listed below

• mjhea0 / flask-spark-docker
  Just a boilerplate for PySpark and Flask
  ☆35Updated 6 years ago
• vergili / bigdata_tutorial
  ☆16Updated 7 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 7 years ago
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆36Updated 6 years ago
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• ds-muzalevskiy / sagemaker-docker-deploy
  ☆18Updated 3 years ago
• karenbajador / pyspark_greatexpectations
  ☆11Updated 2 years ago
• FavioVazquez / ds-optimus
  How to do data science with Optimus, Spark and Python.
  ☆19Updated 5 years ago
• criteo / mlflow-elasticsearchstore
  ElasticSearch implementation of MlFlow tracking store
  ☆18Updated 4 years ago
• benjigoldberg / udacity-airflow
  Udacity Data Pipeline Exercises
  ☆15Updated 4 years ago
• osin-vladimir / architect_big_data_solutions_with_spark
  code, labs and lectures for the course
  ☆46Updated last year
• idealo / terraform-emr-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR using Terraform
  ☆47Updated last month
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• masfworld / cdc_deltaLake
  Docker compose and Google Colab demo to build a CDC with Delta Lake
  ☆15Updated 2 years ago
• shlin168 / airflow-event-plugins
  event-triggered plugins for airflow
  ☆21Updated 5 years ago
• NYUBigDataProject / SparkClean
  A Scalable Data Cleaning Library for PySpark.
  ☆26Updated 5 years ago
• saturncloud / saturn-cloud-examples
  ☆19Updated 3 years ago
• dominodatalab / domino-research
  Projects developed by Domino's R&D team
  ☆76Updated 2 years ago
• florimondmanca / kafka-fraud-detector
  🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python
  ☆84Updated 5 years ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated 11 months ago
• Atreya22 / luigi_rosmann_sales
  Using Luigi to create a Machine Learning Pipeline using the Rossman Sales data from Kaggle
  ☆33Updated 8 years ago
• marrrcin / python-beam-dataflow-cron
  Base project for creating Python Apache Beam pipelines and running them in Google DataFlow using CRON scheduler
  ☆23Updated 7 years ago
• eugeneyan / poc-docker-template
  Simple template showing how to set up docker for reproducible data science with Jupyter notebooks.
  ☆22Updated 8 months ago
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆26Updated 3 years ago
• JasonSanchez / spark-streaming-twitter-kafka
  Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag
  ☆29Updated 8 years ago
• amueller / structured-prediction-workshop
  Introduction to structured prediction with Python and pystruct
  ☆18Updated 6 years ago
• mewwts / feng
  feng - feature engineering for machine-learning champions
  ☆27Updated 7 years ago
• shashankprasanna / kubeflow-pipelines-sagemaker-examples
  Examples for using Amazon SageMaker components in Kubeflow Pipelines
  ☆22Updated 4 years ago
• RichardAfolabi / Realtime-Data-Analytics-Using-Spark
  Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc
  ☆51Updated 8 years ago
• ofermend / practical-data-science-with-hadoop-and-spark
  ☆26Updated last year