Alternatives and similar repositories for Airflow

Users that are interested in Airflow are comparing it to the libraries listed below

• Yelp / data_pipeline
  Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
  ☆110Updated 2 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• teamclairvoyant / airflow-user-management-plugin
  A plugin for Apache Airflow that allows you to manage the users that can login
  ☆14Updated 5 years ago
• netxillon / Hadoop
  Hadoop Cluster Configurations
  ☆32Updated 3 years ago
• dataiku / dataiku-hive-udf
  A collection of Hive UDFs
  ☆75Updated 5 years ago
• yamrcraft / etl-light
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆41Updated 7 years ago
• teamclairvoyant / airflow-scheduler-failover-controller
  A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
  ☆234Updated 2 years ago
• taykey / python-kafka-logging
  Simple python logging handler for forwarding logs to a kafka server
  ☆30Updated 5 years ago
• snowplow-archive / snowplow-web-data-model
  SQL data model for working with Snowplow web data. Supports Redshift and Looker. Snowflake and BigQuery coming soon
  ☆60Updated 4 years ago
• teamclairvoyant / airflow_demo
  Airflow script for incremental data import from Mysql to Hive using Sqoop.
  ☆18Updated 6 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated last year
• yahoo / hive-funnel-udf
  Hive UDFs for funnel analysis
  ☆83Updated 2 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆93Updated 6 years ago
• michalmiklas / atlas-docker
  docker for apache-atlas embedded-cassandra-solr
  ☆23Updated 5 years ago
• astronomer / airflow-example-dags
  Sample Airflow DAGs
  ☆62Updated 2 years ago
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆27Updated 2 years ago
• prestodb / presto-python-client
  Python DB-API client for Presto
  ☆238Updated last year
• shunfei / hadoop_exporter
  Exports hadoop metrics via HTTP for Prometheus consumption
  ☆19Updated 4 years ago
• bolcom / hive_compared_bq
  hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
  ☆28Updated 7 years ago
• xiufengliu / BigETL
  This project is a unified ETL platform that support various data processing technologies, including Spark, Hive, Hadoop, Python, Linux Sh…
  ☆17Updated 9 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆100Updated 4 years ago
• prestodb / f8-2019-demo
  A tutorial on how to get started with Presto.
  ☆56Updated 3 years ago
• knoguchi / cm-druid
  Druid service descriptor and parcel for Cloudera CDH5
  ☆32Updated 5 years ago
• dharmeshkakadia / presto-kubernetes
  Running Presto on k8s
  ☆38Updated 5 years ago
• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 4 years ago
• trulia / legoo
  Legoo: A collection of automation modules to build analytics infrastructure
  ☆20Updated 4 years ago
• gateway-experiments / hadoop-yarn-api-python-client
  Python client for Hadoop® YARN API
  ☆109Updated 2 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆174Updated last year
• cdapio / hydrator-plugins
  Cask Hydrator Plugins Repository
  ☆68Updated last week