Alternatives and similar repositories for airflow:

Users that are interested in airflow are comparing it to the libraries listed below

• stealthly / minotaur
  Open Source Cloud Formation
  ☆59Updated 10 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 4 years ago
• collectivemedia / spark-hyperloglog
  Interactive Audience Analytics with Spark and HyperLogLog
  ☆55Updated 9 years ago
• snowplow-archive / icebucket
  UNRELEASED. An opinionated framework for analytics-on-write on event streams using key-value storage
  ☆14Updated 9 years ago
• mustafaakin / big-data-docker
  Better, container friendly big-data images for Docker
  ☆39Updated 8 years ago
• quantiply / grafana-plugins
  Extensions, custom & experimental panels
  ☆52Updated 9 years ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago
• sheepkiller / presto-marathon-docker
  On demand presto cluster with mesos, marathon and docker.
  ☆30Updated 7 years ago
• hortonworks / cloudbreak-deployer
  Cloudbreak Deployer Tool
  ☆34Updated last year
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 9 years ago
• snowplow / snowplow-s3-loader
  Mirrors a Kinesis stream to Amazon S3 using the KCL
  ☆42Updated 7 months ago
• mesosphere-backup / open-docs
  [DEPRECATED] Documentation for Mesosphere supported open source projects.
  ☆20Updated 5 years ago
• pyr / recordbus
  recordbus: mysql binlog to apache kafka
  ☆80Updated 9 years ago
• snowplow-archive / kinesis-tee
  Unix tee, but for Kinesis streams
  ☆12Updated 3 years ago
• lucidworks / solr-scale-tk
  Fabric-based framework for deploying and managing SolrCloud clusters in the cloud.
  ☆90Updated 6 years ago
• Banno / samza-mesos
  This project allows to run Samza jobs on Mesos cluster
  ☆43Updated 4 years ago
• stealthly / metrics-kafka
  Metrics produced to Kafka and consumers for monitoring them
  ☆100Updated 10 years ago
• tubular / confluent-spark-avro
  Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.
  ☆19Updated 7 years ago
• keenlabs / capillary
  Storm Spout + Kafka State Inspector
  ☆58Updated 5 years ago
• thefactory / autoscale-python
  Python library to manage autoscaling logic and actions
  ☆72Updated 6 years ago
• hmsonline / storm-cassandra-cql
  Storm Cassandra Bridge built on CQL
  ☆42Updated last year
• snowplow / dataflow-runner
  Run templatable playbooks of Hadoop/Spark/et al jobs on Amazon EMR
  ☆19Updated last year
• blackberry / KaBoom
  A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths
  ☆42Updated 8 years ago
• elodina / stack-deploy
  Apache Mesos Platform as a Service Deploy
  ☆21Updated 8 years ago
• ScalaConsultants / spark-kafka-avro
  POC: Spark consumer for bottledwater-pg Kafka Avro topics
  ☆16Updated 4 years ago
• full360 / glue-sneaql-demo
  ☆12Updated 4 years ago
• alexanderdean / Unified-Log-Processing
  Supporting material (code, schemas etc) for Unified Log Processing (Manning Publications)
  ☆98Updated 2 years ago
• cerner / common-kafka
  Common utilities for Apache Kafka
  ☆36Updated last year
• aredee / accumulo-mesos
  ☆17Updated 9 years ago