Alternatives and similar repositories for airflow:

Users that are interested in airflow are comparing it to the libraries listed below

• stealthly / minotaur
  Open Source Cloud Formation
  ☆59Updated 9 years ago
• mesosphere-backup / open-docs
  [DEPRECATED] Documentation for Mesosphere supported open source projects.
  ☆20Updated 5 years ago
• crowdmob / kafka-s3-consumer
  Consumes Kafka topics specified in the config, and outputs them in chunks as desired in an S3 Bucket. Keeps track of offsets via S3.
  ☆15Updated 11 years ago
• cerner / common-kafka
  Common utilities for Apache Kafka
  ☆36Updated last year
• qubole / kinesis-storage-handler
  Hive Storage Handler for Kinesis.
  ☆11Updated 9 years ago
• hortonworks / hive-json
  A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.
  ☆42Updated last year
• alexanderdean / Unified-Log-Processing
  Supporting material (code, schemas etc) for Unified Log Processing (Manning Publications)
  ☆97Updated 2 years ago
• keenlabs / capillary
  Storm Spout + Kafka State Inspector
  ☆58Updated 5 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 6 years ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago
• nathanmarz / kafka-deploy
  Automated deploy for Kafka on AWS
  ☆123Updated 13 years ago
• snowplow-archive / kinesis-tee
  Unix tee, but for Kinesis streams
  ☆12Updated 3 years ago
• snowplow-archive / icebucket
  UNRELEASED. An opinionated framework for analytics-on-write on event streams using key-value storage
  ☆14Updated 9 years ago
• awslabs / amazon-kinesis-aggregators
  Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.
  ☆150Updated 3 years ago
• grisha / json2avro
  Fast JSON to Avro converter
  ☆61Updated 6 years ago
• razvan / kafka-s3-consumer
  Store batched Kafka messages in S3.
  ☆39Updated 2 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• eBay / embedded-druid
  ☆76Updated 8 years ago
• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 3 years ago
• memsql / memsql-loader
  Deprecated - Check out MemSQL Pipelines instead!
  ☆8Updated 7 years ago
• stealthly / metrics-kafka
  Metrics produced to Kafka and consumers for monitoring them
  ☆100Updated 10 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 5 years ago
• snowplow-archive / spark-streaming-example-project
  A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB
  ☆94Updated 4 years ago
• Aloisius / hadoop-s3a
  An AWS SDK-backed FileSystem driver for Hadoop
  ☆64Updated 4 years ago
• hortonworks / cloudbreak-deployer
  Cloudbreak Deployer Tool
  ☆34Updated last year
• uber-archive / kafka-spraynozzle
  A nozzle to spray a kafka topic at an HTTP endpoint. This project is deprecated and not maintained.
  ☆49Updated 5 years ago
• brndnmtthws / kafka-on-marathon
  Scripts for running Apache Kafka on Mesosphere's Marathon
  ☆14Updated 9 years ago
• amazon-archives / kinesis-storm-spout
  Kinesis spout for Storm
  ☆106Updated 6 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 9 years ago
• mingfang / docker-druid
  ☆33Updated 10 years ago