Alternatives and similar repositories for luigi-swf:

Users that are interested in luigi-swf are comparing it to the libraries listed below

• EverythingMe / redshift_console
  Redshift Ops Console
  ☆92Updated 9 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 10 years ago
• stripe-archive / timberlake
  Timberlake is a Job Tracker for Hadoop.
  ☆177Updated 5 years ago
• miku / gluish
  Utils around luigi.
  ☆65Updated 4 years ago
• etsy / Sahale
  A Cascading Workflow Visualizer
  ☆83Updated last year
• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 4 years ago
• thefactory / autoscale-python
  Python library to manage autoscaling logic and actions
  ☆72Updated 6 years ago
• benley / aurora-jobhopper
  Handy http redirect service for Apache Aurora jobs
  ☆21Updated 8 years ago
• ImpalaToGo / ImpalaToGo
  Fork of Cloudera Impala separated from Hadoop
  ☆42Updated 8 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 9 years ago
• Yelp / mycroft
  ☆42Updated 2 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 5 years ago
• stealthly / minotaur
  Open Source Cloud Formation
  ☆59Updated 9 years ago
• Yelp / data_pipeline
  Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
  ☆110Updated 2 years ago
• Netflix / s3mper
  s3mper - Consistent Listing for S3
  ☆228Updated last year
• JeremyGrosser / tablesnap
  Uses inotify to monitor Cassandra SSTables and upload them to S3
  ☆181Updated 3 years ago
• amazon-archives / ecs-mesos-scheduler-driver
  Amazon ECS Scheduler Driver
  ☆168Updated 5 years ago
• hortonworks / cloudbreak-deployer
  Cloudbreak Deployer Tool
  ☆34Updated last year
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆27Updated 2 years ago
• PandoraMedia / kbrowse
  Tool for exploring data on an Apache Kafka cluster
  ☆42Updated 4 years ago
• pyr / recordbus
  recordbus: mysql binlog to apache kafka
  ☆80Updated 9 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• schema-repo / schema-repo
  The Schema Repo is a RESTful web service for storing and serving mappings between schema identifiers and schema definitions.
  ☆156Updated 2 years ago
• Banno / samza-mesos
  This project allows to run Samza jobs on Mesos cluster
  ☆43Updated 3 years ago
• awslabs / amazon-kinesis-aggregators
  Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.
  ☆150Updated 3 years ago
• wickman / pesos
  pesos is a pure python implementation of the mesos framework api
  ☆47Updated 9 years ago
• grisha / json2avro
  Fast JSON to Avro converter
  ☆61Updated 6 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago
• crowdmob / kafka-s3-consumer
  Consumes Kafka topics specified in the config, and outputs them in chunks as desired in an S3 Bucket. Keeps track of offsets via S3.
  ☆15Updated 11 years ago