RUNDSP / luigi-swf
Spotify's Luigi + Amazon's SWF integration
☆16Updated 9 years ago
Alternatives and similar repositories for luigi-swf:
Users that are interested in luigi-swf are comparing it to the libraries listed below
- Redshift Ops Console☆92Updated 9 years ago
- Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker☆253Updated 9 years ago
- Python library to manage autoscaling logic and actions☆72Updated 6 years ago
- A Cascading Workflow Visualizer☆83Updated last year
- Scheduled task execution on top of AWS Data Pipeline☆43Updated 9 years ago
- Fork of Cloudera Impala separated from Hadoop☆42Updated 8 years ago
- Functional, Typesafe, Declarative Data Pipelines☆139Updated 7 years ago
- Amazon ECS Scheduler Driver☆168Updated 5 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 5 years ago
- Open Source Cloud Formation☆59Updated 9 years ago
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- [DEPRECATED] This project is deprecated. It will be archived on December 1, 2017.☆184Updated 7 years ago
- Luigi Plugin for Hubot☆35Updated 8 years ago
- Cloudbreak Deployer Tool☆34Updated last year
- recordbus: mysql binlog to apache kafka☆80Updated 9 years ago
- [DEPRECATED] This project is deprecated. It will be archived on December 1, 2017.☆147Updated 8 years ago
- https://github.com/apache/incubator-myriad is our new home. See☆253Updated 9 years ago
- Tools for working with parquet, impala, and hive☆134Updated 4 years ago
- Timberlake is a Job Tracker for Hadoop.☆177Updated 5 years ago
- A mesos plugin for Relay that lets you auto-scale the number of currently running instances of a bash command☆38Updated 3 years ago
- Utils around luigi.☆65Updated 4 years ago
- This repository holds a number of extensions to Druid that we have created at Yahoo.☆9Updated 6 years ago
- This project allows to run Samza jobs on Mesos cluster☆43Updated 3 years ago
- Tool for exploring data on an Apache Kafka cluster☆42Updated 4 years ago
- Hadoop mapreduce job to bulk load data into Cassandra☆75Updated 2 years ago
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆46Updated last year
- Handy http redirect service for Apache Aurora jobs☆21Updated 7 years ago
- A super simple utility for testing Apache Hive scripts locally for non-Java developers.☆72Updated 8 years ago
- Vault on DCOS☆44Updated 8 years ago
- A tool for running Spark on Google Compute Engine☆16Updated 8 years ago