RUNDSP / luigi-swf
Spotify's Luigi + Amazon's SWF integration
☆16Updated 8 years ago
Alternatives and similar repositories for luigi-swf:
Users that are interested in luigi-swf are comparing it to the libraries listed below
- Redshift Ops Console☆92Updated 9 years ago
- Scheduled task execution on top of AWS Data Pipeline☆43Updated 9 years ago
- Tools for working with parquet, impala, and hive☆133Updated 4 years ago
- Utils around luigi.☆65Updated 3 years ago
- ☆42Updated 2 years ago
- Python library to manage autoscaling logic and actions☆72Updated 6 years ago
- A Cascading Workflow Visualizer☆83Updated last year
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- Luigi Workflow Engine integration for Treasure Data☆16Updated 6 years ago
- Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker☆253Updated 9 years ago
- Serializes data into a JSON format using AVRO schema.☆137Updated 3 years ago
- Amazon ECS Scheduler Driver☆168Updated 4 years ago
- A super simple utility for testing Apache Hive scripts locally for non-Java developers.☆72Updated 7 years ago
- Timberlake is a Job Tracker for Hadoop.☆177Updated 4 years ago
- Simple bash functions for manipulating Amazon Elastic MapReduce clusters☆45Updated 9 years ago
- Functional, Typesafe, Declarative Data Pipelines☆139Updated 6 years ago
- A prototype of Hive UDFs/UDTFs that execute nested SQL queries within rows.☆54Updated 9 years ago
- A Python wrapper for Cascading☆222Updated 5 years ago
- DataPipeline for humans.☆252Updated 2 years ago
- Luigi Plugin for Hubot☆35Updated 8 years ago
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆46Updated last year
- This project allows to run Samza jobs on Mesos cluster☆43Updated 3 years ago
- Cloudbreak Deployer Tool☆35Updated last year
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 4 years ago