RUNDSP / luigi-swfLinks
Spotify's Luigi + Amazon's SWF integration
☆16Updated 9 years ago
Alternatives and similar repositories for luigi-swf
Users that are interested in luigi-swf are comparing it to the libraries listed below
Sorting:
- Scheduled task execution on top of AWS Data Pipeline☆43Updated 10 years ago
- Redshift Ops Console☆92Updated 9 years ago
- Utils around luigi.☆66Updated 4 years ago
- Python library to manage autoscaling logic and actions☆72Updated 6 years ago
- Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker☆253Updated 10 years ago
- A Cascading Workflow Visualizer☆83Updated 2 years ago
- Timberlake is a Job Tracker for Hadoop.☆177Updated 5 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 6 years ago
- Fork of Cloudera Impala separated from Hadoop☆42Updated 8 years ago
- This project allows to run Samza jobs on Mesos cluster☆43Updated 4 years ago
- Tools for working with parquet, impala, and hive☆134Updated 4 years ago
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- recordbus: mysql binlog to apache kafka☆80Updated 9 years ago
- Simple bash functions for manipulating Amazon Elastic MapReduce clusters☆45Updated 9 years ago
- ☆42Updated 2 years ago
- Functional, Typesafe, Declarative Data Pipelines☆139Updated 7 years ago
- DataPipeline for humans.☆249Updated 2 years ago
- A mesos plugin for Relay that lets you auto-scale the number of currently running instances of a bash command☆38Updated 4 years ago
- Open source analytics platform powered by Apache Cassandra, Spark, and Kafka☆34Updated 10 years ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- Supporting material (code, schemas etc) for Unified Log Processing (Manning Publications)☆98Updated 2 years ago
- S3 backed ContentsManager for jupyter notebooks☆14Updated 9 years ago
- Luigi Workflow Engine integration for Treasure Data☆16Updated 7 years ago
- A prototype of Hive UDFs/UDTFs that execute nested SQL queries within rows.☆54Updated 9 years ago
- A python RPC client stack☆45Updated 3 years ago
- Luigi Plugin for Hubot☆36Updated 8 years ago
- A super simple utility for testing Apache Hive scripts locally for non-Java developers.☆72Updated 8 years ago
- Amazon ECS Scheduler Driver☆168Updated 5 years ago
- Collect local Mesos slave, underlying operating system and machine metrics and produce to Apache Kafka☆20Updated 9 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 6 years ago