babbel / floto
Task Orchestration Tool Based on SWF and boto3
☆38Updated 6 years ago
Alternatives and similar repositories for floto:
Users that are interested in floto are comparing it to the libraries listed below
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- Luigi Plugin for Hubot☆36Updated 8 years ago
- Utils around luigi.☆66Updated 4 years ago
- Python bindings for TrailDB☆39Updated 5 years ago
- Scheduled task execution on top of AWS Data Pipeline☆43Updated 10 years ago
- S3-backed notebook manager for IPython☆29Updated 7 years ago
- Deploy dask-distributed on google container engine using kubernetes☆40Updated 6 years ago
- S3 backed ContentsManager for jupyter notebooks☆14Updated 9 years ago
- A Python library for dealing with splittable files☆42Updated 5 years ago
- Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…☆41Updated 9 years ago
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- Start a cluster in EC2 for dask.distributed☆106Updated 4 years ago
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- Proposals for new Jupyter subprojects to enter into incubation☆18Updated 4 years ago
- A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.☆51Updated 7 years ago
- python parallel map on kubernetes☆34Updated 7 years ago
- Simple spill-to-disk dictionary☆60Updated 3 years ago
- Partitioned storage system based on blosc. **No longer actively maintained.**☆152Updated 8 years ago
- Fast and modular async task library for Google App Engine.☆37Updated last year
- Streaming newline delimited JSON I/O.☆12Updated last year
- Python library for dataflow programming.☆65Updated this week
- Dask powered gridsearch and pipeline a la scikit-learn☆42Updated 9 years ago
- Python SDK for working with Snowplow enriched events in Spark, AWS Lambda et al.☆21Updated 4 months ago
- transformpy is a Python 2/3 module for doing transforms on "streams" of data☆29Updated 7 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Updated 9 years ago
- Creating Rickshaw.js visualizations with Python Pandas☆265Updated 8 years ago
- Resize image on the fly using flask, zappa, pillow, opencv-python☆18Updated 7 years ago
- Python to Gremlin Graph Abstraction Layer☆55Updated 7 years ago
- This project contains the code to translate between Apache Spark and SFrame.☆20Updated 8 years ago
- Functional, Typesafe, Declarative Data Pipelines☆139Updated 7 years ago