babbel / flotoLinks
Task Orchestration Tool Based on SWF and boto3
☆39Updated 7 years ago
Alternatives and similar repositories for floto
Users that are interested in floto are comparing it to the libraries listed below
Sorting:
- CLI tool to launch Spark jobs on AWS EMR☆67Updated 2 years ago
- Utils around luigi.☆66Updated 5 months ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆53Updated 7 years ago
- Luigi Plugin for Hubot☆36Updated 9 years ago
- python parallel map on kubernetes☆33Updated 8 years ago
- Functional Airflow DAG definitions.☆38Updated 8 years ago
- S3 backed ContentsManager for jupyter notebooks☆14Updated 9 years ago
- Python bindings for TrailDB☆38Updated 6 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 7 years ago
- A platform for real-time streaming search☆102Updated 9 years ago
- Anomaly Detection Framework☆24Updated 10 years ago
- S3-backed notebook manager for IPython☆29Updated 8 years ago
- Scheduled task execution on top of AWS Data Pipeline☆43Updated 10 years ago
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 7 years ago
- Start a cluster in EC2 for dask.distributed☆105Updated 5 years ago
- Deploy dask-distributed on google container engine using kubernetes☆40Updated 6 years ago
- Briefly - A Python Meta-programming Library for Job Flow Control☆107Updated 7 years ago
- Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…☆40Updated 10 years ago
- A Python library for dealing with splittable files☆42Updated 6 years ago
- PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).☆94Updated 2 years ago
- Resize image on the fly using flask, zappa, pillow, opencv-python☆18Updated 8 years ago
- An external PySpark module that works like R's read.csv or Panda's read_csv, with automatic type inference and null value handling. Parse…☆90Updated 10 years ago
- Simple spill-to-disk dictionary☆62Updated 4 years ago
- python implementation of the parquet columnar file format.☆21Updated last month
- A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.☆52Updated 8 years ago
- Myria is a scalable Analytics-as-a-Service platform based on relational algebra.☆116Updated 4 years ago
- Utilities and examples to asssist in working with PySpark and Cassandra.☆36Updated 10 years ago
- Send summary messages of your Luigi jobs to Slack☆46Updated 6 years ago
- T4 is now in production as Quilt 3☆64Updated 6 years ago
- Partitioned storage system based on blosc. **No longer actively maintained.**☆155Updated 9 years ago