SayreBlades / dask-ecsLinks
An opinionated template for spinning up a dask cluster based on docker.
☆14Updated 7 years ago
Alternatives and similar repositories for dask-ecs
Users that are interested in dask-ecs are comparing it to the libraries listed below
Sorting:
- Functional Airflow DAG definitions.☆38Updated 8 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 6 years ago
- Ansible role to deploy and configure Airflow☆41Updated this week
- Library for building reproducible data pipelines to support experimentation☆20Updated 9 years ago
- python parallel map on kubernetes☆34Updated 8 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- An umbrella project for multiple implementations of model serving☆45Updated 7 years ago
- Functional, Typesafe, Declarative Data Pipelines☆139Updated 7 years ago
- Proposals for new Jupyter subprojects to enter into incubation☆18Updated 5 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Updated 9 years ago
- An example project for doing grid search in MLlib☆13Updated 10 years ago
- Deploy dask-distributed on google container engine using kubernetes☆40Updated 6 years ago
- T4 is now in production as Quilt 3☆64Updated 6 years ago
- A library of machine learning algorithms implemented using principles of functional programming.☆23Updated 8 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 7 years ago
- Terraform module for a PostgreSQL-backed Apache Airflow instance☆24Updated 7 years ago
- Slack notifications for the Luigi workflow manager☆46Updated 4 years ago
- Small Docker image with Python Machine Learning tools (~180MB) https://hub.docker.com/r/frolvlad/alpine-python-machinelearning/☆81Updated 5 months ago
- giter8 template for Scala projects using sbt☆39Updated 8 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆62Updated last year
- A scala-based feature generation and modeling framework☆61Updated 6 years ago
- A Giter8 template for scio☆31Updated 2 weeks ago
- Fast, easy and intuitive machine learning prototyping.☆124Updated 11 years ago
- feng - feature engineering for machine-learning champions☆27Updated 8 years ago
- Saul : Declarative Learning-Based Programming☆64Updated 5 years ago
- Start a cluster in EC2 for dask.distributed☆106Updated 4 years ago
- Example project which simulates an interesting analytics use case using MemSQL Pipelines.☆14Updated 8 years ago
- A place where I build Dockerfiles used in other projects. Built in CircleCI.☆19Updated 5 years ago
- An Apache Spark-shell backend for IPython☆105Updated 4 years ago
- Kafka producer for data collection from cryptocurrency exchanges☆41Updated 8 years ago