SayreBlades / dask-ecs
An opinionated template for spinning up a dask cluster based on docker.
☆14Updated 7 years ago
Alternatives and similar repositories for dask-ecs:
Users that are interested in dask-ecs are comparing it to the libraries listed below
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- python parallel map on kubernetes☆34Updated 7 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 6 years ago
- An example project for doing grid search in MLlib☆13Updated 10 years ago
- Terraform module for a PostgreSQL-backed Apache Airflow instance☆24Updated 6 years ago
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 4 months ago
- Example Repository for Building Complex Data Pipeline with Luigi +TD☆24Updated 9 years ago
- Deploy dask-distributed on google container engine using kubernetes☆40Updated 5 years ago
- Docker image for Apache Hive running on Tez☆7Updated 10 years ago
- Example Scala/SBT event consumer for Amazon Kinesis☆22Updated 9 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Updated 8 years ago
- 🥞 Zero-to-JupyterHub with Kubernetes using an opinionated tech stack☆12Updated 5 years ago
- Example project which simulates an interesting analytics use case using MemSQL Pipelines.☆14Updated 7 years ago
- KnowledgeRepo + JupyterLab☆48Updated 2 months ago
- An umbrella project for multiple implementations of model serving☆46Updated 7 years ago
- Library for building reproducible data pipelines to support experimentation☆20Updated 9 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- Opinionated Python ORM for DynamoDB☆27Updated 5 years ago
- Small Docker image with Python Machine Learning tools (~180MB) https://hub.docker.com/r/frolvlad/alpine-python-machinelearning/☆80Updated last year
- DataStax Enterprise (DSE) Deployment Guide for Amazon Web Services (AWS)☆11Updated 5 years ago
- Docker container to make running Luigi tasks real easy.☆11Updated 8 years ago
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- Minimal docker image for running Luigi☆10Updated 8 years ago
- Proposals for new Jupyter subprojects to enter into incubation☆18Updated 4 years ago
- Python SDK for working with Snowplow enriched events in Spark, AWS Lambda et al.☆21Updated last month