SayreBlades / dask-ecsLinks
An opinionated template for spinning up a dask cluster based on docker.
☆14Updated 7 years ago
Alternatives and similar repositories for dask-ecs
Users that are interested in dask-ecs are comparing it to the libraries listed below
Sorting:
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- python parallel map on kubernetes☆34Updated 7 years ago
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 6 years ago
- T4 is now in production as Quilt 3☆64Updated 5 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Updated 9 years ago
- Example project which simulates an interesting analytics use case using MemSQL Pipelines.☆14Updated 8 years ago
- Terraform module for a PostgreSQL-backed Apache Airflow instance☆24Updated 7 years ago
- Proposals for new Jupyter subprojects to enter into incubation☆18Updated 4 years ago
- Benchmarks of artificial neural network library for Spark MLlib☆11Updated 9 years ago
- Example Scala/SBT event consumer for Amazon Kinesis☆22Updated 10 years ago
- KnowledgeRepo + JupyterLab☆48Updated 6 months ago
- An extension for Jupyter notebooks that allows running notebooks inside a Docker container and converting them to runnable Docker images.☆28Updated last year
- Docker image for Apache Hive running on Tez☆7Updated 10 years ago
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- Minimal docker image for running Luigi☆10Updated 8 years ago
- personal cheatsheets on various technologies☆25Updated 8 years ago
- Small Docker image with Python Machine Learning tools (~180MB) https://hub.docker.com/r/frolvlad/alpine-python-machinelearning/☆80Updated last month
- Integrating AWS Lambda with EC2 hosted Relational Databases☆43Updated 9 years ago
- Python module and CLI to package and upload python lambda functions to AWS Lambda☆25Updated 4 years ago
- An example project for doing grid search in MLlib☆13Updated 10 years ago
- Jupyter kernel for the LAPPS Services DSL.☆22Updated 7 years ago
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 8 months ago
- Google Spreadsheets datasource for SparkSQL and DataFrames☆57Updated last year
- distribute notebooks for users to copy via a web interface☆70Updated 8 years ago
- Deploy dask-distributed on google container engine using kubernetes☆40Updated 6 years ago
- S3 backed ContentsManager for jupyter notebooks☆14Updated 9 years ago
- Configuration and definitions of Airflow for OpenTrials☆18Updated 7 years ago
- Example Repository for Building Complex Data Pipeline with Luigi +TD☆24Updated 10 years ago