Deploy dask on YARN clusters
☆69Aug 10, 2024Updated 2 years ago
Alternatives and similar repositories for dask-yarn
Users that are interested in dask-yarn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tool and library for easily deploying applications on Apache YARN☆145Mar 12, 2024Updated 2 years ago
- Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.☆19Apr 23, 2025Updated last year
- Minimalistic utility library to manage conda environments for pyspark jobs on yarn clusters☆10Dec 26, 2022Updated 3 years ago
- Utilities for Dask and CUDA interactions☆324Updated this week
- A multi-tenant server for securely deploying and managing Dask clusters.☆148Aug 3, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Convert JSON files to Parquet using PyArrow☆99Jan 10, 2024Updated 2 years ago
- FuturePool is a package that introduce known concept of multiprocessing Pool to the async/await world. It allows for easy translation fro…☆14Nov 10, 2024Updated last year
- A distributed task scheduler for Dask☆1,689Updated this week
- Base hadoop/spark/bigdata image with advanced config loading scripts.☆11Nov 3, 2020Updated 5 years ago
- For general discussion and community planning. Discussion issues welcome.☆25Sep 28, 2022Updated 3 years ago
- Run Numba compiled functions in SQLite☆46Feb 18, 2026Updated 6 months ago
- Generate ipywidgets from Parameterized objects in the notebook☆35Nov 28, 2019Updated 6 years ago
- Streaming and approximate algorithms. WIP, use at own risk.☆27Sep 4, 2025Updated 11 months ago
- Linkedin's Cruise Control container image built for Koperator (https://github.com/banzaicloud/koperator)☆13Oct 14, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Jupyter notebook server extension to proxy web services.☆403Aug 11, 2026Updated 3 weeks ago
- Tools to provide a control plane for managing the lifecycle of Dask clusters.☆25Jan 25, 2024Updated 2 years ago
- Distributed SQL Engine in Python using Dask☆411Aug 29, 2024Updated 2 years ago
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆147Oct 14, 2025Updated 10 months ago
- Share notebooks between users in a Hub.☆24Sep 29, 2020Updated 5 years ago
- Easy Hadoop Streaming and MapReduce interfaces in Rust☆39Jan 3, 2026Updated 8 months ago
- Automatic differentiation with uarray/unumpy.☆16Mar 7, 2021Updated 5 years ago
- For when your data won't fit in your dataframe☆52Sep 17, 2025Updated 11 months ago
- Helm charts for Dask☆100Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A C++ framework for working with the CPython API.☆23Feb 15, 2017Updated 9 years ago
- A Delta Lake reader for Dask☆55Jul 29, 2025Updated last year
- Build Tangle-style interactive documents in the Jupyter/IPython Notebook☆12Feb 17, 2022Updated 4 years ago
- Python Hyptertext Preprocessor☆11Jan 26, 2022Updated 4 years ago
- Cluster tools for running Dask on Databricks☆15Jun 3, 2024Updated 2 years ago
- Scalable Machine Learning with Dask☆951Sep 27, 2025Updated 11 months ago
- Hatch plugin for conda environments☆42May 14, 2024Updated 2 years ago
- Go, Rust, Java services to showcase Redis Streams and RediSearch in action☆40May 18, 2021Updated 5 years ago
- Short exercises in Python.☆11Jan 13, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The documentation for the Clustergrammer project☆10Oct 21, 2020Updated 5 years ago
- Published by Packt☆11Jan 18, 2021Updated 5 years ago
- An Interactive Discrete Mathematics Framework for GAP☆11Jul 10, 2026Updated last month
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆54Jul 3, 2018Updated 8 years ago
- Cython based wrapper for libavro☆25Sep 14, 2020Updated 5 years ago
- Embedded SDK for Hermetic Modular eurorack modules, built on Electrosmith Daisy.☆27Updated this week
- Caching based on computation time and storage space☆142Feb 10, 2021Updated 5 years ago