Deploy dask on YARN clusters
☆69Aug 10, 2024Updated 2 years ago
Alternatives and similar repositories for dask-yarn
Users that are interested in dask-yarn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tool and library for easily deploying applications on Apache YARN☆145Mar 12, 2024Updated 2 years ago
- Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.☆19Apr 23, 2025Updated last year
- ☆16Sep 28, 2017Updated 8 years ago
- Minimalistic utility library to manage conda environments for pyspark jobs on yarn clusters☆10Dec 26, 2022Updated 3 years ago
- Utilities for Dask and CUDA interactions☆324Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Resolve data table conflicts☆17Jun 11, 2015Updated 11 years ago
- A multi-tenant server for securely deploying and managing Dask clusters.☆148Aug 3, 2026Updated last week
- Convert JSON files to Parquet using PyArrow☆99Jan 10, 2024Updated 2 years ago
- FuturePool is a package that introduce known concept of multiprocessing Pool to the async/await world. It allows for easy translation fro…☆14Nov 10, 2024Updated last year
- A distributed task scheduler for Dask☆1,676Updated this week
- For general discussion and community planning. Discussion issues welcome.☆25Sep 28, 2022Updated 3 years ago
- Run Numba compiled functions in SQLite☆46Feb 18, 2026Updated 5 months ago
- Generate ipywidgets from Parameterized objects in the notebook☆35Nov 28, 2019Updated 6 years ago
- Streaming and approximate algorithms. WIP, use at own risk.☆27Sep 4, 2025Updated 11 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Jupyter notebook server extension to proxy web services.☆400Updated this week
- Language Modelling, CMI vs Perplexity☆11Mar 17, 2018Updated 8 years ago
- A library for exporting Spark ML models and pipelines to PFA☆55Nov 21, 2018Updated 7 years ago
- A Unix backend for Ibis☆11Jul 11, 2024Updated 2 years ago
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆147Oct 14, 2025Updated 9 months ago
- Conda package for artifact creation that enables offline environments. Ideal for air-gapped deployments.☆15Sep 23, 2024Updated last year
- Automatic differentiation with uarray/unumpy.☆16Mar 7, 2021Updated 5 years ago
- For when your data won't fit in your dataframe☆52Sep 17, 2025Updated 10 months ago
- Helm charts for Dask☆99Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An Ibis back-end for the GizmoSQL Arrow Flight SQL Server (with the DuckDB engine)☆17Jul 29, 2026Updated 2 weeks ago
- Numbast is a tool to build an automated pipeline that converts CUDA APIs into Numba bindings.☆61Updated this week
- A couple of examples to learn how to use numba and blz☆15Apr 3, 2014Updated 12 years ago
- A Delta Lake reader for Dask☆55Jul 29, 2025Updated last year
- Build Tangle-style interactive documents in the Jupyter/IPython Notebook☆12Feb 17, 2022Updated 4 years ago
- Subsumed into xnd☆25Aug 30, 2023Updated 2 years ago
- Python Hyptertext Preprocessor☆11Jan 26, 2022Updated 4 years ago
- Cluster tools for running Dask on Databricks☆15Jun 3, 2024Updated 2 years ago
- Scalable Machine Learning with Dask☆951Sep 27, 2025Updated 10 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- various scripts to be used in conjunction with GeekTool or Ubersicht☆19Mar 30, 2025Updated last year
- MPI-oriented extension of the Spark computational model☆24Jun 5, 2018Updated 8 years ago
- Hatch plugin for conda environments☆42May 14, 2024Updated 2 years ago
- The documentation for the Clustergrammer project☆10Oct 21, 2020Updated 5 years ago
- Published by Packt☆11Jan 18, 2021Updated 5 years ago
- AWS MWAA Quick Start With Terraform.☆20Aug 19, 2021Updated 4 years ago
- An Interactive Discrete Mathematics Framework for GAP☆10Jul 10, 2026Updated last month