eriknw / afar
Run code on a Dask cluster via a context manager or IPython magic
☆30Updated 3 years ago
Alternatives and similar repositories for afar:
Users that are interested in afar are comparing it to the libraries listed below
- Tools to provide a control plane for managing the lifecycle of Dask clusters.☆25Updated last year
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆141Updated 3 months ago
- For general discussion and community planning. Discussion issues welcome.☆23Updated 2 years ago
- ⚡️ An efficient cache for the execution of dask graphs.☆71Updated last year
- An opinionated open source deployment of jupyterhub based on an Slurm job scheduler.☆28Updated 7 months ago
- ☆38Updated this week
- Cluster tools for running Dask on Databricks☆13Updated 11 months ago
- A multi-tenant server for securely deploying and managing Dask clusters.☆141Updated 3 weeks ago
- Dask development blog☆30Updated 5 months ago
- Streaming and approximate algorithms. WIP, use at own risk.☆26Updated 4 months ago
- Schema validation for Xarray objects☆42Updated last month
- ☆89Updated 3 months ago
- Kickstart your JupyterLab based standalone application 🚀☆22Updated 2 years ago
- For when your data won't fit in your dataframe☆44Updated 2 weeks ago
- ☆85Updated 8 months ago
- Disk-to-disk chunk transformation for chunked arrays.☆170Updated last week
- Scalable array processing with bounded memory☆193Updated last month
- Native Dask collection for awkward arrays, and the library to use it.☆64Updated this week
- "Hacking Dask" tutorial materials☆71Updated 3 years ago
- Tools for making Prefect work better for typical data science workflows☆18Updated 3 years ago
- ☆35Updated 3 months ago
- Hatch plugin for conda environments☆40Updated 11 months ago
- [DEPRECATED] Use setup-micromamba instead☆74Updated last year
- dask-pytorch-ddp is a Python package that makes it easy to train PyTorch models on dask clusters using distributed data parallel.☆59Updated 4 years ago
- Deploy Dask on job schedulers like PBS, SLURM, and SGE☆247Updated 3 weeks ago
- Data science environments, for collaboration. ✨☆152Updated this week
- IPython magic for parallel profiling (like `%time`, but parallel)☆71Updated 7 years ago
- Application creator and general launcher for JupyterHub☆37Updated last week
- Introduction to Dask for PyTorch Workflows☆13Updated 4 years ago
- Zarr Enhancement Proposals☆14Updated 2 months ago