dask / distributed
A distributed task scheduler for Dask
☆1,589Updated this week
Alternatives and similar repositories for distributed:
Users that are interested in distributed are comparing it to the libraries listed below
- Extended pickling support for Python objects☆1,688Updated this week
- Scalable Machine Learning with Dask☆912Updated last month
- A Python package to manage extremely large amounts of data☆1,319Updated last week
- Parallel computing with task scheduling☆12,851Updated this week
- Fast numerical array expression evaluator for Python, NumPy, Pandas, PyTables and more☆2,266Updated last month
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,019Updated this week
- Computing with Python functions.☆3,938Updated this week
- parallel graph management and execution in heterogeneous computing☆1,415Updated 2 weeks ago
- python implementation of the parquet columnar file format.☆801Updated 2 months ago
- Airspeed Velocity: A simple Python benchmarking tool with web-based reporting☆876Updated last month
- serialize all of Python☆2,302Updated 2 weeks ago
- Dask tutorial☆1,838Updated last year
- Fast NumPy array functions written in C☆1,085Updated 2 months ago
- S3 Filesystem☆902Updated 3 weeks ago
- N-D labeled arrays and datasets in Python☆3,684Updated this week
- An implementation of chunked, compressed, N-dimensional arrays for Python.☆1,567Updated this week
- NumPy and Pandas interface to Big Data☆3,190Updated last year
- Real-time stream processing for python☆1,251Updated last month
- the portable Python dataframe library☆5,451Updated this week
- An in-browser Python profile viewer☆2,381Updated 2 months ago
- With Holoviews, your data visualizes itself.☆2,735Updated this week
- A lightweight Traits like module☆628Updated last month
- Tools for diffing and merging of Jupyter notebooks.☆2,690Updated 3 months ago
- better multiprocessing and multithreading in Python☆646Updated 2 weeks ago
- Monitor Memory usage of Python code☆4,418Updated 8 months ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,488Updated last month
- Manipulate JSON-like data with NumPy-like idioms.☆855Updated this week
- A high-level plotting API for pandas, dask, xarray, and networkx built on HoloViews☆1,159Updated last month
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,249Updated last month
- Eliot: the logging system that tells you *why* it happened☆1,115Updated last month