dask / distributed
A distributed task scheduler for Dask
☆1,598Updated this week
Alternatives and similar repositories for distributed:
Users that are interested in distributed are comparing it to the libraries listed below
- Scalable Machine Learning with Dask☆916Updated last week
- Extended pickling support for Python objects☆1,702Updated last month
- Parallel computing with task scheduling☆12,950Updated this week
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,027Updated last month
- Computing with Python functions.☆3,981Updated 3 weeks ago
- Real-time stream processing for python☆1,254Updated 2 months ago
- N-D labeled arrays and datasets in Python☆3,709Updated this week
- Dask tutorial☆1,843Updated last year
- A Python package to manage extremely large amounts of data☆1,324Updated last week
- Numba extension for compiling Pandas data frames, Intel® Scalable Dataframe Compiler☆643Updated last year
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆627Updated this week
- Fast numerical array expression evaluator for Python, NumPy, Pandas, PyTables and more☆2,271Updated last week
- Robust and reusable Executor for joblib☆548Updated 3 months ago
- Data Migration for the Blaze Project☆1,004Updated 2 years ago
- Airspeed Velocity: A simple Python benchmarking tool with web-based reporting☆886Updated last month
- Concurrent data pipelines in Python >>>☆1,569Updated last year
- S3 Filesystem☆911Updated this week
- serialize all of Python☆2,318Updated this week
- An implementation of chunked, compressed, N-dimensional arrays for Python.☆1,607Updated this week
- Native Kubernetes integration for Dask☆318Updated 3 weeks ago
- NumPy and Pandas interface to Big Data☆3,193Updated last year
- Fast NumPy array functions written in C☆1,090Updated 4 months ago
- python implementation of the parquet columnar file format.☆808Updated 3 months ago
- SCOOP (Scalable COncurrent Operations in Python)☆648Updated last year
- Cython implementation of Toolz: High performance functional utilities☆1,027Updated last month
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,266Updated 2 months ago
- A columnar data container that can be compressed.☆958Updated 2 years ago
- the portable Python dataframe library☆5,515Updated this week
- A specification that python filesystems should adhere to.☆1,106Updated 2 weeks ago
- Eliot: the logging system that tells you *why* it happened☆1,124Updated 2 months ago