multiprocessing-generator / multiprocessing_generator
Prefetch elements from a Python generator in the background, from a separate process
☆35Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for multiprocessing_generator
- Python module for detection of CPU features☆28Updated last year
- A Vectorized Python Dict/Set☆115Updated last year
- Reproducible research and reusable acyclic workflows in Python. Execute code on HPC systems as if you executed them on your personal comp…☆18Updated 2 years ago
- A python library to manipulate and transform indexable data (lists, arrays, ...)☆48Updated 6 months ago
- Python 3 library to store memory mappable objects into pickle-compatible files☆37Updated 6 years ago
- Productionize machine learning predictions, with ONNX or without☆66Updated 9 months ago
- Large dataset storage format for Pytorch☆45Updated 3 years ago
- A resizable numpy array on disk (mmap based)☆13Updated 2 years ago
- Scalable pattern search optimization with dask☆21Updated 7 years ago
- A runtime shape checker and auto-annotator for tensor programs (pronounced "stanley")☆39Updated 5 years ago
- Python API for writing multiprocessing pipelines☆86Updated 2 years ago
- Using queues, tqdm-multiprocess supports multiple worker processes, each with multiple tqdm progress bars, displaying them cleanly throug…☆41Updated 3 years ago
- A lightweight library for tensorflow 2.0☆66Updated 4 years ago
- Cookiecutter for a Python project making use of xtensor☆31Updated 4 years ago
- Simple example for embedding SSE2 assembly in Cython projects☆22Updated 7 years ago
- Automate issue discovery for your projects against Lightning nightly and releases.☆45Updated this week
- Automatic differentiation with uarray/unumpy.☆16Updated 3 years ago
- Parameterized fit and prediction harnesses for pytorch☆39Updated 4 years ago
- Process, visualize and use data easily.☆20Updated last year
- Make your Python code fly at transonic speeds!☆119Updated 2 months ago
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…☆66Updated last year
- Version control for software 2.0☆64Updated 3 years ago
- Utility functions/scripts for working with GPUs.☆8Updated 3 years ago
- Utilities for sequential processing of tar files.☆24Updated 2 years ago
- ☆18Updated last year
- Extra features for Python's JSON: comments, order, numpy, pandas, datetimes, and many more! Simple but customizable.☆153Updated 2 months ago
- python3 package supporting efficient storage and querying of sets of sets using the trie data structure. Supports finding all the superse…☆24Updated last year
- pytest plugin for a better developer experience when working with the PyTorch test suite☆43Updated 2 years ago
- Random program generator for Python☆10Updated 11 years ago
- dask-pytorch-ddp is a Python package that makes it easy to train PyTorch models on dask clusters using distributed data parallel.☆57Updated 3 years ago