deep-compute / diskarray

Related projects ⓘ

Alternatives and complementary repositories for diskarray

• robbmcleod / cpufeature
  Python module for detection of CPU features
  ☆28Updated last year
• hameerabbasi / arrayish
  A library for downstream compatibility of Numpy-compatible arrays.
  ☆11Updated 5 years ago
• multiprocessing-generator / multiprocessing_generator
  Prefetch elements from a Python generator in the background, from a separate process
  ☆35Updated 3 years ago
• UniNE-CHYN / mmappickle
  Python 3 library to store memory mappable objects into pickle-compatible files
  ☆37Updated 6 years ago
• pytoolz / benchtoolz
  Benchmark Python and Cython code
  ☆13Updated 10 years ago
• neighthan / gpu-utils
  Utility functions/scripts for working with GPUs.
  ☆8Updated 3 years ago
• searchivarius / PyFastPFor
  Python bindings for the fast integer compression library FastPFor.
  ☆57Updated last year
• AWNystrom / DiskDict
  A disk-based key/value store in Python with no dependencies.
  ☆21Updated 9 years ago
• atom-moyer / getpy
  A Vectorized Python Dict/Set
  ☆115Updated last year
• alan-turing-institute / xpandas
  Universal 1d/2d data containers with Transformers functionality for data analysis.
  ☆26Updated 2 years ago
• nmichlo / ruck
  🧬 Modularised Evolutionary Algorithms For Python with Optional JIT and Multiprocessing (Ray) support. Inspired by PyTorch Lightning
  ☆52Updated last year
• dask / zict
  Useful Mutable Mappings
  ☆69Updated last year
• sixty-north / multiprocessing_on_dill
  A friendly fork of the Python Standard Library multiprocessing package which uses dill instead of pickle
  ☆34Updated 4 years ago
• tansey / sdp
  Deep nonparametric estimation of discrete conditional distributions via smoothed dyadic partitioning
  ☆15Updated 7 years ago
• jchacks / data_cache
  Simple in memory data cache designed for ML applications. Built using Redis and Apache Arrow's Plasma in-memory store
  ☆10Updated 4 years ago
• metagraph-dev / metagraph
  Multi-target API for graph analytics with Dask
  ☆26Updated 2 months ago
• aimhubio / aimrocks
  🎯 aimrocks 🎸 — python & cython bindings for RocksDB. Batteries included! 🔋
  ☆28Updated 6 months ago
• jupyterhub / simpervisor
  Simple Python3 Supervisor library
  ☆12Updated this week
• xtensor-stack / xtensor-python-cookiecutter
  Cookiecutter for a Python project making use of xtensor
  ☆31Updated 4 years ago
• cemoody / flexi_hash_embedding
  PyTorch Flexible Hash Embeddings
  ☆28Updated 4 years ago
• QratorLabs / pysdsl
  Python bindings to Succinct Data Structure Library 2.0
  ☆30Updated 5 years ago
• carefree0910 / carefree-data
  A data processing module implemented with numpy
  ☆10Updated 2 years ago
• EleutherAI / tqdm-multiprocess
  Using queues, tqdm-multiprocess supports multiple worker processes, each with multiple tqdm progress bars, displaying them cleanly throug…
  ☆41Updated 3 years ago
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated last year
• posterior / goftests
  Generic goodness of fit tests for random plain old data
  ☆11Updated 8 months ago
• symerio / neurtu
  Interactive parametric benchmarks in Python
  ☆17Updated 3 years ago
• rainwoodman / sharedmem
  A different flavor of multiprocessing in Python
  ☆81Updated 4 years ago
• MaineKuehn / usim
  Lightweight Python Simulation Framework
  ☆18Updated last week
• nv-legate / legate.pandas
  An Aspiring Drop-In Replacement for Pandas at Scale
  ☆73Updated 3 years ago
• escherba / python-metrohash
  Python bindings for MetroHash
  ☆19Updated 2 months ago