CEA-LIST / RPCDataloaderLinks
A variant of the PyTorch Dataloader using remote workers.
☆19Updated 2 years ago
Alternatives and similar repositories for RPCDataloader
Users that are interested in RPCDataloader are comparing it to the libraries listed below
Sorting:
- Demystify RAM Usage in Multi-Process Data Loaders☆205Updated 2 years ago
- Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda☆229Updated 2 years ago
- A small demonstration of using WebDataset with ImageNet and PyTorch Lightning☆75Updated last year
- Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.☆133Updated 2 years ago
- Examples for the WebDataset PyTorch Dataset Library☆51Updated 4 years ago
- An unopinionated replacement for PyTorch's Dataset and ImageFolder, that handles Tar archives☆78Updated 3 years ago
- Customized matrix multiplication kernels☆57Updated 3 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆219Updated 2 years ago
- gpu tester detects broken and slow gpus in a cluster☆72Updated 2 years ago
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆250Updated 3 years ago
- MONeT framework for reducing memory consumption of DNN training☆174Updated 4 years ago
- How and why you want to make your pytorch CUDA/CPP extension with a Makefile☆172Updated 6 years ago
- PyProf2: PyTorch Profiling tool☆82Updated 5 years ago
- Pytorch Custom CUDA kernel for searchsorted☆137Updated 2 years ago
- A python library that provides common I/O interface across different storage backends.☆148Updated 2 months ago
- A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.☆142Updated 3 years ago
- ☆108Updated 4 years ago
- Minimal effort CLIs derived from type hints and parse from command line, config files and environment variables☆406Updated this week
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆131Updated 3 years ago
- Configuration classes enabling type-safe PyTorch configuration for Hydra apps☆226Updated 3 years ago
- DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight …☆237Updated 2 years ago
- ☆62Updated 5 years ago
- Share numpy arrays across processes efficiently ideal for large, read-only datasets☆48Updated 8 years ago
- Code and weights for the paper "Cluster and Predict Latents Patches for Improved Masked Image Modeling"☆125Updated 8 months ago
- A tiny library for stochastic dataset caching in PyTorch.☆44Updated last year
- A Re-implementation of Fixed-update Initialization☆155Updated 6 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 3 years ago
- ☆165Updated 7 years ago
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆97Updated 3 years ago
- Estimate/count FLOPS for a given neural network using pytorch☆305Updated 3 years ago