ppwwyyxx / RAM-multiprocess-dataloaderLinks
Demystify RAM Usage in Multi-Process Data Loaders
☆194Updated 2 years ago
Alternatives and similar repositories for RAM-multiprocess-dataloader
Users that are interested in RAM-multiprocess-dataloader are comparing it to the libraries listed below
Sorting:
- Slicing a PyTorch Tensor Into Parallel Shards☆299Updated last month
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆214Updated 2 years ago
- A general and accurate MACs / FLOPs profiler for PyTorch models☆620Updated last year
- Accelerate training by storing parameters in one contiguous chunk of memory.☆291Updated 4 years ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆235Updated 6 months ago
- Estimate/count FLOPS for a given neural network using pytorch☆305Updated 3 years ago
- Official repository for "Revisiting Weakly Supervised Pre-Training of Visual Perception Models". https://arxiv.org/abs/2201.08371.☆179Updated 3 years ago
- Examples for the WebDataset PyTorch Dataset Library☆50Updated 4 years ago
- Implementation of a Transformer, but completely in Triton☆270Updated 3 years ago
- Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)☆218Updated 3 months ago
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆378Updated last year
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆200Updated 2 years ago
- Code release for "Dropout Reduces Underfitting"☆313Updated 2 years ago
- Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda☆225Updated last year
- A GPU performance profiling tool for PyTorch models☆503Updated 4 years ago
- The C++ Standard Template Library (STL) for Python.☆23Updated last year
- A LARS implementation in PyTorch☆348Updated 5 years ago
- Batch computation of the linear assignment problem on GPU.☆86Updated 5 months ago
- Library for 8-bit optimizers and quantization routines.☆716Updated 2 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆225Updated 3 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆432Updated 9 months ago
- This is the official PyTorch implementation for "Mesa: A Memory-saving Training Framework for Transformers".☆120Updated 3 years ago
- A code generator from ONNX to PyTorch code☆138Updated 2 years ago
- A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.☆141Updated 3 years ago
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆193Updated 2 years ago
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 3 years ago
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆129Updated 7 months ago
- ☆157Updated last year
- Experimental ground for optimizing memory of pytorch models☆366Updated 7 years ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆180Updated last week