ppwwyyxx / RAM-multiprocess-dataloader
Demystify RAM Usage in Multi-Process Data Loaders
☆187Updated last year
Alternatives and similar repositories for RAM-multiprocess-dataloader:
Users that are interested in RAM-multiprocess-dataloader are comparing it to the libraries listed below
- Slicing a PyTorch Tensor Into Parallel Shards☆298Updated 3 years ago
- Estimate/count FLOPS for a given neural network using pytorch☆303Updated 2 years ago
- Implementation of a Transformer, but completely in Triton☆253Updated 2 years ago
- A general and accurate MACs / FLOPs profiler for PyTorch models☆592Updated 8 months ago
- A LARS implementation in PyTorch☆338Updated 4 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆210Updated last year
- Accelerate training by storing parameters in one contiguous chunk of memory.☆292Updated 4 years ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆201Updated 2 years ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆225Updated last week
- A GPU performance profiling tool for PyTorch models☆500Updated 3 years ago
- Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)☆214Updated this week
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆226Updated 2 years ago
- ☆157Updated last year
- Examples for the WebDataset PyTorch Dataset Library☆47Updated 3 years ago
- Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda☆216Updated last year
- A code generator from ONNX to PyTorch code☆135Updated 2 years ago
- This repository contains the experimental PyTorch native float8 training UX☆219Updated 5 months ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆178Updated last month
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆252Updated 2 years ago
- Torch Distributed Experimental☆115Updated 5 months ago
- Accelerate PyTorch models with ONNX Runtime☆357Updated 4 months ago
- Helpful tools and examples for working with flex-attention☆603Updated this week
- Pipeline Parallelism for PyTorch☆739Updated 5 months ago
- A library for unit scaling in PyTorch☆122Updated 2 months ago
- Block-sparse primitives for PyTorch☆154Updated 3 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆417Updated 3 months ago
- A library to analyze PyTorch traces.☆325Updated this week
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 2 years ago
- Configuration classes enabling type-safe PyTorch configuration for Hydra apps☆210Updated 2 years ago
- PyTorch layer-by-layer model profiler☆606Updated 3 years ago