ropas / pyteaLinks
PyTea: PyTorch Tensor shape error analyzer
☆322Updated 3 years ago
Alternatives and similar repositories for pytea
Users that are interested in pytea are comparing it to the libraries listed below
Sorting:
- Slicing a PyTorch Tensor Into Parallel Shards☆300Updated 3 months ago
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆138Updated 2 years ago
- Demystify RAM Usage in Multi-Process Data Loaders☆201Updated 2 years ago
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆381Updated 2 years ago
- Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)☆221Updated 6 months ago
- Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models☆798Updated 3 months ago
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆251Updated 2 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆226Updated 3 years ago
- Accelerate training by storing parameters in one contiguous chunk of memory.☆291Updated 4 years ago
- Code release for "Dropout Reduces Underfitting"☆314Updated 2 years ago
- Implementation of a Transformer, but completely in Triton☆274Updated 3 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆214Updated 2 years ago
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆437Updated last year
- Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda☆227Updated last year
- A lightweight web dashboard for monitoring GPU usage☆202Updated last year
- Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch☆183Updated 2 years ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆240Updated this week
- Implementation of Linformer for Pytorch☆300Updated last year
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆131Updated 10 months ago
- A general and accurate MACs / FLOPs profiler for PyTorch models☆629Updated last month
- Library for 8-bit optimizers and quantization routines.☆779Updated 3 years ago
- Accelerate PyTorch models with ONNX Runtime☆364Updated 7 months ago
- Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc.☆241Updated 3 years ago
- optimizer & lr scheduler & loss function collections in PyTorch☆356Updated this week
- Pytorch Lightning Distributed Accelerators using Ray☆213Updated last year
- Configuration classes enabling type-safe PyTorch configuration for Hydra apps☆222Updated 2 years ago
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆193Updated 2 years ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆797Updated last year
- Prune a model while finetuning or training.☆405Updated 3 years ago
- Implementation of "Attention Is Off By One" by Evan Miller☆197Updated 2 years ago