ropas / pyteaLinks
PyTea: PyTorch Tensor shape error analyzer
☆323Updated 3 years ago
Alternatives and similar repositories for pytea
Users that are interested in pytea are comparing it to the libraries listed below
Sorting:
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆138Updated 2 years ago
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆389Updated 2 years ago
- Slicing a PyTorch Tensor Into Parallel Shards☆300Updated 8 months ago
- Demystify RAM Usage in Multi-Process Data Loaders☆205Updated 2 years ago
- Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models☆807Updated 8 months ago
- Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)☆224Updated 10 months ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆228Updated 3 years ago
- Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc.☆244Updated 3 years ago
- Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch☆184Updated 3 years ago
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆132Updated last year
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆220Updated 2 years ago
- Code release for "Dropout Reduces Underfitting"☆316Updated 2 years ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆246Updated 3 weeks ago
- Implementation of Linformer for Pytorch☆305Updated 2 years ago
- functorch is JAX-like composable function transforms for PyTorch.☆1,436Updated 5 months ago
- Library for 8-bit optimizers and quantization routines.☆780Updated 3 years ago
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,072Updated last year
- Accelerate training by storing parameters in one contiguous chunk of memory.☆294Updated 5 years ago
- A lightweight web dashboard for monitoring GPU usage☆210Updated 3 months ago
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆250Updated 3 years ago
- Prune a model while finetuning or training.☆406Updated 3 years ago
- Accelerate PyTorch models with ONNX Runtime☆367Updated this week
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆193Updated 3 years ago
- ☆292Updated last year
- PDFs and Codelabs for the Efficient Deep Learning book.☆204Updated 2 years ago
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆438Updated last year
- Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"☆372Updated 2 years ago
- A bag of tricks to speed up your deep learning process☆163Updated last year
- A general and accurate MACs / FLOPs profiler for PyTorch models☆635Updated 6 months ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆199Updated 3 years ago