ropas / pytea
PyTea: PyTorch Tensor shape error analyzer
☆314Updated 2 years ago
Related projects: ⓘ
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆134Updated last year
- Slicing a PyTorch Tensor Into Parallel Shards☆295Updated 3 years ago
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆355Updated last year
- Library for 8-bit optimizers and quantization routines.☆713Updated 2 years ago
- Implementation of ConvMixer for "Patches Are All You Need? 🤷"☆1,057Updated last year
- Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models☆746Updated 2 months ago
- A general and accurate MACs / FLOPs profiler for PyTorch models☆557Updated 4 months ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆221Updated 2 years ago
- Implementation of Linformer for Pytorch☆244Updated 8 months ago
- Demystify RAM Usage in Multi-Process Data Loaders☆171Updated last year
- Profiling and inspecting memory in pytorch☆1,013Updated last month
- An All-MLP solution for Vision, from Google AI☆987Updated this week
- A LARS implementation in PyTorch☆332Updated 4 years ago
- optimizer & lr scheduler & loss function collections in PyTorch☆221Updated last week
- Accelerate training by storing parameters in one contiguous chunk of memory.☆291Updated 3 years ago
- Ranger deep learning optimizer rewrite to use newest components☆322Updated 7 months ago
- Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc.☆226Updated 2 years ago
- Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)☆480Updated 3 years ago
- Learning Rate Warmup in PyTorch☆387Updated 4 months ago
- Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)☆207Updated this week
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…☆594Updated last year
- depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.☆424Updated this week
- Code release for "Dropout Reduces Underfitting"☆311Updated last year
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆474Updated 2 years ago
- DeLighT: Very Deep and Light-Weight Transformers☆465Updated 3 years ago
- ☆433Updated last year
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)☆1,281Updated 3 months ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆672Updated 4 months ago
- ☆557Updated this week
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆212Updated 3 years ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆213Updated this week