ropas / pytea
PyTea: PyTorch Tensor shape error analyzer
☆316Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for pytea
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆134Updated last year
- Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models☆760Updated 4 months ago
- Accelerate training by storing parameters in one contiguous chunk of memory.☆291Updated 4 years ago
- A general and accurate MACs / FLOPs profiler for PyTorch models☆571Updated 6 months ago
- Implementation of ConvMixer for "Patches Are All You Need? 🤷"☆1,062Updated 2 years ago
- The goal of this library is to generate more helpful exception messages for matrix algebra expressions for numpy, pytorch, jax, tensorflo…☆796Updated 2 years ago
- Profiling and inspecting memory in pytorch☆1,020Updated 3 months ago
- Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)☆208Updated this week
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)☆1,295Updated 5 months ago
- Slicing a PyTorch Tensor Into Parallel Shards☆296Updated 3 years ago
- Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc.☆228Updated 2 years ago
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆119Updated 11 months ago
- Implementation of a Transformer, but completely in Triton☆249Updated 2 years ago
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆360Updated last year
- Deep Learning Experiment Management☆639Updated last year
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆253Updated 2 years ago
- PDFs and Codelabs for the Efficient Deep Learning book.☆189Updated last year
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆222Updated 2 years ago
- Library for 8-bit optimizers and quantization routines.☆714Updated 2 years ago
- An All-MLP solution for Vision, from Google AI☆1,003Updated 2 months ago
- Code release for "Dropout Reduces Underfitting"☆312Updated last year
- Demystify RAM Usage in Multi-Process Data Loaders☆180Updated last year
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆698Updated 6 months ago
- Visualize PyTorch tensors with a single line of code.☆647Updated 11 months ago
- optimizer & lr scheduler & loss function collections in PyTorch☆237Updated last week
- ☆574Updated last week
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]☆991Updated last year
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆216Updated last week
- [ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?☆325Updated 2 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆207Updated last year