zugexiaodui / torch_flopsLinks
A library for calculating the FLOPs in the forward() process based on torch.fx
☆112Updated 2 months ago
Alternatives and similar repositories for torch_flops
Users that are interested in torch_flops are comparing it to the libraries listed below
Sorting:
- An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…☆89Updated last year
- ☆191Updated last year
- Implementation of Post-training Quantization on Diffusion Models (CVPR 2023)☆138Updated 2 years ago
- Awesome list of papers that extend Mamba to various applications.☆133Updated last month
- [CVPR'23] SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer☆69Updated last year
- [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"☆326Updated 5 months ago
- Curated list of methods that focuses on improving the efficiency of diffusion models☆45Updated 10 months ago
- [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…☆60Updated 11 months ago
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆46Updated 5 months ago
- Causal depthwise conv1d in CUDA, with a PyTorch interface☆465Updated last week
- [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation☆95Updated 2 months ago
- Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…☆104Updated last month
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆290Updated 2 months ago
- Open source implementation of "Vision Transformers Need Registers"☆177Updated last month
- [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".☆247Updated 2 years ago
- XAttention: Block Sparse Attention with Antidiagonal Scoring☆158Updated 2 weeks ago
- Triton implement of bi-directional (non-causal) linear attention☆48Updated 3 months ago
- 📚 Collection of token-level model compression resources.☆87Updated this week
- [CVPR 2025] Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers☆50Updated 8 months ago
- The official implementation of the ICML 2023 paper OFQ-ViT☆30Updated last year
- [NeurIPS 2023] Structural Pruning for Diffusion Models☆194Updated 10 months ago
- [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…☆96Updated last year
- Awasome Papers and Resources in Deep Neural Network Pruning with Source Code.☆157Updated 9 months ago
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models☆294Updated 3 months ago
- The official implementation of the NeurIPS 2022 paper Q-ViT.☆88Updated 2 years ago
- [TMLR] Official PyTorch implementation of paper "Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precisio…☆44Updated 8 months ago
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆69Updated 4 months ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆65Updated last year
- [NeurIPS 2024] The official code of "U-DiTs: Downsample Tokens in U-Shaped Diffusion Transformers"☆207Updated 8 months ago
- The official implementation of PTQD: Accurate Post-Training Quantization for Diffusion Models☆98Updated last year