zugexiaodui / torch_flops
A library for calculating the FLOPs in the forward() process based on torch.fx
☆99Updated 6 months ago
Alternatives and similar repositories for torch_flops:
Users that are interested in torch_flops are comparing it to the libraries listed below
- An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…☆80Updated last year
- [CVPR'23] SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer☆65Updated 11 months ago
- Causal depthwise conv1d in CUDA, with a PyTorch interface☆412Updated 3 months ago
- Implementation of Post-training Quantization on Diffusion Models (CVPR 2023)☆132Updated last year
- [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".☆249Updated last year
- [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"☆290Updated 3 months ago
- ☆189Updated last year
- The official implementation of the NeurIPS 2022 paper Q-ViT.☆87Updated last year
- [NeurIPS 2023] Structural Pruning for Diffusion Models☆183Updated 8 months ago
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆63Updated 3 months ago
- ☆40Updated last year
- Awesome list of papers that extend Mamba to various applications.☆132Updated 3 months ago
- Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…☆89Updated last month
- [IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer☆329Updated last year
- [ICLR 2025 Spotlight] Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures☆428Updated last month
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆113Updated last year
- Neighborhood Attention Extension. Bringing attention to a neighborhood near you!☆426Updated last week
- Recent Advances on Efficient Vision Transformers☆49Updated 2 years ago
- FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores☆307Updated 2 months ago
- [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…☆59Updated 9 months ago
- Curated list of methods that focuses on improving the efficiency of diffusion models☆39Updated 8 months ago
- [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation☆67Updated this week
- The official implementation of PTQD: Accurate Post-Training Quantization for Diffusion Models☆96Updated last year
- Patch convolution to avoid large GPU memory usage of Conv2D☆84Updated 2 months ago
- ☆153Updated 2 months ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆80Updated last year
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆63Updated 11 months ago
- Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…☆47Updated last year
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models☆272Updated last month
- Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation. In CVPR 2022.☆129Updated 2 years ago