Alternatives and similar repositories for thop:

Users that are interested in thop are comparing it to the libraries listed below

• LukasHedegaard / pytorch-benchmark
  Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption
  ☆98Updated last year
• MingSun-Tse / Awesome-Efficient-ViT
  Recent Advances on Efficient Vision Transformers
  ☆49Updated 2 years ago
• chengtao-lv / PTQ4SAM
  [CVPR 2024] PTQ4SAM: Post-Training Quantization for Segment Anything
  ☆62Updated 7 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆136Updated last year
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆22Updated 8 months ago
• DefTruth / ffpa-attn-mma
  📚FFPA: Yet another Faster Flash Prefill Attention with O(1)⚡️SRAM complexity for headdim > 256, 1.8x~3x↑🎉faster than SDPA EA.
  ☆101Updated this week
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆86Updated this week
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆47Updated last year
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆221Updated 6 months ago
• Oneflow-Inc / OneFlow-Pruning
  [CVPR-2023] Towards Any Structural Pruning
  ☆16Updated last year
• Qualcomm-AI-research / transformer-quantization
  ☆198Updated 3 years ago
• ChenMnZ / PrefixQuant
  An algorithm for static activation quantization of LLMs
  ☆115Updated 2 weeks ago
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆57Updated 11 months ago
• indri-voice / vit.triton
  VIT inference in triton because, why not?
  ☆23Updated 8 months ago
• IST-DASLab / OBC
  Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".
  ☆109Updated last year
• vra / flopth
  A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.
  ☆125Updated 2 months ago
• NVlabs / COAT
  ☆68Updated this week
• VainF / Isomorphic-Pruning
  [ECCV 2024] Isomorphic Pruning for Vision Models
  ☆65Updated 6 months ago
• Macaronlin / LLaMA3-Quantization
  A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..
  ☆177Updated last month
• Deep-Learning-Profiling-Tools / triton-viz
  ☆177Updated this week
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆116Updated 11 months ago
• liangyn22 / MCUFormer
  [NeurIPS 2023] MCUFormer: Deploying Vision Transformers on Microcontrollers with Limited Memory
  ☆65Updated last year
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆57Updated this week
• alenic / timm-models-explorer
  Timm model explorer
  ☆37Updated 10 months ago
• facebookresearch / DepthShrinker
  [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …
  ☆71Updated 2 years ago
• Raincleared-Song / sparse_gpu_operator
  GPU operators for sparse tensor operations
  ☆30Updated 11 months ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆141Updated 8 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• ziplab / PTQD
  The official implementation of PTQD: Accurate Post-Training Quantization for Diffusion Models
  ☆94Updated 11 months ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year