ultralytics / thop

Related projects ⓘ

Alternatives and complementary repositories for thop

• NVIDIA / Deep-Learning-Accelerator-SW
  NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.
  ☆179Updated 5 months ago
• LukasHedegaard / pytorch-benchmark
  Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption
  ☆92Updated last year
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆127Updated 3 weeks ago
• Qualcomm-AI-research / FP8-quantization
  ☆123Updated last year
• NVIDIA-AI-IOT / nvidia-tao
  ☆82Updated 2 months ago
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆89Updated 3 weeks ago
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆112Updated 8 months ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆79Updated last year
• levipereira / yolov9-qat
  Implementation of YOLOv9 QAT optimized for deployment on TensorRT platforms.
  ☆84Updated 2 weeks ago
• Qualcomm-AI-research / transformer-quantization
  ☆195Updated 3 years ago
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆125Updated 2 weeks ago
• NVIDIA-AI-IOT / tao-toolkit-triton-apps
  Sample app code for deploying TAO Toolkit trained models to Triton
  ☆84Updated 2 months ago
• sony / model_optimization
  Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…
  ☆330Updated this week
• NVIDIA-AI-IOT / jetson_dla_tutorial
  A tutorial for getting started with the Deep Learning Accelerator (DLA) on NVIDIA Jetson
  ☆288Updated 2 years ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆149Updated 6 months ago
• xijiu9 / Train_Transformers_with_INT4
  ☆134Updated last year
• mit-han-lab / tinychat-tutorial
  ☆52Updated 2 weeks ago
• Macaronlin / LLaMA3-Quantization
  A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..
  ☆166Updated 3 months ago
• fumihwh / onnx-pytorch
  A code generator from ONNX to PyTorch code
  ☆133Updated 2 years ago
• NVIDIA-AI-IOT / tao_toolkit_recipes
  ☆32Updated last year
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆81Updated this week
• onnx / neural-compressor
  Model compression for ONNX
  ☆75Updated this week
• Guangxuan-Xiao / torch-int
  This repository contains integer operators on GPUs for PyTorch.
  ☆184Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆138Updated 2 months ago
• NVIDIA-AI-IOT / yolov5_gpu_optimization
  This repository provides YOLOV5 GPU optimization sample
  ☆100Updated last year
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆168Updated 3 weeks ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆98Updated 2 months ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆147Updated this week
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆48Updated 4 months ago