Alternatives and similar repositories for PyTorch-Eager-Mode-Quantization-TensorRT-Acceleration

Users that are interested in PyTorch-Eager-Mode-Quantization-TensorRT-Acceleration are comparing it to the libraries listed below

• onnx / neural-compressor
  Model compression for ONNX
  ☆99Updated last year
• andravin / spio
  Spio (SPEE-oh) - Experimental CUDA kernel framework unifying typed dimensions, NVRTC JIT specialization, and ML‑guided tuning.
  ☆46Updated this week
• qbxlvnf11 / convert-pytorch-onnx-tensorrt
  Converting weights of Pytorch models to ONNX & TensorRT engines
  ☆50Updated 2 years ago
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆54Updated last month
• leimao / PyTorch-Pruning-Example
  PyTorch Pruning Example
  ☆50Updated 3 years ago
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆170Updated this week
• LukasHedegaard / pytorch-benchmark
  Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption
  ☆109Updated 2 years ago
• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆87Updated this week
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆82Updated last month
• triple-mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆41Updated 3 years ago
• Qualcomm-AI-research / transformer-quantization
  ☆208Updated 4 years ago
• SonySemiconductorSolutions / mct-model-optimization
  Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…
  ☆428Updated this week
• PINTO0309 / simple-onnx-processing-tools
  A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…
  ☆303Updated last year
• NVlabs / EfficientDL
  ☆34Updated 6 months ago
• ultralytics / thop
  Profile PyTorch models for FLOPs and parameters, helping to evaluate computational efficiency and memory usage.
  ☆108Updated last week
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆95Updated last year
• leimao / PyTorch-Quantization-Aware-Training
  PyTorch Quantization Aware Training Example
  ☆149Updated last year
• NVlabs / HALP
  ☆70Updated 3 years ago
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆85Updated this week
• levipereira / yolov9-qat
  Implementation of YOLOv9 QAT optimized for deployment on TensorRT platforms.
  ☆129Updated 8 months ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆83Updated 2 years ago
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems In Docker
  ☆20Updated 2 years ago
• CVHub520 / efficientvit
  EfficientViT is a new family of vision models for efficient high-resolution vision.
  ☆30Updated 2 years ago
• NVIDIA-AI-IOT / clip-distillation
  Zero-label image classification via OpenCLIP knowledge distillation
  ☆141Updated 2 years ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆170Updated this week
• gpu-mode / profiling-cuda-in-torch
  ☆178Updated last year
• WongKinYiu / GeneralistYOLO
  Generalist YOLO: Towards Real-Time End-to-End Multi-Task Visual Language Models
  ☆86Updated 8 months ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆300Updated this week
• alenic / timm-models-explorer
  Timm model explorer
  ☆42Updated last year
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆290Updated 3 weeks ago