Alternatives and similar repositories for PyTorch-Eager-Mode-Quantization-TensorRT-Acceleration

Users that are interested in PyTorch-Eager-Mode-Quantization-TensorRT-Acceleration are comparing it to the libraries listed below

• leimao / PyTorch-Pruning-Example
  PyTorch Pruning Example
  ☆50Updated 3 years ago
• LukasHedegaard / pytorch-benchmark
  Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption
  ☆109Updated 2 years ago
• andravin / spio
  Experimental CUDA kernel framework unifying typed dimensions, NVRTC JIT specialization, and ML‑guided tuning.
  ☆46Updated last week
• onnx / neural-compressor
  Model compression for ONNX
  ☆99Updated last year
• qbxlvnf11 / convert-pytorch-onnx-tensorrt
  Converting weights of Pytorch models to ONNX & TensorRT engines
  ☆50Updated 2 years ago
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆54Updated 2 months ago
• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆94Updated this week
• gpu-mode / profiling-cuda-in-torch
  ☆178Updated last year
• ultralytics / thop
  Profile PyTorch models for FLOPs and parameters, helping to evaluate computational efficiency and memory usage.
  ☆121Updated 3 weeks ago
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆84Updated last week
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆171Updated 2 weeks ago
• NVIDIA / tao_pytorch_backend
  TAO Toolkit deep learning networks with PyTorch backend
  ☆108Updated last month
• NVlabs / EfficientDL
  ☆34Updated 7 months ago
• meta-pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆247Updated 2 weeks ago
• PINTO0309 / simple-onnx-processing-tools
  A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…
  ☆303Updated last year
• alenic / timm-models-explorer
  Timm model explorer
  ☆42Updated last year
• gpu-mode / triton-tutorials
  ☆16Updated 8 months ago
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆182Updated last month
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆85Updated this week
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆95Updated last year
• SzymonOzog / FastSoftmax
  Step by step implementation of a fast softmax kernel in CUDA
  ☆60Updated last year
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆163Updated 3 months ago
• VcampSoldiers / Swin-Transformer-Tensorflow
  Unofficial implementation of "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" (https://arxiv.org/abs/2103.14030)
  ☆67Updated 4 years ago
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆305Updated last year
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆172Updated 2 weeks ago
• fumihwh / onnx-pytorch
  A code generator from ONNX to PyTorch code
  ☆142Updated 3 years ago
• triple-mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆42Updated 3 years ago
• Qualcomm-AI-research / transformer-quantization
  ☆208Updated 4 years ago
• meta-pytorch / superblock
  A block oriented training approach for inference time optimization.
  ☆34Updated last year
• NVIDIA-AI-IOT / clip-distillation
  Zero-label image classification via OpenCLIP knowledge distillation
  ☆141Updated 2 years ago