Alternatives and similar repositories for PyTorch-Eager-Mode-Quantization-TensorRT-Acceleration:

Users that are interested in PyTorch-Eager-Mode-Quantization-TensorRT-Acceleration are comparing it to the libraries listed below

• morousg / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆47Updated this week
• andravin / spio
  Efficient CUDA kernels for training convolutional neural networks with PyTorch.
  ☆38Updated last month
• qbxlvnf11 / convert-pytorch-onnx-tensorrt
  Converting weights of Pytorch models to ONNX & TensorRT engines
  ☆47Updated last year
• onnx / neural-compressor
  Model compression for ONNX
  ☆81Updated 2 months ago
• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆37Updated 2 years ago
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆68Updated this week
• k9ele7en / Triton-TensorRT-Inference-CRAFT-pytorch
  Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…
  ☆32Updated 3 years ago
• visual-layer / visuallayer
  Simplify Your Visual Data Ops. Find and visualize issues with your computer vision datasets such as duplicates, anomalies, data leakage, …
  ☆67Updated last year
• NVlabs / EfficientDL
  ☆31Updated 7 months ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆32Updated 5 months ago
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆30Updated 2 years ago
• alenic / timm-models-explorer
  Timm model explorer
  ☆36Updated 9 months ago
• diegofiori / benchmark-pytorch2.0-with-nebullvm
  ☆9Updated 2 years ago
• Curt-Park / mnist-fastapi-celery-triton
  Simple example of FastAPI + Celery + Triton for benchmarking
  ☆63Updated 2 years ago
• PINTO0309 / scs4onnx
  A very simple tool that compresses the overall size of the ONNX model by aggregating duplicate constant values as much as possible.
  ☆52Updated 2 years ago
• sdpython / onnx-extended
  New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA
  ☆31Updated 3 months ago
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆17Updated last year
• pallashadow / yolov5face_torchserve_tensorrt
  Torchserve + TensorRT + Detection
  ☆18Updated 2 years ago
• snap-research / efficient-nn-tutorial
  Page for the CVPR 2023 Tutorial - Efficient Neural Networks: From Algorithm Design to Practical Mobile Deployments
  ☆12Updated last year
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆27Updated 2 years ago
• FrancescoSaverioZuppichini / dynamic-batching-asyncio
  ☆31Updated last year
• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆21Updated 8 months ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆84Updated last year
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated 7 months ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆75Updated this week
• leimao / Nsight-Compute-Docker-Image
  Nsight Compute in Docker
  ☆11Updated last year
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 5 months ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆107Updated last year
• CPFelix / nanodet
  ☆20Updated 2 years ago