Alternatives and similar repositories for PyTorch-Eager-Mode-Quantization-TensorRT-Acceleration

Users that are interested in PyTorch-Eager-Mode-Quantization-TensorRT-Acceleration are comparing it to the libraries listed below

• andravin / spio
  Memory-Efficient CUDA kernels for training ConvNets with PyTorch.
  ☆41Updated 3 months ago
• leimao / PyTorch-Pruning-Example
  PyTorch Pruning Example
  ☆50Updated 2 years ago
• qbxlvnf11 / convert-pytorch-onnx-tensorrt
  Converting weights of Pytorch models to ONNX & TensorRT engines
  ☆49Updated 2 years ago
• NVlabs / EfficientDL
  ☆31Updated 11 months ago
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems In Docker
  ☆20Updated last year
• morousg / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆51Updated last week
• CVHub520 / efficientvit
  EfficientViT is a new family of vision models for efficient high-resolution vision.
  ☆26Updated last year
• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆39Updated 2 years ago
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated last year
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆87Updated 4 months ago
• alenic / timm-models-explorer
  Timm model explorer
  ☆39Updated last year
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆17Updated last year
• indri-voice / vit.triton
  VIT inference in triton because, why not?
  ☆28Updated last year
• LukasHedegaard / pytorch-benchmark
  Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption
  ☆103Updated last year
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆68Updated this week
• facebookresearch / DeltaCNN
  DeltaCNN End-to-End CNN Inference of Sparse Frame Differences in Videos
  ☆59Updated 2 years ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆96Updated 6 months ago
• facebookresearch / active_indexing
  Official implementation of "Active Image Indexing"
  ☆59Updated 2 years ago
• ohmydroid / reducenet
  ☆40Updated last year
• FrancescoSaverioZuppichini / Loading-huge-PyTorch-models-with-linear-memory-consumption
  Little article showing how to load pytorch's models with linear memory consumption
  ☆34Updated 2 years ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆33Updated 9 months ago
• voxel51 / reconstruction-error-ratios
  Estimate dataset difficulty and detect label mistakes using reconstruction error ratios!
  ☆25Updated 4 months ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆127Updated this week
• visual-layer / visuallayer
  Simplify Your Visual Data Ops. Find and visualize issues with your computer vision datasets such as duplicates, anomalies, data leakage, …
  ☆69Updated 3 weeks ago
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆76Updated 3 weeks ago
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆17Updated last month
• tridao / flash-attention-wheels
  ☆49Updated last year
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆120Updated 10 months ago
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆31Updated 2 years ago