Alternatives and similar repositories for examples

Users that are interested in examples are comparing it to the libraries listed below

• TRT2022 / MST-plus-plus-TensorRT
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆143Updated 3 years ago
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆69Updated 2 years ago
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆141Updated last year
• bytedance / MRECG
  ☆36Updated 2 years ago
• MegEngine / cutlass
  CUDA Templates for Linear Algebra Subroutines
  ☆101Updated last year
• jnulzl / PyTorch-QAT
  PyTorch Quantization Aware Training(QAT,量化感知训练)
  ☆42Updated 2 years ago
• megvii-research / megvii-tsinghua-dl-course
  Slides with modifications for a course at Tsinghua University.
  ☆62Updated 3 years ago
• sophgo / tpu-mq
  Model Quantization Benchmark
  ☆18Updated 2 months ago
• Qingrenn / mmdeploy-summer-camp
  🐱 ncnn int8 模型量化评估
  ☆14Updated 3 years ago
• BillAmihom / RAPQ
  Pytorch implementation of RAPQ, IJCAI 2022
  ☆23Updated 2 years ago
• Ranking666 / Base-quantization
  base quantization methods including: QAT, PTQ, per_channel, per_tensor, dorefa, lsq, adaround, omse, Histogram, bias_correction.etc
  ☆51Updated 3 years ago
• chenlamei / MobileVit_TensorRT
  TensorRT 2022 亚军方案，tensorrt加速mobilevit模型
  ☆68Updated 3 years ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆162Updated 2 months ago
• Tlntin / trt2023
  ☆26Updated 2 years ago
• ModelTC / mqbench-paper
  ☆44Updated 4 years ago
• OAID / TengineInferPipe
  ☆24Updated 3 years ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆83Updated 2 years ago
• YanjingLi0202 / Q-ViT
  The official implementation of the NeurIPS 2022 paper Q-ViT.
  ☆102Updated 2 years ago
• ChenShisen / ncnnqat
  quantize aware training package for NCNN on pytorch
  ☆69Updated 4 years ago
• GATECH-EIC / DepthShrinker
  [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …
  ☆35Updated 3 years ago
• DeadAt0m / LSQFakeQuantize-PyTorch
  FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch
  ☆37Updated 4 years ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆43Updated 2 years ago
• ModelTC / NART
  NART = NART is not A RunTime, a deep learning inference framework.
  ☆37Updated 2 years ago
• hustvl / PD-Quant
  [CVPR 2023] PD-Quant: Post-Training Quantization Based on Prediction Difference Metric
  ☆60Updated 2 years ago
• OpenPPL / ppl.kernel.cuda
  ☆38Updated last year
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆50Updated 2 years ago
• wimh966 / QDrop
  The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quan…
  ☆125Updated 3 months ago
• hahnyuan / PTQ4ViT
  Post-Training Quantization for Vision transformers.
  ☆235Updated 3 years ago
• BBuf / how-to-optimize-gemm
  ☆98Updated 4 years ago
• ArtyZe / yolo_quantization
  Based of paper "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"
  ☆66Updated 4 years ago