Alternatives and similar repositories for examples

Users that are interested in examples are comparing it to the libraries listed below

• TRT2022 / MST-plus-plus-TensorRT
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆143Updated 3 years ago
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆70Updated 2 years ago
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆142Updated 2 years ago
• bytedance / MRECG
  ☆36Updated 2 years ago
• BillAmihom / RAPQ
  Pytorch implementation of RAPQ, IJCAI 2022
  ☆23Updated 2 years ago
• Qingrenn / mmdeploy-summer-camp
  🐱 ncnn int8 模型量化评估
  ☆14Updated 3 years ago
• ModelTC / mqbench-paper
  ☆45Updated 4 years ago
• jnulzl / PyTorch-QAT
  PyTorch Quantization Aware Training(QAT,量化感知训练)
  ☆42Updated 2 years ago
• sophgo / tpu-mq
  Model Quantization Benchmark
  ☆18Updated 4 months ago
• chenlamei / MobileVit_TensorRT
  TensorRT 2022 亚军方案，tensorrt加速mobilevit模型
  ☆68Updated 3 years ago
• megvii-research / megvii-tsinghua-dl-course
  Slides with modifications for a course at Tsinghua University.
  ☆64Updated 3 years ago
• Tlntin / trt2023
  ☆26Updated 2 years ago
• Ranking666 / Base-quantization
  base quantization methods including: QAT, PTQ, per_channel, per_tensor, dorefa, lsq, adaround, omse, Histogram, bias_correction.etc
  ☆51Updated 3 years ago
• MegEngine / cutlass
  CUDA Templates for Linear Algebra Subroutines
  ☆101Updated last year
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Updated 2 years ago
• DeadAt0m / LSQFakeQuantize-PyTorch
  FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch
  ☆37Updated 4 years ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆83Updated 3 years ago
• ChenShisen / ncnnqat
  quantize aware training package for NCNN on pytorch
  ☆69Updated 4 years ago
• GATECH-EIC / DepthShrinker
  [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …
  ☆35Updated 3 years ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆163Updated 3 months ago
• hahnyuan / PTQ4ViT
  Post-Training Quantization for Vision transformers.
  ☆236Updated 3 years ago
• YanjingLi0202 / Q-ViT
  The official implementation of the NeurIPS 2022 paper Q-ViT.
  ☆106Updated 2 years ago
• OpenPPL / ppl.kernel.cuda
  ☆38Updated last year
• ModelTC / LPCV2021_Winner_Solution
  ☆28Updated 4 years ago
• BBuf / onnx_learn
  ☆103Updated 4 years ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆43Updated 2 years ago
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated 2 months ago
• ModelTC / NART
  NART = NART is not A RunTime, a deep learning inference framework.
  ☆37Updated 2 years ago
• ArtyZe / yolo_quantization
  Based of paper "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"
  ☆67Updated 5 years ago
• ICT-ANS / StarLight
  ☆61Updated last year