Alternatives and similar repositories for examples:

Users that are interested in examples are comparing it to the libraries listed below

• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆69Updated last year
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆123Updated last year
• bytedance / MRECG
  ☆34Updated last year
• Qingrenn / mmdeploy-summer-camp
  🐱 ncnn int8 模型量化评估
  ☆12Updated 2 years ago
• chenlamei / MobileVit_TensorRT
  TensorRT 2022 亚军方案，tensorrt加速mobilevit模型
  ☆61Updated 2 years ago
• BillAmihom / RAPQ
  Pytorch implementation of RAPQ, IJCAI 2022
  ☆21Updated last year
• Tlntin / trt2023
  ☆23Updated last year
• megvii-research / megvii-tsinghua-dl-course
  Slides with modifications for a course at Tsinghua University.
  ☆58Updated 2 years ago
• ModelTC / mqbench-paper
  ☆44Updated 3 years ago
• YanjingLi0202 / Q-ViT
  The official implementation of the NeurIPS 2022 paper Q-ViT.
  ☆86Updated last year
• ModelTC / NART
  NART = NART is not A RunTime, a deep learning inference framework.
  ☆38Updated last year
• TRT2022 / MST-plus-plus-TensorRT
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆138Updated 2 years ago
• Ranking666 / Base-quantization
  base quantization methods including: QAT, PTQ, per_channel, per_tensor, dorefa, lsq, adaround, omse, Histogram, bias_correction.etc
  ☆42Updated 2 years ago
• hahnyuan / PTQ4ViT
  Post-Training Quantization for Vision transformers.
  ☆204Updated 2 years ago
• OpenPPL / ppl.kernel.cuda
  ☆35Updated 4 months ago
• ModelTC / LPCV2021_Winner_Solution
  ☆28Updated 3 years ago
• ICT-ANS / StarLight
  ☆59Updated 7 months ago
• megvii-research / basecls
  A codebase & model zoo for pretrained backbone based on MegEngine.
  ☆33Updated last year
• corleonechensiyu / tinyCNN
  将MNN拆解的简易前向推理框架(for study!)
  ☆20Updated 4 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆41Updated last year
• MegEngine / cutlass
  CUDA Templates for Linear Algebra Subroutines
  ☆96Updated 9 months ago
• wimh966 / QDrop
  The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quan…
  ☆115Updated last year
• aim-uofa / model-quantization
  Collections of model quantization algorithms. Any issues, please contact Peng Chen (blueardour@gmail.com)
  ☆42Updated 3 years ago
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆47Updated last year
• Syencil / Programming_Massively_Parallel_Processors
  CUDA 6大并行计算模式 代码与笔记
  ☆60Updated 4 years ago
• GATECH-EIC / DepthShrinker
  [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …
  ☆35Updated 2 years ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆80Updated 2 years ago
• ArtyZe / yolo_quantization
  Based of paper "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"
  ☆62Updated 4 years ago
• xiatwhu / trt2023
  ☆26Updated last year
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆42Updated last year