Alternatives and similar repositories for examples:

Users that are interested in examples are comparing it to the libraries listed below

• TRT2022 / MST-plus-plus-TensorRT
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆138Updated 2 years ago
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆124Updated last year
• bytedance / MRECG
  ☆34Updated last year
• megvii-research / megvii-tsinghua-dl-course
  Slides with modifications for a course at Tsinghua University.
  ☆58Updated 2 years ago
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆69Updated last year
• Tlntin / trt2023
  ☆24Updated last year
• chenlamei / MobileVit_TensorRT
  TensorRT 2022 亚军方案，tensorrt加速mobilevit模型
  ☆61Updated 2 years ago
• Qingrenn / mmdeploy-summer-camp
  🐱 ncnn int8 模型量化评估
  ☆13Updated 2 years ago
• ModelTC / mqbench-paper
  ☆44Updated 3 years ago
• BillAmihom / RAPQ
  Pytorch implementation of RAPQ, IJCAI 2022
  ☆21Updated last year
• xiatwhu / trt2023
  ☆26Updated last year
• Ranking666 / Base-quantization
  base quantization methods including: QAT, PTQ, per_channel, per_tensor, dorefa, lsq, adaround, omse, Histogram, bias_correction.etc
  ☆42Updated 2 years ago
• ModelTC / NART
  NART = NART is not A RunTime, a deep learning inference framework.
  ☆38Updated 2 years ago
• YanjingLi0202 / Q-ViT
  The official implementation of the NeurIPS 2022 paper Q-ViT.
  ☆88Updated last year
• BBuf / ArmNeonOptimization
  arm-neon
  ☆90Updated 7 months ago
• MegEngine / cutlass
  CUDA Templates for Linear Algebra Subroutines
  ☆96Updated 10 months ago
• OpenPPL / ppl.kernel.cuda
  ☆35Updated 5 months ago
• corleonechensiyu / tinyCNN
  将MNN拆解的简易前向推理框架(for study!)
  ☆20Updated 4 years ago
• jnulzl / PyTorch-QAT
  PyTorch Quantization Aware Training(QAT,量化感知训练)
  ☆30Updated last year
• OpenPPL / ppl.pmx
  ☆58Updated 3 months ago
• hahnyuan / PTQ4ViT
  Post-Training Quantization for Vision transformers.
  ☆206Updated 2 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆41Updated last year
• ModelTC / LPCV2021_Winner_Solution
  ☆28Updated 3 years ago
• DeadAt0m / LSQFakeQuantize-PyTorch
  FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch
  ☆33Updated 3 years ago
• Syencil / Programming_Massively_Parallel_Processors
  CUDA 6大并行计算模式 代码与笔记
  ☆60Updated 4 years ago
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆47Updated last year
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆80Updated 2 years ago
• ModelTC / NNLQP
  ☆34Updated 2 years ago
• peiswang / BitSplit
  BitSplit Post-trining Quantization
  ☆49Updated 3 years ago
• ICT-ANS / StarLight
  ☆59Updated 8 months ago