Alternatives and similar repositories for TPAT

Users that are interested in TPAT are comparing it to the libraries listed below

• OpenPPL / ppl.cv
  ppl.cv is a high-performance image processing library of openPPL supporting various platforms.
  ☆511Updated 11 months ago
• NVIDIA-AI-IOT / tensorrt_plugin_generator
  A simple tool that can generate TensorRT plugin code quickly.
  ☆236Updated 2 years ago
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆767Updated last year
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆557Updated 3 years ago
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆457Updated 2 months ago
• OpenPPL / ppl.nn.llm
  ☆141Updated last year
• xiatwhu / trt2023
  ☆26Updated 2 years ago
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆138Updated last year
• grimoire / amirstan_plugin
  Useful tensorrt plugin. For pytorch and mmdetection model conversion.
  ☆165Updated 11 months ago
• TRT2022 / MST-plus-plus-TensorRT
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆143Updated 3 years ago
• HeKun-NVIDIA / AI-Blog
  Collection of blogs on AI development
  ☆20Updated 10 months ago
• deepglint / EasyQuant
  EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…
  ☆405Updated 2 years ago
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆486Updated 11 months ago
• OpenPPL / ppl.kernel.cuda
  ☆37Updated 11 months ago
• rmccorm4 / tensorrt-utils
  ⚡ Useful scripts when using TensorRT
  ☆239Updated 5 years ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆296Updated 3 years ago
• TrojanXu / onnxparser-trt-plugin-sample
  A sample for onnxparser working with trt user defined plugins for TRT7.0
  ☆169Updated 4 years ago
• tpoisonooo / how-to-optimize-gemm
  row-major matmul optimization
  ☆674Updated last month
• PaddlePaddle / CINN
  Compiler Infrastructure for Neural Networks
  ☆147Updated 2 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆163Updated last week
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆896Updated 9 months ago
• AI-performance / embedded-ai.bench
  benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
  ☆204Updated 4 years ago
• NVIDIA / Deep-Learning-Accelerator-SW
  NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.
  ☆218Updated last year
• Archermmt / tvm_walk_through
  code reading for tvm
  ☆76Updated 3 years ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆83Updated 2 years ago
• Adlik / Adlik
  Adlik: Toolkit for Accelerating Deep Learning Inference
  ☆806Updated last year
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆454Updated 5 years ago
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆265Updated last year
• OpenPPL / ppl.nn
  A primitive library for neural network
  ☆1,360Updated 10 months ago
• OpenPPL / ppl.pmx
  ☆59Updated 10 months ago