Alternatives and similar repositories for TPAT:

Users that are interested in TPAT are comparing it to the libraries listed below

• OpenPPL / ppl.cv
  ppl.cv is a high-performance image processing library of openPPL supporting various platforms.
  ☆501Updated 5 months ago
• NVIDIA-AI-IOT / tensorrt_plugin_generator
  A simple tool that can generate TensorRT plugin code quickly.
  ☆230Updated last year
• tpoisonooo / how-to-optimize-gemm
  row-major matmul optimization
  ☆622Updated last year
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆767Updated last year
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆552Updated 3 years ago
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆425Updated 3 months ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆275Updated 2 years ago
• OpenPPL / ppl.nn.llm
  ☆139Updated 11 months ago
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆858Updated 3 months ago
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆482Updated 5 months ago
• microsoft / nnfusion
  A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.
  ☆981Updated 7 months ago
• bytedance / byteir
  A model compilation solution for various hardware
  ☆424Updated this week
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆285Updated 3 years ago
• Yinghan-Li / YHs_Sample
  Yinghan's Code Sample
  ☆320Updated 2 years ago
• OpenPPL / ppl.llm.serving
  ☆127Updated 3 months ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆148Updated 3 months ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆159Updated last week
• grimoire / amirstan_plugin
  Useful tensorrt plugin. For pytorch and mmdetection model conversion.
  ☆165Updated 6 months ago
• onnx / optimizer
  ONNX Optimizer
  ☆690Updated 2 weeks ago
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆451Updated 5 years ago
• LitLeo / TensorRT_Tutorial
  ☆1,023Updated last year
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆264Updated 4 months ago
• OpenPPL / ppl.nn
  A primitive library for neural network
  ☆1,331Updated 4 months ago
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆126Updated last year
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆80Updated 2 years ago
• PaddlePaddle / CINN
  Compiler Infrastructure for Neural Networks
  ☆145Updated last year
• TrojanXu / onnxparser-trt-plugin-sample
  A sample for onnxparser working with trt user defined plugins for TRT7.0
  ☆167Updated 4 years ago
• OpenPPL / ppl.kernel.cuda
  ☆36Updated 6 months ago
• Cjkkkk / CUDA_gemm
  A simple high performance CUDA GEMM implementation.
  ☆360Updated last year
• OpenPPL / ppl.pmx
  ☆58Updated 4 months ago