Tencent / TPAT

Related projects ⓘ

Alternatives and complementary repositories for TPAT

• NVIDIA-AI-IOT / tensorrt_plugin_generator
  A simple tool that can generate TensorRT plugin code quickly.
  ☆221Updated last year
• OpenPPL / ppl.cv
  ppl.cv is a high-performance image processing library of openPPL supporting various platforms.
  ☆493Updated 3 weeks ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆228Updated 2 years ago
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆762Updated last year
• grimoire / amirstan_plugin
  Useful tensorrt plugin. For pytorch and mmdetection model conversion.
  ☆159Updated last month
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆400Updated this week
• onnx / optimizer
  Actively maintained ONNX Optimizer
  ☆647Updated 8 months ago
• tpoisonooo / how-to-optimize-gemm
  row-major matmul optimization
  ☆591Updated last year
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆277Updated 2 years ago
• LitLeo / TensorRT_Tutorial
  ☆990Updated 8 months ago
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆547Updated 2 years ago
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆257Updated 9 months ago
• NVIDIA / TensorRT-Model-Optimizer
  TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillati…
  ☆567Updated this week
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆453Updated 4 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆145Updated this week
• AI-performance / embedded-ai.bench
  benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
  ☆203Updated 3 years ago
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆116Updated 10 months ago
• ModelTC / MQBench
  Model Quantization Benchmark
  ☆765Updated 5 months ago
• Yinghan-Li / YHs_Sample
  Yinghan's Code Sample
  ☆289Updated 2 years ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆79Updated last year
• rmccorm4 / tensorrt-utils
  ⚡ Useful scripts when using TensorRT
  ☆240Updated 4 years ago
• deepglint / EasyQuant
  EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…
  ☆393Updated last year
• OpenPPL / ppl.llm.kernel.cuda
  ☆138Updated 2 weeks ago
• Cjkkkk / CUDA_gemm
  A simple high performance CUDA GEMM implementation.
  ☆335Updated 10 months ago
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆816Updated this week
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆457Updated 8 months ago
• OpenPPL / ppl.nn.llm
  ☆140Updated 6 months ago
• TRT2022 / MST-plus-plus-TensorRT
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆135Updated 2 years ago
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆473Updated 3 weeks ago
• NVIDIA-AI-IOT / cuDLA-samples
  YOLOv5 on Orin DLA
  ☆186Updated 9 months ago