nikil-ravi / trt_tutorial

Related projects ⓘ

Alternatives and complementary repositories for trt_tutorial

• PINTO0309 / simple-onnx-processing-tools
  A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…
  ☆277Updated 6 months ago
• Okery / YOLOv5-PyTorch
  A PyTorch implementation of YOLOv5
  ☆168Updated 2 years ago
• pbridger / tensorrt-ssd300-8bit-quantized
  ☆52Updated 3 years ago
• BlueMirrors / cvu
  Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platform…
  ☆88Updated last year
• ttanzhiqiang / onnx_tensorrt_project
  Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxn…
  ☆211Updated 3 years ago
• rmccorm4 / tensorrt-utils
  ⚡ Useful scripts when using TensorRT
  ☆240Updated 4 years ago
• gmongaras / YOLOX_From_Scratch
  Attempting to build YOLOX from scratch
  ☆28Updated 2 years ago
• tienluongngoc / yolov5_triton_inference_server
  ☆53Updated 2 years ago
• leimao / ONNX-Runtime-Inference
  ONNX Runtime Inference C++ Example
  ☆222Updated last year
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆88Updated 2 weeks ago
• isarsoft / yolov4-triton-tensorrt
  This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
  ☆278Updated 2 years ago
• analogdevicesinc / distiller
  Fork of Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://nervanasystems.githu…
  ☆14Updated 3 months ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆79Updated last year
• maggiez0138 / yolov5_quant_sample
  This is 8-bit quantization sample for yolov5. Both PTQ, QAT and Partial Quantization have been implemented, and present the results based…
  ☆98Updated 2 years ago
• cyrusbehr / tensorrt-cpp-api
  TensorRT C++ API Tutorial
  ☆620Updated 2 months ago
• ml6team / deepstream-python
  NVIDIA Deepstream 6.1 Python boilerplate
  ☆134Updated 11 months ago
• huynhbaobk / tensorrt-triton-yolov5
  ☆53Updated 2 years ago
• saurabh-shandilya / onnx-utils
  Utility scripts for editing or modifying onnx models. Utility scripts to summarize onnx model files along with visualization for loop ope…
  ☆80Updated 3 years ago
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆257Updated 8 months ago
• NVIDIA-AI-IOT / yolo_deepstream
  yolo model qat and deploy with deepstream&tensorrt
  ☆549Updated last month
• royinx / CUDA_Resize
  resize image in (CUDA, python, cupy)
  ☆38Updated last year
• leimao / LibTorch-ResNet-CIFAR
  ResNet Implementation, Training, and Inference Using LibTorch C++ API
  ☆35Updated 5 months ago
• iwatake2222 / InferenceHelper
  C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ON…
  ☆277Updated 2 years ago
• wang-xinyu / pytorchx
  Implement popular deep learning networks in pytorch, used by tensorrtx.
  ☆191Updated 2 years ago
• jeetkanjani7 / Parallel_NMS
  Parallel CUDA implementation of NON maximum Suppression
  ☆77Updated 4 years ago
• TRT2022 / MST-plus-plus-TensorRT
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆135Updated 2 years ago
• NobuoTsukamoto / tensorrt-examples
  TensorRT Examples (TensorRT, Jetson Nano, Python, C++)
  ☆92Updated last year
• linghu8812 / tensorrt_inference
  ☆706Updated last year
• zhiqwang / yolort
  yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
  ☆721Updated 2 weeks ago
• zhenhuaw-me / tflite
  Parse TFLite models (*.tflite) EASILY with Python. Check the API at https://zhenhuaw.me/tflite/docs/
  ☆96Updated last year