tensorflow / tensorrt
TensorFlow/TensorRT integration
☆737Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for tensorrt
- TensorFlow models accelerated with NVIDIA TensorRT☆684Updated 3 years ago
- Save, Load Frozen Graph and Run Inference From Frozen Graph in TensorFlow 1.x and 2.x☆300Updated 3 years ago
- Tensorflow Backend for ONNX☆1,285Updated 7 months ago
- Convert tf.keras/Keras models to ONNX☆381Updated 3 years ago
- Explore the Capabilities of the TensorRT Platform☆260Updated 3 years ago
- Image classification with NVIDIA TensorRT from TensorFlow models.☆455Updated 3 years ago
- This repository is for my YT video series about optimizing a Tensorflow deep learning model using TensorRT. We demonstrate optimizing LeN…☆302Updated 5 years ago
- Actively maintained ONNX Optimizer☆644Updated 8 months ago
- ONNX-TensorRT: TensorRT backend for ONNX☆2,948Updated this week
- Running object detection on a webcam feed using TensorRT on NVIDIA GPUs in Python.☆211Updated 3 years ago
- Deploy your model with TensorRT quickly.☆760Updated 11 months ago
- Fast and accurate object detection with end-to-end GPU optimization☆887Updated 3 years ago
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,320Updated 2 months ago
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,491Updated this week
- A performant and modular runtime for TensorFlow☆756Updated 3 weeks ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,585Updated this week
- A scalable inference server for models optimized with OpenVINO™☆672Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆426Updated this week
- ⚡ Useful scripts when using TensorRT☆240Updated 4 years ago
- TVM integration into PyTorch☆453Updated 4 years ago
- Samples for TensorRT/Deepstream for Tesla & Jetson☆1,136Updated 3 weeks ago
- Guide for building custom op for TensorFlow☆378Updated last year
- ONNXMLTools enables conversion of models to ONNX☆1,018Updated 5 months ago
- Dockerfiles and scripts for ONNX container images☆134Updated 2 years ago
- A benchmark framework for Tensorflow☆1,147Updated last year
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆278Updated 2 years ago
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆560Updated this week
- Common utilities for ONNX converters☆251Updated 4 months ago
- Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms☆718Updated last year
- TensorRT Plugin Autogen Tool☆367Updated last year