tensorflow / tensorrtLinks
TensorFlow/TensorRT integration
☆745Updated last year
Alternatives and similar repositories for tensorrt
Users that are interested in tensorrt are comparing it to the libraries listed below
Sorting:
- Tensorflow Backend for ONNX☆1,324Updated last year
- TensorFlow models accelerated with NVIDIA TensorRT☆689Updated 4 years ago
- Save, Load Frozen Graph and Run Inference From Frozen Graph in TensorFlow 1.x and 2.x☆304Updated 4 years ago
- Convert tf.keras/Keras models to ONNX☆381Updated 4 years ago
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,556Updated this week
- Explore the Capabilities of the TensorRT Platform☆264Updated 4 years ago
- This repository is for my YT video series about optimizing a Tensorflow deep learning model using TensorRT. We demonstrate optimizing LeN…☆301Updated 6 years ago
- Image classification with NVIDIA TensorRT from TensorFlow models.☆459Updated 4 years ago
- Guide for building custom op for TensorFlow☆381Updated 2 years ago
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,546Updated 6 years ago
- Fast and accurate object detection with end-to-end GPU optimization☆898Updated 4 years ago
- A scalable inference server for models optimized with OpenVINO™☆767Updated this week
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,480Updated 3 weeks ago
- ONNX Optimizer☆760Updated this week
- TVM integration into PyTorch☆454Updated 5 years ago
- A performant and modular runtime for TensorFlow☆760Updated last month
- ☆371Updated 4 months ago
- Deploy your model with TensorRT quickly.☆767Updated last year
- Running object detection on a webcam feed using TensorRT on NVIDIA GPUs in Python.☆226Updated 4 years ago
- A profiling and performance analysis tool for machine learning☆433Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆491Updated 3 weeks ago
- ⚡ Useful scripts when using TensorRT☆239Updated 5 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,156Updated 3 weeks ago
- Dockerfiles and scripts for ONNX container images☆138Updated 3 years ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,869Updated this week
- Common source, scripts and utilities for creating Triton backends.☆348Updated 3 weeks ago
- Code for: "And the bit goes down: Revisiting the quantization of neural networks"☆633Updated 4 years ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆644Updated 2 weeks ago
- A benchmark framework for Tensorflow☆1,147Updated 2 years ago
- Dive into Deep Learning Compiler☆648Updated 3 years ago