tensorflow / tensorrt
TensorFlow/TensorRT integration
☆738Updated last year
Alternatives and similar repositories for tensorrt:
Users that are interested in tensorrt are comparing it to the libraries listed below
- TensorFlow models accelerated with NVIDIA TensorRT☆686Updated 3 years ago
- Convert tf.keras/Keras models to ONNX☆380Updated 3 years ago
- Tensorflow Backend for ONNX☆1,292Updated 9 months ago
- Save, Load Frozen Graph and Run Inference From Frozen Graph in TensorFlow 1.x and 2.x☆300Updated 4 years ago
- Explore the Capabilities of the TensorRT Platform☆261Updated 3 years ago
- Image classification with NVIDIA TensorRT from TensorFlow models.☆455Updated 4 years ago
- This repository is for my YT video series about optimizing a Tensorflow deep learning model using TensorRT. We demonstrate optimizing LeN…☆302Updated 5 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆2,996Updated last month
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,507Updated this week
- TVM integration into PyTorch☆453Updated 5 years ago
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,356Updated this week
- A scalable inference server for models optimized with OpenVINO™☆694Updated this week
- Deploy your model with TensorRT quickly.☆764Updated last year
- Guide for building custom op for TensorFlow☆378Updated last year
- Actively maintained ONNX Optimizer☆657Updated 10 months ago
- A performant and modular runtime for TensorFlow☆759Updated last month
- Fast and accurate object detection with end-to-end GPU optimization☆891Updated 3 years ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,647Updated this week
- Running object detection on a webcam feed using TensorRT on NVIDIA GPUs in Python.☆216Updated 3 years ago
- A benchmark framework for Tensorflow☆1,148Updated last year
- A profiling and performance analysis tool for TensorFlow☆363Updated this week
- Dockerfiles and scripts for ONNX container images☆136Updated 2 years ago
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,533Updated 5 years ago
- Samples for TensorRT/Deepstream for Tesla & Jetson☆1,167Updated last month
- Common source, scripts and utilities for creating Triton backends.☆305Updated this week
- ONNXMLTools enables conversion of models to ONNX☆1,044Updated last week
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆972Updated 3 months ago
- Dive into Deep Learning Compiler☆646Updated 2 years ago
- Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO☆715Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆446Updated this week