TensorFlow/TensorRT integration
☆743Nov 30, 2023Updated 2 years ago
Alternatives and similar repositories for tensorrt
Users that are interested in tensorrt are comparing it to the libraries listed below
Sorting:
- TensorFlow models accelerated with NVIDIA TensorRT☆692Feb 14, 2021Updated 5 years ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆12,723Updated this week
- ONNX-TensorRT: TensorRT backend for ONNX☆3,188Feb 3, 2026Updated 3 weeks ago
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,517Feb 20, 2026Updated last week
- Explore the Capabilities of the TensorRT Platform☆262Aug 23, 2021Updated 4 years ago
- Image classification with NVIDIA TensorRT from TensorFlow models.☆460Nov 10, 2020Updated 5 years ago
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,563Feb 17, 2026Updated last week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,947Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,375Feb 21, 2026Updated last week
- This repository is for my YT video series about optimizing a Tensorflow deep learning model using TensorRT. We demonstrate optimizing LeN…☆299Jul 4, 2019Updated 6 years ago
- An easy to use PyTorch to TensorRT converter☆4,857Aug 17, 2024Updated last year
- TensorFlow object detection models accelerated with NVIDIA TensorRT (TF-TRT)☆128Sep 15, 2020Updated 5 years ago
- A flexible, high-performance serving system for machine learning models☆6,350Dec 18, 2025Updated 2 months ago
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,634Feb 19, 2026Updated last week
- A performant and modular runtime for TensorFlow☆753Sep 4, 2025Updated 5 months ago
- This is a simple demonstration for running Keras model model on Tensorflow with TensorRT integration(TFTRT) or on TensorRT directly with…☆67Jul 17, 2018Updated 7 years ago
- A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch☆8,926Feb 16, 2026Updated last week
- State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enter…☆14,735Aug 12, 2024Updated last year
- An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.☆2,914Mar 31, 2023Updated 2 years ago
- Implementation of popular deep learning networks with TensorRT network definition API☆7,680Updated this week
- Reference models and tools for Cloud TPUs.☆5,266Feb 5, 2026Updated 3 weeks ago
- Tutorials for creating and using ONNX models☆3,658Jul 15, 2024Updated last year
- Guide for building custom op for TensorFlow☆385Mar 23, 2023Updated 2 years ago
- Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.☆8,736Oct 16, 2025Updated 4 months ago
- Implementation of EfficientNet model. Keras and TensorFlow Keras.☆2,101Jan 24, 2024Updated 2 years ago
- Tensorflow Backend for ONNX☆1,326Mar 28, 2024Updated last year
- MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Co…☆5,817Aug 7, 2025Updated 6 months ago
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,546Aug 28, 2019Updated 6 years ago
- Open Machine Learning Compiler Framework☆13,142Updated this week
- Enhanced networking support for TensorFlow. Maintained by SIG-networking.☆98Nov 19, 2021Updated 4 years ago
- ☆1,047Mar 13, 2024Updated last year
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,675Dec 1, 2025Updated 2 months ago
- Simplify your onnx model☆4,297Updated this week
- Useful extra functionality for TensorFlow 2.x maintained by SIG-addons☆1,708Sep 4, 2025Updated 5 months ago
- Google Brain AutoML☆6,450Mar 2, 2025Updated 11 months ago
- TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet☆1,789Sep 2, 2025Updated 5 months ago
- Mesh TensorFlow: Model Parallelism Made Easier☆1,626Nov 17, 2023Updated 2 years ago
- tensorrt5 , centernet , centerface, deform conv, int8☆771Oct 26, 2022Updated 3 years ago
- TFX is an end-to-end platform for deploying production ML pipelines☆2,174Updated this week