The Triton backend for TensorRT.
☆97Oct 8, 2026Updated this week
Alternatives and similar repositories for tensorrt_backend
Users that are interested in tensorrt_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Aug 23, 2024Updated 2 years ago
- Common source, scripts and utilities for creating Triton backends.☆381Updated this week
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆702Updated this week
- The Triton backend for the ONNX Runtime.☆187Updated this week
- TRITONCACHE implementation of a Redis cache☆18Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆682Updated this week
- OpenVINO backend for Triton.☆39Oct 6, 2026Updated last week
- ☆363Updated this week
- The Triton TensorRT-LLM Backend☆945Updated this week
- The core library and APIs implementing the Triton Inference Server.☆184Updated this week
- ☆22Oct 6, 2026Updated last week
- ☆36Feb 9, 2024Updated 2 years ago
- The Triton backend for the PyTorch TorchScript models.☆184Sep 11, 2026Updated last month
- A DeepStream sample application demonstrating end-to-end retail video analytics for brick-and-mortar retail.☆60Oct 13, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆11,081Updated this week
- This repository contains tutorials and examples for Triton Inference Server☆869Updated this week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆226May 27, 2026Updated 4 months ago
- A project demonstrating how to make DeepStream docker images.☆97Aug 19, 2026Updated last month
- ☆29Sep 9, 2026Updated last month
- QCRAFT AutoScheduler: a library that allows users to automatically schedule the execution of their own quantum circuits, improving effici…☆18Oct 28, 2025Updated 11 months ago
- PaddleOCR Lite license plate detection on bare Raspberry Pi 4☆12Apr 16, 2024Updated 2 years ago
- Deploy OmniVoice TTS model using TRT-LLM and Triton Inference Server on Modal.☆18May 29, 2026Updated 4 months ago
- yolov5-deepsort+opencv.kcf+TensorRT+QT☆29Jan 20, 2022Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆530Updated this week
- A simple tool that can generate TensorRT plugin code quickly.☆243Jul 11, 2023Updated 3 years ago
- A client library in Rust for Nvidia Triton.☆31Aug 3, 2023Updated 3 years ago
- Deploy stable diffusion model with onnx/tenorrt + tritonserver☆123Aug 15, 2023Updated 3 years ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆25Dec 12, 2024Updated last year
- Code for the paper "On the Importance of Feature Decorrelation for Unsupervised Representation Learning for RL" (ICML 2023)☆12Jun 13, 2023Updated 3 years ago
- Custom gst-nvinfer for alignment in Deepstream☆33Nov 22, 2024Updated last year
- SPRINT: Script-agnostic Structure Recognition in Tables☆18Mar 26, 2025Updated last year
- Frame for controllers managing resource in/beyond Cluster, and offering the ability of following PodOpsLifecycle.☆11Mar 23, 2026Updated 6 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Official implementation of the ICLR 2024 paper AffineQuant☆31Mar 30, 2024Updated 2 years ago
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆849Aug 13, 2025Updated last year
- Agile assessment exercise ideas☆16Apr 14, 2025Updated last year
- A boilerplate to use multiprocessing for your gRPC server in your Python project☆25Sep 14, 2021Updated 5 years ago
- ComPy-Learn is a framework for exploring program representations for ML4CODE tasks.☆23Aug 7, 2023Updated 3 years ago
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆14,808Updated this week
- Triton Migration Guide for DeepStreamSDK.☆15Dec 19, 2023Updated 2 years ago