The core library and APIs implementing the Triton Inference Server.
☆184Oct 8, 2026Updated this week
Alternatives and similar repositories for core
Users that are interested in core are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Common source, scripts and utilities for creating Triton backends.☆381Updated this week
- The Triton backend for the ONNX Runtime.☆187Updated this week
- Common source, scripts and utilities shared across all Triton repositories.☆81Updated this week
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆702Updated this week
- Triton backend for managing the model state tensors automatically in sequence batcher☆17Feb 12, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆530Updated this week
- The Triton backend for TensorRT.☆97Updated this week
- The Triton backend for TensorFlow.☆57Nov 22, 2025Updated 10 months ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆682Updated this week
- The Triton TensorRT-LLM Backend☆945Updated this week
- ☆363Updated this week
- The Triton backend for the PyTorch TorchScript models.☆184Updated this week
- OneFlow Serving☆20Apr 10, 2025Updated last year
- ☆162Oct 6, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- This repository contains tutorials and examples for Triton Inference Server☆870Updated this week
- TRITONCACHE implementation of a Redis cache☆18Updated this week
- ☆414Nov 11, 2023Updated 2 years ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆148Updated this week
- ☆27Sep 1, 2023Updated 3 years ago
- ☆24Apr 11, 2026Updated 6 months ago
- An api for interfacing Nvidia Trition Inference Server with Rust☆12Jun 12, 2023Updated 3 years ago
- HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…☆208May 22, 2026Updated 4 months ago
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆73Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- ☆36Feb 9, 2024Updated 2 years ago
- ☆22Oct 6, 2026Updated last week
- Disaggregated serving system for Large Language Models (LLMs).☆842Apr 6, 2025Updated last year
- FastAPI middleware for comparing different ML model serving approaches☆15Jul 5, 2023Updated 3 years ago
- ☆11Oct 11, 2023Updated 3 years ago
- NVIDIA Inference Xfer Library (NIXL)☆1,304Updated this week
- Triton Inference Server Web UI☆21Jul 25, 2026Updated 2 months ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆14Oct 1, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- CUDA Core Compute Libraries☆2,537Updated this week
- ☆57Oct 17, 2023Updated 2 years ago
- PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections☆126Jun 23, 2022Updated 4 years ago
- Some tensorflow examples☆17Apr 3, 2018Updated 8 years ago
- This repository describes how to add a custom TensorRT plugin in c++ and python☆29Jun 25, 2021Updated 5 years ago
- Automatic tuning for ML model deployment on Kubernetes☆80Nov 1, 2024Updated last year
- Development repository for the Triton language and compiler☆20,366Updated this week