Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inference Server.
☆73Mar 2, 2026Updated this week
Alternatives and similar repositories for triton_cli
Users that are interested in triton_cli are comparing it to the libraries listed below
Sorting:
- A client library in Rust for Nvidia Triton.☆30Aug 3, 2023Updated 2 years ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆218Feb 3, 2026Updated last month
- ☆13May 8, 2023Updated 2 years ago
- This repository contains tutorials and examples for Triton Inference Server☆824Feb 9, 2026Updated 3 weeks ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆673Feb 27, 2026Updated last week
- Fuses IMU readings with a complementary filter to achieve accurate pitch and roll readings.☆15Aug 23, 2021Updated 4 years ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆21Aug 3, 2025Updated 7 months ago
- [ICLR 2026] Official implementation of DiCache: Let Diffusion Model Determine Its Own Cache☆55Jan 26, 2026Updated last month
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆836Aug 13, 2025Updated 6 months ago
- OpenAI compatible API for TensorRT LLM triton backend☆220Aug 1, 2024Updated last year
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆506Updated this week
- The Triton TensorRT-LLM Backend☆926Updated this week
- The core library and APIs implementing the Triton Inference Server.☆169Updated this week
- ☆65Apr 26, 2025Updated 10 months ago
- An experimental communicating attention kernel based on DeepEP.☆35Jul 29, 2025Updated 7 months ago
- Repository for open inference protocol specification☆65May 12, 2025Updated 9 months ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆150Updated this week
- Code for Draft Attention☆99May 22, 2025Updated 9 months ago
- A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…☆224Feb 21, 2026Updated last week
- An NVIDIA Triton Server workflow for OCR and the LayoutLMv3 Transformer Model☆30Sep 14, 2022Updated 3 years ago
- This repository provides optical character detection and recognition solution optimized on Nvidia devices.☆87May 13, 2025Updated 9 months ago
- MIG Partition Editor for NVIDIA GPUs☆241Updated this week
- ESG Insights AI simplifies ESG data analysis with advanced AI models, ensuring compliance with GRI standards. It helps asset managers ass…☆13Oct 31, 2024Updated last year
- Integration of the Arduino CLI into VS Code☆10Nov 7, 2020Updated 5 years ago
- A client packaged based on go-redis that operates Tair For Redis Modules.☆41Nov 7, 2024Updated last year
- The NVIDIA Driver Manager is a Kubernetes component which assist in seamless upgrades of NVIDIA Driver on each node of the cluster.☆49Feb 23, 2026Updated last week
- Implementation of SmoothCache, a project aimed at speeding-up Diffusion Transformer (DiT) based GenAI models with error-guided caching.☆48Jul 17, 2025Updated 7 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆116Updated this week
- Official implementation of REArtGS (NeurIPS 2025)☆19Oct 24, 2025Updated 4 months ago
- [ICLR2026] The code for "Interp3D: Correspondence-Aware Interpolation for Generative Textured 3D Morphing."☆24Jan 21, 2026Updated last month
- Generating music with Machine Learning☆11Feb 8, 2021Updated 5 years ago
- Zipkin client for asgi. Compatible with Starlette Framework and Jaeger tracing server☆10Apr 21, 2024Updated last year
- Performance tests for multinode NGC.Ready certification☆15Jan 28, 2026Updated last month
- Distributed preprocessing and data loading for language datasets☆40Apr 10, 2024Updated last year
- GenPiCam - a RaspberryPi based camera that reimagines the world with GenAI.☆10Jun 28, 2023Updated 2 years ago
- Common source, scripts and utilities for creating Triton backends.☆369Feb 9, 2026Updated 3 weeks ago
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆684Feb 24, 2026Updated last week
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 2 years ago
- [SIGGRAPH Asia 25] Official code for Neural Texture Splatting: Expressive 3D Gaussian Splatting for View Synthesis, Geometry, and Dynamic…☆32Nov 29, 2025Updated 3 months ago