Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inference Server.
☆73Jul 22, 2026Updated this week
Alternatives and similar repositories for triton_cli
Users that are interested in triton_cli are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13May 8, 2023Updated 3 years ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆224May 27, 2026Updated last month
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆678Updated this week
- This repository contains tutorials and examples for Triton Inference Server☆855Updated this week
- The DL Streamer Pipeline Zoo is a catalog of optimized media and media analytics pipelines. It includes tools for downloading pipelines a…☆16Aug 20, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- TRITONCACHE implementation of a Redis cache☆18Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆522Updated this week
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated last year
- ☆10Jul 14, 2019Updated 7 years ago
- ☆151Updated this week
- Infrastructure as code for GPU accelerated managed Kubernetes clusters.☆60Apr 30, 2025Updated last year
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆846Aug 13, 2025Updated 11 months ago
- The Triton TensorRT-LLM Backend☆939Updated this week
- Simple python library for generating your own perfetto traces for your application. Can be used for both app instrumentation and custom …☆26Jun 22, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated 11 months ago
- This repository provides optical character detection and recognition solution optimized on Nvidia devices.☆90May 13, 2025Updated last year
- ☆22Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆159Updated this week
- An NVIDIA Triton Server workflow for OCR and the LayoutLMv3 Transformer Model☆30Sep 14, 2022Updated 3 years ago
- مختصات جغرافیایی مرزهای استان های ایران به صورت عددی و نمایشی و امکان انتخاب موقعیت های جغرافیایی تصادفی در هر استان دلخواه☆13Sep 18, 2016Updated 9 years ago
- Lifeweb AI team Language Models☆17Mar 11, 2024Updated 2 years ago
- MIG Partition Editor for NVIDIA GPUs☆259Updated this week
- Vast-ai public repository for open sourced tools, plugins, etc.☆17Nov 4, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…☆240May 15, 2026Updated 2 months ago
- Support for language highlighting of KECC(KAIST Educational C Compiler) IR☆12May 17, 2022Updated 4 years ago
- SGLang Kernel Wheel Index☆24Updated this week
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆312Updated this week
- Rust task graph library☆15Mar 24, 2015Updated 11 years ago
- Example of out-of-RAM k-nearest neighbors search using faiss☆18Mar 28, 2026Updated 3 months ago
- The Triton backend for TensorFlow.☆56Nov 22, 2025Updated 8 months ago
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆38Aug 29, 2025Updated 10 months ago
- A Todo List built with Clerk, Next.js and Neon RLS (SQL from the Backend)☆12Apr 8, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Start and Stop AWS EC2 Instances☆12Sep 9, 2021Updated 4 years ago
- ☆350Updated this week
- Run cloud native workloads on NVIDIA GPUs☆240Jul 14, 2026Updated last week
- In this repository, we leverage the power of few-shot learning combined with a transfer learning approach to tackle the task of object de…☆10Jun 17, 2023Updated 3 years ago
- ☆13Dec 3, 2021Updated 4 years ago
- ☆65Apr 26, 2025Updated last year
- Common source, scripts and utilities for creating Triton backends.☆377Updated this week