Alternatives and similar repositories for triton_cli

Users that are interested in triton_cli are comparing it to the libraries listed below

• catie-aq / triton-rust

  View on GitHub
  An api for interfacing Nvidia Trition Inference Server with Rust
  ☆11Jun 12, 2023Updated 2 years ago
• cchan / nanoGPT-fp8

  View on GitHub
  ☆13May 8, 2023Updated 2 years ago
• triton-inference-server / model_navigator

  View on GitHub
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆217Feb 3, 2026Updated last week
• octoml / triton-client-rs

  View on GitHub
  A client library in Rust for Nvidia Triton.
  ☆30Aug 3, 2023Updated 2 years ago
• triton-inference-server / tutorials

  View on GitHub
  This repository contains tutorials and examples for Triton Inference Server
  ☆819Feb 4, 2026Updated last week
• triton-inference-server / python_backend

  View on GitHub
  Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
  ☆667Feb 7, 2026Updated last week
• triton-inference-server / redis_cache

  View on GitHub
  TRITONCACHE implementation of a Redis cache
  ☆16Jan 13, 2026Updated last month
• seanboe / SimpleFusion

  View on GitHub
  Fuses IMU readings with a complementary filter to achieve accurate pitch and roll readings.
  ☆15Aug 23, 2021Updated 4 years ago
• npuichigo / openai_trtllm

  View on GitHub
  OpenAI compatible API for TensorRT LLM triton backend
  ☆220Aug 1, 2024Updated last year
• triton-inference-server / developer_tools

  View on GitHub
  ☆22Updated this week
• KuangjuX / AttnLink

  View on GitHub
  An experimental communicating attention kernel based on DeepEP.
  ☆35Jul 29, 2025Updated 6 months ago
• triton-inference-server / pytriton

  View on GitHub
  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
  ☆832Aug 13, 2025Updated 6 months ago
• kserve / open-inference-protocol

  View on GitHub
  Repository for open inference protocol specification
  ☆64May 12, 2025Updated 9 months ago
• jt-zhang / Sparse_Attention_API

  View on GitHub
  ☆67Oct 25, 2025Updated 3 months ago
• triton-inference-server / tensorrtllm_backend

  View on GitHub
  The Triton TensorRT-LLM Backend
  ☆918Updated this week
• NVIDIA / nim-deploy

  View on GitHub
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆221Updated this week
• triton-inference-server / dali_backend

  View on GitHub
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆140Feb 6, 2026Updated last week
• PeterWone / vscode-arduino-cli

  View on GitHub
  Integration of the Arduino CLI into VS Code
  ☆10Nov 7, 2020Updated 5 years ago
• NVIDIA / k8s-driver-manager

  View on GitHub
  The NVIDIA Driver Manager is a Kubernetes component which assist in seamless upgrades of NVIDIA Driver on each node of the cluster.
  ☆48Updated this week
• NVIDIA / go-nvlib

  View on GitHub
  A collection of useful Go libraries for use with NVIDIA GPU management tools
  ☆50Jan 15, 2026Updated 3 weeks ago
• ROCm / vllm

  View on GitHub
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆114Feb 7, 2026Updated last week
• Mellanox / ngc_multinode_perf

  View on GitHub
  Performance tests for multinode NGC.Ready certification
  ☆15Jan 28, 2026Updated 2 weeks ago
• basetenlabs / SGLang-Workshop

  View on GitHub
  Workshop materials for AI Engineer World's Fair
  ☆13Jun 3, 2025Updated 8 months ago
• Yifei-Zuo / Flash-LLA

  View on GitHub
  Official repository for the paper Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regressi…
  ☆23Oct 1, 2025Updated 4 months ago
• Holmes-Alan / SR-VAE

  View on GitHub
  SR-VAE
  ☆10Jul 26, 2021Updated 4 years ago
• triton-inference-server / backend

  View on GitHub
  Common source, scripts and utilities for creating Triton backends.
  ☆367Updated this week
• triton-inference-server / client

  View on GitHub
  Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
  ☆677Feb 6, 2026Updated last week
• visten92 / PINN

  View on GitHub
  A Physics Informed Neural Network Implementation for Burgers Equation in Tensorflow 2.0
  ☆10Feb 25, 2022Updated 3 years ago
• asyncins / RedLock

  View on GitHub
  基于 Redis 官方分布式锁文章的 Python 实现
  ☆10Jan 16, 2021Updated 5 years ago
• wrld / SaLon3R

  View on GitHub
  [Arxiv'25] SaLon3R: Structure-aware Long-term Generalizable 3D Reconstruction from Unposed Images
  ☆45Oct 18, 2025Updated 3 months ago
• scy-v / ReSemAct

  View on GitHub
  ReSemAct: Advancing Fine-Grained Robotic Manipulation via Semantic Structuring and Affordance Refinement
  ☆17Jan 5, 2026Updated last month
• 19reborn / neural-texture-splatting

  View on GitHub
  [SIGGRAPH Asia 25] Official code for Neural Texture Splatting: Expressive 3D Gaussian Splatting for View Synthesis, Geometry, and Dynamic…
  ☆31Nov 29, 2025Updated 2 months ago
• yeahdongcn / WFH

  View on GitHub
  能够远程办公（work from home）的公司名单
  ☆16Mar 2, 2022Updated 3 years ago
• smly / java-labelpropagation

  View on GitHub
  (obsoleted) java implementation of labelpropagation
  ☆11Sep 2, 2015Updated 10 years ago
• homeport / yft

  View on GitHub
  /j f t/ - YAML file tool
  ☆13Apr 5, 2025Updated 10 months ago
• gardener-attic / vpa-exporter

  View on GitHub
  [DEPRECATED] Prometheus exporter for VPA recommendations
  ☆12Aug 22, 2023Updated 2 years ago
• Jellyfish042 / RWKV_Othello

  View on GitHub
  A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…
  ☆43Jan 25, 2025Updated last year
• Sunshine-Ye / NIPS22-ST

  View on GitHub
  ☆11Oct 24, 2024Updated last year
• meeuw / unattended-windows-10

  View on GitHub
  Packer templates to install Windows 10 Evaluation using the qemu/kvm builder.
  ☆12Sep 2, 2021Updated 4 years ago