TensorRT-LLM server with Structured Outputs (JSON) built with Rust
☆69Apr 25, 2025Updated 11 months ago
Alternatives and similar repositories for llgtrt
Users that are interested in llgtrt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Super-fast Structured Outputs☆717Updated this week
- Rust crate for some audio utilities☆27Mar 8, 2025Updated last year
- A Keras like abstraction layer on top of the Rust ML framework candle☆23Jun 16, 2024Updated last year
- A Rust crate for subscribing and retrieving the current active space on Mac OS X☆22Oct 26, 2024Updated last year
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆48Feb 18, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A thin rusty wrapper over the YuNet face detection network (aka `libfacedetect`)☆11Aug 26, 2025Updated 7 months ago
- A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.☆28Apr 15, 2024Updated last year
- ☆12Oct 5, 2024Updated last year
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆44Apr 1, 2023Updated 2 years ago
- ☆10Aug 18, 2023Updated 2 years ago
- A simple Gradio WebUI for loading/unloading models and loras in tabbyAPI.☆20Nov 21, 2024Updated last year
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆65Jul 2, 2024Updated last year
- Tantivy directory implementation backed by object_store☆40Jan 22, 2024Updated 2 years ago
- Rust bindings to the https://github.com/coqui-ai TTS library☆19Mar 27, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Testing library/runner for load and integration testing using intelligent bots☆20Apr 8, 2024Updated last year
- Smol Supervisor for long-lived tokio tasks☆42Mar 22, 2026Updated last week
- experiment☆12Jan 1, 2023Updated 3 years ago
- RusTTS is an unofficial Coqui TTS implementation.☆21Aug 12, 2022Updated 3 years ago
- Summarize commits of your teammates using LLM to save time☆13Jan 17, 2025Updated last year
- Dependency free implementation of DBSCAN clustering in Rust☆12Apr 6, 2023Updated 2 years ago
- ☆14Mar 13, 2026Updated 2 weeks ago
- Modern Markdown formatter with smart typography, line wrapping, and tag support (Python reference implementation)☆59Mar 1, 2026Updated 3 weeks ago
- A clone-able base site to help you get started quickly with Bartholomew☆17Jan 2, 2024Updated 2 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- The Triton TensorRT-LLM Backend☆929Mar 17, 2026Updated last week
- This is the GitHub Repo for Ray Summit Training 2022☆16Oct 14, 2022Updated 3 years ago
- Simple, efficient and cross-platform TFIDF-based text summarizer in Rust☆13Apr 12, 2024Updated last year
- Whisper.cpp with diarization☆20Nov 18, 2024Updated last year
- ☆67Mar 28, 2025Updated last year
- A persistent queue for asyncio Python☆13May 8, 2024Updated last year
- Mark a function to run before main.☆11Feb 15, 2017Updated 9 years ago
- Ask shortgpt for instant and concise answers☆13May 7, 2023Updated 2 years ago
- An Azure Application Insights exporter for axum via tracing.☆11Feb 7, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- libgourou is a free implementation of Adobe's ADEPT protocol used to add DRM on ePub/PDF files… forked from https://indefero.soutade.fr/p…☆27Dec 5, 2022Updated 3 years ago
- This library has the basic types to avoid use `undefined` or `null`.☆12Jun 15, 2024Updated last year
- Pluralising Synthetic Intelligence☆20Mar 19, 2026Updated last week
- Metal GPU implementation of the Qwen3 transformer model on macOS with complete Apple Silicon compute shader acceleration.☆43Oct 6, 2025Updated 5 months ago
- Easy MCP (Model Context Protocol) servers and AI agents, defined as YAML.☆19Dec 9, 2025Updated 3 months ago
- Optimise the sound of your headphones and speakers☆24Mar 23, 2026Updated last week
- A Learn-to-Rank algorithm library☆13Aug 15, 2024Updated last year