TensorRT-LLM server with Structured Outputs (JSON) built with Rust
☆71Apr 25, 2025Updated last year
Alternatives and similar repositories for llgtrt
Users that are interested in llgtrt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Super-fast Structured Outputs☆772May 18, 2026Updated last week
- Rust crate for some audio utilities☆28Mar 8, 2025Updated last year
- Graph model execution API for Candle☆17Jul 27, 2025Updated 10 months ago
- OxiCUDA replaces the entire NVIDIA CUDA Toolkit software stack with type-safe, memory-safe Rust code.☆117May 21, 2026Updated last week
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- OpenAI compatible API for TensorRT LLM triton backend☆220Aug 1, 2024Updated last year
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆47Apr 1, 2023Updated 3 years ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆67Jul 2, 2024Updated last year
- ☆20Aug 1, 2025Updated 9 months ago
- Tantivy directory implementation backed by object_store☆40Jan 22, 2024Updated 2 years ago
- Rust bindings to the https://github.com/coqui-ai TTS library☆21Mar 27, 2023Updated 3 years ago
- Smol Supervisor for long-lived tokio tasks☆43Mar 22, 2026Updated 2 months ago
- Exploring Effect Cluster + SST Cluster together☆65Apr 8, 2025Updated last year
- ☆16Aug 1, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Monadic Error Handling for Python☆13Aug 29, 2024Updated last year
- ☆14Mar 26, 2026Updated 2 months ago
- Async SSH tunnel through a jump host.☆13Jun 27, 2023Updated 2 years ago
- The Triton TensorRT-LLM Backend☆934May 7, 2026Updated 3 weeks ago
- Dependency free implementation of DBSCAN clustering in Rust☆13Apr 6, 2023Updated 3 years ago
- `zellij attach` via the internet, end to end encrypted☆69Feb 21, 2026Updated 3 months ago
- ☆72May 16, 2026Updated 2 weeks ago
- Simple, efficient and cross-platform TFIDF-based text summarizer in Rust☆13Apr 12, 2024Updated 2 years ago
- General purpose rate limiting library for Cloudflare Workers☆20May 13, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Modern Markdown formatter with smart typography, line wrapping, and tag support (Python reference implementation)☆65Mar 1, 2026Updated 2 months ago
- An Embedded Rust crate with support for multiple sensors☆30Mar 20, 2026Updated 2 months ago
- Mark a function to run before main.☆11Feb 15, 2017Updated 9 years ago
- Ask shortgpt for instant and concise answers☆13May 7, 2023Updated 3 years ago
- Provides a frame iterator for videos by using ffmpeg. Decodes images using the image crate.☆12Mar 31, 2021Updated 5 years ago
- This library has the basic types to avoid use `undefined` or `null`.☆12Jun 15, 2024Updated last year
- Pluralising Synthetic Intelligence☆20May 11, 2026Updated 2 weeks ago
- A generator for golang alfred workflow that helps you create boilerplate code.☆13Jun 26, 2024Updated last year
- Whisper.cpp with diarization☆21Nov 18, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A daemon that makes a desktop OS accessible to AI agents☆40May 29, 2025Updated last year
- AI assistant for Stanford Pediatric Primary Care☆13Apr 23, 2026Updated last month
- Go inter-process communication library.☆13Apr 12, 2020Updated 6 years ago
- Listen in on TCP conversations on the network your computer is attached to☆18Jan 15, 2023Updated 3 years ago
- Gradual typing for tensor shapes in Rust☆74Mar 7, 2026Updated 2 months ago
- LLaMA2 + Rust☆13Aug 8, 2023Updated 2 years ago
- Objective-C class which describes the time interval between two dates in a human readable format i.e. 'in 1 minute', * 'in 7 years', '6 …☆170Jul 18, 2015Updated 10 years ago