TensorRT-LLM server with Structured Outputs (JSON) built with Rust
☆72Apr 25, 2025Updated last year
Alternatives and similar repositories for llgtrt
Users that are interested in llgtrt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Super-fast Structured Outputs☆793Updated this week
- Interoperability between Polars and Clickhouse☆14Feb 26, 2025Updated last year
- Rust crate for some audio utilities☆28Mar 8, 2025Updated last year
- Graph model execution API for Candle☆18Jul 27, 2025Updated 10 months ago
- OxiCUDA replaces the entire NVIDIA CUDA Toolkit software stack with type-safe, memory-safe Rust code.☆124Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Keras like abstraction layer on top of the Rust ML framework candle☆23Jun 16, 2024Updated 2 years ago
- A Rust crate for subscribing and retrieving the current active space on Mac OS X☆22Oct 26, 2024Updated last year
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated 2 years ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Feb 18, 2025Updated last year
- A thin rusty wrapper over the YuNet face detection network (aka `libfacedetect`)☆11Aug 26, 2025Updated 9 months ago
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated last year
- @effect/schema compiler and pipeable API for OpenAPI☆16Jun 23, 2024Updated last year
- ☆12Apr 21, 2026Updated last month
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆67Jul 2, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Tantivy directory implementation backed by object_store☆40Jan 22, 2024Updated 2 years ago
- Rust bindings to the https://github.com/coqui-ai TTS library☆21Mar 27, 2023Updated 3 years ago
- Smol Supervisor for long-lived tokio tasks☆44Mar 22, 2026Updated 2 months ago
- This is my custom Corne keyboard layout with nice!nano v2 + nice!view + seed xiao as dongle☆19Feb 8, 2026Updated 4 months ago
- Summarize commits of your teammates using LLM to save time☆13Jan 17, 2025Updated last year
- Monadic Error Handling for Python☆13Aug 29, 2024Updated last year
- Ultra Fast Multi-Modality Vector Database☆18Feb 21, 2024Updated 2 years ago
- End-to-end integration of HuggingFace's models for sequence labeling.☆11Oct 4, 2020Updated 5 years ago
- ☆14Mar 26, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A docker container that runs Laravel Octane with Swoole.☆11Jun 17, 2021Updated 5 years ago
- Async SSH tunnel through a jump host.☆13Jun 27, 2023Updated 2 years ago
- A clone-able base site to help you get started quickly with Bartholomew☆17Jan 2, 2024Updated 2 years ago
- ☆76May 16, 2026Updated last month
- Simple, efficient and cross-platform TFIDF-based text summarizer in Rust☆13Apr 12, 2024Updated 2 years ago
- General purpose rate limiting library for Cloudflare Workers☆20May 13, 2026Updated last month
- Mark a function to run before main.☆11Feb 15, 2017Updated 9 years ago
- Ask shortgpt for instant and concise answers☆13May 7, 2023Updated 3 years ago
- Provides a frame iterator for videos by using ffmpeg. Decodes images using the image crate.☆12Mar 31, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Jun 8, 2021Updated 5 years ago
- ☆68Mar 28, 2025Updated last year
- This library has the basic types to avoid use `undefined` or `null`.☆12Jun 15, 2024Updated 2 years ago
- Pluralising Synthetic Intelligence☆20May 11, 2026Updated last month
- Whisper.cpp with diarization☆21Nov 18, 2024Updated last year
- The driver for LMCache core to run in vLLM☆67Feb 4, 2025Updated last year
- A daemon that makes a desktop OS accessible to AI agents☆41May 29, 2025Updated last year