guidance-ai / llgtrtView external linksLinks
TensorRT-LLM server with Structured Outputs (JSON) built with Rust
☆67Apr 25, 2025Updated 9 months ago
Alternatives and similar repositories for llgtrt
Users that are interested in llgtrt are comparing it to the libraries listed below
Sorting:
- Super-fast Structured Outputs☆688Updated this week
- Rust crate for some audio utilities☆27Mar 8, 2025Updated 11 months ago
- A thin rusty wrapper over the YuNet face detection network (aka `libfacedetect`)☆11Aug 26, 2025Updated 5 months ago
- ☆12Oct 5, 2024Updated last year
- Download your Notion's database and save it locally into SQLite.☆16Mar 27, 2022Updated 3 years ago
- A set of extensible tools to accelerate software development☆17Dec 22, 2025Updated last month
- A Rust crate for subscribing and retrieving the current active space on Mac OS X☆22Oct 26, 2024Updated last year
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆48Feb 18, 2025Updated 11 months ago
- Rust bindings to the https://github.com/coqui-ai TTS library☆19Mar 27, 2023Updated 2 years ago
- My girlfriend wants me to stop swearing. Let's ask Whisper for some help.☆16Oct 12, 2022Updated 3 years ago
- RusTTS is an unofficial Coqui TTS implementation.☆21Aug 12, 2022Updated 3 years ago
- A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.☆28Apr 15, 2024Updated last year
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆65Jul 2, 2024Updated last year
- An easy personal blog template for Github Pages.☆28Mar 24, 2024Updated last year
- 🦀 Smol Supervisor for Tokio Tasks☆43Dec 22, 2025Updated last month
- Read image segmentation masks fast☆13Jul 25, 2024Updated last year
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆39Updated this week
- A sharp command-line tool for AI-assisted coding.☆39Jun 12, 2025Updated 8 months ago
- Fully Local Push-to-Transcribe☆17Nov 6, 2025Updated 3 months ago
- HeadlessPivot☆29Jan 29, 2026Updated 2 weeks ago
- 【python】初體驗-俄羅斯方塊遊戲☆11Apr 4, 2020Updated 5 years ago
- Vscode extension to Auto start the projects in vscode☆16Sep 11, 2024Updated last year
- An extensible AI agents framework☆16Jun 3, 2025Updated 8 months ago
- Assembly language (汇编语言程序设计 第三版 王爽)☆12Aug 17, 2022Updated 3 years ago
- Text Corpus of African American Fiction and Poetry, from 1853-1923☆10Aug 5, 2020Updated 5 years ago
- A meal planner and recipe management web application. Allowing the user to efficiently plan their weekly meals.☆12Feb 7, 2022Updated 4 years ago
- Minimal State Machines☆43May 8, 2025Updated 9 months ago
- PyTorch GStreamer elements in Rust for Computer Vision and Deep Learning☆37Aug 4, 2022Updated 3 years ago
- Apple frameworks bindings for rust☆190Updated this week
- Rust implementation of Ultralytics YOLOv8/v10 using ONNX (ort)☆39Apr 11, 2025Updated 10 months ago
- PACT Agent Collaboration Layer☆15Dec 23, 2025Updated last month
- A Perplexity API MCP server that unlocks Perplexity's search-augmented AI capabilities for LLM agents. Features robust error handling, se…☆21Jul 22, 2025Updated 6 months ago
- Protocol buffers and other common resources.☆13Jan 20, 2026Updated 3 weeks ago
- bctx is a tool for packing and uploading docker build context.☆12Jul 6, 2025Updated 7 months ago
- Rust MCP framework for building AI agents☆22Dec 28, 2025Updated last month
- Weighted Masks Fusion (WMF) - Ensembling for Instance Segmentation.☆11Aug 1, 2023Updated 2 years ago
- This project is based on the [LTX-Video](https://github.com/Lightricks/LTX-Video) algorithm of the diffusers and optimized and accelerate…☆12Dec 31, 2024Updated last year
- ☆17Dec 26, 2025Updated last month
- Implementation of the ICIP paper "GPU-ACCELERATED SIFT-AIDED SOURCE IDENTIFICATION OF STABILIZED VIDEOS"☆11Oct 6, 2023Updated 2 years ago