TensorRT-LLM server with Structured Outputs (JSON) built with Rust
☆72Apr 25, 2025Updated last year
Alternatives and similar repositories for llgtrt
Users that are interested in llgtrt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Super-fast Structured Outputs☆809Jun 25, 2026Updated last week
- Rust crate for some audio utilities☆28Jun 17, 2026Updated 3 weeks ago
- A set of extensible tools to accelerate software development☆16Jun 8, 2026Updated last month
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Feb 18, 2025Updated last year
- A thin rusty wrapper over the YuNet face detection network (aka `libfacedetect`)☆11Aug 26, 2025Updated 10 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Functional configuration management with Typescript☆20Apr 7, 2025Updated last year
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆47Apr 1, 2023Updated 3 years ago
- @effect/schema compiler and pipeable API for OpenAPI☆16Jun 23, 2024Updated 2 years ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆67Jul 2, 2024Updated 2 years ago
- Tantivy directory implementation backed by object_store☆42Jan 22, 2024Updated 2 years ago
- Manage branches for your Jira tickets☆18Updated this week
- experiment☆12Jan 1, 2023Updated 3 years ago
- This is my custom Corne keyboard layout with nice!nano v2 + nice!view + seed xiao as dongle☆20Jun 21, 2026Updated 2 weeks ago
- Summarize commits of your teammates using LLM to save time☆13Jan 17, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Aug 1, 2024Updated last year
- ☆14Jun 21, 2026Updated 2 weeks ago
- Rust Cross-platform Power State Plugin (PSP). Monitoring the power state and emit events via an MPSC channel.☆10Jun 27, 2026Updated last week
- A docker container that runs Laravel Octane with Swoole.☆11Jun 17, 2021Updated 5 years ago
- Async SSH tunnel through a jump host.☆13Jun 27, 2023Updated 3 years ago
- A clone-able base site to help you get started quickly with Bartholomew☆17Jan 2, 2024Updated 2 years ago
- Your dive log for deep work☆11Aug 16, 2023Updated 2 years ago
- Dependency free implementation of DBSCAN clustering in Rust☆13Apr 6, 2023Updated 3 years ago
- Quickstart for Zero & SolidJS.☆34Jun 30, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Simple, efficient and cross-platform TFIDF-based text summarizer in Rust☆13Apr 12, 2024Updated 2 years ago
- General purpose rate limiting library for Cloudflare Workers☆20May 13, 2026Updated last month
- A sharp command-line tool for AI-assisted coding.☆39Jun 12, 2025Updated last year
- A persistent queue for asyncio Python☆13May 8, 2024Updated 2 years ago
- Ask shortgpt for instant and concise answers☆13May 7, 2023Updated 3 years ago
- ☆14Jun 8, 2021Updated 5 years ago
- This library has the basic types to avoid use `undefined` or `null`.☆12Jun 15, 2024Updated 2 years ago
- An LLM leaderboard for stateful agents☆21Oct 16, 2025Updated 8 months ago
- HSNW module for Redis☆59Sep 1, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A generator for golang alfred workflow that helps you create boilerplate code.☆13Jun 26, 2024Updated 2 years ago
- Easy MCP (Model Context Protocol) servers and AI agents, defined as YAML.☆19Dec 9, 2025Updated 7 months ago
- A Learn-to-Rank algorithm library☆13Aug 15, 2024Updated last year
- A small library combining libpq and libuv☆10Dec 22, 2022Updated 3 years ago
- Whisper.cpp with diarization☆22Nov 18, 2024Updated last year
- Key value store using the redis protocol with Postgres as a backend☆59Nov 9, 2024Updated last year
- A daemon that makes a desktop OS accessible to AI agents☆42May 29, 2025Updated last year