TensorRT-LLM server with Structured Outputs (JSON) built with Rust
☆70Apr 25, 2025Updated 11 months ago
Alternatives and similar repositories for llgtrt
Users that are interested in llgtrt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Super-fast Structured Outputs☆737Updated this week
- Interoperability between Polars and Clickhouse☆14Feb 26, 2025Updated last year
- Graph model execution API for Candle☆17Jul 27, 2025Updated 8 months ago
- A Rust crate for subscribing and retrieving the current active space on Mac OS X☆22Oct 26, 2024Updated last year
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆48Feb 18, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated last year
- A thin rusty wrapper over the YuNet face detection network (aka `libfacedetect`)☆11Aug 26, 2025Updated 7 months ago
- A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.☆28Apr 15, 2024Updated 2 years ago
- A libcluster strategy for Digital Ocean Droplets☆12May 11, 2023Updated 2 years ago
- Cldr-based fork of the most excellent "trans" library☆10Aug 11, 2024Updated last year
- Natural Language Processing in Elixir☆18Mar 30, 2024Updated 2 years ago
- OpenAI compatible API for TensorRT LLM triton backend☆219Aug 1, 2024Updated last year
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆44Apr 1, 2023Updated 3 years ago
- @effect/schema compiler and pipeable API for OpenAPI☆16Jun 23, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆66Jul 2, 2024Updated last year
- ☆20Aug 1, 2025Updated 8 months ago
- Tantivy directory implementation backed by object_store☆40Jan 22, 2024Updated 2 years ago
- Incredibly fast Whisper-large-v3☆15Nov 13, 2023Updated 2 years ago
- Official CLI for creating React Three Fiber projects☆16Sep 16, 2025Updated 7 months ago
- Node.js client for Google Cloud Video Intelligence: Search and discover your media content.☆13Sep 11, 2019Updated 6 years ago
- Smol Supervisor for long-lived tokio tasks☆43Mar 22, 2026Updated 3 weeks ago
- TensorFlow Lite Elixir bindings with optional EdgeTPU support.☆22Apr 4, 2025Updated last year
- Generate a map of your codebaseto help AI Agents understand your architecture, coding conventions and patterns. Discoverable with Semanti…☆40Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This is my custom Corne keyboard layout with nice!nano v2 + nice!view + seed xiao as dongle☆16Feb 8, 2026Updated 2 months ago
- ☆16Aug 1, 2024Updated last year
- Monadic Error Handling for Python☆12Aug 29, 2024Updated last year
- ☆14Mar 26, 2026Updated 3 weeks ago
- Async SSH tunnel through a jump host.☆13Jun 27, 2023Updated 2 years ago
- A clone-able base site to help you get started quickly with Bartholomew☆17Jan 2, 2024Updated 2 years ago
- The Triton TensorRT-LLM Backend☆931Apr 8, 2026Updated last week
- `zellij attach` via the internet, end to end encrypted☆66Feb 21, 2026Updated last month
- ☆113Apr 8, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Simple, efficient and cross-platform TFIDF-based text summarizer in Rust☆13Apr 12, 2024Updated 2 years ago
- A place to find the samples I create on my blog.☆11Apr 21, 2017Updated 8 years ago
- Universal LLM API client — 142+ providers, 11 native language bindings, powered by Rust core☆143Apr 10, 2026Updated last week
- ☆67Mar 28, 2025Updated last year
- A persistent queue for asyncio Python☆13May 8, 2024Updated last year
- An Embedded Rust crate with support for multiple sensors☆29Mar 20, 2026Updated 3 weeks ago
- Ask shortgpt for instant and concise answers☆13May 7, 2023Updated 2 years ago