TensorRT-LLM server with Structured Outputs (JSON) built with Rust
☆67Apr 25, 2025Updated 10 months ago
Alternatives and similar repositories for llgtrt
Users that are interested in llgtrt are comparing it to the libraries listed below
Sorting:
- Super-fast Structured Outputs☆706Updated this week
- Rust crate for some audio utilities☆27Mar 8, 2025Updated last year
- Download your Notion's database and save it locally into SQLite.☆16Mar 27, 2022Updated 3 years ago
- Graph model execution API for Candle☆17Jul 27, 2025Updated 7 months ago
- A set of extensible tools to accelerate software development☆17Dec 22, 2025Updated 2 months ago
- Interoperability between Polars and Clickhouse☆14Feb 26, 2025Updated last year
- A Rust crate for subscribing and retrieving the current active space on Mac OS X☆22Oct 26, 2024Updated last year
- Rust bindings to the https://github.com/coqui-ai TTS library☆19Mar 27, 2023Updated 2 years ago
- My girlfriend wants me to stop swearing. Let's ask Whisper for some help.☆16Oct 12, 2022Updated 3 years ago
- A simple Gradio WebUI for loading/unloading models and loras in tabbyAPI.☆20Nov 21, 2024Updated last year
- RusTTS is an unofficial Coqui TTS implementation.☆21Aug 12, 2022Updated 3 years ago
- Quickstart for Zero & SolidJS.☆29Dec 18, 2025Updated 2 months ago
- OpenAI compatible API for TensorRT LLM triton backend☆220Aug 1, 2024Updated last year
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆65Jul 2, 2024Updated last year
- Tantivy directory implementation backed by object_store☆40Jan 22, 2024Updated 2 years ago
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆39Mar 2, 2026Updated last week
- Modern Markdown formatter with smart typography, line wrapping, and tag support (Python reference implementation)☆57Mar 1, 2026Updated last week
- Assembly language (汇编语言程序设计 第三版 王爽)☆12Aug 17, 2022Updated 3 years ago
- End-to-end integration of HuggingFace's models for sequence labeling.☆11Oct 4, 2020Updated 5 years ago
- HeadlessPivot☆29Feb 27, 2026Updated last week
- Text Corpus of African American Fiction and Poetry, from 1853-1923☆10Aug 5, 2020Updated 5 years ago
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆43Apr 1, 2023Updated 2 years ago
- Vscode extension to Auto start the projects in vscode☆16Sep 11, 2024Updated last year
- An extensible AI agents framework☆16Jun 3, 2025Updated 9 months ago
- `zellij attach` via the internet, end to end encrypted☆60Feb 21, 2026Updated 2 weeks ago
- Rust implementation of Ultralytics YOLOv8/v10 using ONNX (ort)☆39Apr 11, 2025Updated 10 months ago
- Implementation of the ICIP paper "GPU-ACCELERATED SIFT-AIDED SOURCE IDENTIFICATION OF STABILIZED VIDEOS"☆11Oct 6, 2023Updated 2 years ago
- ☆11Jan 28, 2023Updated 3 years ago
- ☆17Dec 26, 2025Updated 2 months ago
- About Nam Ha Minh's GitHub☆16Feb 20, 2023Updated 3 years ago
- An auto clicker app that can discreetly keep your windows active through user interactions without interrupting your workflow, even when …☆13Dec 28, 2025Updated 2 months ago
- Fully Local Push-to-Transcribe☆18Nov 6, 2025Updated 4 months ago
- A feature-rich Websocket IRC client in JavaScript☆12Dec 13, 2025Updated 2 months ago
- springboot环境下java调用c程序生成动态链接库(.so文件)，并调用（基于JNI，Ubuntu）☆11Aug 26, 2024Updated last year
- PACT Agent Collaboration Layer☆15Feb 26, 2026Updated last week
- This project is based on the [LTX-Video](https://github.com/Lightricks/LTX-Video) algorithm of the diffusers and optimized and accelerate…☆13Dec 31, 2024Updated last year
- bctx is a tool for packing and uploading docker build context.☆12Jul 6, 2025Updated 8 months ago
- Dockerfile for johnsmith0031/alpaca_lora_4bit☆12Apr 10, 2023Updated 2 years ago
- Cholidean Harmony Structure☆31Updated this week