Super-fast Structured Outputs
☆907Nov 6, 2026Updated this week
Alternatives and similar repositories for llguidance
Users that are interested in llguidance are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast, Flexible and Portable Structured Generation☆1,995Updated this week
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆73Apr 25, 2025Updated last year
- ☆102Sep 28, 2026Updated last month
- Derivative-based regular expression engine for Rust☆29Oct 16, 2026Updated 3 weeks ago
- Faster structured generation☆320Aug 5, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A guidance language for controlling large language models.☆21,821May 21, 2026Updated 5 months ago
- Structured Outputs☆16,005Sep 21, 2026Updated last month
- A high-performance constrained decoding engine based on context free grammar in Rust☆60May 22, 2025Updated last year
- AICI: Prompts as (Wasm) Programs☆2,074Jan 22, 2025Updated last year
- Enforce the output format (JSON Schema, Regex etc) of a language model☆2,038Apr 4, 2026Updated 7 months ago
- Graph model execution API for Candle☆19Jul 27, 2025Updated last year
- Fast, flexible LLM inference☆7,817Updated this week
- A language for constraint-guided and efficient LLM programming.☆4,226May 22, 2025Updated last year
- Renderer for the harmony response format to be used with gpt-oss☆4,539Apr 8, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Efficient and general syntactical decoding for Large Language Models☆341Jan 19, 2026Updated 9 months ago
- A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.☆377Jul 27, 2026Updated 3 months ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆38,560Updated this week
- DSPy: The framework for programming—not prompting—language models☆38,967Updated this week
- State-of-the-art LLM compression, built for production inference with vLLM☆3,951Updated this week
- Use context-free grammars with an LLM☆175Mar 21, 2024Updated 2 years ago
- structured outputs for llms☆14,100Updated this week
- Minimalist ML framework for Rust☆21,282Updated this week
- A secure Python sandbox, written in Rust, for code written by AI.☆8,854Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- FlashInfer: Kernel Library for LLM Serving☆6,870Updated this week
- Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, S…☆4,372Oct 31, 2026Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,513Updated this week
- A blazing fast inference solution for text embeddings models☆5,110Updated this week
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆237Jun 7, 2025Updated last year
- 🤗 A specialized library for integrating context-free grammars (CFG) in EBNF with the Hugging Face Transformers☆140Jan 13, 2026Updated 9 months ago
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆7,266Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,453Updated this week
- Tensor library for machine learning☆15,591Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The programming language for agents☆9,492Updated this week
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,938Feb 24, 2024Updated 2 years ago
- Official Rust Implementation of Model2Vec☆233Updated this week
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆740Oct 18, 2026Updated 2 weeks ago
- Large Language Model Text Generation Inference☆10,882Mar 21, 2026Updated 7 months ago
- ☆15Apr 26, 2025Updated last year
- xet client tech, used in huggingface_hub☆625Updated this week