Super-fast Structured Outputs
☆890Oct 14, 2026Updated this week
Alternatives and similar repositories for llguidance
Users that are interested in llguidance are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast, Flexible and Portable Structured Generation☆1,964Updated this week
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆73Apr 25, 2025Updated last year
- ☆101Sep 28, 2026Updated 2 weeks ago
- Faster structured generation☆321Aug 5, 2026Updated 2 months ago
- Derivative-based regular expression engine for Rust☆28Sep 18, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A guidance language for controlling large language models.☆21,802May 21, 2026Updated 4 months ago
- Structured Outputs☆15,952Sep 21, 2026Updated 3 weeks ago
- A high-performance constrained decoding engine based on context free grammar in Rust☆60May 22, 2025Updated last year
- AICI: Prompts as (Wasm) Programs☆2,076Jan 22, 2025Updated last year
- Enforce the output format (JSON Schema, Regex etc) of a language model☆2,041Apr 4, 2026Updated 6 months ago
- Fast, flexible LLM inference☆7,757Updated this week
- Graph model execution API for Candle☆18Jul 27, 2025Updated last year
- Renderer for the harmony response format to be used with gpt-oss☆4,529Apr 8, 2026Updated 6 months ago
- A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.☆373Jul 27, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A language for constraint-guided and efficient LLM programming.☆4,223May 22, 2025Updated last year
- SGLang is a high-performance serving framework for large language models and multimodal models.☆37,274Updated this week
- State-of-the-art LLM compression, built for production inference with vLLM☆3,884Updated this week
- DSPy: The framework for programming—not prompting—language models☆38,679Updated this week
- FlashInfer: Kernel Library for LLM Serving☆6,672Updated this week
- A secure Python sandbox, written in Rust, for code written by AI.☆8,714Updated this week
- Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, S…☆4,340Updated this week
- Minimalist ML framework for Rust☆21,194Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆94,061Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Datacenter Scale Distributed Inference Serving Framework☆8,328Updated this week
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆735Updated this week
- structured outputs for llms☆14,030Updated this week
- Use context-free grammars with an LLM☆175Mar 21, 2024Updated 2 years ago
- Tensor library for machine learning☆15,497Updated this week
- The programming language for agents☆9,421Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,424Updated this week
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆7,170Updated this week
- A blazing fast inference solution for text embeddings models☆5,083Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Official Rust Implementation of Model2Vec☆221Updated this week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,108Updated this week
- Fast tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and WordPiece tok…☆62Aug 10, 2026Updated 2 months ago
- Go ahead and axolotl questions☆12,590Updated this week
- ☆15Apr 26, 2025Updated last year
- A framework for few-shot evaluation of language models.☆14,260Sep 14, 2026Updated last month
- Incremental Python parser for constrained generation of code by LLMs.☆19Sep 18, 2024Updated 2 years ago