Super-fast Structured Outputs
☆843Aug 17, 2026Updated this week
Alternatives and similar repositories for llguidance
Users that are interested in llguidance are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast, Flexible and Portable Structured Generation☆1,823Updated this week
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆72Apr 25, 2025Updated last year
- ☆100Feb 12, 2026Updated 6 months ago
- Derivative-based regular expression engine for Rust☆27Updated this week
- Faster structured generation☆306Aug 5, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A guidance language for controlling large language models.☆21,711May 21, 2026Updated 2 months ago
- Structured Outputs☆15,643Updated this week
- A high-performance constrained decoding engine based on context free grammar in Rust☆59May 22, 2025Updated last year
- AICI: Prompts as (Wasm) Programs☆2,075Jan 22, 2025Updated last year
- Enforce the output format (JSON Schema, Regex etc) of a language model☆2,028Apr 4, 2026Updated 4 months ago
- Graph model execution API for Candle☆18Jul 27, 2025Updated last year
- Renderer for the harmony response format to be used with gpt-oss☆4,481Apr 8, 2026Updated 4 months ago
- A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.☆365Jul 27, 2026Updated 3 weeks ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆32,029Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fast, flexible LLM inference☆7,610Updated this week
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆3,696Updated this week
- DSPy: The framework for programming—not prompting—language models☆37,382Updated this week
- A language for constraint-guided and efficient LLM programming.☆4,204May 22, 2025Updated last year
- A minimal, secure Python interpreter written in Rust for use by AI☆8,078Updated this week
- Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, S…☆4,268Jul 10, 2026Updated last month
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆714Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆7,795Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆89,360Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tensor library for machine learning☆15,193Updated this week
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆6,946Updated this week
- The programming language for agents☆9,030Updated this week
- Use context-free grammars with an LLM☆176Mar 21, 2024Updated 2 years ago
- Official Rust Implementation of Model2Vec☆207May 24, 2026Updated 2 months ago
- Fast tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and WordPiece tok…☆58Aug 10, 2026Updated last week
- Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild☆3,984Updated this week
- ☆15Apr 26, 2025Updated last year
- Fast, Accurate, Lightweight Python library to make State of the Art Embedding☆3,149Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Benchmark structured generation libraries☆31Oct 25, 2024Updated last year
- structured outputs for llms☆13,746Aug 9, 2026Updated last week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆11,199Updated this week
- Minimalist ML framework for Rust☆20,920Updated this week
- A guide to structured generation using constrained decoding☆18Jun 9, 2024Updated 2 years ago
- OpenAI's Structured Outputs with Logprobs☆211May 26, 2025Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,372Updated this week