guidance-ai / llguidanceLinks
Super-fast Structured Outputs
☆533Updated last week
Alternatives and similar repositories for llguidance
Users that are interested in llguidance are comparing it to the libraries listed below
Sorting:
- Faster structured generation☆252Updated 4 months ago
- ☆426Updated last month
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆60Updated 5 months ago
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆225Updated 3 months ago
- High-Performance Engine for Multi-Vector Search☆160Updated last week
- Simple UI for debugging correlations of text embeddings☆292Updated 4 months ago
- Inference server benchmarking tool☆112Updated 5 months ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆204Updated 2 months ago
- Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from R…☆485Updated this week
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆149Updated 2 months ago
- Fast, Flexible and Portable Structured Generation☆1,288Updated this week
- Comparison of Language Model Inference Engines☆229Updated 9 months ago
- A high-performance constrained decoding engine based on context free grammar in Rust☆55Updated 4 months ago
- Late Interaction Models Training & Retrieval☆608Updated last week
- ☆225Updated 3 months ago
- A flexible, adaptive classification system for dynamic text classification☆463Updated last week
- Fast parallel LLM inference for MLX☆220Updated last year
- xet client tech, used in huggingface_hub☆278Updated this week
- A framework for optimizing DSPy programs with RL☆185Updated last week
- ☆232Updated 3 months ago
- ☆61Updated 3 months ago
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆189Updated last year
- Where GPUs get cooked 👩🍳🔥☆282Updated 2 weeks ago
- OO for LLMs☆856Updated this week
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆324Updated last week
- Embeddable library or single binary for indexing and searching 1B vectors☆304Updated 3 months ago
- ☆159Updated 10 months ago
- Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model☆243Updated 4 months ago
- A Lightweight Library for AI Observability☆251Updated 7 months ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆701Updated this week