Alternatives and similar repositories for llguidance

Users that are interested in llguidance are comparing it to the libraries listed below

• dottxt-ai / outlines-core
  Faster structured generation
  ☆230Updated last month
• ScalingIntelligence / tokasaurus
  ☆363Updated this week
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆187Updated 3 weeks ago
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆217Updated last month
• guidance-ai / llgtrt
  TensorRT-LLM server with Structured Outputs (JSON) built with Rust
  ☆55Updated 2 months ago
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆139Updated this week
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆287Updated last month
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆219Updated 6 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆137Updated 2 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆198Updated last year
• LaurentMazare / mamba.rs
  ☆130Updated last year
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆54Updated last month
• cognitivecomputations / spectrum
  ☆128Updated 3 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 11 months ago
• pyember / ember
  ☆187Updated 2 weeks ago
• Oxen-AI / GRPO-With-Cargo-Feedback
  This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback
  ☆97Updated 4 months ago
• mixedbread-ai / baguetter
  Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…
  ☆184Updated 10 months ago
• AnswerDotAI / fastdata
  ☆154Updated 7 months ago
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• lightonai / fast-plaid
  High-Performance Engine for Multi-Vector Search
  ☆116Updated last month
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆79Updated 2 months ago
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆222Updated last month
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆481Updated this week
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆242Updated last week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆216Updated 11 months ago
• benbrandt / text-splitter
  Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from R…
  ☆452Updated this week
• apoorvumang / prompt-lookup-decoding
  ☆546Updated 10 months ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆314Updated 8 months ago
• cohere-ai / BinaryVectorDB
  Efficient vector database for hundred millions of embeddings.
  ☆206Updated last year
• apple / ml-recurrent-drafter
  ☆214Updated 5 months ago