Alternatives and similar repositories for outlines:

Users that are interested in outlines are comparing it to the libraries listed below

• instructor-ai / instructor
  structured outputs for llms
  ☆9,808Updated this week
• guidance-ai / guidance
  A guidance language for controlling large language models.
  ☆19,918Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,864Updated 9 months ago
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆22,470Updated this week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆8,882Updated this week
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,643Updated last year
• Unstructured-IO / unstructured
  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
  ☆10,581Updated this week
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆19,333Updated this week
• langfuse / langfuse
  🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…
  ☆9,536Updated this week
• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆8,514Updated last week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆4,957Updated last week
• letta-ai / letta
  Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.
  ☆15,432Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,905Updated this week
• ShishirPatil / gorilla
  Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
  ☆11,909Updated this week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,830Updated this week
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…
  ☆5,908Updated this week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆11,810Updated this week
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆18,652Updated this week
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,321Updated last month
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆4,646Updated last week
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆40,106Updated this week
• langchain-ai / langgraph
  Build resilient language agents as graphs.
  ☆10,285Updated this week
• lavague-ai / LaVague
  Large Action Model framework to develop AI Web Agents
  ☆5,965Updated 2 months ago
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆12,220Updated this week
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆5,585Updated this week
• neuml / txtai
  💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
  ☆10,571Updated last week
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆41,815Updated this week
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆5,075Updated this week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆3,729Updated 7 months ago
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆10,993Updated this week