Alternatives and similar repositories for lmql:

Users that are interested in lmql are comparing it to the libraries listed below

• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,527Updated 10 months ago
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆4,362Updated this week
• run-llama / llama-hub
  A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
  ☆3,464Updated 10 months ago
• dottxt-ai / outlines
  Structured Text Generation
  ☆10,350Updated this week
• PrefectHQ / marvin
  ✨ Build AI interfaces that spark joy
  ☆5,420Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆4,812Updated last month
• kyegomez / tree-of-thoughts
  Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …
  ☆4,418Updated 2 months ago
• griptape-ai / griptape
  Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.
  ☆2,125Updated this week
• run-llama / llama-lab
  ☆1,431Updated last year
• xlang-ai / instructor-embedding
  [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
  ☆1,902Updated this week
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,341Updated 4 months ago
• hegelai / prompttools
  Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…
  ☆2,760Updated 5 months ago
• stochasticai / xTuring
  Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-sour…
  ☆2,626Updated 3 months ago
• guidance-ai / guidance
  A guidance language for controlling large language models.
  ☆19,460Updated this week
• eyurtsev / kor
  LLM(😽)
  ☆1,643Updated last week
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,172Updated 4 months ago
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆4,318Updated this week
• princeton-nlp / tree-of-thought-llm
  [NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models
  ☆5,008Updated 6 months ago
• marella / ctransformers
  Python bindings for the Transformer models implemented in C/C++ using GGML library.
  ☆1,827Updated 11 months ago
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆8,293Updated this week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆3,845Updated last week
• instructor-ai / instructor
  structured outputs for llms
  ☆8,909Updated this week
• Unstructured-IO / unstructured
  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
  ☆9,785Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,592Updated this week
• promptslab / Promptify
  Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…
  ☆3,366Updated 10 months ago
• ianarawjo / ChainForge
  An open-source visual programming environment for battle-testing prompts to LLMs.
  ☆2,446Updated 2 weeks ago
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,043Updated last week
• srush / MiniChain
  A tiny library for coding with large language models.
  ☆1,219Updated 6 months ago
• jackmpcollins / magentic
  Seamlessly integrate LLMs as Python functions
  ☆2,151Updated this week