eth-sri / lmql
A language for constraint-guided and efficient LLM programming.
☆3,892Updated 10 months ago
Alternatives and similar repositories for lmql:
Users that are interested in lmql are comparing it to the libraries listed below
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,695Updated last year
- Adding guardrails to large language models.☆4,780Updated last week
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,475Updated last year
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,514Updated 7 months ago
- Structured Text Generation☆11,369Updated this week
- An open-source visual programming environment for battle-testing prompts to LLMs.☆2,566Updated this week
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,254Updated this week
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆3,466Updated 2 months ago
- Simple UI for LLM Model Finetuning☆2,062Updated last year
- ☆3,314Updated last year
- Harness LLMs with Multi-Agent Programming☆3,230Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆11,986Updated this week
- A guidance language for controlling large language models.☆20,037Updated last week
- Numbers every LLM developer should know☆4,203Updated last year
- Large Language Model Text Generation Inference☆10,010Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,015Updated last month
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,048Updated 7 months ago
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,485Updated 5 months ago
- LLM as a Chatbot Service☆3,316Updated last year
- ☆1,466Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,469Updated 8 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,829Updated 8 months ago
- LLM(😽)☆1,666Updated 2 months ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,362Updated 8 months ago
- A school for camelids☆1,208Updated last year
- Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.☆2,084Updated 2 months ago
- [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings☆1,931Updated 3 months ago
- structured outputs for llms☆10,156Updated this week
- AutoChain: Build lightweight, extensible, and testable LLM Agents☆1,846Updated 10 months ago
- SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability v…☆7,676Updated this week