dottxt-ai / outlines
Structured Text Generation
☆10,350Updated this week
Alternatives and similar repositories for outlines:
Users that are interested in outlines are comparing it to the libraries listed below
- structured outputs for llms☆8,909Updated this week
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,527Updated 10 months ago
- DSPy: The framework for programming—not prompting—language models☆21,018Updated this week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆9,785Updated this week
- A language for constraint-guided and efficient LLM programming.☆3,768Updated 7 months ago
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆16,235Updated this week
- Go ahead and axolotl questions☆8,293Updated this week
- A guidance language for controlling large language models.☆19,460Updated this week
- Large Language Model Text Generation Inference☆9,592Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,812Updated last month
- Build Conversational AI in minutes ⚡️☆7,691Updated this week
- Python bindings for llama.cpp☆8,420Updated last week
- Supercharge Your LLM Application Evaluations 🚀☆7,889Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆11,197Updated this week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆3,442Updated 5 months ago
- Letta (formerly MemGPT) is a framework for creating LLM services with memory.☆13,996Updated this week
- Adding guardrails to large language models.☆4,362Updated this week
- Tensor library for machine learning☆11,541Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆33,809Updated this week
- Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.☆10,380Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆11,688Updated this week
- 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows☆9,975Updated this week
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆6,749Updated 6 months ago
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,172Updated 4 months ago
- Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!☆5,269Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llam…☆7,839Updated this week
- SGLang is a fast serving framework for large language models and vision language models.☆7,353Updated this week
- the AI-native open-source embedding database☆17,023Updated this week
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,168Updated 7 months ago
- SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability v…☆7,048Updated this week