simonw / llm
Access large language models from the command-line
☆4,789Updated this week
Related projects ⓘ
Alternatives and complementary repositories for llm
- structured outputs for llms☆8,225Updated this week
- Structured Text Generation☆9,487Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆13,971Updated this week
- A vector search SQLite extension that runs anywhere!☆4,213Updated this week
- Go ahead and axolotl questions☆7,930Updated this week
- ☆9,368Updated 3 months ago
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆4,784Updated this week
- the first library to let you embed a developer agent in your own app!☆11,825Updated 7 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,653Updated this week
- Adding guardrails to large language models.☆4,127Updated this week
- DSPy: The framework for programming—not prompting—language models☆18,885Updated this week
- Large Action Model framework to develop AI Web Agents☆5,477Updated this week
- Open-source vector similarity search for Postgres☆12,643Updated 3 weeks ago
- aider is AI pair programming in your terminal☆22,251Updated this week
- Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!☆4,766Updated this week
- A language for constraint-guided and efficient LLM programming.☆3,699Updated 5 months ago
- A CLI Swiss Army Knife for ChatGPT☆2,579Updated last month
- AICI: Prompts as (Wasm) Programs☆1,936Updated last week
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,464Updated 8 months ago
- Harness LLMs with Multi-Agent Programming☆2,664Updated this week
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,467Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆7,261Updated this week
- Build Conversational AI in minutes ⚡️☆7,224Updated this week
- A guidance language for controlling large language models.☆19,118Updated last week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆9,182Updated this week
- Letta (formerly MemGPT) is a framework for creating LLM services with memory.☆12,838Updated this week
- ✨ Build AI interfaces that spark joy☆5,301Updated this week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!☆3,256Updated 3 months ago
- Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.☆10,079Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆11,487Updated this week