simonw / llm
Access large language models from the command-line
☆6,157Updated this week
Alternatives and similar repositories for llm:
Users that are interested in llm are comparing it to the libraries listed below
- Concatenate a directory full of files into a single prompt for use with LLMs☆1,087Updated this week
- Structured Text Generation☆10,730Updated this week
- Distribute and run LLMs with a single file.☆21,749Updated 3 weeks ago
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆5,547Updated this week
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,582Updated 11 months ago
- Rapidly build AI apps in Python☆5,860Updated this week
- Seamlessly integrate LLMs as Python functions☆2,189Updated 2 weeks ago
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆10,151Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆17,621Updated this week
- aider is AI pair programming in your terminal☆27,429Updated this week
- Examples in the MLX framework☆6,955Updated this week
- A vector search SQLite extension that runs anywhere!☆4,862Updated 3 weeks ago
- A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3,…☆2,010Updated 4 months ago
- All things prompt engineering☆5,532Updated 8 months ago
- An open-source visual programming environment for battle-testing prompts to LLMs.☆2,496Updated this week
- The most advanced AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.☆4,880Updated this week
- ☆6,567Updated 3 weeks ago
- structured outputs for llms☆9,428Updated this week
- A language for constraint-guided and efficient LLM programming.☆3,823Updated 8 months ago
- All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq…☆5,579Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆11,592Updated this week
- DSPy: The framework for programming—not prompting—language models☆21,930Updated this week
- Adding guardrails to large language models.☆4,518Updated this week
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆3,595Updated this week
- LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…☆5,831Updated 5 months ago
- Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!☆5,607Updated this week
- ☆9,470Updated 6 months ago
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,565Updated this week
- A self-organizing file system with llama 3☆5,148Updated this week
- Letta (formerly MemGPT) is a framework for creating LLM services with memory.☆14,540Updated this week