Alternatives and similar repositories for llm:

Users that are interested in llm are comparing it to the libraries listed below

• simonw / files-to-prompt
  Concatenate a directory full of files into a single prompt for use with LLMs
  ☆1,363Updated last month
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…
  ☆5,908Updated this week
• Mozilla-Ocho / llamafile
  Distribute and run LLMs with a single file.
  ☆22,019Updated this week
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,109Updated this week
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆22,574Updated this week
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆19,333Updated this week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,876Updated 6 months ago
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆10,993Updated this week
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆5,303Updated 2 months ago
• instructor-ai / instructor
  structured outputs for llms
  ☆9,860Updated this week
• astral-sh / uv
  An extremely fast Python package and project manager, written in Rust.
  ☆45,368Updated this week
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆18,797Updated this week
• letta-ai / letta
  Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.
  ☆15,432Updated this week
• PrefectHQ / marvin
  ✨ AI agents that spark joy
  ☆5,573Updated this week
• ml-explore / mlx-examples
  Examples in the MLX framework
  ☆7,181Updated this week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,240Updated this week
• Aider-AI / aider
  aider is AI pair programming in your terminal
  ☆29,525Updated this week
• Unstructured-IO / unstructured
  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
  ☆10,581Updated this week
• weaviate / Verba
  Retrieval Augmented Generation (RAG) chatbot powered by Weaviate
  ☆6,955Updated this week
• lancedb / lancedb
  Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.
  ☆5,922Updated this week
• huggingface / smolagents
  🤗 smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.
  ☆15,512Updated this week
• timescale / pgai
  A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL
  ☆4,543Updated this week
• sigoden / aichat
  All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq…
  ☆6,089Updated last week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆3,729Updated 7 months ago
• MadcowD / ell
  A language model programming library.
  ☆5,689Updated 3 weeks ago
• langchain-ai / langgraph
  Build resilient language agents as graphs.
  ☆10,484Updated this week
• jackmpcollins / magentic
  Seamlessly integrate LLMs as Python functions
  ☆2,230Updated 3 weeks ago
• ShishirPatil / gorilla
  Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
  ☆11,909Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,868Updated 9 months ago
• bodo-run / yek
  A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption
  ☆1,809Updated this week