Alternatives and similar repositories for llama_index

Users that are interested in llama_index are comparing it to the libraries listed below

• langchain-ai / langchain
  🦜🔗 Build context-aware reasoning applications
  ☆107,179Updated this week
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆19,784Updated this week
• guidance-ai / guidance
  A guidance language for controlling large language models.
  ☆20,155Updated last week
• deepset-ai / haystack
  AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file convert…
  ☆20,648Updated this week
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆47,245Updated this week
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,550Updated last month
• kyrolabs / awesome-langchain
  😎 Awesome list of tools and projects with the awesome LangChain framework
  ☆8,306Updated this week
• openai / tiktoken
  tiktoken is a fast BPE tokeniser for use with OpenAI's models.
  ☆14,461Updated last month
• mem0ai / mem0
  Memory for AI Agents; SOTA in AI Agent Memory, beating OpenAI Memory in accuracy by 26% - https://mem0.ai/research
  ☆29,071Updated this week
• microsoft / autogen
  A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…
  ☆44,480Updated this week
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,539Updated 7 months ago
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆22,551Updated this week
• letta-ai / letta
  Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.
  ☆16,404Updated this week
• Unstructured-IO / unstructured
  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
  ☆11,190Updated this week
• openai / chatgpt-retrieval-plugin
  The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.
  ☆21,175Updated 10 months ago
• langchain-ai / chat-langchain
  ☆5,875Updated last week
• microsoft / JARVIS
  JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
  ☆24,140Updated 7 months ago
• langchain-ai / langgraph
  Build resilient language agents as graphs.
  ☆12,540Updated this week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆79,738Updated this week
• unslothai / unsloth
  Finetune Qwen3, Llama 4, TTS, DeepSeek-R1 & Gemma 3 LLMs 2x faster with 70% less memory! 🦥
  ☆38,553Updated this week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,430Updated 11 months ago
• nomic-ai / gpt4all
  GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
  ☆73,303Updated last month
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,900Updated 9 months ago
• qdrant / qdrant
  Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…
  ☆23,494Updated this week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,257Updated this week
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆20,618Updated 2 weeks ago
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆24,189Updated this week
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆9,591Updated last week
• ShishirPatil / gorilla
  Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
  ☆12,066Updated 2 weeks ago
• yoheinakajima / babyagi
  ☆21,461Updated 6 months ago