Alternatives and similar repositories for Awesome-LLMOps

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆6,103Updated this week
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,790Updated 2 weeks ago
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,933Updated 3 weeks ago
• truera / trulens
  Evaluation and Tracking for LLM Experiments and AI Agents
  ☆2,955Updated 2 weeks ago
• kyrolabs / awesome-langchain
  😎 Awesome list of tools and projects with the awesome LangChain framework
  ☆8,995Updated last week
• NVIDIA-NeMo / Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆5,379Updated this week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,455Updated last year
• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,842Updated last year
• 567-labs / instructor
  structured outputs for llms
  ☆11,943Updated this week
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,858Updated 4 months ago
• hegelai / prompttools
  Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…
  ☆2,975Updated last year
• Unstructured-IO / unstructured
  Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…
  ☆13,359Updated 2 weeks ago
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆11,116Updated this week
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆12,471Updated this week
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…
  ☆9,348Updated this week
• dottxt-ai / outlines
  Structured Outputs
  ☆13,025Updated last week
• ray-project / llm-numbers
  Numbers every LLM developer should know
  ☆4,273Updated last year
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,660Updated last month
• vibrantlabsai / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆11,676Updated this week
• Agenta-AI / agenta
  The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
  ☆3,491Updated this week
• langchain-ai / langserve
  LangServe 🦜️🏓
  ☆2,221Updated last month
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,684Updated 3 weeks ago
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆7,882Updated this week
• a16z-infra / llm-app-stack
  ☆1,271Updated last year
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,091Updated 6 months ago
• kaushikb11 / awesome-llm-agents
  A curated list of awesome LLM agents frameworks.
  ☆1,194Updated this week
• SylphAI-Inc / AdalFlow
  AdalFlow: The library to build & auto-optimize LLM applications.
  ☆3,905Updated last week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,987Updated this week
• ianarawjo / ChainForge
  An open-source visual programming environment for battle-testing prompts to LLMs.
  ☆2,894Updated 3 weeks ago
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆4,217Updated last week