Alternatives and similar repositories for Awesome-LLMOps

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• kyrolabs / awesome-langchain
  😎 Awesome list of tools and projects with the awesome LangChain framework
  ☆8,844Updated 2 months ago
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆5,739Updated last week
• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,833Updated last year
• hegelai / prompttools
  Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…
  ☆2,938Updated last year
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆7,159Updated last week
• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆10,998Updated this week
• truera / trulens
  Evaluation and Tracking for LLM Experiments and AI Agents
  ☆2,826Updated this week
• NVIDIA-NeMo / Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆5,115Updated this week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,309Updated last year
• ray-project / llm-numbers
  Numbers every LLM developer should know
  ☆4,259Updated last year
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,451Updated 4 months ago
• argilla-io / argilla
  Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
  ☆4,714Updated last week
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆10,803Updated this week
• ianarawjo / ChainForge
  An open-source visual programming environment for battle-testing prompts to LLMs.
  ☆2,785Updated 2 weeks ago
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,786Updated 2 months ago
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,824Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,066Updated 4 months ago
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,822Updated last week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,550Updated 3 weeks ago
• a16z-infra / llm-app-stack
  ☆1,242Updated last year
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,466Updated 6 months ago
• hwchase17 / langchain-hub
  ☆3,371Updated 2 years ago
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,720Updated this week
• IntelLabs / fastRAG
  Efficient Retrieval Augmentation and Generation Framework
  ☆1,728Updated 9 months ago
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…
  ☆8,608Updated this week
• lunary-ai / lunary
  The production toolkit for LLMs. Observability, prompt management and evaluations.
  ☆1,423Updated this week
• langchain-ai / langserve
  LangServe 🦜️🏓
  ☆2,170Updated last week
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆4,144Updated 3 months ago
• dottxt-ai / outlines
  Structured Outputs
  ☆12,674Updated this week
• langchain-ai / chat-langchain
  ☆6,103Updated last week