Alternatives and similar repositories for Awesome-LLMOps:

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆8,341Updated last week
• dottxt-ai / outlines
  Structured Text Generation
  ☆10,871Updated this week
• ray-project / llm-numbers
  Numbers every LLM developer should know
  ☆4,185Updated last year
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆4,909Updated last month
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆5,294Updated this week
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆4,545Updated this week
• kyrolabs / awesome-langchain
  😎 Awesome list of tools and projects with the awesome LangChain framework
  ☆8,013Updated last week
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆4,476Updated this week
• Unstructured-IO / unstructured
  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
  ☆10,333Updated this week
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…
  ☆5,683Updated this week
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆4,901Updated this week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆8,756Updated this week
• hegelai / prompttools
  Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…
  ☆2,805Updated 6 months ago
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆22,182Updated this week
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,429Updated 5 months ago
• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,772Updated 7 months ago
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,835Updated 9 months ago
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,026Updated 3 months ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,833Updated this week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆2,377Updated last week
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆3,861Updated last month
• langchain-ai / chat-langchain
  ☆5,732Updated last month
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,104Updated this week
• ianarawjo / ChainForge
  An open-source visual programming environment for battle-testing prompts to LLMs.
  ☆2,513Updated this week
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆8,715Updated last week
• langfuse / langfuse
  🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…
  ☆9,007Updated this week
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,327Updated this week
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,430Updated this week
• instructor-ai / instructor
  structured outputs for llms
  ☆9,589Updated this week
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,288Updated 3 weeks ago