Alternatives and similar repositories for Awesome-LLMOps

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,843Updated last year
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆6,267Updated 2 weeks ago
• vibrantlabsai / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆12,261Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,767Updated 2 months ago
• truera / trulens
  Evaluation and Tracking for LLM Experiments and AI Agents
  ☆3,039Updated this week
• NVIDIA-NeMo / Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆5,515Updated this week
• Unstructured-IO / unstructured
  Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…
  ☆13,658Updated this week
• kyrolabs / awesome-langchain
  😎 Awesome list of tools and projects with the awesome LangChain framework
  ☆9,098Updated 2 weeks ago
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,841Updated last week
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆3,178Updated 2 months ago
• hegelai / prompttools
  Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…
  ☆2,997Updated last year
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆8,266Updated this week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,679Updated 7 months ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,731Updated last week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆11,098Updated this week
• dottxt-ai / outlines
  Structured Outputs
  ☆13,237Updated this week
• IntelLabs / fastRAG
  Efficient Retrieval Augmentation and Generation Framework
  ☆1,758Updated last week
• langchain-ai / langserve
  LangServe 🦜️🏓
  ☆2,244Updated 3 months ago
• Agenta-AI / agenta
  The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
  ☆3,720Updated this week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,536Updated last year
• ianarawjo / ChainForge
  An open-source visual programming environment for battle-testing prompts to LLMs.
  ☆2,912Updated 2 weeks ago
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,820Updated 8 months ago
• SylphAI-Inc / AdalFlow
  AdalFlow: The library to build & auto-optimize LLM applications.
  ☆3,990Updated 2 weeks ago
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,909Updated 6 months ago
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆11,401Updated this week
• run-llama / llama_deploy
  Deploy your agentic worfklows to production
  ☆2,071Updated last month
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,392Updated last week
• griptape-ai / griptape
  Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.
  ☆2,455Updated last week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,126Updated 7 months ago
• langfuse / langfuse
  🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…
  ☆20,711Updated this week