Alternatives and similar repositories for Awesome-LLMOps

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆9,607Updated last week
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆5,132Updated 3 weeks ago
• kyrolabs / awesome-langchain
  😎 Awesome list of tools and projects with the awesome LangChain framework
  ☆8,424Updated last month
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆6,027Updated this week
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆8,464Updated this week
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆10,013Updated 3 weeks ago
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,963Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,974Updated last month
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,249Updated this week
• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,798Updated 10 months ago
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,603Updated 9 months ago
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,191Updated 3 months ago
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆12,343Updated this week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,052Updated 10 months ago
• langchain-ai / langgraph
  Build resilient language agents as graphs.
  ☆14,521Updated last week
• 567-labs / instructor
  structured outputs for llms
  ☆10,793Updated this week
• Unstructured-IO / unstructured
  Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…
  ☆11,670Updated this week
• langfuse / langfuse
  🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…
  ☆12,943Updated this week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,707Updated last week
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,432Updated this week
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆4,823Updated this week
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆25,821Updated this week
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…
  ☆7,288Updated this week
• langchain-ai / chat-langchain
  ☆5,941Updated 3 weeks ago
• hegelai / prompttools
  Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…
  ☆2,883Updated 10 months ago
• skypilot-org / skypilot
  SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability v…
  ☆8,280Updated this week
• guidance-ai / guidance
  A guidance language for controlling large language models.
  ☆20,372Updated this week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆9,715Updated this week
• promptslab / Promptify
  Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…
  ☆3,840Updated 4 months ago
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,028Updated last month