Alternatives and similar repositories for Awesome-LLMOps:

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆7,411Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆4,686Updated 2 weeks ago
• langfuse / langfuse
  🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llam…
  ☆6,823Updated this week
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆4,185Updated this week
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆3,725Updated last week
• kyrolabs / awesome-langchain
  😎 Awesome list of tools and projects with the awesome LangChain framework
  ☆7,679Updated 3 months ago
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…
  ☆4,881Updated this week
• bentoml / OpenLLM
  Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
  ☆10,135Updated last week
• Unstructured-IO / unstructured
  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
  ☆9,287Updated this week
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆4,231Updated this week
• run-llama / llama-hub
  A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
  ☆3,455Updated 9 months ago
• langchain-ai / langgraph
  Build resilient language agents as graphs.
  ☆6,953Updated this week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆2,883Updated this week
• hegelai / prompttools
  Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…
  ☆2,723Updated 3 months ago
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆4,881Updated this week
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆4,056Updated this week
• ray-project / llm-numbers
  Numbers every LLM developer should know
  ☆4,117Updated 10 months ago
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆7,289Updated this week
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆19,401Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,716Updated 6 months ago
• langchain-ai / chat-langchain
  ☆5,477Updated this week
• EleutherAI / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆7,094Updated this week
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆6,291Updated this week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆10,833Updated this week
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆3,834Updated this week
• instructor-ai / instructor
  structured outputs for llms
  ☆8,390Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,162Updated this week
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆4,746Updated last week
• dottxt-ai / outlines
  Structured Text Generation
  ☆9,856Updated this week
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,703Updated 4 months ago