Alternatives and similar repositories for Awesome-LLMOps

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,539Updated 7 months ago
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,077Updated 2 months ago
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆4,923Updated last week
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,560Updated this week
• kyrolabs / awesome-langchain
  😎 Awesome list of tools and projects with the awesome LangChain framework
  ☆8,306Updated last week
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,296Updated this week
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆3,982Updated last month
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆5,646Updated this week
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,442Updated 3 months ago
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆9,336Updated this week
• hegelai / prompttools
  Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…
  ☆2,849Updated 9 months ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,119Updated this week
• guidance-ai / guidance
  A guidance language for controlling large language models.
  ☆20,155Updated last week
• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,791Updated 9 months ago
• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆9,136Updated this week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆3,935Updated 9 months ago
• ShishirPatil / gorilla
  Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
  ☆12,066Updated 2 weeks ago
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆6,268Updated this week
• 567-labs / instructor
  structured outputs for llms
  ☆10,411Updated this week
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,929Updated 11 months ago
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆9,591Updated last week
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,880Updated 10 months ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,430Updated 11 months ago
• ray-project / llm-numbers
  Numbers every LLM developer should know
  ☆4,222Updated last year
• deepset-ai / haystack
  AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file convert…
  ☆20,648Updated this week
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,646Updated last week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆12,097Updated last week
• Unstructured-IO / unstructured
  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
  ☆11,190Updated this week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,543Updated last week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆2,972Updated last week