Alternatives and similar repositories for ragas

Users that are interested in ragas are comparing it to the libraries listed below

• Unstructured-IO / unstructured
  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
  ☆11,190Updated this week
• 567-labs / instructor
  structured outputs for llms
  ☆10,443Updated this week
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆24,298Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,077Updated 2 months ago
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,609Updated this week
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,446Updated this week
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆4,950Updated this week
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆5,697Updated this week
• langfuse / langfuse
  🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…
  ☆11,428Updated this week
• langchain-ai / langgraph
  Build resilient language agents as graphs.
  ☆12,765Updated this week
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆4,725Updated this week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆9,368Updated this week
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆19,879Updated this week
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆22,551Updated this week
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆6,331Updated this week
• truera / trulens
  Evaluation and Tracking for LLM Experiments
  ☆2,501Updated this week
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,589Updated last week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,543Updated 2 weeks ago
• FlagOpen / FlagEmbedding
  Retrieval and Retrieval-augmented LLMs
  ☆9,649Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,119Updated this week
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆3,967Updated last week
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,305Updated this week
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,544Updated 8 months ago
• microsoft / graphrag
  A modular graph-based Retrieval-Augmented Generation (RAG) system
  ☆25,213Updated this week
• embeddings-benchmark / mteb
  MTEB: Massive Text Embedding Benchmark
  ☆2,513Updated this week
• Chainlit / chainlit
  Build Conversational AI in minutes ⚡️
  ☆9,649Updated 2 weeks ago
• letta-ai / letta
  Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.
  ☆16,480Updated this week
• stanford-futuredata / ColBERT
  ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)
  ☆3,386Updated last month
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…
  ☆6,547Updated this week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆12,122Updated this week