Alternatives and similar repositories for auto-rag-eval

Users that are interested in auto-rag-eval are comparing it to the libraries listed below

• amazon-science / RefChecker
  RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Langua…
  ☆374Updated last month
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆157Updated last year
• apple / ml-superposition-prompting
  ☆144Updated 11 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆186Updated 6 months ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆107Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆39Updated 11 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 9 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆112Updated 9 months ago
• awslabs / rag-qa-arena
  ☆45Updated 10 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆130Updated last year
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆135Updated last year
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆254Updated 2 months ago
• aws-samples / llm-evaluation-methodology
  ☆44Updated 7 months ago
• apple / ToolSandbox
  ☆178Updated 10 months ago
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆111Updated 9 months ago
• zeroentropy-ai / legalbenchrag
  This is the repo for the LegalBench-RAG Paper: https://arxiv.org/abs/2408.10343.
  ☆97Updated 3 weeks ago
• SalesforceAIResearch / SFR-RAG
  ☆75Updated 5 months ago
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆472Updated last week
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆235Updated 10 months ago
• project-miracl / miracl
  A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
  ☆188Updated 10 months ago
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆144Updated 6 months ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆425Updated last year
• naver / bergen
  Benchmarking library for RAG
  ☆209Updated 2 weeks ago
• YHPeter / Awesome-RAG-Evaluation
  The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.
  ☆160Updated 2 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆135Updated 2 weeks ago
• yixuantt / MultiHop-RAG
  Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)
  ☆330Updated 2 months ago
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆213Updated 3 weeks ago
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆115Updated last year
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆112Updated 2 weeks ago
• facebookresearch / CRAG
  Comprehensive benchmark for RAG
  ☆194Updated last week