Alternatives and similar repositories for auto-rag-eval

Users that are interested in auto-rag-eval are comparing it to the libraries listed below

• amazon-science / RefChecker
  RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Langua…
  ☆414Updated 8 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆218Updated last year
• facebookresearch / CRAG
  Comprehensive benchmark for RAG
  ☆259Updated 7 months ago
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆168Updated 2 years ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• apple / ml-superposition-prompting
  ☆147Updated last year
• naver / bergen
  Benchmarking library for RAG
  ☆255Updated last week
• apple / ToolSandbox
  ☆234Updated 2 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆686Updated 10 months ago
• nlpyang / geval
  Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
  ☆404Updated last year
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆206Updated 3 weeks ago
• docugami / KG-RAG-datasets
  Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasets
  ☆195Updated last year
• patronus-ai / financebench
  ☆243Updated last year
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆174Updated last week
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆120Updated 3 months ago
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆116Updated 6 months ago
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆572Updated last week
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆446Updated last year
• yixuantt / MultiHop-RAG
  Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)
  ☆418Updated 9 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆321Updated 3 weeks ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆159Updated 2 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆469Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆80Updated last year
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆237Updated 4 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆317Updated last year
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆113Updated last year
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆597Updated last year
• quotient-ai / judges
  A small library of LLM judges
  ☆317Updated 6 months ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆137Updated 2 years ago
• AIR-Bench / AIR-Bench
  [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆166Updated 3 months ago