Alternatives and similar repositories for auto-rag-eval:

Users that are interested in auto-rag-eval are comparing it to the libraries listed below

• apple / ml-superposition-prompting
  ☆141Updated 7 months ago
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆146Updated last year
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆83Updated 6 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆74Updated 5 months ago
• amazon-science / RefChecker
  RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Langua…
  ☆341Updated 3 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆125Updated 11 months ago
• naver / bergen
  Benchmarking library for RAG
  ☆166Updated last week
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆147Updated 2 months ago
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆125Updated 2 months ago
• SALT-NLP / demonstrated-feedback
  ☆117Updated 4 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆106Updated last week
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆101Updated 10 months ago
• xsc1234 / Search-in-the-Chain
  Code for Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasks
  ☆54Updated 10 months ago
• facebookresearch / CRAG
  Comprehensive benchmark for RAG
  ☆114Updated 3 months ago
• Liyan06 / MiniCheck
  MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
  ☆124Updated last month
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆100Updated 5 months ago
• awslabs / rag-qa-arena
  ☆37Updated 6 months ago
• SalesforceAIResearch / SFR-RAG
  ☆73Updated last month
• neulab / ragged
  Retrieval Augmented Generation Generalized Evaluation Dataset
  ☆51Updated 3 months ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆124Updated last year
• writer / writing-in-the-margins
  ☆108Updated 5 months ago
• jakespringer / echo-embeddings
  ☆139Updated 10 months ago
• mddunlap924 / LangChain-SynData-RAG-Eval
  LangChain, Llama2-Chat, and zero- and few-shot prompting are used to generate synthetic datasets for IR and RAG system evaluation
  ☆37Updated last year
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆197Updated 4 months ago
• YHPeter / Awesome-RAG-Evaluation
  The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.
  ☆129Updated 4 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆547Updated 3 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆128Updated 3 months ago
• olly-styles / WorkBench
  WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting.
  ☆37Updated 6 months ago
• IBM / InspectorRAGet
  The repository contains generative AI analytics platform application code.
  ☆23Updated 3 months ago
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆198Updated 3 months ago