Alternatives and similar repositories for auto-rag-eval:

Users that are interested in auto-rag-eval are comparing it to the libraries listed below

• amazon-science / RefChecker
  RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Langua…
  ☆361Updated 5 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆170Updated 4 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 7 months ago
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆155Updated last year
• AlexTMallen / adaptive-retrieval
  ☆174Updated 2 years ago
• awslabs / rag-qa-arena
  ☆40Updated 8 months ago
• SalesforceAIResearch / FaithEval
  ☆36Updated last month
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆83Updated 8 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆106Updated 7 months ago
• apple / ml-superposition-prompting
  ☆143Updated 9 months ago
• aws-samples / llm-evaluation-methodology
  ☆43Updated 5 months ago
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆137Updated 4 months ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆422Updated last year
• myeon9h / PlanRAG
  Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24
  ☆139Updated 10 months ago
• jakespringer / echo-embeddings
  ☆145Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆35Updated 9 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆228Updated 6 months ago
• xsc1234 / Search-in-the-Chain
  Code for Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasks
  ☆55Updated last year
• facebookresearch / CRAG
  Comprehensive benchmark for RAG
  ☆170Updated 5 months ago
• naver / bergen
  Benchmarking library for RAG
  ☆193Updated last week
• awslabs / extending-the-context-length-of-open-source-llms
  ☆53Updated 4 months ago
• SALT-NLP / demonstrated-feedback
  ☆120Updated 6 months ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆101Updated last year
• zorazrw / filco
  [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton
  ☆192Updated last year
• carriex / recomp
  RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentation.
  ☆126Updated last week
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆222Updated 3 weeks ago
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆203Updated 4 months ago
• matthewrenze / self-reflection
  Self-Reflection in LLM Agents: Effects on Problem-Solving Performance
  ☆69Updated 5 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆108Updated last week