Alternatives and similar repositories for auto-rag-eval:

Users that are interested in auto-rag-eval are comparing it to the libraries listed below

• amazon-science / RefChecker
  RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Langua…
  ☆336Updated 2 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆132Updated last month
• patronus-ai / financebench
  ☆126Updated last month
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆82Updated 5 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆124Updated 10 months ago
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆63Updated 11 months ago
• facebookresearch / CRAG
  Comprehensive benchmark for RAG
  ☆99Updated 2 months ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆101Updated 9 months ago
• apple / ml-superposition-prompting
  ☆137Updated 5 months ago
• yixuantt / MultiHop-RAG
  Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)
  ☆242Updated last month
• aws-samples / llm-evaluation-methodology
  ☆40Updated 2 months ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆121Updated last year
• SALT-NLP / demonstrated-feedback
  ☆115Updated 3 months ago
• OSU-NLP-Group / TableLlama
  [NAACL'24] Dataset, code and models for "TableLlama: Towards Open Large Generalist Models for Tables".
  ☆122Updated 8 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆106Updated 3 weeks ago
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆141Updated last year
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆97Updated 4 months ago
• apple / ToolSandbox
  ☆149Updated 5 months ago
• carriex / recomp
  RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentation.
  ☆117Updated 6 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆253Updated 2 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆75Updated 3 months ago
• vinid / NegotiationArena
  ☆65Updated 9 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆54Updated 2 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated 9 months ago
• docugami / KG-RAG-datasets
  Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasets
  ☆141Updated 9 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆526Updated 2 months ago
• awslabs / rag-qa-arena
  ☆34Updated 5 months ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆119Updated 10 months ago
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆74Updated 8 months ago
• nyu-mll / quality
  ☆124Updated this week