amazon-science / RefChecker
RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.
☆361Updated 5 months ago
Alternatives and similar repositories for RefChecker:
Users that are interested in RefChecker are comparing it to the libraries listed below
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆513Updated 10 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆436Updated this week
- Automated Evaluation of RAG Systems☆582Updated 3 weeks ago
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆170Updated 4 months ago
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆480Updated 6 months ago
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)☆302Updated 3 weeks ago
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆463Updated last year
- Corrective Retrieval Augmented Generation☆367Updated 6 months ago
- Generative Representational Instruction Tuning☆623Updated last month
- Dense X Retrieval: What Retrieval Granularity Should We Use?☆155Updated last year
- Benchmark baseline for retrieval qa applications☆109Updated last year
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆850Updated 4 months ago
- List of papers on hallucination detection in LLMs.☆846Updated 2 weeks ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆257Updated last year
- Repository for Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions, ACL23☆203Updated 10 months ago
- Code repo for the ICML 2024 paper "Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation"☆73Updated 10 months ago
- The repository for the survey paper <<Survey on Large Language Models Factuality: Knowledge, Retrieval and Domain-Specificity>>☆339Updated last year
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆205Updated 5 months ago
- Data and code for FreshLLMs (https://arxiv.org/abs/2310.03214)☆354Updated last week
- Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]☆592Updated last year
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆151Updated 5 months ago
- ☆278Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆340Updated last year
- Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasets☆152Updated last year
- RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentation.☆126Updated last week
- ☆360Updated last year
- Guideline following Large Language Model for Information Extraction☆365Updated 5 months ago
- ☆300Updated 2 months ago
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆340Updated last week
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆240Updated 10 months ago