amazon-science / RefCheckerLinks
RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.
☆414Updated 8 months ago
Alternatives and similar repositories for RefChecker
Users that are interested in RefChecker are comparing it to the libraries listed below
Sorting:
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆597Updated last year
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆218Updated last year
- Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"☆404Updated last year
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆509Updated last year
- Forward-Looking Active REtrieval-augmented generation (FLARE)☆664Updated 2 years ago
- Comprehensive benchmark for RAG☆259Updated 7 months ago
- Automated Evaluation of RAG Systems☆686Updated 10 months ago
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)☆418Updated 9 months ago
- Corrective Retrieval Augmented Generation☆443Updated last year
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆285Updated 2 years ago
- Code repo for the ICML 2024 paper "Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation"☆86Updated last year
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆572Updated last week
- Data and code for FreshLLMs (https://arxiv.org/abs/2310.03214)☆385Updated 2 months ago
- Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]☆653Updated last year
- Generative Representational Instruction Tuning☆685Updated 7 months ago
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆549Updated last year
- Evaluate your LLM's response with Prometheus and GPT4 💯☆1,038Updated 9 months ago
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆374Updated 2 years ago
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆189Updated 9 months ago
- RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentation.☆144Updated 3 weeks ago
- Guideline following Large Language Model for Information Extraction☆425Updated last year
- Dense X Retrieval: What Retrieval Granularity Should We Use?☆168Updated 2 years ago
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆310Updated last year
- [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton☆196Updated last year
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆344Updated last year
- The papers are organized according to our survey: Evaluating Large Language Models: A Comprehensive Survey.☆792Updated last year
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆169Updated last year
- Source code for the paper "Active Prompting with Chain-of-Thought for Large Language Models"☆248Updated last year
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆413Updated 9 months ago
- The code and data for "StructGPT: A general framework for Large Language Model to Reason on Structured Data"☆421Updated 2 years ago