amazon-science / RefChecker
RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.
☆357Updated 4 months ago
Alternatives and similar repositories for RefChecker:
Users that are interested in RefChecker are comparing it to the libraries listed below
- Automated Evaluation of RAG Systems☆569Updated this week
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆161Updated 3 months ago
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆808Updated 3 months ago
- Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"☆318Updated last year
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆504Updated 9 months ago
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆478Updated 5 months ago
- Comprehensive benchmark for RAG☆154Updated 4 months ago
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)☆286Updated 4 months ago
- Forward-Looking Active REtrieval-augmented generation (FLARE)☆621Updated last year
- Generative Representational Instruction Tuning☆613Updated 2 weeks ago
- Corrective Retrieval Augmented Generation☆359Updated 5 months ago
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆293Updated 5 months ago
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆143Updated 5 months ago
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆453Updated last year
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆419Updated this week
- Benchmark baseline for retrieval qa applications☆105Updated 11 months ago
- Dense X Retrieval: What Retrieval Granularity Should We Use?☆152Updated last year
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆151Updated 4 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆350Updated 6 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆228Updated 7 months ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆893Updated 2 weeks ago
- Code repo for the ICML 2024 paper "Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation"☆72Updated 9 months ago
- Source code for the paper "Active Prompting with Chain-of-Thought for Large Language Models"☆236Updated 10 months ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆254Updated last year
- Guideline following Large Language Model for Information Extraction☆358Updated 5 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆300Updated 3 months ago
- This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"☆203Updated 3 months ago
- Official repository for ORPO☆446Updated 10 months ago
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆236Updated last year
- Implementation of "RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation".☆228Updated 10 months ago