stanford-futuredata / ARES
Automated Evaluation of RAG Systems
☆569Updated this week
Alternatives and similar repositories for ARES:
Users that are interested in ARES are comparing it to the libraries listed below
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆815Updated 3 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆419Updated this week
- Evaluate your LLM's response with Prometheus and GPT4 💯☆893Updated 2 weeks ago
- Corrective Retrieval Augmented Generation☆359Updated 5 months ago
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)☆286Updated 4 months ago
- Forward-Looking Active REtrieval-augmented generation (FLARE)☆621Updated last year
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆1,153Updated 7 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,359Updated 2 weeks ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆504Updated 9 months ago
- Fine-Tuning Embedding for RAG with Synthetic Data☆489Updated last year
- ☆855Updated 5 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆305Updated 3 months ago
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆763Updated last month
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆143Updated 5 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆228Updated 7 months ago
- RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Langua…☆357Updated 4 months ago
- Generative Representational Instruction Tuning☆613Updated 2 weeks ago
- Code for explaining and evaluating late chunking (chunked pooling)☆355Updated 3 months ago
- HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels☆524Updated 3 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,078Updated last week
- Efficient Retrieval Augmentation and Generation Framework☆1,500Updated 2 months ago
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆478Updated 5 months ago
- Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]☆585Updated last year
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆293Updated 5 months ago
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆2,012Updated 10 months ago
- ☆504Updated 4 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆415Updated last year
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆166Updated 4 months ago
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆202Updated 5 months ago
- Automatically evaluate your LLMs in Google Colab☆613Updated 10 months ago