stanford-futuredata / ARES
Automated Evaluation of RAG Systems
☆532Updated 2 months ago
Alternatives and similar repositories for ARES:
Users that are interested in ARES are comparing it to the libraries listed below
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆719Updated last month
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,260Updated last week
- Corrective Retrieval Augmented Generation☆342Updated 3 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆395Updated last week
- ☆820Updated 3 months ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆854Updated 3 weeks ago
- Code for explaining and evaluating late chunking (chunked pooling)☆313Updated last month
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)☆249Updated 2 months ago
- Generative Representational Instruction Tuning☆588Updated last week
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆1,066Updated 4 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆277Updated last month
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆283Updated 3 months ago
- Framework for enhancing LLMs for RAG tasks using fine-tuning.☆522Updated last month
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,022Updated this week
- RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Langua…☆337Updated 2 months ago
- Forward-Looking Active REtrieval-augmented generation (FLARE)☆600Updated last year
- Official repository for ORPO☆432Updated 7 months ago
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆117Updated 3 months ago
- ☆489Updated 2 months ago
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆731Updated 4 months ago
- Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]☆561Updated 10 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,064Updated this week
- Easily embed, cluster and semantically label text datasets☆493Updated 10 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆987Updated last week
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆213Updated 5 months ago
- Fine-Tuning Embedding for RAG with Synthetic Data☆479Updated last year
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆491Updated 7 months ago
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…☆732Updated 2 months ago
- Efficient Retrieval Augmentation and Generation Framework☆1,428Updated 2 weeks ago
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆194Updated 2 months ago