stanford-futuredata / ARESLinks
Automated Evaluation of RAG Systems
β684Updated 9 months ago
Alternatives and similar repositories for ARES
Users that are interested in ARES are comparing it to the libraries listed below
Sorting:
- Evaluate your LLM's response with Prometheus and GPT4 π―β1,031Updated 8 months ago
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalβ1,537Updated last year
- RAGChecker: A Fine-grained Framework For Diagnosing RAGβ1,044Updated last year
- β906Updated last year
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)β416Updated 9 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.β571Updated 3 weeks ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)β344Updated last year
- Code for explaining and evaluating late chunking (chunked pooling)β482Updated last year
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.β819Updated 6 months ago
- Corrective Retrieval Augmented Generationβ438Updated last year
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.β1,588Updated last month
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelsβ593Updated last year
- Fine-Tuning Embedding for RAG with Synthetic Dataβ524Updated 2 years ago
- Efficient Retrieval Augmentation and Generation Frameworkβ1,758Updated last week
- RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Languaβ¦β414Updated 8 months ago
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.β185Updated 8 months ago
- Comprehensive benchmark for RAGβ258Updated 7 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipyβ1,456Updated 3 weeks ago
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"β237Updated 3 months ago
- Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]β652Updated last year
- Forward-Looking Active REtrieval-augmented generation (FLARE)β665Updated 2 years ago
- TAG-Bench: A benchmark for table-augmented generation (TAG)β766Updated 9 months ago
- HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labelsβ567Updated last year
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generationβ310Updated last year
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.β446Updated last year
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and croβ¦β926Updated 2 weeks ago
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.β320Updated 6 months ago
- Automatically evaluate your LLMs in Google Colabβ682Updated last year
- Generative Representational Instruction Tuningβ683Updated 6 months ago
- A tool for evaluating LLMsβ427Updated last year