Automated Evaluation of RAG Systems
☆740Mar 28, 2025Updated last year
Alternatives and similar repositories for ARES
Users that are interested in ARES are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Supercharge Your LLM Application Evaluations 🚀☆16,251Feb 24, 2026Updated 8 months ago
- ☆379May 17, 2024Updated 2 years ago
- Evaluation and Tracking for LLM Experiments and AI Agents☆3,629Updated this week
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆1,136Dec 13, 2024Updated last year
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,974May 17, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models☆419May 20, 2025Updated last year
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆172Nov 18, 2024Updated last year
- ☆243Apr 2, 2025Updated last year
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆2,443May 25, 2024Updated 2 years ago
- The LLM Evaluation Framework☆19,334Updated this week
- DSPy: The framework for programming—not prompting—language models☆38,961Updated this week
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)☆477Sep 16, 2026Updated last month
- ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)☆3,952Oct 14, 2025Updated last year
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆200Oct 25, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆24Jun 12, 2024Updated 2 years ago
- A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.☆2,331Oct 16, 2025Updated last year
- Your Personal Librarian Agent. Ask anything on your computer, organize files, remember important info and files.☆5,379Updated this week
- MTEB: State-of-the-art evaluation of embeddings across languages and modalities☆3,499Updated this week
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆328Jul 10, 2025Updated last year
- Comprehensive benchmark for RAG☆313Jun 14, 2025Updated last year
- Benchmarking library for RAG☆282Jul 14, 2026Updated 3 months ago
- ⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)☆3,604Oct 27, 2026Updated last week
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,643Dec 20, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Efficient Retrieval Augmentation and Generation Framework☆1,785Jan 12, 2026Updated 9 months ago
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆36,580Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆15,680Updated this week
- A framework for few-shot evaluation of language models.☆14,415Updated this week
- AI Observability & Evaluation☆12,176Updated this week
- Structured Outputs☆16,005Sep 21, 2026Updated last month
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆6,806Updated this week
- LlamaIndex is the document processing platform for AI☆52,831Updated this week
- Retrieval and Retrieval-augmented LLMs☆12,300Oct 27, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,579Oct 29, 2026Updated last week
- A guidance language for controlling large language models.☆21,821May 21, 2026Updated 5 months ago
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆7,440Updated this week
- structured outputs for llms☆14,099Updated this week
- Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"☆429Feb 4, 2024Updated 2 years ago
- [ACL 2025] GaRAGe: A Benchmark with Grounding Annotations for RAG Evaluation.☆15Jun 10, 2025Updated last year
- Train transformer language models with reinforcement learning.☆19,675Updated this week