An evaluation suite for Retrieval-Augmented Generation (RAG).
☆27Apr 26, 2025Updated last year
Alternatives and similar repositories for RAG-evaluation-harnesses
Users that are interested in RAG-evaluation-harnesses are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Kernel Herding for probability density estimation☆14Feb 23, 2016Updated 10 years ago
- ☆21Apr 26, 2026Updated 5 months ago
- ☆14Apr 21, 2023Updated 3 years ago
- This is the source code for: Context-aware Entity Typing in Knowledge Graphs.☆16May 10, 2022Updated 4 years ago
- ☆18May 5, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆26Jun 6, 2025Updated last year
- Repo of "Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems" (ACL 2026)☆36Apr 27, 2026Updated 5 months ago
- This repository contains the replication of the iGSM dataset generation process from the Physics of LLM paper by Zeyuan Zhu.☆17Sep 13, 2024Updated 2 years ago
- Exploiting Inter-sample and Inter-feature Relations in Dataset Distillation (CVPR24)☆10Jun 16, 2024Updated 2 years ago
- ☆10Jul 13, 2024Updated 2 years ago
- [ACL 2023] Contextual Distortion Reveals Constituency: Mask Language Models are Implicit Parsers.☆14Jun 3, 2023Updated 3 years ago
- ☆11Jan 3, 2024Updated 2 years ago
- ☆13Jan 13, 2026Updated 9 months ago
- SERVER: Multi-modal Speech Emotion Recognition using Transformer-based and Vision-based Embeddings☆15Jan 23, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated 2 years ago
- ☆25May 29, 2022Updated 4 years ago
- ☆12Oct 17, 2024Updated 2 years ago
- ☆14May 30, 2019Updated 7 years ago
- Code for the paper "HALoGEN: Fantastic LLM Hallucinations and Where To Find Them"☆30May 18, 2025Updated last year
- This repository contains the official implementation for the ECCV'22 paper, "SPIN: An Empirical Evaluation on Sharing Parameters of Isotr…☆20Sep 11, 2026Updated last month
- AEGIS: Automated Error Generation and Attribution for Multi-Agent Systems☆28Aug 17, 2026Updated 2 months ago
- ☆15Jan 14, 2026Updated 9 months ago
- [Findings of EMNLP 2022] Code of paper Generative Prompt Tuning for Relation Classification. https://arxiv.org/abs/2210.12435☆20May 7, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆32Mar 1, 2024Updated 2 years ago
- One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning☆40Jul 1, 2023Updated 3 years ago
- Video packaging platform - this will build a Docker with a web API that will let you upload, encrypt and serve videos as MPEG DASH files☆10Jul 1, 2026Updated 3 months ago
- arXiv 2024 | ZIP: entropy-law data selection for efficient LLM alignment.☆28Jun 10, 2026Updated 4 months ago
- [Findings of EMNLP 2024] AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models☆20Oct 2, 2024Updated 2 years ago
- ☆15Jan 27, 2025Updated last year
- Code for the paper "TD or not TD: Analyzing the Role of Temporal Differencing in Deep Reinforcement Learning", Artemij Amiranashvili, Ale…☆12Aug 24, 2018Updated 8 years ago
- code for EMNLP 2022 paper Better Few-Shot Relation Extraction with Label Prompt Dropout☆26Nov 8, 2024Updated last year
- Benchmarking Open-Ended Inference Optimization by AI Agents☆47Jul 6, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Revisiting Peng's Q(lambda) for Modern Reinforcement Learning☆15Jul 23, 2021Updated 5 years ago
- ConfAgents: A Conformal-Guided Multi-Agent Framework for Cost-Efficient Medical Diagnosis☆15Jul 22, 2026Updated 2 months ago
- Benchmark for automated failure attributions in agentic systems (🏆 ICML 2025 Spotlight)☆36Jan 6, 2026Updated 9 months ago
- Pile Deduplication Code☆18May 15, 2023Updated 3 years ago
- A PyTorch native platform for training generative AI models☆17Jun 30, 2026Updated 3 months ago
- A pytorch implemention of the Explainable AI work 'Contrastive layerwise relevance propagation (CLRP)'☆17Jun 24, 2022Updated 4 years ago
- An implementation of DreamerV2 written in JAX, with support for running multiple random seeds of an experiment on a single GPU.☆18Jan 16, 2023Updated 3 years ago