The Paper List on Data Contamination for Large Language Models Evaluation.
☆118Sep 28, 2026Updated last month
Alternatives and similar repositories for awesome-data-contamination
Users that are interested in awesome-data-contamination are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Nov 26, 2024Updated last year
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆60Aug 13, 2024Updated 2 years ago
- DICE: Detecting In-distribution Data Contamination with LLM's Internal State☆10Sep 21, 2024Updated 2 years ago
- ☆15Oct 13, 2025Updated last year
- This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…☆243Nov 3, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The official repo for DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph☆19Oct 13, 2024Updated 2 years ago
- [ACL 2025] Official code for ''Learning to Reason from Feedback at Test-Time''.☆13May 16, 2025Updated last year
- Official completion of “Training on the Benchmark Is Not All You Need”.☆40Dec 31, 2024Updated last year
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆82Apr 11, 2024Updated 2 years ago
- Latest Evaluation Toolkit (LatestEval). Assessing the language models with latest, uncontaminated materials.☆28Feb 17, 2025Updated last year
- Lightweight tool to identify Data Contamination in LLMs evaluation☆52Mar 8, 2024Updated 2 years ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆326Dec 20, 2023Updated 2 years ago
- [ICLR 2025] Permute-and-Flip: An optimally robust and watermarkable decoder for LLMs☆19Mar 20, 2025Updated last year
- The official implementation of the paper "Data Contamination Calibration for Black-box LLMs"☆17May 21, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python package for measuring memorization in LLMs.☆198Jul 16, 2025Updated last year
- SVIP: Towards Verifiable Inference of Open-Source Large Language Models☆15Jun 3, 2025Updated last year
- Ward: Provable RAG Dataset Inference via LLM Watermarks (ICLR 2025)☆12May 15, 2025Updated last year
- BeHonest: Benchmarking Honesty in Large Language Models☆37Aug 15, 2024Updated 2 years ago
- Xlore2.0 Code[BaiduExtractor, HudongExtractor, WikiExtractor, XloreData, XloreWeb]☆12Apr 5, 2017Updated 9 years ago
- [NeurIPS '24 Spotlight] PertEval: Unveiling Real Knowledge Capacity of LLMs via Knowledge-invariant Perturbations☆14Oct 30, 2024Updated 2 years ago
- Official code for ICLR 2024 paper, SEABO: A Simple Search-Based Method for Offline Imitation Learning☆14Jan 19, 2024Updated 2 years ago
- Code and data to support Bamman et al. (2020), "A Dataset of Literary Coreference" (LREC)☆11Dec 8, 2022Updated 3 years ago
- Code for LLM_Catastrophic_Forgetting via SAM.☆11Jun 7, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆20Oct 24, 2023Updated 3 years ago
- ☆28Dec 18, 2024Updated last year
- ☆25Nov 30, 2020Updated 5 years ago
- personal website powered by a Hakyll compiler that renders pages with Typst☆14Nov 9, 2026Updated last week
- Learning from Negative samples for Biomedical Generative Entity Linking☆19May 25, 2025Updated last year
- The implementation of Teachability-Aware On-Policy Distillation (TA-OPD), the method introduced in Not All Disagreement Is Learnable: Tok…☆22May 25, 2026Updated 5 months ago
- Data and code for "Nibbling at the Hard Core of Word Sense Disambiguation" (ACL 2022).☆17Mar 25, 2022Updated 4 years ago
- ☆36Mar 10, 2025Updated last year
- Python package developed to evaluate textual overlap (N-Grams) between two volumes of text.☆11Sep 23, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The official repository for the paper entitled "Time Travel in LLMs: Tracing Data Contamination in Large Language Models."☆16Jun 11, 2024Updated 2 years ago
- ☆14May 12, 2026Updated 6 months ago
- Official repository for LongTableBench (EMNLP'25 paper), a comprehensive benchmark for evaluating long-context reasoning over semi-struct…☆11Nov 4, 2025Updated last year
- Code for NeurIPS 2024 paper "Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs"☆48Feb 20, 2025Updated last year
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆90Jun 20, 2026Updated 5 months ago
- A bibliography and survey of the papers surrounding o1☆1,213Jul 7, 2026Updated 4 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆34May 23, 2024Updated 2 years ago
Are these results useful?