An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
☆61Aug 13, 2024Updated last year
Alternatives and similar repositories for LLMSanitize
Users that are interested in LLMSanitize are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DICE: Detecting In-distribution Data Contamination with LLM's Internal State☆12Sep 21, 2024Updated last year
- The Paper List on Data Contamination for Large Language Models Evaluation.☆115Jun 2, 2026Updated last month
- [NeurIPS 2024] Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Sampling☆35Nov 8, 2024Updated last year
- ☆34Mar 21, 2026Updated 3 months ago
- Listing all reported open-source LLMs achieving a higher score than proprietary, paying OpenAI models (ChatGPT, GPT-4).☆68Feb 1, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Trending projects & awesome papers about data-centric llm studies.☆40May 20, 2025Updated last year
- ☆16Nov 26, 2024Updated last year
- [ACL 2023] Modeling What-to-ask and How-to-ask for Answer-unaware Conversational Question Generation☆14Jul 11, 2023Updated 2 years ago
- ☆14Aug 18, 2022Updated 3 years ago
- ☆44Oct 7, 2024Updated last year
- 校园帮需求分析报告☆10Apr 4, 2020Updated 6 years ago
- [ICML 2024] Self-Infilling Code Generation☆18May 5, 2024Updated 2 years ago
- ☆13Jun 20, 2023Updated 3 years ago
- ☆19Jul 24, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Feb 11, 2021Updated 5 years ago
- Official codes for NAACL 2025 paper "LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias …☆11Nov 25, 2025Updated 7 months ago
- Noise-robust de-duplication at scale☆19Apr 9, 2023Updated 3 years ago
- Website for HKU NLP group (under construction)☆14Mar 20, 2026Updated 3 months ago
- [EMNLP’24 Main] Encoding and Controlling Global Semantics for Long-form Video Question Answering☆18Oct 9, 2024Updated last year
- PyTorch code for EMNLP 2021 paper: Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialog…☆28Oct 4, 2021Updated 4 years ago
- [ACL 2024] Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation☆10May 26, 2024Updated 2 years ago
- triton ver of gqa flash attn, based on the tutorial☆12Aug 4, 2024Updated last year
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆64Oct 21, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [EMNLP 2023] ALCUNA: Large Language Models Meet New Knowledge☆30Oct 30, 2023Updated 2 years ago
- [ICLR 2025] Permute-and-Flip: An optimally robust and watermarkable decoder for LLMs☆19Mar 20, 2025Updated last year
- Implementation of the paper: "Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning…☆22Nov 2, 2021Updated 4 years ago
- ☆21May 24, 2024Updated 2 years ago
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆90Sep 17, 2024Updated last year
- An evaluation suite for Retrieval-Augmented Generation (RAG).☆24Apr 26, 2025Updated last year
- ☆43Mar 26, 2025Updated last year
- Official repository of StablePrompt: Automatic Prompt Tuning using Reinforcement Learning for Large Language Model (EMNLP 2024)☆42Feb 11, 2025Updated last year
- This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…☆243Nov 3, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆228Nov 16, 2024Updated last year
- ☆23Jul 5, 2024Updated last year
- ☆15Feb 26, 2025Updated last year
- Exploring Few-Shot Adaptation of Language Models with Tables☆25Aug 22, 2022Updated 3 years ago
- Official Implementation of "Probing Language Models for Pre-training Data Detection"☆20Dec 4, 2024Updated last year
- Learning Latent Semantic Annotations for Grounding Natural Language to Structured Data☆13Jan 28, 2019Updated 7 years ago
- Adversarial Attack for Pre-trained Code Models☆10Jul 19, 2022Updated 3 years ago