ntunlp / LLMSanitize
An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
☆51Updated 7 months ago
Alternatives and similar repositories for LLMSanitize:
Users that are interested in LLMSanitize are comparing it to the libraries listed below
- Lightweight tool to identify Data Contamination in LLMs evaluation☆49Updated last year
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆66Updated 2 years ago
- ☆41Updated last year
- Evaluating the Ripple Effects of Knowledge Editing in Language Models☆54Updated 11 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆61Updated 4 months ago
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated 2 years ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆58Updated last year
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆106Updated 6 months ago
- Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"☆63Updated last year
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆77Updated 11 months ago
- Do Large Language Models Know What They Don’t Know?☆92Updated 4 months ago
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆71Updated last year
- ☆44Updated 6 months ago
- ☆52Updated 7 months ago
- ☆17Updated last year
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆58Updated 2 years ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆55Updated 8 months ago
- ☆86Updated last year
- ☆59Updated 6 months ago
- "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)☆13Updated last year
- The repository for paper <Evaluating Open-QA Evaluation>☆24Updated 11 months ago
- ☆48Updated 11 months ago
- ☆72Updated last year
- Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"☆24Updated last year
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆50Updated 3 months ago
- AbstainQA, ACL 2024☆25Updated 5 months ago
- Evaluate the Quality of Critique☆35Updated 9 months ago
- Recent papers on (1) Psychology of LLMs; (2) Biases in LLMs.☆47Updated last year
- ☆41Updated last year
- BeHonest: Benchmarking Honesty in Large Language Models☆31Updated 7 months ago