swj0419 / detect-pretrain-code
This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Ajith, Mengzhou Xia, Yangsibo Huang, Daogao Liu , Terra Blevins , Danqi Chen , Luke Zettlemoyer.
☆216Updated last year
Alternatives and similar repositories for detect-pretrain-code:
Users that are interested in detect-pretrain-code are comparing it to the libraries listed below
- BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).☆122Updated last year
- The Paper List on Data Contamination for Large Language Models Evaluation.☆91Updated last month
- Lightweight tool to identify Data Contamination in LLMs evaluation☆46Updated 11 months ago
- LLM Unlearning☆140Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆104Updated 10 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆412Updated 4 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆157Updated 8 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning"☆100Updated 7 months ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆464Updated last month
- 【ACL 2024】 SALAD benchmark & MD-Judge☆125Updated 2 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆215Updated 3 months ago
- A Survey on Data Selection for Language Models☆210Updated 4 months ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆89Updated 8 months ago
- Self-Alignment with Principle-Following Reward Models☆154Updated 11 months ago
- Generative Judge for Evaluating Alignment☆228Updated last year
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆173Updated 9 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆130Updated 5 months ago
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆106Updated 5 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆245Updated 5 months ago
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆201Updated 4 months ago
- ☆130Updated 2 months ago
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆136Updated 7 months ago
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆87Updated 6 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆153Updated 8 months ago
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆65Updated 11 months ago
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆83Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆84Updated last week
- R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)☆65Updated 2 weeks ago
- ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.☆77Updated 9 months ago
- [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs☆35Updated last week