swj0419 / detect-pretrain-codeLinks
This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Ajith, Mengzhou Xia, Yangsibo Huang, Daogao Liu , Terra Blevins , Danqi Chen , Luke Zettlemoyer.
☆233Updated 2 years ago
Alternatives and similar repositories for detect-pretrain-code
Users that are interested in detect-pretrain-code are comparing it to the libraries listed below
Sorting:
- BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).☆166Updated 2 years ago
- The Paper List on Data Contamination for Large Language Models Evaluation.☆104Updated 2 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆192Updated last year
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…☆125Updated last year
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆133Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆121Updated last year
- 【ACL 2024】 SALAD benchmark & MD-Judge☆164Updated 8 months ago
- A Survey on Data Selection for Language Models☆252Updated 6 months ago
- ☆41Updated 2 years ago
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆57Updated last year
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆138Updated 6 months ago
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆111Updated 3 months ago
- Lightweight tool to identify Data Contamination in LLMs evaluation☆52Updated last year
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆149Updated last year
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆128Updated 4 months ago
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆68Updated 3 years ago
- Generative Judge for Evaluating Alignment☆247Updated last year
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆118Updated last year
- LLM Unlearning☆177Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆169Updated last month
- A Survey of Hallucination in Large Foundation Models☆55Updated last year
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆76Updated last year
- Code implementation of synthetic continued pretraining☆138Updated 10 months ago
- ☆103Updated last year
- Evaluating the Ripple Effects of Knowledge Editing in Language Models☆56Updated last year
- ☆47Updated last year
- [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"☆145Updated last year
- [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct☆190Updated 10 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]☆109Updated 8 months ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆523Updated 9 months ago