swj0419 / detect-pretrain-code
This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Ajith, Mengzhou Xia, Yangsibo Huang, Daogao Liu , Terra Blevins , Danqi Chen , Luke Zettlemoyer.
☆198Updated 10 months ago
Related projects: ⓘ
- Benchmarking LLMs with Challenging Tasks from Real Users☆182Updated last month
- BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).☆99Updated 10 months ago
- A Survey on Data Selection for Language Models☆148Updated 3 months ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆405Updated 4 months ago
- Self-Alignment with Principle-Following Reward Models☆144Updated 6 months ago
- DSIR large-scale data selection framework for language model training☆221Updated 5 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly"☆121Updated 3 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning"☆87Updated 2 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆134Updated 6 months ago
- ☆170Updated last month
- The Paper List on Data Contamination for Large Language Models Evaluation.☆46Updated this week
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆100Updated 3 months ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆148Updated 6 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆134Updated 2 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆84Updated 5 months ago
- A Survey of Attributions for Large Language Models☆155Updated 3 weeks ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆337Updated 2 months ago
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆104Updated 2 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆135Updated last month
- 【ACL 2024】 SALAD benchmark & MD-Judge☆81Updated this week
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆268Updated last week
- Generative Judge for Evaluating Alignment☆208Updated 8 months ago
- Codes for papers on Large Language Models Personalization (LaMP)☆102Updated 5 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆208Updated last week
- Project for the paper entitled `Instruction Tuning for Large Language Models: A Survey`☆134Updated 6 months ago
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆143Updated 5 months ago
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆201Updated 10 months ago
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆73Updated 7 months ago
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆128Updated 2 months ago
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆96Updated last week