alon-albalak / data-selection-survey
A Survey on Data Selection for Language Models
☆207Updated 4 months ago
Alternatives and similar repositories for data-selection-survey:
Users that are interested in data-selection-survey are comparing it to the libraries listed below
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆200Updated 3 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆157Updated 7 months ago
- The Paper List on Data Contamination for Large Language Models Evaluation.☆90Updated last month
- Project for the paper entitled `Instruction Tuning for Large Language Models: A Survey`☆159Updated 2 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆411Updated 3 months ago
- This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…☆215Updated last year
- A Survey of Attributions for Large Language Models☆187Updated 5 months ago
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆161Updated last year
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆462Updated 3 weeks ago
- ☆205Updated last week
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆139Updated 5 months ago
- Collection of training data management explorations for large language models☆307Updated 6 months ago
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA☆111Updated 3 months ago
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆86Updated 6 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆103Updated 10 months ago
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆332Updated last year
- Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.☆129Updated last year
- Fantastic Data Engineering for Large Language Models☆70Updated last month
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning"☆100Updated 7 months ago
- DSIR large-scale data selection framework for language model training☆242Updated 10 months ago
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…☆108Updated 7 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆168Updated 9 months ago
- ☆251Updated last year
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆293Updated 5 months ago
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆106Updated 5 months ago
- AI Logging for Interpretability and Explainability🔬☆102Updated 8 months ago
- All available datasets for Instruction Tuning of Large Language Models☆241Updated last year
- LLM hallucination paper list☆302Updated 11 months ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆67Updated last month
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆135Updated 3 months ago