☆51Jan 24, 2024Updated 2 years ago
Alternatives and similar repositories for DsDm
Users that are interested in DsDm are comparing it to the libraries listed below
Sorting:
- Aioli: A unified optimization framework for language model data mixing☆32Jan 17, 2025Updated last year
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆79Nov 14, 2024Updated last year
- ☆17Mar 23, 2025Updated 11 months ago
- Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…☆13Aug 8, 2025Updated 6 months ago
- A fast, effective data attribution method for neural networks in PyTorch☆232Nov 18, 2024Updated last year
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆48Oct 31, 2023Updated 2 years ago
- ☆26May 30, 2023Updated 2 years ago
- Debiasing Through Data Attribution☆12May 23, 2024Updated last year
- Data for "Datamodels: Predicting Predictions with Training Data"☆97May 25, 2023Updated 2 years ago
- ☆10Oct 20, 2023Updated 2 years ago
- Decomposing and Editing Predictions by Modeling Model Computation☆139Jun 12, 2024Updated last year
- ☆109Jul 15, 2025Updated 7 months ago
- ☆13Dec 12, 2025Updated 2 months ago
- ☆13Jun 4, 2024Updated last year
- Official pytorch implementation of ICML2025 "TAROT: Targeted Data Selection via Optimal Transport"☆28Dec 12, 2024Updated last year
- ☆32May 24, 2023Updated 2 years ago
- ☆14Mar 4, 2024Updated last year
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆28Aug 19, 2025Updated 6 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆201Dec 8, 2025Updated 2 months ago
- ☆43Oct 13, 2023Updated 2 years ago
- ☆18Mar 18, 2024Updated last year
- https://footprints.baulab.info☆17Oct 4, 2024Updated last year
- ☆16Apr 3, 2023Updated 2 years ago
- ☆16Jul 20, 2023Updated 2 years ago
- DSIR large-scale data selection framework for language model training☆270Apr 7, 2024Updated last year
- Code for NeurIPS'23 paper "A Bayesian Approach To Analysing Training Data Attribution In Deep Learning"☆17Jan 12, 2024Updated 2 years ago
- ☆20Apr 16, 2025Updated 10 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆350Dec 26, 2023Updated 2 years ago
- Codebase for ICML submission "DOGE: Domain Reweighting with Generalization Estimation"☆21Feb 29, 2024Updated 2 years ago
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training☆19Oct 12, 2024Updated last year
- Official implementation of TBA for async LLM post-training.☆29Nov 5, 2025Updated 3 months ago
- ☆23Jan 17, 2025Updated last year
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆512Oct 20, 2024Updated last year
- ☆23Oct 4, 2024Updated last year
- ☆20Nov 4, 2025Updated 3 months ago
- ☆42Feb 12, 2026Updated 2 weeks ago
- A Survey on Data Selection for Language Models☆253Apr 29, 2025Updated 10 months ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆20May 31, 2023Updated 2 years ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆137Mar 14, 2024Updated last year