Olivia-fsm / DoGE
Codebase for ICML submission "DOGE: Domain Reweighting with Generalization Estimation"
☆14Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for DoGE
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆41Updated last year
- AI Logging for Interpretability and Explainability🔬☆88Updated 5 months ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆68Updated 3 weeks ago
- ☆43Updated 9 months ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆85Updated 3 years ago
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆57Updated 8 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆118Updated last month
- Augmenting Statistical Models with Natural Language Parameters☆17Updated last month
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆63Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆96Updated 7 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models☆48Updated 2 months ago
- ☆79Updated last year
- ☆107Updated 3 months ago
- ☆61Updated 2 years ago
- ☆85Updated 11 months ago
- ☆33Updated last year
- [EMNLP Findings 2024 & ACL 2024 NLRSE Oral] Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards☆44Updated 6 months ago
- ☆37Updated 7 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆52Updated last week
- LoFiT: Localized Fine-tuning on LLM Representations☆21Updated 4 months ago
- Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)☆52Updated last month
- ☆44Updated 2 months ago
- Long Context Extension and Generalization in LLMs☆39Updated last month
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆113Updated 2 weeks ago
- Repo for ACL2023 Findings paper "Emergent Modularity in Pre-trained Transformers"☆19Updated last year
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆30Updated 2 months ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆83Updated 5 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning"☆91Updated 4 months ago
- Röttger et al. (2023): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆61Updated 10 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆67Updated 5 months ago