microsoft / mttl
Building modular LMs with parameter-efficient fine-tuning.
☆80Updated this week
Related projects ⓘ
Alternatives and complementary repositories for mttl
- ☆79Updated last year
- contrastive decoding☆178Updated last year
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆95Updated 2 months ago
- ☆51Updated last year
- [EMNLP Findings 2024 & ACL 2024 NLRSE Oral] Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards☆44Updated 6 months ago
- [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"☆105Updated last year
- AI Logging for Interpretability and Explainability🔬☆87Updated 5 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆116Updated 3 weeks ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆69Updated 8 months ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆85Updated 3 years ago
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆41Updated last year
- Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment☆64Updated last year
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆63Updated last year
- ☆58Updated last year
- ☆149Updated 9 months ago
- ☆61Updated 2 years ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆85Updated last year
- Language models scale reliably with over-training and on downstream tasks☆94Updated 7 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆111Updated last week
- [ICML 2023] Code for our paper “Compositional Exemplars for In-context Learning”.☆92Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆96Updated 7 months ago
- ☆46Updated 10 months ago
- Self-Alignment with Principle-Following Reward Models☆148Updated 8 months ago
- ☆107Updated 3 months ago
- ☆37Updated 6 months ago
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆55Updated last year
- One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning☆38Updated last year
- Directional Preference Alignment☆49Updated last month
- ☆27Updated last year
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆59Updated 9 months ago