nathanhu0 / CaMeLS
Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
☆23Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for CaMeLS
- [EMNLP-2022 Findings] Code for paper “ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback”.☆24Updated last year
- Data Valuation on In-Context Examples (ACL23)☆23Updated 3 weeks ago
- DEMix Layers for Modular Language Modeling☆53Updated 3 years ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆69Updated last year
- ☆40Updated 2 years ago
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆73Updated last year
- Influence Experiments☆36Updated last year
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆18Updated 2 months ago
- ☆37Updated 6 months ago
- ☆44Updated 2 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs?☆23Updated 5 months ago
- Adding new tasks to T0 without catastrophic forgetting☆30Updated 2 years ago
- ☆22Updated 2 years ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆84Updated 3 years ago
- ☆51Updated last year
- [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning☆97Updated last year
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆56Updated last year
- Analyzing LLM Alignment via Token distribution shift☆13Updated 9 months ago
- ☆34Updated 3 months ago
- Long Context Extension and Generalization in LLMs☆39Updated last month
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆45Updated 4 months ago
- Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).☆24Updated 2 months ago
- PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)☆71Updated 2 years ago
- Few-shot Learning with Auxiliary Data☆26Updated 11 months ago
- ☆18Updated last year
- [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.☆46Updated 2 years ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆18Updated 2 months ago
- [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning☆21Updated last year
- ☆78Updated last year
- Code for preprint: Summarizing Differences between Text Distributions with Natural Language☆42Updated last year