baekrok / DASH-Direction-Aware-SHrinkingLinks
☆10Updated 5 months ago
Alternatives and similar repositories for DASH-Direction-Aware-SHrinking
Users that are interested in DASH-Direction-Aware-SHrinking are comparing it to the libraries listed below
Sorting:
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆36Updated last year
- Position Coupling: Improving Length Generalization of Arithmetic Transformers Using Task Structure (NeurIPS 2024) + Arithmetic Transfor…☆11Updated last month
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆14Updated 10 months ago
- ☆67Updated 6 months ago
- ☆13Updated 2 months ago
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆16Updated 6 months ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- Continual learning of task-specific approximations of the parameter posterior distribution via a shared hypernetwork.☆16Updated 7 months ago
- ☆19Updated last year
- ☆24Updated 2 months ago
- ☆32Updated last year
- ☆34Updated last year
- Bayesian Low-Rank Adaptation for Large Language Models☆34Updated 11 months ago
- Code repo for the NeurIPS 2021 paper "Online Adaption to Label Distribution Shift".☆15Updated 2 years ago
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆48Updated last year
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- ☆11Updated last year
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆12Updated 2 years ago
- Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.☆10Updated last year
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆102Updated last year
- Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation☆22Updated 3 months ago
- ☆11Updated 2 years ago
- Benchmark for Natural Temporal Distribution Shift (NeurIPS 2022)☆66Updated 2 years ago
- Pytorch code for experiments on Linear Transformers☆21Updated last year
- Source code for "Latent Plan Transformer for Trajectory Abstraction: Planning as Latent Space Inference." In NeurIPS 2024☆16Updated 6 months ago
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆68Updated 4 months ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.☆27Updated last year
- Official PyTorch Implementation for Continual Learning and Private Unlearning☆15Updated 2 years ago
- Official Code of Learning to Unlearn: Instance-Wise Unlearning for Pre-trained Classifiers (AAAI 2024)☆17Updated 7 months ago