jadohu / LANTERNLinks
Official Implementation of LANTERN (ICLR'25) and LANTERN++(ICLRW-SCOPE'25)
☆16Updated 6 months ago
Alternatives and similar repositories for LANTERN
Users that are interested in LANTERN are comparing it to the libraries listed below
Sorting:
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆110Updated 2 months ago
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆13Updated last year
- Official PyTorch implementation of DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (ICML 2025 Oral)☆37Updated 2 months ago
- Awesome-Low-Rank-Adaptation☆115Updated 10 months ago
- Official code implementation of "GEX: A flexible method for approximating influence via Geometric Ensemble" (NeurIPS 2023)☆13Updated last year
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆104Updated 2 years ago
- Implementations for "Trimming the ℓ₁ Regularizer: Statistical Analysis, Optimization, and Applications to Deep Learning" Published on ICM…☆34Updated 4 years ago
- Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.☆117Updated 3 weeks ago
- ☆11Updated 10 months ago
- ☆14Updated last year
- ☆58Updated 8 months ago
- ☆51Updated last year
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆66Updated 10 months ago
- meta learning from the initializaion induced by word embedding☆22Updated 4 years ago
- LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters☆35Updated last month
- [TKDE'25] The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".☆412Updated last month
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆49Updated 10 months ago
- ☆28Updated 6 months ago
- An implementation of the DISP-LLM method from the NeurIPS 2024 paper: Dimension-Independent Structural Pruning for Large Language Models.☆22Updated last month
- ☆36Updated 2 years ago
- Welcome to the 'In Context Learning Theory' Reading Group☆30Updated 9 months ago
- [NeurIPS 2024] BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models☆28Updated 3 weeks ago
- A curated reading list of research in Mixture-of-Experts(MoE).☆641Updated 10 months ago
- This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).☆46Updated 2 years ago
- Code for "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts" published at ICLR 2023☆29Updated 2 years ago
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.☆518Updated this week
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆29Updated 7 months ago
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆906Updated this week
- ☆43Updated 10 months ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆19Updated 3 years ago