jadohu / LANTERNLinks
Official Implementation of LANTERN (ICLR'25) and LANTERN++(ICLRW-SCOPE'25)
☆17Updated 7 months ago
Alternatives and similar repositories for LANTERN
Users that are interested in LANTERN are comparing it to the libraries listed below
Sorting:
- Awesome-Low-Rank-Adaptation☆116Updated last year
- ☆59Updated 10 months ago
- Implementations for "Trimming the ℓ₁ Regularizer: Statistical Analysis, Optimization, and Applications to Deep Learning" Published on ICM…☆34Updated 4 years ago
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆111Updated 3 months ago
- Official code implementation of "GEX: A flexible method for approximating influence via Geometric Ensemble" (NeurIPS 2023)☆14Updated last year
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆13Updated last year
- meta learning from the initializaion induced by word embedding☆22Updated 4 years ago
- ☆14Updated last year
- A curated reading list of research in Mixture-of-Experts(MoE).☆648Updated 11 months ago
- Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.☆125Updated 2 months ago
- An implementation of the DISP-LLM method from the NeurIPS 2024 paper: Dimension-Independent Structural Pruning for Large Language Models.☆22Updated 2 months ago
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆979Updated last month
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆105Updated 2 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆66Updated last year
- ☆51Updated last year
- Awesome list for LLM pruning.☆267Updated last week
- Official PyTorch implementation of DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (ICML 2025 Oral)☆43Updated 3 months ago
- Code for "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts" published at ICLR 2023☆29Updated 2 years ago
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.☆563Updated this week
- Code for coreset selection methods☆243Updated 2 years ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆92Updated 11 months ago
- ☆36Updated 2 years ago
- Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer☆20Updated 8 months ago
- Official implementation of the ICLR paper "Streamlining Redundant Layers to Compress Large Language Models"☆30Updated 5 months ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆376Updated this week
- ☆11Updated last week
- [TKDE'25] The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".☆435Updated 2 months ago
- ☆76Updated 3 years ago
- ☆28Updated 7 months ago
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆51Updated 11 months ago