wang-kee / LiNeSLinks
Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
☆29Updated 7 months ago
Alternatives and similar repositories for LiNeS
Users that are interested in LiNeS are comparing it to the libraries listed below
Sorting:
- ☆17Updated 5 months ago
- ☆32Updated 5 months ago
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆27Updated 4 months ago
- One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation☆40Updated 8 months ago
- ☆20Updated 11 months ago
- Code for "Merging Text Transformers from Different Initializations"☆20Updated 4 months ago
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆38Updated 3 weeks ago
- Model Merging with SVD to Tie the KnOTS [ICLR 2025]☆57Updated 2 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆32Updated 3 months ago
- Codebase for Instruction Following without Instruction Tuning☆34Updated 9 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 9 months ago
- ☆19Updated 4 months ago
- Code for T-MARS data filtering☆35Updated last year
- ☆26Updated 4 months ago
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"☆38Updated last year
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆38Updated 8 months ago
- ☆79Updated 10 months ago
- ☆15Updated 2 months ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆24Updated 6 months ago
- PyTorch implementation of StableMask (ICML'24)☆13Updated 11 months ago
- The repository contains code for Adaptive Data Optimization☆25Updated 6 months ago
- ☆18Updated 4 months ago
- Lottery Ticket Adaptation☆39Updated 7 months ago
- Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"☆15Updated 2 months ago
- Unofficial Implementation of Selective Attention Transformer☆17Updated 7 months ago
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆33Updated 3 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆52Updated 3 months ago
- This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.☆27Updated last year
- Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."☆42Updated 8 months ago