pixeli99 / MixLN
[ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxiang Li, Lu Yin, Shiwei Liu
☆19Updated 3 months ago
Alternatives and similar repositories for MixLN:
Users that are interested in MixLN are comparing it to the libraries listed below
- ☆41Updated 5 months ago
- ☆17Updated 3 months ago
- The official repo of continuous speculative decoding☆24Updated 3 weeks ago
- ☆39Updated last month
- Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆15Updated last month
- Code for "A Sober Look at Progress in Language Model Reasoning" paper☆33Updated this week
- Official implementation of ECCV24 paper: POA☆24Updated 8 months ago
- ☆17Updated 3 months ago
- PyTorch implementation of StableMask (ICML'24)☆12Updated 9 months ago
- This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.☆18Updated 9 months ago
- Official code for the paper "Attention as a Hypernetwork"☆27Updated 9 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆26Updated 7 months ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆26Updated last year
- [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models☆41Updated last month
- Code for T-MARS data filtering☆35Updated last year
- ☆31Updated 3 months ago
- ☆35Updated last month
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆30Updated 10 months ago
- ☆20Updated last month
- ☆18Updated 9 months ago
- ☆16Updated 8 months ago
- Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"☆27Updated last year
- [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs☆23Updated 6 months ago
- Official PyTorch Implementation for Task Vectors are Cross-Modal☆22Updated 4 months ago
- Lottery Ticket Adaptation☆39Updated 4 months ago
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆42Updated last month
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆40Updated last year
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆25Updated 5 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆82Updated 6 months ago
- The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]☆15Updated last month