gstoica27 / KnOTSLinks
Model Merging with SVD to Tie the KnOTS [ICLR 2025]
☆62Updated 4 months ago
Alternatives and similar repositories for KnOTS
Users that are interested in KnOTS are comparing it to the libraries listed below
Sorting:
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆55Updated 11 months ago
- [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆146Updated last month
- [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models☆77Updated 2 months ago
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆30Updated 9 months ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆57Updated 8 months ago
- [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections☆21Updated 9 months ago
- Data distillation benchmark☆67Updated last month
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆127Updated 4 months ago
- [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models☆48Updated 3 months ago
- ☆34Updated 4 months ago
- ☆182Updated 10 months ago
- ☆41Updated 2 weeks ago
- Matryoshka Multimodal Models☆112Updated 6 months ago
- [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …☆60Updated 10 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆107Updated last month
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆62Updated 5 months ago
- Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"☆124Updated last year
- Official implementation of MAIA, A Multimodal Automated Interpretability Agent☆83Updated last month
- This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).☆31Updated last year
- Code accompanying the paper "Massive Activations in Large Language Models"☆174Updated last year
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆121Updated last month
- [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…☆76Updated 8 months ago
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆30Updated 3 months ago
- AnchorAttention: Improved attention for LLMs long-context training☆212Updated 6 months ago
- ☆30Updated last year
- A curated list of Model Merging methods.☆92Updated 10 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆38Updated 10 months ago
- Remasking Discrete Diffusion Models with Inference-Time Scaling☆36Updated 5 months ago
- Distributed Optimization Infra for learning CLIP models☆27Updated 10 months ago
- PyTorch implementation of StableMask (ICML'24)☆13Updated last year