amazon-science / adaptive-feature-transferLinks
Official implementation of Adaptive Feature Transfer (AFT)
☆23Updated last year
Alternatives and similar repositories for adaptive-feature-transfer
Users that are interested in adaptive-feature-transfer are comparing it to the libraries listed below
Sorting:
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆57Updated 8 months ago
- HGRN2: Gated Linear RNNs with State Expansion☆54Updated last year
- Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]☆67Updated 11 months ago
- Unofficial Implementation of Selective Attention Transformer☆17Updated 10 months ago
- Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)☆22Updated last year
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆15Updated 5 months ago
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆30Updated 9 months ago
- Implementation of Agent Attention in Pytorch☆91Updated last year
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Updated 2 years ago
- Official code for the paper "Attention as a Hypernetwork"☆40Updated last year
- Latest Weight Averaging (NeurIPS HITY 2022)☆31Updated 2 years ago
- Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning☆45Updated last year
- [NeurIPS 2023] Official repository for "Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models"☆12Updated last year
- Official implementation of the paper "You Do Not Fully Utilize Transformer's Representation Capacity"☆30Updated 3 months ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆33Updated last year
- Do Vision and Language Models Share Concepts? A Vector Space Alignment Study☆16Updated 9 months ago
- User-friendly implementation of the Mixture-of-Sparse-Attention (MoSA). MoSA selects distinct tokens for each head with expert choice rou…☆26Updated 3 months ago
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆37Updated 6 months ago
- Recycling diverse models☆45Updated 2 years ago
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆30Updated 3 months ago
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆53Updated last year
- ☆34Updated 5 months ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆124Updated 2 weeks ago
- The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …☆16Updated 2 months ago
- State Space Models☆70Updated last year
- ☆18Updated 7 months ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆33Updated 10 months ago
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆56Updated last year
- ☆31Updated 6 months ago
- ☆43Updated 9 months ago