yifanzhang-pro / M-MAELinks
Official implementation of Matrix Variational Masked Autoencoder (M-MAE) for ICML paper "Information Flow in Self-Supervised Learning" (https://arxiv.org/abs/2309.17281)
☆14Updated 9 months ago
Alternatives and similar repositories for M-MAE
Users that are interested in M-MAE are comparing it to the libraries listed below
Sorting:
- ☆26Updated 3 years ago
- Code for the paper Self-Supervised Learning of Split Invariant Equivariant Representations☆28Updated last year
- The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …☆16Updated 2 weeks ago
- Official implementation for Sparse MetA-Tuning (SMAT)☆16Updated last week
- ☆11Updated 7 months ago
- Unofficial implementation of paper : Exploring the Space of Key-Value-Query Models with Intention☆11Updated 2 years ago
- Curse-of-memory phenomenon of RNNs in sequence modelling☆19Updated last month
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆31Updated 2 years ago
- Experiments for "A Closer Look at In-Context Learning under Distribution Shifts"☆19Updated 2 years ago
- Code for T-MARS data filtering☆35Updated last year
- Official code for the paper "Attention as a Hypernetwork"☆39Updated last year
- Stochastic Optimization for Global Contrastive Learning without Large Mini-batches☆20Updated 2 years ago
- [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…☆25Updated 3 years ago
- Official implementation of ICML 2024 paper "Matrix Information Theory for Self-supervised Learning" (https://arxiv.org/abs/2305.17326)☆28Updated 9 months ago
- ☆14Updated 3 years ago
- Official implementation of "Continual Learning by Modeling Intra-Class Variation" (MOCA). [TMLR 2023]☆16Updated 2 years ago
- [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…☆11Updated last year
- ☆21Updated 2 years ago
- Test-Time Distribution Normalization For Contrastively Learned Vision-language Models☆28Updated last year
- [NeurIPS'24] Official PyTorch implementation for paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"☆20Updated 4 months ago
- Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…☆21Updated last year
- HGRN2: Gated Linear RNNs with State Expansion☆55Updated 10 months ago
- CatMAE☆14Updated last year
- Xmixers: A collection of SOTA efficient token/channel mixers☆11Updated 7 months ago
- [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization☆32Updated 8 months ago
- Official code for `Visual Attention Emerges from Recurrent Sparse Reconstruction' (ICML 2022)☆36Updated 2 years ago
- [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…☆24Updated 2 years ago
- Repository containing code for blockwise SSL training☆29Updated 8 months ago
- A Benchmark for Efficient and Compositional Visual Reasoning☆25Updated last year
- ☆37Updated 10 months ago