ExplainableML / fomo_in_fluxLinks
Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
☆58Updated 9 months ago
Alternatives and similar repositories for fomo_in_flux
Users that are interested in fomo_in_flux are comparing it to the libraries listed below
Sorting:
- [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models☆78Updated 4 months ago
- [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization☆35Updated last year
- [NeurIPS 2024] RaVL: Discovering and Mitigating Spurious Correlations in Fine-Tuned Vision-Language Models☆27Updated 10 months ago
- Test-Time Distribution Normalization For Contrastively Learned Vision-language Models☆27Updated last year
- ☆53Updated 8 months ago
- [WACV 2025] Official implementation of "Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation" by Xiwen Wei, Guihong L…☆51Updated last month
- ☆38Updated last year
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆33Updated 2 years ago
- Code for T-MARS data filtering☆35Updated 2 years ago
- [NeurIPS 2023] Official repository for "Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models"☆12Updated last year
- If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions☆17Updated last year
- Official repo of Progressive Data Expansion: data, code and evaluation☆29Updated last year
- [NeurIPS'24] Official PyTorch implementation for paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"☆25Updated 7 months ago
- ☆35Updated last year
- Model Merging with SVD to Tie the KnOTS [ICLR 2025]☆68Updated 6 months ago
- Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)☆43Updated last year
- Official code for the paper "Does CLIP's Generalization Performance Mainly Stem from High Train-Test Similarity?" (ICLR 2024)☆10Updated last year
- Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…☆21Updated last year
- Data-Efficient Multimodal Fusion on a Single GPU☆67Updated last year
- Official implementation for Sparse MetA-Tuning (SMAT)☆18Updated 2 months ago
- [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.☆27Updated last year
- This repository houses the code for the paper - "The Neglected of VLMs"☆29Updated 5 months ago
- Distributed Optimization Infra for learning CLIP models☆27Updated last year
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Updated 2 years ago
- Pytorch Implementation for "Preserving Linear Separability in Continual Learning by Backward Feature Projection" (CVPR 2023)☆18Updated 2 years ago
- Code release for "Understanding Bias in Large-Scale Visual Datasets"☆21Updated 10 months ago
- Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models☆37Updated 5 months ago
- Holistic evaluation of multimodal foundation models☆48Updated last year
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆56Updated last year
- https://arxiv.org/abs/2209.15162☆52Updated 2 years ago