ExplainableML / fomo_in_flux
Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
☆51Updated 2 months ago
Alternatives and similar repositories for fomo_in_flux:
Users that are interested in fomo_in_flux are comparing it to the libraries listed below
- Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models☆73Updated 5 months ago
- Pytorch Implementation for "Preserving Linear Separability in Continual Learning by Backward Feature Projection" (CVPR 2023)☆18Updated last year
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆32Updated last year
- ☆41Updated last month
- [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization☆29Updated 4 months ago
- Compress conventional Vision-Language Pre-training data☆49Updated last year
- ☆22Updated 4 months ago
- ☆37Updated 3 months ago
- This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).☆27Updated 11 months ago
- ☆38Updated 3 months ago
- [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models☆45Updated 2 months ago
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Updated last year
- More dimensions = More fun☆21Updated 6 months ago
- [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…☆49Updated 4 months ago
- Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)☆33Updated last year
- Code release for paper Extremely Simple Activation Shaping for Out-of-Distribution Detection☆50Updated 5 months ago
- [NeurIPS 2023] Official repository for "Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models"☆12Updated 8 months ago
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆51Updated 5 months ago
- Code release for "Understanding Bias in Large-Scale Visual Datasets"☆18Updated 2 months ago
- ☆10Updated 2 years ago
- [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"☆14Updated 4 months ago
- HGRN2: Gated Linear RNNs with State Expansion☆52Updated 6 months ago
- Model Merging with SVD to Tie the KnOTS [ICLR 2025]☆42Updated 3 weeks ago
- Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)☆38Updated last year
- We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…☆12Updated 2 months ago
- [ICCV 2023] Black Box Few-Shot Adaptation for Vision-Language models☆19Updated 9 months ago
- Codebase for adaptive continual memory☆13Updated last year
- SparCL: Sparse Continual Learning on the Edge @ NeurIPS 22☆29Updated last year
- An Enhanced CLIP Framework for Learning with Synthetic Captions☆26Updated 2 months ago
- Holistic evaluation of multimodal foundation models☆42Updated 6 months ago