sunxm2357 / DIME-FM
Implementation of "DIME-FM: DIstilling Multimodal and Efficient Foundation Models"
☆12Updated last year
Related projects ⓘ
Alternatives and complementary repositories for DIME-FM
- Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)☆37Updated 11 months ago
- [CVPR2024 Highlight] Official implementation for Transferable Visual Prompting. The paper "Exploring the Transferability of Visual Prompt…☆32Updated 5 months ago
- ☆26Updated 9 months ago
- Task Residual for Tuning Vision-Language Models (CVPR 2023)☆66Updated last year
- NegCLIP.☆27Updated last year
- Repository for the paper: Teaching Structured Vision & Language Concepts to Vision & Language Models☆45Updated last year
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆41Updated 4 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆49Updated 5 months ago
- [NeurIPS 2023] Align Your Prompts: Test-Time Prompting with Distribution Alignment for Zero-Shot Generalization☆97Updated 9 months ago
- This repository houses the code for the paper - "The Neglected of VLMs"☆23Updated 3 months ago
- Instruction Tuning in Continual Learning paradigm☆26Updated 4 months ago
- ☆22Updated last year
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆22Updated 6 months ago
- VQACL: A Novel Visual Question Answering Continual Learning Setting (CVPR'23)☆31Updated 7 months ago
- [AAAI2023] Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task (Oral)☆38Updated 8 months ago
- Official implementation of "Towards Distribution-Agnostic Generalized Category Discovery" (NIPS 2023)☆24Updated last year
- The official implementation of paper "Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval" accepted by NeurIPS…☆21Updated 6 months ago
- Towards a Unified View on Visual Parameter-Efficient Transfer Learning☆27Updated 2 years ago
- ☆55Updated last year
- [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.☆64Updated last year
- [CVPR2022] PyTorch re-implementation of Prompt Distribution Learning☆15Updated last year
- 📍 Official pytorch implementation of paper "ProtoCLIP: Prototypical Contrastive Language Image Pretraining" (IEEE TNNLS)☆48Updated last year
- [CVPR' 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding☆43Updated 3 months ago
- (CVPR2024) MeaCap: Memory-Augmented Zero-shot Image Captioning☆37Updated 3 months ago
- [CVPR 2024] Retrieval-Augmented Image Captioning with External Visual-Name Memory for Open-World Comprehension☆34Updated 7 months ago
- ☆34Updated last year
- ☆21Updated last year
- Compress conventional Vision-Language Pre-training data☆49Updated last year
- [ICCV2023] - CTP: Towards Vision-Language Continual Pretraining via Compatible Momentum Contrast and Topology Preservation☆29Updated last month