aimagelab / DiCO
Revisiting Image Captioning Training Paradigm via Direct CLIP-based Optimization (BMVC 2024 Oral ✨)
☆16Updated 5 months ago
Alternatives and similar repositories for DiCO:
Users that are interested in DiCO are comparing it to the libraries listed below
- Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluation. CVPR 2023☆60Updated 4 months ago
- [CVPR 2025] RAP: Retrieval-Augmented Personalization☆15Updated this week
- ☆38Updated 3 months ago
- [CVPR 2024] The official implementation of paper "synthesize, diagnose, and optimize: towards fine-grained vision-language understanding"☆37Updated last week
- Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"☆35Updated 6 months ago
- ☆14Updated 4 months ago
- [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences☆35Updated last month
- A Large Multimodal Model for Pixel-Level Visual Grounding in Videos☆41Updated 2 months ago
- Code and data setup for the paper "Are Diffusion Models Vision-and-language Reasoners?"☆31Updated 11 months ago
- 🤖 [ICLR'25] Multimodal Video Understanding Framework (MVU)☆27Updated last month
- Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision☆31Updated 4 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆56Updated 8 months ago
- [NeurIPS'24] I2EBench: A Comprehensive Benchmark for Instruction-based Image Editing☆18Updated 3 months ago
- ☆70Updated 2 months ago
- Official PyTorch code of GroundVQA (CVPR'24)☆56Updated 5 months ago
- Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment☆41Updated 2 months ago
- Official repository of "Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tuning"☆27Updated last week
- Code release for "SegLLM: Multi-round Reasoning Segmentation"☆69Updated last week
- COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!☆24Updated 3 months ago
- ☆16Updated last year
- Official implementation of CVPR 2024 paper "Retrieval-Augmented Open-Vocabulary Object Detection".☆33Updated 5 months ago
- [CVPR 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding☆45Updated 7 months ago
- Visual self-questioning for large vision-language assistant.☆40Updated 5 months ago
- Meta-Prompting for Automating Zero-shot Visual Recognition with LLMs (ECCV 2024)☆19Updated 7 months ago
- This is the official implementation of RGNet: A Unified Retrieval and Grounding Network for Long Videos☆13Updated this week
- This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.☆18Updated 8 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆44Updated 2 months ago
- Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"☆24Updated 4 months ago
- [CVPR 2024] Context-Guided Spatio-Temporal Video Grounding☆49Updated 8 months ago
- 🔥 [CVPR 2024] Official implementation of "See, Say, and Segment: Teaching LMMs to Overcome False Premises (SESAME)"☆32Updated 8 months ago