snumprlab / isr-dpo
Official Implementation of ISR-DPO:Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO (AAAI'25)
☆18Updated last month
Alternatives and similar repositories for isr-dpo:
Users that are interested in isr-dpo are comparing it to the libraries listed below
- Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding☆45Updated last year
- [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆41Updated 2 months ago
- [ECCV 2024] EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrieval☆35Updated 6 months ago
- [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"☆37Updated 3 months ago
- Language Repository for Long Video Understanding☆31Updated 9 months ago
- ☆24Updated 3 months ago
- ☆12Updated 3 months ago
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆63Updated 6 months ago
- VisualGPTScore for visio-linguistic reasoning☆27Updated last year
- Code and data for the paper "Emergent Visual-Semantic Hierarchies in Image-Text Representations" (ECCV 2024)☆26Updated 7 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆57Updated 9 months ago
- Can 3D Vision-Language Models Truly Understand Natural Language?☆21Updated 11 months ago
- Repository for the paper: Teaching VLMs to Localize Specific Objects from In-context Examples☆22Updated 3 months ago
- [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences☆36Updated 2 weeks ago
- Awesome Vision-Language Compositionality, a comprehensive curation of research papers in literature.☆19Updated last month
- [ECCV 2024] OpenPSG: Open-set Panoptic Scene Graph Generation via Large Multimodal Models☆42Updated 2 months ago
- Official Implementation (Pytorch) of the "VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Capti…☆17Updated last month
- Code and data setup for the paper "Are Diffusion Models Vision-and-language Reasoners?"☆31Updated last year
- Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision☆35Updated 5 months ago
- ☆11Updated 8 months ago
- Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"☆25Updated 6 months ago
- Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".☆42Updated last year
- Code implementation of paper "MUSE: Mamba is Efficient Multi-scale Learner for Text-video Retrieval (AAAI2025)"☆18Updated last month
- Large Language Models are Temporal and Causal Reasoners for Video Question Answering (EMNLP 2023)☆75Updated 7 months ago
- IMProv: Inpainting-based Multimodal Prompting for Computer Vision Tasks☆58Updated 5 months ago
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆27Updated 10 months ago
- PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"☆33Updated last year
- ☆25Updated last year
- Egocentric Video Understanding Dataset (EVUD)☆27Updated 8 months ago
- [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'☆20Updated 2 months ago