friedrichor / UNITELinks
official code for "Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrieval"
☆18Updated last week
Alternatives and similar repositories for UNITE
Users that are interested in UNITE are comparing it to the libraries listed below
Sorting:
- ☆75Updated 7 months ago
- Official implementation of paper ReTaKe: Reducing Temporal and Knowledge Redundancy for Long Video Understanding☆34Updated 3 months ago
- Official repository of "CoMP: Continual Multimodal Pre-training for Vision Foundation Models"☆27Updated 2 months ago
- A lightweight flexible Video-MLLM developed by TencentQQ Multimedia Research Team.☆71Updated 8 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆56Updated 9 months ago
- [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection☆87Updated 3 weeks ago
- Repo for paper "T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs"☆49Updated 3 months ago
- A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability☆94Updated 6 months ago
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆46Updated last year
- The official repository for ACL2025 paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".☆46Updated last month
- [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding☆73Updated 2 months ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆47Updated 3 months ago
- [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning☆69Updated 4 months ago
- ☆91Updated last year
- MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models☆40Updated 2 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆60Updated last year
- ☆14Updated last month
- Official implement of MIA-DPO☆58Updated 5 months ago
- The official implementation of RAR☆88Updated last year
- ☆80Updated 7 months ago
- Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025☆55Updated 3 months ago
- [ICLR 2025] IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model☆31Updated 7 months ago
- [CVPR 2025] LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understanding☆46Updated 3 weeks ago
- A collection of visual instruction tuning datasets.☆76Updated last year
- Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency☆42Updated 3 weeks ago
- ☆37Updated 11 months ago
- TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning☆77Updated last month
- Turning to Video for Transcript Sorting☆48Updated last year
- A Large-scale Dataset for training and evaluating model's ability on Dense Text Image Generation☆70Updated 4 months ago
- Offical PyTorch implementation of Clover: Towards A Unified Video-Language Alignment and Fusion Model (CVPR2023)☆40Updated 2 years ago