friedrichor / UNITELinks
official code for "Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrieval"
β42Updated 6 months ago
Alternatives and similar repositories for UNITE
Users that are interested in UNITE are comparing it to the libraries listed below
Sorting:
- A lightweight flexible Video-MLLM developed by TencentQQ Multimedia Research Team.β74Updated last year
- π R2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding (ECCV 2024)β89Updated last year
- β37Updated last year
- LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learningβ75Updated 8 months ago
- β80Updated last year
- Lion: Kindling Vision Intelligence within Large Language Modelsβ51Updated 2 years ago
- β88Updated last year
- γNeurIPS 2024γDense Connector for MLLMsβ180Updated last year
- A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilityβ105Updated last year
- Research Code for Multimodal-Cognition Team in Ant Groupβ172Updated 3 months ago
- Official implementation of paper AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understandingβ88Updated 9 months ago
- β133Updated 2 years ago
- The official implementation of RARβ92Updated last month
- FreeVA: Offline MLLM as Training-Free Video Assistantβ68Updated last year
- Official repository of MMDU datasetβ102Updated last year
- β160Updated last year
- [ACM MM 2025] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"β100Updated last month
- LinVT: Empower Your Image-level Large Language Model to Understand Videosβ83Updated last year
- A collection of visual instruction tuning datasets.β76Updated last year
- Evaluation code and datasets for the ACL 2024 paper, VISTA: Visualized Text Embedding for Universal Multi-Modal Retrieval. The original cβ¦β46Updated last year
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignmentβ58Updated last year
- [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledgeβ153Updated 4 months ago
- FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding. (WACV2025)β34Updated 9 months ago
- [ICLR 2025] TRACE: Temporal Grounding Video LLM via Casual Event Modelingβ142Updated 5 months ago
- β124Updated last year
- [ICCV 2025] LVBench: An Extreme Long Video Understanding Benchmarkβ135Updated 6 months ago
- [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Trainingβ227Updated 10 months ago
- Narrative movie understanding benchmarkβ77Updated 7 months ago
- [CVPR 2025] LamRA: Large Multimodal Model as Your Advanced Retrieval Assistantβ172Updated 6 months ago
- The Next Step Forward in Multimodal LLM Alignmentβ196Updated 8 months ago