friedrichor / UNITELinks
official code for "Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrieval"
☆36Updated 3 months ago
Alternatives and similar repositories for UNITE
Users that are interested in UNITE are comparing it to the libraries listed below
Sorting:
- Research Code for Multimodal-Cognition Team in Ant Group☆169Updated 2 weeks ago
- ☆37Updated last year
- [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆94Updated 2 months ago
- Official repository of MMDU dataset☆96Updated last year
- WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning☆35Updated 4 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆179Updated last year
- [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge☆152Updated last month
- ☆87Updated last year
- Lion: Kindling Vision Intelligence within Large Language Models☆51Updated last year
- A lightweight flexible Video-MLLM developed by TencentQQ Multimedia Research Team.☆74Updated last year
- LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning☆70Updated 5 months ago
- ☆91Updated last year
- Official repository of "CoMP: Continual Multimodal Pre-training for Vision Foundation Models"☆32Updated 6 months ago
- [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale☆118Updated last year
- The Next Step Forward in Multimodal LLM Alignment☆184Updated 6 months ago
- Official implementation of paper AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding☆86Updated 6 months ago
- A Simple Framework of Small-scale LMMs for Video Understanding☆95Updated 4 months ago
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆100Updated 5 months ago
- LinVT: Empower Your Image-level Large Language Model to Understand Videos☆82Updated 10 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆57Updated last year
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆63Updated last year
- Narrative movie understanding benchmark☆76Updated 4 months ago
- ☆66Updated last year
- Precision Search through Multi-Style Inputs☆72Updated 3 months ago
- Video dataset dedicated to portrait-mode video recognition.☆52Updated 2 weeks ago
- ☆133Updated last year
- LMM solved catastrophic forgetting, AAAI2025☆44Updated 6 months ago
- ☆80Updated 11 months ago
- A collection of visual instruction tuning datasets.☆76Updated last year
- A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability☆100Updated 11 months ago