deepglint / UniME
The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"
☆27Updated this week
Alternatives and similar repositories for UniME:
Users that are interested in UniME are comparing it to the libraries listed below
- The official repository for the RealSyn dataset☆21Updated 2 months ago
- ☆73Updated 5 months ago
- MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models☆33Updated 2 weeks ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆57Updated 7 months ago
- ☆80Updated last month
- This is the official repo for ByteVideoLLM/Dynamic-VLM☆20Updated 4 months ago
- Official repository of "CoMP: Continual Multimodal Pre-training for Vision Foundation Models"☆24Updated 3 weeks ago
- Unifying Visual Understanding and Generation with Dual Visual Vocabularies 🌈☆42Updated last week
- A collection of visual instruction tuning datasets.☆76Updated last year
- Official implement of MIA-DPO☆55Updated 3 months ago
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆49Updated 5 months ago
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆53Updated 9 months ago
- [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models☆57Updated 4 months ago
- Official repository of MMDU dataset☆89Updated 6 months ago
- Croc: Pretraining Large Multimodal Models with Cross-Modal Comprehension☆22Updated 6 months ago
- The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …☆52Updated 5 months ago
- ☆36Updated 9 months ago
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆28Updated 3 weeks ago
- [CVPR 2025 Highlight] Official Pytorch codebase for paper: "Assessing and Learning Alignment of Unimodal Vision and Language Models"☆33Updated last week
- ☆42Updated 3 months ago
- CLIP-MoE: Mixture of Experts for CLIP☆31Updated 6 months ago
- [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning☆49Updated 11 months ago
- R1-Vision: Let's first take a look at the image☆46Updated 2 months ago
- ☆51Updated this week
- LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning☆48Updated last month
- [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501☆56Updated 9 months ago
- Official implementation of paper ReTaKe: Reducing Temporal and Knowledge Redundancy for Long Video Understanding☆32Updated last month
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆44Updated 4 months ago
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆114Updated 5 months ago
- Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning☆21Updated 7 months ago