PKU-YuanGroup / LanguageBind
【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
☆805Updated last year
Alternatives and similar repositories for LanguageBind
Users that are interested in LanguageBind are comparing it to the libraries listed below
Sorting:
- [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding☆619Updated 3 months ago
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆641Updated 6 months ago
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)☆806Updated 9 months ago
- [CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding☆367Updated last week
- ☆779Updated 10 months ago
- ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆547Updated last week
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆580Updated 7 months ago
- Recent LLM-based CV and related works. Welcome to comment/contribute!☆862Updated 2 months ago
- [ECCV2024] Video Foundation Models & Data for Multimodal Understanding☆1,855Updated 3 weeks ago
- Emu Series: Generative Multimodal Models from BAAI☆1,720Updated 7 months ago
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆877Updated 5 months ago
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆1,159Updated 3 months ago
- A Framework of Small-scale Large Multimodal Models☆817Updated 2 weeks ago
- A family of lightweight multimodal models.☆1,016Updated 5 months ago
- Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding☆615Updated 5 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆740Updated last year
- VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling☆405Updated this week
- Official repository for the paper PLLaVA☆649Updated 9 months ago
- VisionLLM Series☆1,059Updated 2 months ago
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,396Updated 2 weeks ago
- [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model☆328Updated 6 months ago
- [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".☆273Updated 11 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆376Updated 3 weeks ago
- Aligning LMMs with Factually Augmented RLHF☆361Updated last year
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆607Updated last year
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆512Updated last month
- ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models☆635Updated 4 months ago
- [CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding☆937Updated 7 months ago
- [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …☆484Updated 9 months ago
- [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"☆807Updated 9 months ago