NVlabs / LITA
☆162Updated 4 months ago
Alternatives and similar repositories for LITA:
Users that are interested in LITA are comparing it to the libraries listed below
- PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models☆252Updated last year
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆314Updated 7 months ago
- Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"☆94Updated this week
- EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties☆119Updated 3 months ago
- [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs☆135Updated 6 months ago
- Supercharged BLIP-2 that can handle videos☆117Updated last year
- [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds☆90Updated 7 months ago
- Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models☆192Updated last month
- Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding☆259Updated 6 months ago
- VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling☆323Updated this week
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant☆230Updated 6 months ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆143Updated 8 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆105Updated last week
- ☆132Updated 5 months ago
- [CVPR 24] The repository provides code for running inference and training for "Segment and Caption Anything" (SCA) , links for downloadin…☆212Updated 5 months ago
- Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models☆84Updated 2 months ago
- [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"☆139Updated 5 months ago
- Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"☆93Updated 4 months ago
- LLaVA-MORE: Enhancing Visual Instruction Tuning with LLaMA 3.1☆102Updated last week
- Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding☆156Updated last month
- Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)☆114Updated 10 months ago
- Long Context Transfer from Language to Vision☆362Updated 3 months ago
- Official Implementation for "MyVLM: Personalizing VLMs for User-Specific Queries" (ECCV 2024)☆162Updated 7 months ago
- [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos☆105Updated 2 months ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆146Updated 5 months ago
- Densely Captioned Images (DCI) dataset repository.☆169Updated 8 months ago
- ☆177Updated 7 months ago
- [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".☆252Updated 8 months ago
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆121Updated 6 months ago
- [CVPR2025] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models☆136Updated this week