NVlabs / LITA
☆176Updated 7 months ago
Alternatives and similar repositories for LITA
Users that are interested in LITA are comparing it to the libraries listed below
Sorting:
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆319Updated 9 months ago
- Code for CVPR25 paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"☆110Updated 2 months ago
- ☆133Updated 7 months ago
- EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties☆124Updated 6 months ago
- [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"☆145Updated 8 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆111Updated last month
- [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds☆92Updated 10 months ago
- Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models☆106Updated last month
- VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning☆121Updated this week
- PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models☆257Updated last year
- An open source implementation of CLIP (With TULIP Support)☆136Updated last month
- [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs☆142Updated 8 months ago
- Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)☆119Updated last year
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆154Updated 7 months ago
- Long Context Transfer from Language to Vision☆374Updated last month
- Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"☆96Updated 6 months ago
- Supercharged BLIP-2 that can handle videos☆117Updated last year
- [ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM☆73Updated 6 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆154Updated 5 months ago
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆158Updated 4 months ago
- [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".☆272Updated 11 months ago
- Official Implementation of "Chrono: A Simple Blueprint for Representing Time in MLLMs"☆87Updated 2 months ago
- Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment☆50Updated 4 months ago
- LinVT: Empower Your Image-level Large Language Model to Understand Videos☆74Updated 4 months ago
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆124Updated 8 months ago
- ☆133Updated last year
- (2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding☆308Updated 9 months ago
- [CVPR 24] The repository provides code for running inference and training for "Segment and Caption Anything" (SCA) , links for downloadin…☆222Updated 7 months ago
- Official Implementation for "MyVLM: Personalizing VLMs for User-Specific Queries" (ECCV 2024)☆169Updated 10 months ago
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]☆214Updated last month