Beckschen / LLaVolta
[NeurIPS 2024] Efficient Multi-modal Models via Stage-wise Visual Context Compression
β50Updated 5 months ago
Alternatives and similar repositories for LLaVolta:
Users that are interested in LLaVolta are comparing it to the libraries listed below
- π₯ Aurora Series: A more efficient multimodal large language model series for video.β62Updated 2 months ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effectβ¦β35Updated 7 months ago
- β43Updated 2 weeks ago
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"β45Updated 3 months ago
- VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".β91Updated 6 months ago
- VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selectionβ41Updated this week
- β26Updated 5 months ago
- Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Modelsβ59Updated 7 months ago
- The official code of the paper "PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction".β50Updated last week
- Official implement of MIA-DPOβ49Updated 2 months ago
- Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignmentβ38Updated 2 weeks ago
- Official repo for StableLLAVAβ94Updated last year
- Diffusion Powers Video Tokenizer for Comprehension and Generationβ40Updated last month
- [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videosβ95Updated 3 weeks ago
- VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generationβ84Updated 4 months ago
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.orβ¦β112Updated 6 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, β¦β95Updated 2 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspectiveβ57Updated 2 months ago
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedbackβ56Updated 4 months ago
- Liquid: Language Models are Scalable Multi-modal Generatorsβ60Updated last month
- Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantβ63Updated 2 months ago
- Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)β54Updated last year
- [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understandingβ56Updated last week
- VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)β44Updated last year
- Code Release of F-LMM: Grounding Frozen Large Multimodal Modelsβ60Updated 5 months ago
- Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".β56Updated last year
- β128Updated last month
- Codes for Paper: Towards Semantic Equivalence of Tokenization in Multimodal LLMβ48Updated 3 months ago
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perceptionβ130Updated last month