OpenGVLab / vinci
☆28Updated this week
Alternatives and similar repositories for vinci:
Users that are interested in vinci are comparing it to the libraries listed below
- INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model☆41Updated 5 months ago
- Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment☆35Updated last week
- Multimodal Video Understanding Framework (MVU)☆26Updated 7 months ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆35Updated 6 months ago
- ☆34Updated 11 months ago
- Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction☆34Updated this week
- Official Repository of Personalized Visual Instruct Tuning☆26Updated 2 months ago
- [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding☆49Updated last year
- LAVIS - A One-stop Library for Language-Vision Intelligence☆47Updated 5 months ago
- MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment☆31Updated 6 months ago
- Official repo of the paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"☆23Updated 3 months ago
- Diffusion Powers Video Tokenizer for Comprehension and Generation☆38Updated last month
- [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences☆32Updated 3 months ago
- This is the official repo for ByteVideoLLM/Dynamic-VLM☆18Updated 3 weeks ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆43Updated last week
- Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"☆18Updated last month
- ☆31Updated 3 months ago
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆40Updated 8 months ago
- Retrieval-Augmented Personalization☆11Updated last month
- PiTe: Pixel-Temporal Alignment for Large Video-Language Model☆15Updated this week
- PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"☆17Updated 2 months ago
- OLA-VLM: Elevating Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024☆44Updated 3 weeks ago
- [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"☆14Updated 2 months ago
- The official repo of continuous speculative decoding☆19Updated last month
- [NeurIPS 2024] Efficient Multi-modal Models via Stage-wise Visual Context Compression☆49Updated 5 months ago
- [PR 2024] A large Cross-Modal Video Retrieval Dataset with Reading Comprehension☆23Updated last year
- How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges☆30Updated last year
- ☆46Updated 3 weeks ago