mu-cai / matryoshka-mm
Matryoshka Multimodal Models
☆90Updated last month
Alternatives and similar repositories for matryoshka-mm:
Users that are interested in matryoshka-mm are comparing it to the libraries listed below
- ☆132Updated last year
- This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"☆126Updated 7 months ago
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…☆112Updated 6 months ago
- Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegrained Image …☆62Updated last month
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆127Updated 2 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆43Updated 2 weeks ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆138Updated 7 months ago
- ☆107Updated 5 months ago
- [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale☆200Updated 10 months ago
- Official repo for StableLLAVA☆94Updated last year
- ☆44Updated 8 months ago
- Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"☆19Updated 3 months ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆188Updated last week
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆130Updated last month
- ☆47Updated last year
- Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)☆54Updated last year
- MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models☆58Updated 4 months ago
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆56Updated 4 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆154Updated 3 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆95Updated 2 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆109Updated 8 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆145Updated 2 months ago
- Densely Captioned Images (DCI) dataset repository.☆167Updated 6 months ago
- ☆67Updated 6 months ago
- A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo☆32Updated 5 months ago
- ☆134Updated 2 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆56Updated 3 months ago
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria☆59Updated 3 months ago
- [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…☆49Updated 3 months ago
- VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆91Updated 6 months ago