mu-cai / matryoshka-mmLinks
Matryoshka Multimodal Models
☆107Updated 4 months ago
Alternatives and similar repositories for matryoshka-mm
Users that are interested in matryoshka-mm are comparing it to the libraries listed below
Sorting:
- [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"☆132Updated 11 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆57Updated last month
- [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…☆75Updated 5 months ago
- ☆133Updated last year
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆139Updated 6 months ago
- Official repo for StableLLAVA☆95Updated last year
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…☆125Updated 10 months ago
- Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).☆129Updated last month
- ☆115Updated 10 months ago
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆59Updated 3 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆155Updated 6 months ago
- [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale☆208Updated last year
- Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"☆28Updated 7 months ago
- Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".☆58Updated last year
- ☆74Updated 10 months ago
- An open source implementation of CLIP (With TULIP Support)☆147Updated 2 weeks ago
- Preference Learning for LLaVA☆45Updated 6 months ago
- [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.☆96Updated 10 months ago
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆78Updated 4 months ago
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆52Updated 6 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆115Updated last month
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆67Updated last year
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆145Updated 5 months ago
- [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models☆74Updated 8 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆164Updated 7 months ago
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"☆99Updated last week
- SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models☆112Updated last month
- E5-V: Universal Embeddings with Multimodal Large Language Models☆249Updated 5 months ago
- A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo☆34Updated 9 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆176Updated last month