layer6ai-labs / fusemix
Data-Efficient Multimodal Fusion on a Single GPU
☆47Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for fusemix
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆41Updated last week
- LMM which strictly superset LLM embedded☆31Updated this week
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆48Updated last month
- Official Repository of Personalized Visual Instruct Tuning☆23Updated this week
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆37Updated last week
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆32Updated 4 months ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆48Updated 3 months ago
- ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆27Updated 4 months ago
- Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data☆32Updated 7 months ago
- Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models☆69Updated last month
- [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …☆69Updated 9 months ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆17Updated 3 months ago
- Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)☆52Updated last year
- Official implement of MIA-DPO☆32Updated last week
- Making LLaVA Tiny via MoE-Knowledge Distillation☆55Updated 2 weeks ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆29Updated 4 months ago
- Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"☆16Updated 3 weeks ago
- ☆72Updated 5 months ago
- Compress conventional Vision-Language Pre-training data☆49Updated last year
- Official repository of paper "Subobject-level Image Tokenization"☆62Updated 6 months ago
- VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)☆43Updated 11 months ago
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆22Updated 5 months ago
- ☆37Updated last year
- PiTe: Pixel-Temporal Alignment for Large Video-Language Model☆12Updated last month
- 🔥 Aurora Series: A more efficient multimodal large language model series for video.☆40Updated last week
- ☆29Updated 3 weeks ago
- [ICLR 23] Contrastive Aligned of Vision to Language Through Parameter-Efficient Transfer Learning☆36Updated last year
- [ICLR 2024] Official code for the paper "LLM Blueprint: Enabling Text-to-Image Generation with Complex and Detailed Prompts"☆68Updated 5 months ago
- Official implementation of CVPR 2024 paper "Retrieval-Augmented Open-Vocabulary Object Detection".☆27Updated last month
- Matryoshka Multimodal Models☆81Updated last month