layer6ai-labs / fusemix
Data-Efficient Multimodal Fusion on a Single GPU
☆52Updated 9 months ago
Alternatives and similar repositories for fusemix:
Users that are interested in fusemix are comparing it to the libraries listed below
- Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"☆23Updated 4 months ago
- [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆40Updated 3 weeks ago
- Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)☆54Updated last year
- Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data☆33Updated 11 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆44Updated last month
- LAVIS - A One-stop Library for Language-Vision Intelligence☆47Updated 6 months ago
- VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)☆44Updated last year
- [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models☆45Updated 2 months ago
- ☆37Updated 3 months ago
- Official Repository of Personalized Visual Instruct Tuning☆26Updated 3 months ago
- [ICLR 2024] Contextualized Diffusion Models for Text-Guided Image and Video Generation☆62Updated 8 months ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆48Updated 5 months ago
- [ICLR 2024] Official code for the paper "LLM Blueprint: Enabling Text-to-Image Generation with Complex and Detailed Prompts"☆73Updated 8 months ago
- Language Repository for Long Video Understanding☆31Updated 7 months ago
- 🤖 [ICLR'25] Multimodal Video Understanding Framework (MVU)☆27Updated 2 weeks ago
- 🔥 [CVPR 2024] Official implementation of "See, Say, and Segment: Teaching LMMs to Overcome False Premises (SESAME)"☆32Updated 7 months ago
- ☆30Updated this week
- (arXiv.2405.18406) RACCooN: A Versatile Instructional Video Editing Framework with Auto-Generated Narratives☆32Updated 3 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆73Updated 3 weeks ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆20Updated 6 months ago
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆19Updated last month
- Compress conventional Vision-Language Pre-training data☆49Updated last year
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆59Updated 3 months ago
- Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)☆38Updated last year
- ☆29Updated last year
- ☆72Updated 9 months ago
- ☆37Updated 3 weeks ago
- INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model☆41Updated 6 months ago
- [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences☆35Updated 3 weeks ago
- Official repository of paper "Subobject-level Image Tokenization"☆65Updated 9 months ago