layer6ai-labs / fusemix
Data-Efficient Multimodal Fusion on a Single GPU
☆59Updated last year
Alternatives and similar repositories for fusemix
Users that are interested in fusemix are comparing it to the libraries listed below
Sorting:
- ☆50Updated 2 months ago
- ☆41Updated 6 months ago
- [CVPR 2024] The official implementation of paper "synthesize, diagnose, and optimize: towards fine-grained vision-language understanding"☆42Updated 2 months ago
- [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"☆39Updated 5 months ago
- ☆45Updated 3 months ago
- The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …☆52Updated 6 months ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆47Updated 9 months ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated 9 months ago
- Croc: Pretraining Large Multimodal Models with Cross-Modal Comprehension☆22Updated 6 months ago
- [CVPR 2025 Highlight] Official Pytorch codebase for paper: "Assessing and Learning Alignment of Unimodal Vision and Language Models"☆34Updated 3 weeks ago
- Official repository of paper "Subobject-level Image Tokenization"☆70Updated last month
- FreeVA: Offline MLLM as Training-Free Video Assistant☆61Updated 11 months ago
- Official implementation of TagAlign☆34Updated 5 months ago
- Official PyTorch repository for GRAM☆58Updated this week
- Official implementation of CVPR 2024 paper "Retrieval-Augmented Open-Vocabulary Object Detection".☆37Updated 8 months ago
- Official repository of "Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach" (ACL 2024 Oral)☆22Updated last month
- This is the official repo for ByteVideoLLM/Dynamic-VLM☆20Updated 4 months ago
- [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences☆38Updated 2 months ago
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆81Updated last year
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆27Updated 11 months ago
- COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!☆24Updated 5 months ago
- ☆30Updated last month
- ☆52Updated 2 years ago
- [CVPR2025] Code Release of F-LMM: Grounding Frozen Large Multimodal Models☆86Updated 9 months ago
- Code and Models for "GeneCIS A Benchmark for General Conditional Image Similarity"☆58Updated last year
- [CVPR 2025] FLAIR: VLM with Fine-grained Language-informed Image Representations☆67Updated last month
- An Enhanced CLIP Framework for Learning with Synthetic Captions☆30Updated 3 weeks ago
- [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models☆59Updated this week
- [CVPR 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding☆49Updated last month
- [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions☆130Updated 5 months ago