lzw-lzw / UnifiedMLLMLinks
UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
☆22Updated last year
Alternatives and similar repositories for UnifiedMLLM
Users that are interested in UnifiedMLLM are comparing it to the libraries listed below
Sorting:
- ☆35Updated 2 months ago
- [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆49Updated last month
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆63Updated 6 months ago
- [ECCV'24 Oral] PiTe: Pixel-Temporal Alignment for Large Video-Language Model☆17Updated 6 months ago
- Explore how to get a VQ-VAE models efficiently!☆48Updated last month
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆28Updated 8 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆70Updated 9 months ago
- AliTok: Towards Sequence Modeling Alignment between Tokenizer and Autoregressive Model☆44Updated last month
- ☆135Updated last year
- [CVPR 2024] "Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition"☆13Updated last year
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆28Updated 4 months ago
- ☆32Updated 4 months ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated last year
- LMM solved catastrophic forgetting, AAAI2025☆44Updated 4 months ago
- Distributed Optimization Infra for learning CLIP models☆27Updated 10 months ago
- A unified framework for controllable caption generation across images, videos, and audio. Supports multi-modal inputs and customizable ca…☆48Updated last month
- High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning☆47Updated last month
- [EMNLP 2024] Preserving Multi-Modal Capabilities of Pre-trained VLMs for Improving Vision-Linguistic Compositionality☆18Updated 10 months ago
- NeurIPS'2023 official implementation code☆65Updated last year
- [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models☆69Updated 3 months ago
- The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]☆20Updated 6 months ago
- The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows☆84Updated last week
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆37Updated last year
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆52Updated 3 months ago
- [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …☆75Updated last year
- [ICCV 2025] Dynamic-VLM☆24Updated 8 months ago
- ☆18Updated 8 months ago
- ☆44Updated 3 months ago
- On Path to Multimodal Generalist: General-Level and General-Bench☆19Updated last month
- Data-Efficient Multimodal Fusion on a Single GPU☆66Updated last year