haihuangcode / CMG
The official implementation of Achieving Cross Modal Generalization with Multimodal Unified Representation (NeurIPS '23)
☆216Updated 3 months ago
Alternatives and similar repositories for CMG:
Users that are interested in CMG are comparing it to the libraries listed below
- ☆104Updated 6 months ago
- A Unified Parameter-Efficient Transfer Learning Benchmark for Computer Vision Tasks☆274Updated 7 months ago
- This repository is the official implementation of "DTL: Disentangled Transfer Learning for Visual Recognition", which is accepted by AAAI…☆105Updated last year
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆230Updated 4 months ago
- A curated list of research based on CLIP.☆193Updated 4 months ago
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆114Updated this week
- Pytorch Implementation of "Sinkhorn Distance Minimization for Knowledge Distillation", COLING 2024 and TNNLS 2024☆120Updated 3 weeks ago
- [ICLR 2025] What do we expect from LMMs as AIGI evaluators and how do they perform?☆143Updated last month
- VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Model☆257Updated last month
- ☆393Updated 8 months ago
- Official code for TPAMI2024 paper: Pixel Distillation: Cost-flexible Distillation across Image Sizes and Heterogeneous Networks☆56Updated 4 months ago
- Simple PyTorch implementation of "Libra: Building Decoupled Vision System on Large Language Models" (accepted by ICML 2024)☆155Updated 3 months ago
- ☆348Updated 7 months ago
- [ICLR 2025] Tool-Planner: Task Planning with Clusters across Multiple Tools☆104Updated last month
- ☆105Updated 7 months ago
- Biomedical Generalist Video Generation Model☆179Updated 5 months ago
- PyTorch implementation of the paper : Exploring Regional Clues in CLIP for Zero-Shot Semantic Segmentation.☆46Updated 8 months ago
- [CVPR 2025] A benchmark for video quality understanding of LMMs☆103Updated 2 weeks ago
- Collection of awesome parameter-efficient fine-tuning resources.☆530Updated last week
- Video QA Assistant based on LLMs with frame convolution☆210Updated last year
- [CVPR 2025] VASparse: Towards Efficient Visual Hallucination Mitigation via Visual-Aware Token Sparsification☆23Updated this week
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆197Updated 5 months ago
- Teaching LMMs for Image Quality Scoring and Interpreting☆70Updated this week
- (ICML 24) Residual-Conditioned Optimal Transport: Towards Structure-Preserving Unpaired and Paired Image Restoration☆105Updated 2 months ago
- [IJCAI 2023] Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignment☆51Updated 11 months ago
- Alchemy Cat —— 🔥Config System for SOTA☆115Updated last week
- Official Repository of paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆143Updated 3 weeks ago
- 东北大学学位论文LaTex版，可直接导入Overleaf。LaTex version of Northeastern University's thesis, which can be imported directly into Overleaf.☆82Updated last month
- [CVPR'24] DuPL: Dual Student with Trustworthy Progressive Learning for Robust Weakly Supervised Semantic Segmentation.☆77Updated 9 months ago
- This repository contains the official implementation of the paper TokenUnify: Scalable Autoregressive Visual Pre-training with Mixture To…☆50Updated 7 months ago