SkyworkAI / MoHLinks
MoH: Multi-Head Attention as Mixture-of-Head Attention
☆294Updated last year
Alternatives and similar repositories for MoH
Users that are interested in MoH are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆254Updated last year
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆72Updated 7 months ago
- Official Repository of ACL 2025 paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆144Updated 8 months ago
- VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Model☆345Updated 7 months ago
- ☆116Updated 5 months ago
- [ICCV 2025] MM-IFEngine: Towards Multimodal Instruction Following☆113Updated 2 months ago
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆138Updated 6 months ago
- A curated list of research based on CLIP.☆281Updated last year
- A Unified Parameter-Efficient Transfer Learning Benchmark for Computer Vision Tasks☆275Updated last year
- The official implementation of 1. Achieving Cross Modal Generalization with Multimodal Unified Representation (NeurIPS '23) 2. Open-set …☆245Updated last month
- ☆419Updated last year
- This repository is the official implementation of "DTL: Disentangled Transfer Learning for Visual Recognition", which is accepted by AAAI…☆131Updated 4 months ago
- 🎉 The code repository for "Parrot: Multilingual Visual Instruction Tuning" in PyTorch.☆77Updated 5 months ago
- [ICLR 2025] What do we expect from LMMs as AIGI evaluators and how do they perform?☆139Updated 9 months ago
- [CVPR 2024] "MACE: Mass Concept Erasure in Diffusion Models" (Official Implementation)☆393Updated 5 months ago
- Alchemy Cat —— 🔥Config System for SOTA☆111Updated last month
- About Official repo of paper "SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Models". A post-training framework that creates a …☆82Updated this week
- [CVPR 2024 Highlight] Logit Standardization in Knowledge Distillation☆382Updated last year
- [ICLR 2025] Tool-Planner: Task Planning with Clusters across Multiple Tools☆114Updated 6 months ago
- Teaching LMMs for Image Quality Scoring and Interpreting☆93Updated 7 months ago
- Collection of awesome parameter-efficient fine-tuning resources.☆579Updated last month
- Pytorch Implementation of "Sinkhorn Distance Minimization for Knowledge Distillation", COLING 2024 and TNNLS 2024☆121Updated 6 months ago
- PyTorch implementation of the paper : Exploring Regional Clues in CLIP for Zero-Shot Semantic Segmentation.☆47Updated last year
- [CVPR 2025] A benchmark for video quality understanding of LMMs☆111Updated 8 months ago
- (ICML' 24) Residual-Conditioned Optimal Transport: Towards Structure-Preserving Unpaired and Paired Image Restoration☆111Updated 7 months ago
- [AAAI 2025] MultiBooth: This repo is the official implementation of "MultiBooth: Towards Generating All Your Concepts in an Image from Te…☆118Updated 11 months ago
- ☆114Updated last year
- ☆196Updated 11 months ago
- [ICLR2025] Kolmogorov-Arnold Transformer☆836Updated 8 months ago
- Official implementation of our NeurIPS 2025 paper: "FlyLoRA: Boosting Task Decoupling and Parameter Efficiency via Implicit Rank-Wise Mix…☆86Updated 2 weeks ago