SkyworkAI / MoHLinks
MoH: Multi-Head Attention as Mixture-of-Head Attention
☆248Updated 7 months ago
Alternatives and similar repositories for MoH
Users that are interested in MoH are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆222Updated 7 months ago
- This repository is the official implementation of "DTL: Disentangled Transfer Learning for Visual Recognition", which is accepted by AAAI…☆112Updated last year
- A Unified Parameter-Efficient Transfer Learning Benchmark for Computer Vision Tasks☆272Updated 9 months ago
- Official Repository of paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆147Updated 3 months ago
- [ICLR 2025] Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models☆72Updated 2 months ago
- ☆106Updated last week
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆124Updated 3 weeks ago
- VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Model☆333Updated last month
- MM-IFEngine: Towards Multimodal Instruction Following☆91Updated last month
- Pytorch Implementation of "Sinkhorn Distance Minimization for Knowledge Distillation", COLING 2024 and TNNLS 2024☆122Updated last month
- The official implementation of Achieving Cross Modal Generalization with Multimodal Unified Representation (NeurIPS '23)☆218Updated 5 months ago
- A curated list of research based on CLIP.☆219Updated 6 months ago
- ☆400Updated 10 months ago
- ☆144Updated last month
- [ICLR 2025] What do we expect from LMMs as AIGI evaluators and how do they perform?☆144Updated 4 months ago
- PyTorch implementation of the paper : Exploring Regional Clues in CLIP for Zero-Shot Semantic Segmentation.☆49Updated 10 months ago
- Alchemy Cat —— 🔥Config System for SOTA☆115Updated 2 months ago
- Collection of awesome parameter-efficient fine-tuning resources.☆557Updated 2 months ago
- [CVPR 2024] "MACE: Mass Concept Erasure in Diffusion Models" (Official Implementation)☆395Updated 2 months ago
- Teaching LMMs for Image Quality Scoring and Interpreting☆91Updated 2 months ago
- [CVPR 2024 Highlight] Logit Standardization in Knowledge Distillation☆374Updated 7 months ago
- (ICML' 24) Residual-Conditioned Optimal Transport: Towards Structure-Preserving Unpaired and Paired Image Restoration☆108Updated last month
- ☆203Updated 6 months ago
- ☆117Updated 11 months ago
- [ICLR 2025] Tool-Planner: Task Planning with Clusters across Multiple Tools☆110Updated 3 weeks ago
- [ICML 2024] JSQ: Compressing Large Language Models by Joint Sparsification and Quantization☆151Updated 7 months ago
- [CVPR 2025] A benchmark for video quality understanding of LMMs☆105Updated 2 months ago
- (TPAMI' 25) Degradation-Aware Residual-Conditioned Optimal Transport for Unified Image Restoration☆95Updated last week
- Biomedical Generalist Video Generation Model☆179Updated 7 months ago
- Official code for TPAMI2024 paper: Pixel Distillation: Cost-flexible Distillation across Image Sizes and Heterogeneous Networks☆58Updated last month