SkyworkAI / MoH
MoH: Multi-Head Attention as Mixture-of-Head Attention
☆191Updated 3 months ago
Alternatives and similar repositories for MoH:
Users that are interested in MoH are comparing it to the libraries listed below
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆167Updated 3 months ago
- A Unified Parameter-Efficient Transfer Learning Benchmark for Computer Vision Tasks☆270Updated 5 months ago
- ☆40Updated 6 months ago
- Pytorch Implementation of "Sinkhorn Distance Minimization for Knowledge Distillation", COLING 2024 and TNNLS 2024☆119Updated 2 months ago
- [LMM + AIGC] What do we expect from LMMs as AIGI evaluators and how do they perform?☆142Updated 4 months ago
- [CVPR 2024] "MACE: Mass Concept Erasure in Diffusion Models" (Official Implementation)☆389Updated 2 months ago
- This repository is the official implementation of "DTL: Disentangled Transfer Learning for Visual Recognition", which is accepted by AAAI…☆92Updated 11 months ago
- ☆377Updated 6 months ago
- A curated list of research based on CLIP.☆150Updated 2 months ago
- ☆116Updated 7 months ago
- The official implementation of Achieving Cross Modal Generalization with Multimodal Unified Representation (NeurIPS '23)☆206Updated last month
- [ICLR 2025] Tool-Planner: Task Planning with Clusters across Multiple Tools☆102Updated 7 months ago
- [AAAI 2025] MultiBooth: This repo is the official implementation of "MultiBooth: Towards Generating All Your Concepts in an Image from Te…☆111Updated last month
- Simple PyTorch implementation of "Libra: Building Decoupled Vision System on Large Language Models" (accepted by ICML 2024)☆141Updated 2 months ago
- (ICML 24) Residual-Conditioned Optimal Transport: Towards Structure-Preserving Unpaired and Paired Image Restoration☆104Updated last week
- PyTorch implementation of the paper : Exploring Regional Clues in CLIP for Zero-Shot Semantic Segmentation.☆41Updated 6 months ago
- ☆177Updated last year
- [ICLR 2025] "Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances" (Official Implementation)☆235Updated this week
- Biomedical Generalist Video Generation Model☆181Updated 3 months ago
- A benchmark for video quality understanding of LMMs☆101Updated 3 months ago
- Alchemy Cat —— 🔥Config System for SOTA☆115Updated last month
- In 2024, the strongest open-source implementation of asymmetric magvit_v2 supports inference code but excludes VQVAE. It supports the joi…☆130Updated 6 months ago
- Official code for TPAMI2024 paper: Pixel Distillation: Cost-flexible Distillation across Image Sizes and Heterogeneous Networks☆54Updated 2 months ago
- [ICLR 2025] 3DIS: Depth-Driven Decoupled Instance Synthesis for Text-to-Image Generation☆193Updated this week
- ☆202Updated 2 months ago
- This is the official code for the paper Tailor3D☆180Updated 6 months ago
- Degradation-Aware Residual-Conditioned Optimal Transport for Unified Image Restoration☆69Updated this week
- ☆336Updated 5 months ago
- Collection of awesome parameter-efficient fine-tuning resources.☆499Updated 5 months ago