Alternatives and similar repositories for mllm-npu:

Users that are interested in mllm-npu are comparing it to the libraries listed below

• AdaCache-DiT / AdaCache
  Adaptive Caching for Faster Video Generation with Diffusion Transformers
  ☆144Updated 5 months ago
• thu-nics / DiTFastAttn
  ☆156Updated 3 months ago
• Victorwz / Open-Qwen2VL
  Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources
  ☆155Updated 2 weeks ago
• xdit-project / DistVAE
  A parallelism VAE avoids OOM for high resolution image generation
  ☆59Updated 2 months ago
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆182Updated last week
• ZhangAIPI / YOPO_MLLM_Pruning
  Pruning the VLLMs
  ☆91Updated 4 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆99Updated last month
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆102Updated last week
• ByteDance-Seed / VeOmni
  VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework
  ☆285Updated last week
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆201Updated 3 months ago
• mit-han-lab / vila-u
  [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
  ☆280Updated 2 months ago
• KangarooGroup / Kangaroo
  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input
  ☆64Updated 7 months ago
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆97Updated 7 months ago
• mit-han-lab / x-attention
  XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆137Updated 2 weeks ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆60Updated 4 months ago
• shufangxun / LLaVA-MoD
  [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation
  ☆127Updated 2 weeks ago
• thu-nics / FrameFusion
  The official code implementation of paper "Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models"
  ☆38Updated this week
• Vchitect / LiteGen
  A light-weight and high-efficient training framework for accelerating diffusion tasks.
  ☆46Updated 7 months ago
• JinXins / Awesome-Token-Merge-for-MLLMs
  A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.
  ☆47Updated 3 months ago
• SCZwangxiao / video-FlexReduc
  Official implementation of paper AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding
  ☆41Updated 3 weeks ago
• bytedance / Valley
  Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.
  ☆228Updated last month
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆221Updated last year
• alibaba / conv-llava
  ☆115Updated 8 months ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆158Updated this week
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆120Updated 5 months ago
• LengSicong / MMR1
  MMR1: Advancing the Frontiers of Multimodal Reasoning
  ☆153Updated last month
• step-law / steplaw
  ☆151Updated this week
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆186Updated 2 months ago
• mini-sora / MiniSora-DiT
  minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora
  ☆41Updated last year
• WePOINTS / WePOINTS
  ☆173Updated 2 months ago