TencentARC / mllm-npu

Related projects ⓘ

Alternatives and complementary repositories for mllm-npu

• thu-nics / DiTFastAttn
  ☆100Updated last month
• mit-han-lab / vila-u
  VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
  ☆137Updated 3 weeks ago
• DefTruth / Awesome-Diffusion-Inference
  📒A small curated list of Awesome Diffusion Inference Papers with codes.
  ☆96Updated this week
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆197Updated 7 months ago
• Vchitect / LiteGen
  A light-weight and high-efficient training framework for accelerating diffusion tasks.
  ☆41Updated 2 months ago
• AdaCache-DiT / AdaCache
  Adaptive Caching for Faster Video Generation with Diffusion Transformers
  ☆91Updated 2 weeks ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆179Updated last month
• pkunlp-icler / FastV
  [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…
  ☆274Updated 3 months ago
• WePOINTS / WePOINTS
  ☆68Updated last week
• TIGER-AI-Lab / VLM2Vec
  This repo contains the code and data for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks"
  ☆69Updated last week
• baaivision / EVE
  [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models
  ☆231Updated last month
• alibaba / conv-llava
  ☆105Updated 3 months ago
• VectorSpaceLab / Video-XL
  🔥🔥First-ever hour scale video understanding models
  ☆166Updated 3 weeks ago
• mini-sora / MiniSora-DiT
  minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora
  ☆38Updated 7 months ago
• xdit-project / DistVAE
  A parallelism VAE avoids OOM for high resolution image generation
  ☆40Updated last month
• mulanai / MuLan
  MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)
  ☆127Updated 5 months ago
• OpenGVLab / OmniCorpus
  OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
  ☆274Updated this week
• baaivision / CapsFusion
  [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale
  ☆194Updated 8 months ago
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆89Updated 2 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆334Updated 3 weeks ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆246Updated 4 months ago
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆84Updated 2 months ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆102Updated 3 weeks ago
• showlab / Awesome-Unified-Multimodal-Models
  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.
  ☆215Updated 2 weeks ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆79Updated 5 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆115Updated last week
• wkcn / TinyCLIP
  [ICCV2023] TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance
  ☆66Updated 4 months ago
• horseee / learning-to-cache
  [NeurIPS 2024] Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching
  ☆75Updated 4 months ago
• DAMO-NLP-SG / Inf-CLIP
  The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A su…
  ☆178Updated 3 weeks ago