Alternatives and similar repositories for RWKV-CLIP:

Users that are interested in RWKV-CLIP are comparing it to the libraries listed below

• alibaba / conv-llava
  ☆115Updated 8 months ago
• ZhangXJ199 / TinyLLaVA-Video
  A Simple Framework of Small-scale LMMs for Video Understanding
  ☆56Updated last week
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆155Updated 4 months ago
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆97Updated 7 months ago
• Victorwz / Open-Qwen2VL
  Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources
  ☆182Updated 3 weeks ago
• Beckschen / ViTamin
  [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"
  ☆203Updated 10 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆159Updated 6 months ago
• DAMO-NLP-SG / Inf-CLIP
  [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…
  ☆240Updated 3 months ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆154Updated 7 months ago
• howard-hou / VisualRWKV
  VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.
  ☆220Updated 3 weeks ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆201Updated 3 months ago
• shufangxun / LLaVA-MoD
  [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation
  ☆140Updated 3 weeks ago
• yuyq96 / TextHawk
  Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models
  ☆60Updated 5 months ago
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆223Updated last year
• xmu-xiaoma666 / Multimodal-Open-O1
  Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…
  ☆29Updated 7 months ago
• kyegomez / NaViT
  My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
  ☆228Updated 3 weeks ago
• baaivision / EVE
  EVE Series: Encoder-Free Vision-Language Models from BAAI
  ☆322Updated last month
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆143Updated 4 months ago
• Fantasyele / LLaVA-KD
  ☆73Updated 5 months ago
• feizc / Diffusion-RWKV
  Scaling RWKV-Like Architectures for Diffusion Models
  ☆127Updated last year
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated 7 months ago
• ggg0919 / cantor
  ☆83Updated 11 months ago
• baaivision / CapsFusion
  [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale
  ☆208Updated last year
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆154Updated 5 months ago
• IDEA-Research / ChatRex
  Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding
  ☆182Updated 3 months ago
• Kwai-YuanQi / MM-RLHF
  The Next Step Forward in Multimodal LLM Alignment
  ☆145Updated last month
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆40Updated last week
• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆163Updated 8 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆100Updated 2 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year