Alternatives and similar repositories for RWKV-CLIP

Users that are interested in RWKV-CLIP are comparing it to the libraries listed below

• ZhangXJ199 / TinyLLaVA-Video
  A Simple Framework of Small-scale LMMs for Video Understanding
  ☆73Updated last month
• howard-hou / VisualRWKV
  VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.
  ☆234Updated 2 months ago
• alibaba / conv-llava
  ☆118Updated last year
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆160Updated 7 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆207Updated 7 months ago
• invictus717 / MiCo
  [ICCV'25] Explore the Limits of Omni-modal Pretraining at Scale
  ☆111Updated 11 months ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆44Updated last year
• Beckschen / ViTamin
  [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"
  ☆207Updated last year
• FudanNLPLAB / MouSi
  ☆73Updated last year
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated 2 weeks ago
• ggg0919 / cantor
  ☆86Updated last year
• DAMO-NLP-SG / Inf-CLIP
  [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…
  ☆263Updated 6 months ago
• yuyq96 / TextHawk
  Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models
  ☆62Updated 9 months ago
• TencentARC / mllm-npu
  mllm-npu: training multimodal large language models on Ascend NPUs
  ☆91Updated 11 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆171Updated 9 months ago
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆125Updated 9 months ago
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆60Updated 5 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆144Updated 8 months ago
• Hon-Wong / ByteVideoLLM
  [ICCV 2025] Dynamic-VLM
  ☆23Updated 7 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 3 months ago
• Victorwz / Open-Qwen2VL
  [COLM 2025] Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources
  ☆244Updated 2 months ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆165Updated 10 months ago
• deepglint / UniME
  [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"
  ☆83Updated last month
• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆164Updated last year
• jacklishufan / LaViDa
  Official Implementation of LaViDa: :A Large Diffusion Language Model for Multimodal Understanding
  ☆123Updated 2 weeks ago
• kyegomez / NaViT
  My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
  ☆250Updated 2 weeks ago
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆53Updated 2 weeks ago
• xmu-xiaoma666 / Multimodal-Open-O1
  Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…
  ☆29Updated 10 months ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆87Updated 9 months ago
• luogen1996 / LLaVA-HR
  [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant
  ☆238Updated 11 months ago