deepglint / RWKV-CLIPLinks
[EMNLP 2024] RWKV-CLIP: A Robust Vision-Language Representation Learner
☆136Updated last month
Alternatives and similar repositories for RWKV-CLIP
Users that are interested in RWKV-CLIP are comparing it to the libraries listed below
Sorting:
- VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.☆227Updated 3 weeks ago
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆159Updated 6 months ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆204Updated 5 months ago
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆62Updated 7 months ago
- A Simple Framework of Small-scale LMMs for Video Understanding☆65Updated 2 weeks ago
- [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"☆206Updated last year
- ☆115Updated 10 months ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆160Updated 9 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆167Updated 8 months ago
- ☆80Updated 7 months ago
- My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"☆240Updated 2 months ago
- [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…☆257Updated 5 months ago
- [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation☆173Updated 2 months ago
- Scaling RWKV-Like Architectures for Diffusion Models☆133Updated last year
- [ICCV'25] Explore the Limits of Omni-modal Pretraining at Scale☆103Updated 9 months ago
- The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆75Updated last month
- ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆124Updated 3 months ago
- ☆85Updated last year
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆146Updated 6 months ago
- Dimple, the first Discrete Diffusion Multimodal Large Language Model☆71Updated last month
- (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction☆111Updated 3 months ago
- Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources☆229Updated last month
- [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training☆209Updated 3 months ago
- ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆149Updated last month
- ☆73Updated last year
- A collection of visual instruction tuning datasets.☆76Updated last year
- Matryoshka Multimodal Models☆110Updated 5 months ago
- The official repository for the RealSyn dataset☆34Updated last month
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆56Updated 9 months ago
- [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"☆146Updated 9 months ago