Alternatives and similar repositories for LLM2CLIP

Users that are interested in LLM2CLIP are comparing it to the libraries listed below

• Meituan-AutoML / VisionLLaMA
  VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks
  ☆384Updated 10 months ago
• thunlp / LLaVA-UHD
  LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer
  ☆379Updated last month
• bfshi / scaling_on_scales
  When do we not need larger vision models?
  ☆396Updated 3 months ago
• beichenzbc / Long-CLIP
  [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"
  ☆813Updated 9 months ago
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆321Updated 10 months ago
• luogen1996 / LLaVA-HR
  [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant
  ☆238Updated 9 months ago
• DAMO-NLP-SG / Inf-CLIP
  [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…
  ☆248Updated 4 months ago
• OpenGVLab / OmniCorpus
  [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
  ☆356Updated last month
• andimarafioti / florence2-finetuning
  Quick exploration into fine tuning florence 2
  ☆316Updated 8 months ago
• mbzuai-oryx / LlamaV-o1
  [ACL 2025 🔥] Rethinking Step-by-step Visual Reasoning in LLMs
  ☆299Updated 2 weeks ago
• TIGER-AI-Lab / VLM2Vec
  This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]
  ☆237Updated this week
• Hon-Wong / VoRA
  [Fully open] [Encoder-free MLLM] Vision as LoRA
  ☆280Updated last week
• baaivision / EVE
  EVE Series: Encoder-Free Vision-Language Models from BAAI
  ☆327Updated 3 months ago
• IDEA-Research / ChatRex
  Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding
  ☆184Updated 4 months ago
• UCSC-VLAA / OpenVision
  OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learning
  ☆237Updated 3 weeks ago
• jy0205 / LaVIT
  LaVIT: Empower the Large Language Model to Understand and Generate Visual Content
  ☆580Updated 7 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆378Updated 2 months ago
• LLaVA-VL / LLaVA-Interactive-Demo
  LLaVA-Interactive-Demo
  ☆372Updated 10 months ago
• Vision-CAIR / LongVU
  [ICML 2025] Official PyTorch implementation of LongVU
  ☆380Updated 3 weeks ago
• magic-research / PLLaVA
  Official repository for the paper PLLaVA
  ☆654Updated 10 months ago
• allenai / unified-io-2
  ☆613Updated last year
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆825Updated last month
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆249Updated 5 months ago
• zhangfaen / finetune-Qwen2-VL
  ☆362Updated 3 months ago
• penghao-wu / vstar
  PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
  ☆619Updated last year
• pkunlp-icler / FastV
  [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…
  ☆430Updated 5 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆744Updated last year
• kyegomez / NaViT
  My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
  ☆234Updated 2 months ago
• SunzeY / AlphaCLIP
  [CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want
  ☆821Updated 10 months ago
• baaivision / DIVA
  [ICLR 2025] Diffusion Feedback Helps CLIP See Better
  ☆280Updated 4 months ago