Alternatives and similar repositories for ViT-Lens:

Users that are interested in ViT-Lens are comparing it to the libraries listed below

• UX-Decoder / FIND
  [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"
  ☆123Updated 7 months ago
• isekai-portal / Link-Context-Learning
  ☆97Updated 11 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• AILab-CVC / M2PT
  [CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
  ☆99Updated last year
• ChenDelong1999 / subobjects
  Official repository of paper "Subobject-level Image Tokenization"
  ☆69Updated 2 weeks ago
• OliverRensu / D-iGPT
  [ICML 2024] This repository includes the official implementation of our paper "Rejuvenating image-GPT as Strong Visual Representation Lea…
  ☆98Updated 11 months ago
• YuchenLiu98 / COMM
  Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models
  ☆197Updated 3 months ago
• ziqipang / LM4VisualEncoding
  [ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"
  ☆234Updated last year
• AFeng-x / Draw-and-Understand
  [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆69Updated 2 months ago
• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆81Updated last year
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆97Updated 7 months ago
• Max-Fu / tvl
  [ICML 2024] A Touch, Vision, and Language Dataset for Multimodal Alignment
  ☆71Updated 2 months ago
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆86Updated 7 months ago
• TonyLianLong / CrossMAE
  Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders
  ☆107Updated last week
• MCR-PEFT / Ex-MCR
  ☆43Updated last year
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆152Updated 6 months ago
• ExplainableML / flair
  [CVPR 2025] FLAIR: VLM with Fine-grained Language-informed Image Representations
  ☆61Updated 2 weeks ago
• showlab / cosmo
  ☆72Updated 11 months ago
• fabawi / ImageBind-LoRA
  Fine-tuning "ImageBind One Embedding Space to Bind Them All" with LoRA
  ☆180Updated last year
• xk-huang / segment-caption-anything
  [CVPR 24] The repository provides code for running inference and training for "Segment and Caption Anything" (SCA) , links for downloadin…
  ☆219Updated 6 months ago
• showlab / VideoLISA
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  ☆113Updated 3 months ago
• mit-han-lab / vila-u
  [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
  ☆280Updated 2 months ago
• NVlabs / QLIP
  [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
  ☆68Updated last month
• yuhui-zh15 / VLMClassifier
  Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)
  ☆78Updated 6 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated 2 weeks ago
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆141Updated 7 months ago
• Hon-Wong / VoRA
  [Fully open] [Encoder-free MLLM] Vision as LoRA
  ☆95Updated last week
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression
  ☆54Updated 2 months ago
• mightyzau / RegionBLIP
  ☆58Updated last year
• zh460045050 / V2L-Tokenizer
  ☆130Updated 9 months ago