Alternatives and similar repositories for LM4VisualEncoding

Users that are interested in LM4VisualEncoding are comparing it to the libraries listed below

• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆166Updated 10 months ago
• tsb0601 / MMVP
  ☆354Updated last year
• yossigandelsman / clip_text_span
  official implementation of "Interpreting CLIP's Image Representation via Text-Based Decomposition"
  ☆223Updated 4 months ago
• yuhui-zh15 / VLMClassifier
  Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)
  ☆91Updated 11 months ago
• LijieFan / LaCLIP
  [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"
  ☆286Updated last year
• Chenyu-Wang567 / MLLM-Tool
  MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning
  ☆132Updated last year
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• facebookresearch / DCI
  Densely Captioned Images (DCI) dataset repository.
  ☆192Updated last year
• amazon-science / QA-ViT
  ☆70Updated last year
• dvlab-research / Prompt-Highlighter
  [CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs
  ☆153Updated last year
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆147Updated 10 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆70Updated 7 months ago
• FeipengMa6 / VLoRA
  [NeurIPS 2024] Visual Perception by Large Language Model’s Weights
  ☆50Updated 6 months ago
• foundation-multimodal-models / CAPTURE
  ☆76Updated last year
• 42Shawn / LLaVA-PruMerge
  LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models
  ☆149Updated last week
• baaivision / EVE
  EVE Series: Encoder-Free Vision-Language Models from BAAI
  ☆352Updated 2 months ago
• zh460045050 / V2L-Tokenizer
  ☆137Updated last year
• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆118Updated 5 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆133Updated last year
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆195Updated last year
• HKUST-LongGroup / Awesome-MLLM-Benchmarks
  ☆139Updated 7 months ago
• Weixin-Liang / Modality-Gap
  Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
  ☆161Updated 3 years ago
• ant-research / DreamLIP
  [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions
  ☆136Updated 4 months ago
• chuangchuangtan / LLaVA-NeXT-Image-Llama3-Lora
  LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft
  ☆44Updated last year
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆331Updated last year
• liuzhuang13 / bias
  ☆113Updated last year
• ggjy / DeLVM
  ☆118Updated last year
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆189Updated 3 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆140Updated last week
• imagegridworth / IG-VLM
  ☆138Updated last year