Alternatives and similar repositories for awesome-VLLMs:

Users that are interested in awesome-VLLMs are comparing it to the libraries listed below

• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆68Updated last week
• xuanlinli17 / large_vlm_distillation_ood
  Distilling Large Vision-Language Model with Out-of-Distribution Generalizability (ICCV 2023)
  ☆55Updated 10 months ago
• AnjieCheng / SpatialRGPT
  [NeurIPS'24] This repository is the implementation of "SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models"
  ☆117Updated 2 months ago
• keshik6 / HourVideo
  [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding
  ☆63Updated last month
• yfzhang114 / MME-RealWorld
  ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?
  ☆93Updated last week
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆149Updated 3 months ago
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆67Updated 3 months ago
• see-say-segment / sesame
  🔥 [CVPR 2024] Official implementation of "See, Say, and Segment: Teaching LMMs to Overcome False Premises (SESAME)"
  ☆32Updated 8 months ago
• Theia-4869 / FasterVLM
  Official code for paper: [CLS] Attention is All You Need for Training-Free Visual Token Pruning: Make VLM Inference Faster.
  ☆47Updated 2 months ago
• Adlith / MoE-Jetpack
  [NeurIPS 24] MoE Jetpack: From Dense Checkpoints to Adaptive Mixture of Experts for Vision Tasks
  ☆105Updated 3 months ago
• yuhui-zh15 / VLMClassifier
  Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)
  ☆70Updated 4 months ago
• ggjy / DeLVM
  ☆114Updated 8 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆125Updated last year
• naver-ai / egtr
  [CVPR 2024 Best paper award candidate] EGTR: Extracting Graph from Transformer for Scene Graph Generation
  ☆95Updated 7 months ago
• dongyh20 / Insight-V
  Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆131Updated 2 months ago
• Mr-Neko / JM3D
  The offical implemention of JM3D.
  ☆29Updated last year
• franciszzj / OpenPSG
  [ECCV 2024] OpenPSG: Open-set Panoptic Scene Graph Generation via Large Multimodal Models
  ☆39Updated last month
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆55Updated 8 months ago
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆85Updated 5 months ago
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆34Updated 2 months ago
• Understanding-Visual-Datasets / VisDiff
  Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)
  ☆113Updated 10 months ago
• x-cls / superclass
  [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training
  ☆200Updated last month
• kaiyuyue / nxtp
  Object Recognition as Next Token Prediction (CVPR 2024 Highlight)
  ☆172Updated last month
• bytedance / OmniScient-Model
  This repo contains the code for our paper Towards Open-Ended Visual Recognition with Large Language Model
  ☆93Updated 7 months ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆90Updated 7 months ago
• deepcs233 / Visual-CoT
  [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …
  ☆237Updated 2 months ago
• shxie2020 / Awesome-UGVFM
  A collection of vision foundation models unifying understanding and generation.
  ☆40Updated last month
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆133Updated 2 months ago
• clova-tool / CLOVA-tool
  ☆27Updated 8 months ago