Alternatives and similar repositories for MLLMs-Augmented

Users that are interested in MLLMs-Augmented are comparing it to the libraries listed below

• HKUST-LongGroup / CoMM
  Official repository for CoMM Dataset
  ☆48Updated 11 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆68Updated last year
• FeipengMa6 / VLoRA
  [NeurIPS 2024] Visual Perception by Large Language Model’s Weights
  ☆55Updated 8 months ago
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆80Updated last year
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆27Updated 2 years ago
• LaVi-Lab / AIM
  [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"
  ☆49Updated 2 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆70Updated 10 months ago
• Paranioar / UniPT
  [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
  ☆68Updated last year
• wuw2019 / LoTLIP
  [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
  ☆47Updated 11 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆51Updated last year
• dhg-wei / TOPA
  (NeurIPS 2024 Spotlight) TOPA: Extend Large Language Models for Video Understanding via Text-Only Pre-Alignment
  ☆30Updated last year
• ant-research / DreamLIP
  [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions
  ☆135Updated 7 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆136Updated last year
• alibaba / conv-llava
  ☆124Updated last year
• Visual-AI / PruneVid
  [ACL 2025] PruneVid: Visual Token Pruning for Efficient Video Large Language Models
  ☆62Updated 7 months ago
• Shengcao-Cao / groundLMM
  Emergent Visual Grounding in Large Multimodal Models Without Grounding Supervision
  ☆42Updated 2 months ago
• foundation-multimodal-models / CAPTURE
  ☆81Updated last year
• JierunChen / Ref-L4
  Evaluation code for Ref-L4, a new REC benchmark in the LMM era
  ☆53Updated last year
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆53Updated 9 months ago
• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆76Updated last year
• lezhang7 / Enhance-FineGrained
  [CVPR 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding
  ☆53Updated 8 months ago
• OpenGVLab / MMIU
  [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  ☆92Updated last year
• vinid / neg_clip
  NegCLIP.
  ☆38Updated 2 years ago
• maifoundations / Visionary-R1
  Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning
  ☆41Updated 5 months ago
• palchenli / VL-Instruction-Tuning
  ☆91Updated 2 years ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆58Updated last year
• mlvlab / vid-TLDR
  Official implementation of CVPR 2024 paper "vid-TLDR: Training Free Token merging for Light-weight Video Transformer".
  ☆52Updated 2 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆41Updated 2 weeks ago
• SivanDoveh / TSVLC
  Repository for the paper: Teaching Structured Vision & Language Concepts to Vision & Language Models
  ☆47Updated 2 years ago