Alternatives and similar repositories for MLLMs-Augmented

Users that are interested in MLLMs-Augmented are comparing it to the libraries listed below

• Paranioar / UniPT
  [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
  ☆67Updated 10 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆63Updated last year
• HKUST-LongGroup / CoMM
  Official repository for CoMM Dataset
  ☆46Updated 7 months ago
• ant-research / DreamLIP
  [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions
  ☆135Updated 3 months ago
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆79Updated 10 months ago
• LaVi-Lab / AIM
  [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"
  ☆37Updated 2 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆70Updated 6 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• haoyu-bu / CAFe
  Code for "CAFe: Unifying Representation and Generation with Contrastive-Autoregressive Finetuning"
  ☆22Updated 5 months ago
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆27Updated last year
• Visual-AI / PruneVid
  The official repository for ACL2025 paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".
  ☆53Updated 3 months ago
• Share14 / ShareGemini
  ☆31Updated last year
• dhg-wei / TOPA
  (NeurIPS 2024 Spotlight) TOPA: Extend Large Language Models for Video Understanding via Text-Only Pre-Alignment
  ☆31Updated 11 months ago
• wuw2019 / LoTLIP
  [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
  ☆43Updated 7 months ago
• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆76Updated last year
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆48Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆39Updated last year
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆86Updated 11 months ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆89Updated last year
• mlvlab / vid-TLDR
  Official implementation of CVPR 2024 paper "vid-TLDR: Training Free Token merging for Light-weight Video Transformer".
  ☆52Updated last year
• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆103Updated 4 months ago
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆105Updated last year
• alibaba / conv-llava
  ☆119Updated last year
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆36Updated 4 months ago
• meetdavidwan / crg
  PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"
  ☆35Updated last year
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆48Updated 5 months ago
• foundation-multimodal-models / CAPTURE
  ☆73Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• Yaxin9Luo / Gamma-MOD
  [ICLR2025] γ -MOD: Mixture-of-Depth Adaptation for Multimodal Large Language Models
  ☆38Updated 6 months ago