Alternatives and similar repositories for MLLMs-Augmented

Users that are interested in MLLMs-Augmented are comparing it to the libraries listed below

• HKUST-LongGroup / CoMM
  Official repository for CoMM Dataset
  ☆49Updated last year
• ant-research / DreamLIP
  [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions
  ☆136Updated 8 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆68Updated last year
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆80Updated last year
• Paranioar / UniPT
  [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
  ☆68Updated last year
• FeipengMa6 / VLoRA
  [NeurIPS 2024] Visual Perception by Large Language Model’s Weights
  ☆55Updated 9 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆71Updated 11 months ago
• mlvlab / vid-TLDR
  Official implementation of CVPR 2024 paper "vid-TLDR: Training Free Token merging for Light-weight Video Transformer".
  ☆52Updated 2 months ago
• JierunChen / Ref-L4
  Evaluation code for Ref-L4, a new REC benchmark in the LMM era
  ☆53Updated last year
• wuw2019 / LoTLIP
  [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
  ☆47Updated last year
• foundation-multimodal-models / CAPTURE
  ☆81Updated last year
• alibaba / conv-llava
  ☆124Updated last year
• Visual-AI / PruneVid
  [ACL 2025] PruneVid: Visual Token Pruning for Efficient Video Large Language Models
  ☆65Updated 8 months ago
• ChocoWu / SeTok
  Codes for ICLR 2025 Paper: Towards Semantic Equivalence of Tokenization in Multimodal LLM
  ☆76Updated 9 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆76Updated last year
• dhg-wei / TOPA
  (NeurIPS 2024 Spotlight) TOPA: Extend Large Language Models for Video Understanding via Text-Only Pre-Alignment
  ☆30Updated last year
• LaVi-Lab / AIM
  [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"
  ☆54Updated 3 months ago
• CASIA-IVA-Lab / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆54Updated 10 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆51Updated last year
• Share14 / ShareGemini
  ☆32Updated last year
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆112Updated last year
• haoyu-bu / CAFe
  Code for "CAFe: Unifying Representation and Generation with Contrastive-Autoregressive Finetuning"
  ☆32Updated 9 months ago
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆27Updated 2 years ago
• DCDmllm / Momentor
  ☆80Updated last year
• TimeMarker-LLM / TimeMarker
  A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability
  ☆105Updated last year
• hasanar1f / HiRED
  [AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Visio…
  ☆44Updated 9 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆136Updated 2 years ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆96Updated last year
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆180Updated last year