Alternatives and similar repositories for HAVEN:

Users that are interested in HAVEN are comparing it to the libraries listed below

• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆65Updated 10 months ago
• locuslab / llava-token-compression
  ☆41Updated 5 months ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆29Updated 8 months ago
• RainBowLuoCS / DEEM
  (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆29Updated last month
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated 7 months ago
• haonan3 / V1
  V1: Toward Multimodal Reasoning by Designing Auxiliary Task
  ☆33Updated last week
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆55Updated 3 months ago
• John-AI-Lab / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆46Updated this week
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated last month
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆44Updated 4 months ago
• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 4 months ago
• DAMO-NLP-SG / CMM
  ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  ☆45Updated 6 months ago
• bethgelab / sober-reasoning
  Code for "A Sober Look at Progress in Language Model Reasoning" paper
  ☆36Updated last week
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆42Updated last month
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• hasanar1f / HiRED
  [AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Visio…
  ☆30Updated last week
• hulianyuyy / iLLaVA
  iLLaVA: An Image is Worth Fewer Than 1/3 Input Tokens in Large Multimodal Models
  ☆18Updated 2 months ago
• RayRuiboChen / Self-Filter
  ☆22Updated 10 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆73Updated 3 months ago
• zjunlp / Deco
  [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
  ☆58Updated 4 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆66Updated 6 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆37Updated 6 months ago
• si0wang / VisVM
  ☆40Updated 3 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆49Updated 5 months ago
• pengts / VW-LMM
  ☆25Updated 11 months ago
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"
  ☆24Updated last month
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆31Updated 6 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆100Updated 2 months ago
• opendatalab / MLLM-DataEngine
  MLLM-DataEngine: An Iterative Refinement Approach for MLLM
  ☆46Updated 11 months ago
• MME-Benchmarks / MME-CoT
  MME-CoT: Benchmarking Chain-of-Thought in LMMs for Reasoning Quality, Robustness, and Efficiency
  ☆100Updated 3 weeks ago