Alternatives and similar repositories for MMSci

Users that are interested in MMSci are comparing it to the libraries listed below

• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆57Updated 7 months ago
• bigai-nlco / LatentSeek
  Official Repository of LatentSeek
  ☆30Updated last week
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆45Updated 6 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆28Updated 10 months ago
• google / spiqa
  Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]
  ☆58Updated 4 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆67Updated last year
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆23Updated 2 months ago
• NUS-TRAIL / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆64Updated 2 weeks ago
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆84Updated 11 months ago
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"
  ☆103Updated 2 weeks ago
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆34Updated 10 months ago
• MAmmoTH-VL / MAmmoTH-VL
  (ACL 2025) MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
  ☆44Updated this week
• QizhiPei / MathFusion
  MathFusion: Enhancing Mathematic Problem-solving of LLM through Instruction Fusion (ACL 2025)
  ☆22Updated last week
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated last year
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 7 months ago
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆44Updated last month
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆84Updated 8 months ago
• thu-ml / Noise-Contrastive-Alignment
  Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)
  ☆53Updated 6 months ago
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆43Updated 3 weeks ago
• gzcch / Bingo
  ☆54Updated last year
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆35Updated last year
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆47Updated 5 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆115Updated last month
• declare-lab / LLM-PuzzleTest
  This repository is maintained to release dataset and models for multimodal puzzle reasoning.
  ☆90Updated 3 months ago
• vlf-silkie / VLFeedback
  ☆99Updated last year
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆45Updated last year
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆78Updated 4 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆77Updated 4 months ago
• UCSC-VLAA / VLAA-Thinking
  SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models
  ☆112Updated last month