MM-LLMs / mm-llms.github.io

Related projects ⓘ

Alternatives and complementary repositories for mm-llms.github.io

• swordlidev / Evaluation-Multimodal-LLMs-Survey
  A Survey on Benchmarks of Multimodal Large Language Models
  ☆59Updated 3 weeks ago
• friedrichor / Awesome-Multimodal-Papers
  A curated list of awesome Multimodal studies.
  ☆92Updated this week
• mrwu-mac / ControlMLLM
  [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'
  ☆88Updated last month
• LightChen233 / M3CoT
  ☆37Updated 5 months ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆130Updated last month
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆122Updated 3 months ago
• FudanNLPLAB / MouSi
  ☆72Updated 8 months ago
• yfzhang114 / MME-RealWorld
  ✨✨ MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?
  ☆77Updated last month
• WillDreamer / Aurora
  [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model
  ☆82Updated 11 months ago
• mathllm / MATH-V
  MATH-Vision dataset and code to measure Multimodal Mathematical Reasoning capabilities.
  ☆68Updated 3 weeks ago
• LALBJ / PAI
  [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs
  ☆64Updated this week
• wdndev / mllm_interview_note
  主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识
  ☆80Updated 5 months ago
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆27Updated 3 months ago
• FudanDISC / ReForm-Eval
  An benchmark for evaluating the capabilities of large vision-language models (LVLMs)
  ☆33Updated 11 months ago
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆85Updated 2 months ago
• NiuTrans / Vision-LLM-Alignment
  This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…
  ☆79Updated 3 weeks ago
• wutaiqiang / MoSLoRA
  ☆73Updated 4 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆145Updated last month
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆98Updated 2 weeks ago
• palchenli / VL-Instruction-Tuning
  ☆84Updated 11 months ago
• Liuziyu77 / RAR
  The official implementation of RAR
  ☆72Updated 7 months ago
• TideDra / VL-RLHF
  A RLHF Infrastructure for Vision-Language Models
  ☆98Updated 4 months ago
• om-ai-lab / GroundVLP
  GroundVLP: Harnessing Zero-shot Visual Grounding from Vision-Language Pre-training and Open-Vocabulary Object Detection (AAAI 2024)
  ☆58Updated 10 months ago
• YanqiDai / MMRole
  A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents
  ☆30Updated 3 weeks ago
• yfzhang114 / Awesome-Multimodal-Large-Language-Models
  Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models
  ☆133Updated this week
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆230Updated last month
• deepcs233 / Visual-CoT
  [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …
  ☆132Updated 3 weeks ago
• alibaba / conv-llava
  ☆103Updated 3 months ago
• Yangyi-Chen / SOLO
  Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆113Updated last month
• opendatalab / HA-DPO
  Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
  ☆64Updated 9 months ago