Alternatives and similar repositories for GPT-4V-API

Users that are interested in GPT-4V-API are comparing it to the libraries listed below

• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆58Updated 9 months ago
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆25Updated last month
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆24Updated 10 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆29Updated last year
• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆123Updated 2 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆20Updated last year
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated last year
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated last year
• WildVision-AI / LMM-Engines
  ☆16Updated 9 months ago
• muirbench / MuirBench
  A Comprehensive Benchmark for Robust Multi-image Understanding
  ☆12Updated 11 months ago
• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆46Updated 5 months ago
• YujieLu10 / TIP
  Multimodal-Procedural-Planning
  ☆92Updated 2 years ago
• ShujinWu-0814 / MACAROON
  Public code repo for EMNLP 2024 Findings paper "MACAROON: Training Vision-Language Models To Be Your Engaged Partners"
  ☆14Updated 10 months ago
• yunfeixie233 / ViGaL
  ☆51Updated 2 months ago
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"
  ☆26Updated 3 months ago
• apple / ml-mia-bench
  This repo contains code and data for ICLR 2025 paper MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
  ☆31Updated 5 months ago
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆35Updated last year
• OpenGVLab / Awesome-LLM4Tool
  A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools
  ☆68Updated last year
• dqxiu / KAssess
  ☆14Updated last year
• showlab / assistgpt
  ☆66Updated 2 years ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆52Updated 7 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆33Updated last year
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]
  ☆73Updated last month
• WildVision-AI / WildVision-Bench
  ☆16Updated 9 months ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆50Updated 9 months ago