Alternatives and similar repositories for GPT-4V-API:

Users that are interested in GPT-4V-API are comparing it to the libraries listed below

• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆48Updated 3 months ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆45Updated 3 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆41Updated this week
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆34Updated last year
• chuyg1005 / seeclick-crawler
  ☆15Updated 9 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆26Updated 6 months ago
• Timothyxxx / EnvInteractiveLMPapers
  Paper collections of methods that using language to interact with environment, including interact with real world, simulated world or WWW…
  ☆124Updated last year
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• GAIR-NLP / OlympicArena
  This is the official repository of the paper "OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI"
  ☆91Updated last month
• GAIR-NLP / weak-to-strong-reasoning
  ☆58Updated 4 months ago
• YujieLu10 / TIP
  Multimodal-Procedural-Planning
  ☆91Updated last year
• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆117Updated last month
• mukhal / grace
  [EMNLP 2023, Findings] GRACE: Discriminator-Guided Chain-of-Thought Reasoning
  ☆46Updated 3 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆62Updated 8 months ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆43Updated 7 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆35Updated 2 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆71Updated 7 months ago
• xufangzhi / Symbol-LLM
  [ACL 2024] The project of Symbol-LLM
  ☆47Updated 6 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆58Updated 6 months ago
• sotopia-lab / sotopia-pi
  Sotopia-π: Interactive Learning of Socially Intelligent Language Agents (ACL 2024)
  ☆57Updated 8 months ago
• pipilurj / G-LLaVA
  Official github repo of G-LLaVA
  ☆122Updated 8 months ago
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆76Updated 7 months ago
• RAIVNLab / mnms
  m&ms: A Benchmark to Evaluate Tool-Use for multi-step multi-modal tasks
  ☆35Updated 4 months ago
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated last year
• showlab / Awesome-Long-Context
  A curated list of resources about long-context in large-language models and video understanding.
  ☆29Updated last year
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated last year
• pkunlp-icler / PCA-EVAL
  [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain
  ☆101Updated 10 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆128Updated 2 months ago
• OpenGVLab / Awesome-LLM4Tool
  A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools
  ☆67Updated last year