albertwy / GPT-4V-Evaluation

Related projects ⓘ

Alternatives and complementary repositories for GPT-4V-Evaluation

• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆48Updated last year
• junyangwang0410 / HaELM
  An automatic MLLM hallucination detection framework
  ☆17Updated last year
• lfy79001 / S3Eval
  [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models
  ☆33Updated 5 months ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆25Updated last week
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆29Updated 7 months ago
• LightChen233 / M3CoT
  ☆38Updated 5 months ago
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆17Updated last month
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆32Updated last week
• zhaochen0110 / Timo
  Code and data for "Timo: Towards Better Temporal Reasoning for Language Models" (COLM 2024)
  ☆18Updated 3 weeks ago
• FudanDISC / ReForm-Eval
  An benchmark for evaluating the capabilities of large vision-language models (LVLMs)
  ☆33Updated last year
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆46Updated 7 months ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆33Updated 3 weeks ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆46Updated last month
• scofield7419 / Video-of-Thought
  Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"
  ☆40Updated 4 months ago
• rookie-joe / AutoPSV
  ☆31Updated 3 weeks ago
• OpenKG-ORG / EasyDetect
  An Easy-to-use Hallucination Detection Framework for LLMs.
  ☆48Updated 7 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• yaolinli / DeCo
  ☆24Updated 4 months ago
• iwangjian / Midi-Tuning
  Code and data for "Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue" (ACL 2024)
  ☆21Updated 3 months ago
• JetRunner / SuperICL
  Code for "Small Models are Valuable Plug-ins for Large Language Models"
  ☆122Updated last year
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆26Updated 4 months ago
• Aman-4-Real / MMTG
  [ACM MM 2022]: Multi-Modal Experience Inspired AI Creation
  ☆19Updated 6 months ago
• LightChen233 / reasoning-boundary
  ☆20Updated last month
• ChartMimic / ChartMimic
  ChartMimic: Evaluating LMM’s Cross-Modal Reasoning Capability via Chart-to-Code Generation
  ☆94Updated 4 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆22Updated 4 months ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆43Updated 5 months ago
• zhaochen0110 / Cotempqa
  Code and data for "Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?" (ACL 2024)
  ☆28Updated 4 months ago
• HaozheZhao / MIC_tool
  ☆13Updated last year
• gzcch / Bingo
  ☆53Updated 7 months ago
• thunlp / Muffin
  ☆58Updated 9 months ago