Alternatives and similar repositories for DocumentCLIP

Users that are interested in DocumentCLIP are comparing it to the libraries listed below

• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆33Updated last year
• umd-huang-lab / Mementos
  ☆31Updated last year
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆23Updated 2 months ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆83Updated 11 months ago
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆57Updated 8 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆28Updated 11 months ago
• showlab / Awesome-Long-Context
  A curated list of resources about long-context in large-language models and video understanding.
  ☆31Updated last year
• khuangaf / CHOCOLATE
  Code and data for the ACL 2024 Findings paper "Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning"
  ☆26Updated last year
• dqxiu / KAssess
  ☆14Updated last year
• open-vision-language / oven
  ☆38Updated last year
• usydnlp / vdoc
  ☆15Updated 2 years ago
• zjunlp / TRICE
  [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback
  ☆41Updated last year
• lfy79001 / S3Eval
  [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models
  ☆32Updated last year
• haon-chen / mmE5
  ☆49Updated 4 months ago
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆24Updated 9 months ago
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated last year
• yale-nlp / refdpo
  ☆16Updated 11 months ago
• eric-ai-lab / Screen-Point-and-Read
  Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"
  ☆28Updated 10 months ago
• thunlp / Muffin
  ☆64Updated last year
• pleaseconnectwifi / DANCE
  PyTorch code for Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles (DANCE)
  ☆23Updated 2 years ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆50Updated 2 weeks ago
• tianyi-lab / Mosaic-IT
  [ACL'25] Mosaic-IT: Cost-Free Compositional Data Synthesis for Instruction Tuning
  ☆19Updated this week
• bytedance / MTVQA
  MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering. A comprehensive evaluation of multimodal large model multilingua…
  ☆59Updated last month
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆51Updated 6 months ago
• NExTplusplus / TAT-DQA
  TAT-DQA: Towards Complex Document Understanding By Discrete Reasoning
  ☆23Updated 9 months ago