Alternatives and similar repositories for DocumentCLIP

Users that are interested in DocumentCLIP are comparing it to the libraries listed below

• usydnlp / vdoc
  ☆15Updated 2 years ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated last year
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated last year
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆33Updated last year
• nttmdlab-nlp / SlideVQA
  SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images (AAAI2023)
  ☆90Updated 3 months ago
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• dqxiu / KAssess
  ☆14Updated last year
• umd-huang-lab / Mementos
  ☆31Updated last year
• hsiehjackson / Mr.Right
  Mr. Right: Multimodal Retrieval on Representation of ImaGe witH Text
  ☆24Updated 2 years ago
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆23Updated last week
• NExTplusplus / TAT-DQA
  TAT-DQA: Towards Complex Document Understanding By Discrete Reasoning
  ☆23Updated 10 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆29Updated last year
• NiteshMethani / PlotQA
  Dataset introduced in PlotQA: Reasoning over Scientific Plots
  ☆78Updated 2 years ago
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆87Updated last year
• showlab / Awesome-Long-Context
  A curated list of resources about long-context in large-language models and video understanding.
  ☆31Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆57Updated 8 months ago
• MAEHCM / AET
  Code for AAAI 2023 Paper : “Alignment-Enriched Tuning for Patch-Level Pre-trained Document Image Models”
  ☆18Updated 2 years ago
• YunxinLi / LingCloud
  Attaching human-like eyes to the large language model. The codes of IEEE TMM paper "LMEye: An Interactive Perception Network for Large La…
  ☆48Updated 11 months ago
• CONE-MT / LLaMAX
  ☆71Updated 7 months ago
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆35Updated last year
• lupantech / IconQA
  Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".
  ☆52Updated last year
• yxuansu / Contrastive_Search_versus_Contrastive_Decoding
  An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation
  ☆27Updated last year
• bytedance / MTVQA
  MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering. A comprehensive evaluation of multimodal large model multilingua…
  ☆59Updated 2 months ago
• yilunzhao / RobuT
  Data and code for ACL 2023 paper "RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbations"
  ☆14Updated last year
• huggingface / docmatix
  A huge dataset for Document Visual Question Answering
  ☆19Updated 11 months ago
• lfy79001 / S3Eval
  [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models
  ☆32Updated last year
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated last year