Alternatives and similar repositories for DocumentCLIP

Users that are interested in DocumentCLIP are comparing it to the libraries listed below

• mlfoundations / VisIT-Bench
  ☆50Updated last year
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated last year
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated 2 years ago
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆27Updated 2 months ago
• usydnlp / vdoc
  ☆15Updated 3 years ago
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆35Updated last year
• hsiehjackson / Mr.Right
  Mr. Right: Multimodal Retrieval on Representation of ImaGe witH Text
  ☆24Updated 3 years ago
• umd-huang-lab / Mementos
  ☆31Updated last year
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated 2 years ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated 2 years ago
• nttmdlab-nlp / SlideVQA
  SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images (AAAI2023)
  ☆95Updated 5 months ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated last year
• showlab / Awesome-Long-Context
  A curated list of resources about long-context in large-language models and video understanding.
  ☆31Updated 2 years ago
• AGI-Edgerunners / IIL
  Code for our Paper "All in an Aggregated Image for In-Image Learning"
  ☆29Updated last year
• NExTplusplus / TAT-DQA
  TAT-DQA: Towards Complex Document Understanding By Discrete Reasoning
  ☆24Updated last year
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• OpenGVLab / Awesome-LLM4Tool
  A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools
  ☆68Updated 2 years ago
• pleaseconnectwifi / DANCE
  PyTorch code for Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles (DANCE)
  ☆23Updated 2 years ago
• michaelsaxon / CoCoCroLa
  The Conceptual Coverage Across Languages Benchmark for Text-to-Image Models
  ☆12Updated 10 months ago
• YujieLu10 / TIP
  Multimodal-Procedural-Planning
  ☆92Updated 2 years ago
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated 2 years ago
• lupantech / IconQA
  Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".
  ☆52Updated last year
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆30Updated last year
• NewsStoriesData / newsstories.github.io
  ☆22Updated 3 years ago
• gregor-ge / mBLIP
  ☆87Updated last year
• yale-nlp / refdpo
  ☆16Updated last year
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆20Updated 2 years ago
• dqxiu / KAssess
  ☆14Updated last year
• ChenDelong1999 / polite-flamingo
  🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)
  ☆64Updated last year