Alternatives and similar repositories for pix2struct:

Users that are interested in pix2struct are comparing it to the libraries listed below

• microsoft / UDOP
  ☆243Updated 2 years ago
• js0nwu / webui
  ☆111Updated last year
• vis-nlp / ChartQA
  ☆180Updated 8 months ago
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆265Updated 9 months ago
• microsoft / MM-REACT
  Official repo for MM-REACT
  ☆944Updated last year
• shabie / docformer
  Implementation of DocFormer: End-to-End Transformer for Document Understanding, a multi-modal transformer based architecture for the task…
  ☆269Updated 2 years ago
• microsoft / GenerativeImage2Text
  GIT: A Generative Image-to-text Transformer for Vision and Language
  ☆559Updated last year
• lupantech / ScienceQA
  Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
  ☆644Updated 6 months ago
• opendatalab / OmniDocBench
  A Comprehensive Benchmark for Document Parsing and Evaluation
  ☆288Updated 3 weeks ago
• mlfoundations / datacomp
  DataComp: In search of the next generation of multimodal datasets
  ☆687Updated last year
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆479Updated last year
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆352Updated last year
• SkunkworksAI / BakLLaVA
  ☆708Updated last year
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,235Updated 2 years ago
• Yuliang-Liu / MultimodalOCR
  On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)
  ☆571Updated last month
• OSU-NLP-Group / SeeAct
  [ICML'24] SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large mult…
  ☆731Updated last month
• microsoft / i-Code
  ☆1,692Updated 5 months ago
• philschmid / document-ai-transformers
  ☆354Updated last year
• doc-analysis / DocBank
  DocBank: A Benchmark Dataset for Document Layout Analysis
  ☆601Updated 7 months ago
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆921Updated this week
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆730Updated last year
• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆197Updated 6 months ago
• LukeForeverYoung / UReader
  ☆131Updated last year
• google-research-datasets / screen_qa
  ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …
  ☆107Updated last month
• LLaVA-VL / LLaVA-Interactive-Demo
  LLaVA-Interactive-Demo
  ☆366Updated 7 months ago
• shikras / shikra
  ☆772Updated 8 months ago
• SCUT-DLVCLab / Document-AI-Recommendations
  Algorithms, papers, datasets, performance comparisons for Document AI. Continuously updating.
  ☆183Updated 3 weeks ago
• microsoft / SoM
  Set-of-Mark Prompting for GPT-4V and LMMs
  ☆1,324Updated 7 months ago
• facebookresearch / MetaCLIP
  ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expert…
  ☆1,367Updated last week
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆610Updated last week