Alternatives and similar repositories for Thinking-while-Observing

Users that are interested in Thinking-while-Observing are comparing it to the libraries listed below

• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆38Updated 11 months ago
• luomancs / ReMuQ
  a multimodal retrieval dataset
  ☆24Updated 2 years ago
• PhoebusSi / VQA-VS
  Code for our EMNLP-2022 paper: "Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA"
  ☆40Updated 3 years ago
• limanling / clip-event
  ☆107Updated 3 years ago
• AndersonStra / MuKEA
  MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering
  ☆99Updated 2 years ago
• hackerchenzhuo / LaKo
  [Paper][IJCKG 2022] LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection
  ☆26Updated last year
• kugwzk / DiDE
  Code for EMNLP 2022 paper “Distilled Dual-Encoder Model for Vision-Language Understanding”
  ☆31Updated 2 years ago
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆69Updated 3 years ago
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 3 years ago
• allenai / multimodalqa
  ☆146Updated 3 years ago
• WebQnA / WebQA
  ☆60Updated 11 months ago
• XL2248 / SOV-MAS
  The code and data for "Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization"
  ☆11Updated 2 years ago
• Yuco-Z / Awesome-Multi-Modal-Dialog
  [Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics
  ☆37Updated 10 months ago
• Zhiquan-Wen / D-VQA
  PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)
  ☆27Updated 3 years ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated 2 years ago
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆53Updated last year
• phellonchen / awesome-visual-dialog
  Recent Advances in Visual Dialog
  ☆30Updated 3 years ago
• liujch1998 / vera
  ☆16Updated 2 years ago
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated 2 years ago
• woojeongjin / FewVLM
  A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models (ACL 2022)
  ☆43Updated 3 years ago
• zmykevin / UC2
  CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training
  ☆34Updated 4 years ago
• open-vision-language / oven
  ☆41Updated 2 years ago
• OhadRubin / EPR
  ☆64Updated 3 years ago
• open-vision-language / infoseek
  ☆67Updated 2 years ago
• xiami2019 / CLAIF
  [Findings of ACL'2023] Improving Contrastive Learning of Sentence Embeddings from AI Feedback
  ☆40Updated 2 years ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• zmykevin / UVLP
  CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment
  ☆22Updated 3 years ago
• guoyang9 / UnifER
  Official implementation for the MM'22 paper.
  ☆13Updated 3 years ago
• Hzfinfdu / MPMP
  ACL'2023: Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning
  ☆40Updated 3 years ago
• xxxiaol / spatial-commonsense
  Source code and data for Things not Written in Text: Exploring Spatial Commonsense from Visual Signals (ACL2022 main conference paper).
  ☆20Updated 3 years ago