Alternatives and similar repositories for Thinking-while-Observing:

Users that are interested in Thinking-while-Observing are comparing it to the libraries listed below

• hackerchenzhuo / LaKo
  [Paper][IJCKG 2022] LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection
  ☆25Updated last year
• guoyang9 / UnifER
  Official implementation for the MM'22 paper.
  ☆12Updated 2 years ago
• phellonchen / awesome-visual-dialog
  Recent Advances in Visual Dialog
  ☆30Updated 2 years ago
• alirezasalemi7 / DEDR-MM-FiD
  the code for paper: A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question Answering
  ☆12Updated last year
• limanling / clip-event
  ☆101Updated 2 years ago
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆63Updated 2 years ago
• PhoebusSi / VQA-VS
  Code for our EMNLP-2022 paper: "Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA"
  ☆38Updated 2 years ago
• aditya10 / VLC-BERT
  Code for WACV 2023 paper "VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge"
  ☆21Updated last year
• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆31Updated 2 months ago
• luomancs / ReMuQ
  a multimodal retrieval dataset
  ☆22Updated last year
• jialinwu17 / MAVEX
  ☆28Updated 2 years ago
• Zhiquan-Wen / D-VQA
  PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)
  ☆24Updated 2 years ago
• PhoebusSi / MMBS
  Code for our EMNLP-2022 paper: "Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning"
  ☆14Updated 2 years ago
• HITsz-TMG / SKURG
  ☆16Updated last year
• ZUCC-AI / UMIE
  Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning
  ☆32Updated 8 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆63Updated 3 months ago
• kugwzk / DiDE
  Code for EMNLP 2022 paper “Distilled Dual-Encoder Model for Vision-Language Understanding”
  ☆29Updated last year
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆42Updated 3 months ago
• PhoebusSi / SAR
  Code for our ACL2021 paper: "Check It Again: Progressive Visual Question Answering via Visual Entailment"
  ☆31Updated 3 years ago
• WeiminXiong / RationaleCL
  Rationale-enhanced language models are better continual relation learners (EMNLP 2023 Main Conference)
  ☆12Updated last year
• open-vision-language / oven
  ☆32Updated last year
• uds-lsv / MCSE
  NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings
  ☆55Updated 8 months ago
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 2 years ago
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆50Updated 7 months ago
• val-iisc / RMLVQA
  ☆14Updated last year
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated last year
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆75Updated 9 months ago
• iwangjian / Color4Dial
  Code and data for "Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue" (ACL Findings 2023).
  ☆22Updated last year
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆63Updated last year