Alternatives and similar repositories for Thinking-while-Observing

Users that are interested in Thinking-while-Observing are comparing it to the libraries listed below

• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆38Updated last year
• limanling / clip-event
  ☆108Updated 3 years ago
• PhoebusSi / VQA-VS
  Code for our EMNLP-2022 paper: "Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA"
  ☆40Updated 3 years ago
• Hzfinfdu / MPMP
  ACL'2023: Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning
  ☆40Updated 3 years ago
• WebQnA / WebQA
  ☆60Updated 11 months ago
• luomancs / ReMuQ
  a multimodal retrieval dataset
  ☆24Updated 2 years ago
• allenai / multimodalqa
  ☆146Updated 3 years ago
• open-vision-language / oven
  ☆42Updated 2 years ago
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆69Updated 3 years ago
• kugwzk / DiDE
  Code for EMNLP 2022 paper “Distilled Dual-Encoder Model for Vision-Language Understanding”
  ☆31Updated 2 years ago
• AndersonStra / MuKEA
  MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering
  ☆99Updated 2 years ago
• JetRunner / SuperICL
  Code for "Small Models are Valuable Plug-ins for Large Language Models"
  ☆132Updated 2 years ago
• phellonchen / awesome-visual-dialog
  Recent Advances in Visual Dialog
  ☆30Updated 3 years ago
• hackerchenzhuo / LaKo
  [Paper][IJCKG 2022] LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection
  ☆26Updated last year
• ZUCC-AI / UMIE
  Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning
  ☆45Updated last year
• WeiminXiong / RationaleCL
  Rationale-enhanced language models are better continual relation learners (EMNLP 2023 Main Conference)
  ☆12Updated 2 years ago
• RunxinXu / ChildTuning
  Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》
  ☆62Updated 4 years ago
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated 2 years ago
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆69Updated last year
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆53Updated last year
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated 2 years ago
• RenShuhuai-Andy / my-tools
  my commonly-used tools
  ☆63Updated 11 months ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated 2 years ago
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆66Updated 2 years ago
• Zhiquan-Wen / D-VQA
  PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)
  ☆27Updated 3 years ago
• iwangjian / Color4Dial
  Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue (ACL Findings 2023)
  ☆21Updated last month
• liujch1998 / vera
  ☆16Updated 2 years ago
• OhadRubin / EPR
  ☆64Updated 3 years ago
• XL2248 / SOV-MAS
  The code and data for "Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization"
  ☆11Updated 2 years ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year