MichiganNLP / In-the-wild-QA

Related projects ⓘ

Alternatives and complementary repositories for In-the-wild-QA

• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 3 years ago
• WadeYin9712 / GD-VCR
  Code and data for "Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning" (EMNLP 2021).
  ☆28Updated 3 years ago
• ExplainableML / CLEVR-X
  CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations
  ☆25Updated last year
• multimodal / multimodal
  A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"
  ☆79Updated 2 years ago
• keep-smile-001 / opentqa
  opentqa is a open framework of the textbook question answering, which includes xtqa, mcan, cmr, mfb, mutan.
  ☆11Updated 3 years ago
• dialogtekgeek / AVSD-DSTC10_Official
  Audio Visual Scene-Aware Dialog (AVSD) Challenge at the 10th Dialog System Technology Challenge (DSTC)
  ☆27Updated 2 years ago
• gchhablani / multilingual-image-captioning
  ☆44Updated 3 years ago
• TheShadow29 / VidSitu
  [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)
  ☆57Updated 3 years ago
• salesforce / VD-BERT
  ☆44Updated 2 years ago
• usydnlp / vdoc
  ☆15Updated 2 years ago
• salesforce / paprika
  Code for CVPR 2023 paper "Procedure-Aware Pretraining for Instructional Video Understanding"
  ☆46Updated last year
• e-bug / iglue
  [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"
  ☆49Updated last year
• adapter-hub / xGQA
  ☆26Updated 2 years ago
• zinengtang / VidLanKD
  Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))
  ☆56Updated last year
• allenai / sherlock
  Code, data, models for the Sherlock corpus
  ☆55Updated last year
• McGill-NLP / imagecode
  Code and data for ImageCoDe, a contextual vison-and-language benchmark
  ☆39Updated 8 months ago
• uds-lsv / MCSE
  NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings
  ☆53Updated 5 months ago
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆60Updated 2 years ago
• maximek3 / e-ViL
  ☆40Updated last year
• e-bug / cross-modal-ablation
  [EMNLP 2021] Code and data for our paper "Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers…
  ☆20Updated 2 years ago
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆112Updated 2 years ago
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆32Updated last year
• berniebear / Multi-HT100M
  ☆51Updated 2 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆44Updated 9 months ago
• bpiyush / TestOfTime
  Official code for our CVPR 2023 paper: Test of Time: Instilling Video-Language Models with a Sense of Time
  ☆45Updated 4 months ago
• google-research-datasets / maxm
  MaXM is a suite of test-only benchmarks for multilingual visual question answering in 7 languages: English (en), French (fr), Hindi (hi),…
  ☆13Updated 9 months ago
• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆26Updated 9 months ago
• researchmm / generate-it
  A collection of models for image<->text generation in ACM MM 2021.
  ☆65Updated 3 years ago
• rowanz / piglet
  PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World [ACL 2021]
  ☆54Updated 3 years ago