Alternatives and similar repositories for mmf

Users that are interested in mmf are comparing it to the libraries listed below

• ZephyrZhuQi / ssbaseline

  View on GitHub
  Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps[AAAI2021]
  ☆57Apr 5, 2022Updated 3 years ago
• ChenyuGAO-CS / SMA

  View on GitHub
  The imdb files with SBD-Trans OCR for TextVQA dataset.
  ☆11Nov 30, 2021Updated 4 years ago
• yashkant / sam-textvqa

  View on GitHub
  Official code for paper "Spatially Aware Multimodal Transformers for TextVQA" published at ECCV, 2020.
  ☆65Sep 15, 2021Updated 4 years ago
• guanghuixu / AnchorCaptioner

  View on GitHub
  ☆30May 7, 2021Updated 4 years ago
• xinke-wang / Awesome-Text-VQA

  View on GitHub
  ☆188May 8, 2024Updated last year
• wzk1015 / CNMT

  View on GitHub
  [AAAI 2021] Confidence-aware Non-repetitive Multimodal Transformers for TextCaps
  ☆24Mar 29, 2023Updated 2 years ago
• guanghuixu / CRN_tvqa

  View on GitHub
  ☆15Oct 27, 2020Updated 5 years ago
• microsoft / TAP

  View on GitHub
  TAP: Text-Aware Pre-training for Text-VQA and Text-Caption, CVPR 2021 (Oral)
  ☆73May 22, 2023Updated 2 years ago
• ronghanghu / lcgn

  View on GitHub
  Code release for Hu et al., Language-Conditioned Graph Networks for Relational Reasoning. in ICCV, 2019
  ☆92Aug 9, 2019Updated 6 years ago
• HAWLYQ / Qc-TextCap

  View on GitHub
  ☆16Dec 25, 2021Updated 4 years ago
• xiaojino / RUArt

  View on GitHub
  RUArt: A Novel Text-Centered Solution for Text-Based Visual Question Answering
  ☆10Nov 27, 2022Updated 3 years ago
• FuxiaoLiu / DocumentCLIP

  View on GitHub
  [ICPRAI 2024] DocumentCLIP: Linking Figures and Main Body Text in Reflowed Documents
  ☆16Apr 4, 2024Updated last year
• khanhptnk / hanna

  View on GitHub
  Visual Navigation with Natural Multimodal Assistance (EMNLP 2019)
  ☆29Jun 30, 2020Updated 5 years ago
• linjieli222 / VQA_ReGAT

  View on GitHub
  Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"
  ☆187Apr 15, 2021Updated 4 years ago
• LuoweiZhou / VLP

  View on GitHub
  Vision-Language Pre-training for Image Captioning and Question Answering
  ☆423Jan 18, 2022Updated 4 years ago
• easonnie / mlp-vil

  View on GitHub
  MLPs for Vision and Langauge Modeling (Coming Soon)
  ☆27Dec 9, 2021Updated 4 years ago
• AndresPMD / StacMR

  View on GitHub
  Scene Text Aware Cross Modal Retrieval (StacMR)
  ☆24Sep 3, 2021Updated 4 years ago
• uakarsh / latr

  View on GitHub
  Implementation of LaTr: Layout-aware transformer for scene-text VQA,a novel multimodal architecture for Scene Text Visual Question Answer…
  ☆55Oct 30, 2024Updated last year
• hannandarryl / ManyModalQA

  View on GitHub
  Code and Data for ManyModalQA: Modality Disambiguation and QA over Diverse Inputs
  ☆17Mar 2, 2020Updated 5 years ago
• zhangybzbo / EnvBiasVLN

  View on GitHub
  Feature resources of "Diagnosing the Environment Bias in Vision-and-Language Navigation"
  ☆16May 6, 2020Updated 5 years ago
• yanxinzju / CSS-VQA

  View on GitHub
  Counterfactual Samples Synthesizing for Robust VQA
  ☆79Nov 24, 2022Updated 3 years ago
• yuleiniu / vc

  View on GitHub
  Code for CVPR'18 "Grounding Referring Expressions in Images by Variational Context"
  ☆30Jul 4, 2018Updated 7 years ago
• lichengunc / speaker_listener_reinforcer

  View on GitHub
  Torch Implementation of Speaker-Listener-Reinforcer for Referring Expression Generation and Comprehension
  ☆34Mar 8, 2018Updated 7 years ago
• hyounghk / VideoQADenseCapFrameGate-ACL2020

  View on GitHub
  Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…
  ☆34May 14, 2020Updated 5 years ago
• yuxiaodongHRI / SOIT

  View on GitHub
  SOIT: Segmenting Objects with Instance-Aware Transformers
  ☆14Jun 6, 2022Updated 3 years ago
• romebert / RomeBERT

  View on GitHub
  ☆16May 6, 2021Updated 4 years ago
• bearcatt / LaBERT

  View on GitHub
  A length-controllable and non-autoregressive image captioning model.
  ☆69Jun 10, 2021Updated 4 years ago
• zhangxuying1004 / RSTNet

  View on GitHub
  Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)
  ☆123Dec 17, 2022Updated 3 years ago
• daqingliu / NMTree

  View on GitHub
  Code release for Learning to Assemble Neural Module Tree Networks for Visual Grounding (ICCV 2019)
  ☆39Nov 23, 2019Updated 6 years ago
• lufanma / IFR

  View on GitHub
  Implementation of the paper ''Implicit Feature Refinement for Instance Segmentation''.
  ☆20Oct 27, 2021Updated 4 years ago
• anisha2102 / docvqa

  View on GitHub
  Document Visual Question Answering
  ☆131Jul 30, 2020Updated 5 years ago
• facebookresearch / mmf

  View on GitHub
  A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
  ☆5,615Jan 12, 2026Updated last month
• zmykevin / UVLP

  View on GitHub
  CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment
  ☆22Apr 15, 2022Updated 3 years ago
• baaaad / ECE

  View on GitHub
  [ECCV'22 Poster] Explicit Image Caption Editing
  ☆22Nov 30, 2022Updated 3 years ago
• wenhuchen / Semi-Supervised-Image-Captioning

  View on GitHub
  Code for "bootstrap, review, decode: using out-of-domain textual data to improve image captioning"
  ☆21Dec 26, 2016Updated 9 years ago
• doubledaibo / clcaption_nips2017

  View on GitHub
  Contrastive Learning for Image Captioning
  ☆51Feb 22, 2018Updated 7 years ago
• zyang-ur / ReSC

  View on GitHub
  Improving One-stage Visual Grounding by Recursive Sub-query Construction, ECCV 2020
  ☆89Sep 30, 2021Updated 4 years ago
• ChenRocks / UNITER

  View on GitHub
  Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
  ☆800Jun 30, 2021Updated 4 years ago
• zhaominyiz / EPiDA

  View on GitHub
  Official Code for 'EPiDA: An Easy Plug-in Data Augmentation Framework for High Performance Text Classification' - NAACL 2022
  ☆23May 9, 2022Updated 3 years ago