Alternatives and similar repositories for CNMT

Users that are interested in CNMT are comparing it to the libraries listed below

• AndresPMD / StacMR
  Scene Text Aware Cross Modal Retrieval (StacMR)
  ☆24Updated 4 years ago
• intersun / LightningDOT
  source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
  ☆72Updated 3 years ago
• VALUE-Leaderboard / DataRelease
  Data Release for VALUE Benchmark
  ☆30Updated 3 years ago
• microsoft / TAP
  TAP: Text-Aware Pre-training for Text-VQA and Text-Caption, CVPR 2021 (Oral)
  ☆73Updated 2 years ago
• microsoft / UniTAB
  UniTAB: Unifying Text and Box Outputs for Grounded VL Modeling, ECCV 2022 (Oral Presentation)
  ☆89Updated 2 years ago
• jayleicn / mTVRetrieval
  [ACL 2021] mTVR: Multilingual Video Moment Retrieval
  ☆27Updated 3 years ago
• VALUE-Leaderboard / StarterCode
  Starter Code for VALUE benchmark
  ☆80Updated 3 years ago
• ronghanghu / mmf
  A modular framework for Visual Question Answering research by the FAIR A-STAR team
  ☆45Updated 4 years ago
• MILVLG / rosita
  ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
  ☆56Updated 2 years ago
• ChenyuGAO-CS / SMA
  The imdb files with SBD-Trans OCR for TextVQA dataset.
  ☆11Updated 4 years ago
• yashkant / sam-textvqa
  Official code for paper "Spatially Aware Multimodal Transformers for TextVQA" published at ECCV, 2020.
  ☆65Updated 4 years ago
• zhanxlin / Product1M
  Product1M
  ☆90Updated 3 years ago
• ShiYaya / emscore
  Research code for CVPR 2022 paper: "EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching"
  ☆26Updated 3 years ago
• ZephyrZhuQi / ssbaseline
  Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps[AAAI2021]
  ☆57Updated 3 years ago
• zinengtang / DeCEMBERT
  Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)
  ☆17Updated 2 years ago
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆92Updated 2 years ago
• mad-red / VSR-guided-CIC
  Human-like Controllable Image Captioning with Verb-specific Semantic Roles.
  ☆36Updated 3 years ago
• researchmm / soho
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆208Updated 3 years ago
• WangFei-2019 / Image-text-Retrieval
  ☆47Updated 3 years ago
• showlab / Region_Learner
  The Pytorch implementation for "Video-Text Pre-training with Learned Regions"
  ☆42Updated 3 years ago
• jayleicn / VideoLanguageFuturePred
  [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction
  ☆51Updated 3 years ago
• zmykevin / UVLP
  CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment
  ☆22Updated 3 years ago
• syuqings / video-paragraph
  Codes for paper "Towards Diverse Paragraph Captioning for Untrimmed Videos". CVPR 2021
  ☆66Updated 4 years ago
• fenglinliu98 / MIA
  Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）
  ☆65Updated 5 years ago
• hardyqr / HAL
  [AAAI'20] Code release for "HAL: Improved Text-Image Matching by Mitigating Visual Semantic Hubs".
  ☆38Updated 2 years ago
• zmykevin / UC2
  CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training
  ☆34Updated 4 years ago
• yj-yu / lsmdc
  ☆33Updated 7 years ago
• FingerRec / OA-Transformer
  [CVPR 2022] The code for our paper 《Object-aware Video-language Pre-training for Retrieval》
  ☆62Updated 3 years ago
• uakarsh / latr
  Implementation of LaTr: Layout-aware transformer for scene-text VQA,a novel multimodal architecture for Scene Text Visual Question Answer…
  ☆55Updated last year
• bearcatt / LaBERT
  A length-controllable and non-autoregressive image captioning model.
  ☆68Updated 4 years ago