Alternatives and similar repositories for CNMT

Users that are interested in CNMT are comparing it to the libraries listed below

• AndresPMD / StacMR
  Scene Text Aware Cross Modal Retrieval (StacMR)
  ☆24Updated 3 years ago
• intersun / LightningDOT
  source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
  ☆72Updated 2 years ago
• microsoft / TAP
  TAP: Text-Aware Pre-training for Text-VQA and Text-Caption, CVPR 2021 (Oral)
  ☆72Updated 2 years ago
• ronghanghu / mmf
  A modular framework for Visual Question Answering research by the FAIR A-STAR team
  ☆45Updated 3 years ago
• zhanxlin / Product1M
  Product1M
  ☆87Updated 2 years ago
• ZephyrZhuQi / ssbaseline
  Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps[AAAI2021]
  ☆57Updated 3 years ago
• VALUE-Leaderboard / StarterCode
  Starter Code for VALUE benchmark
  ☆80Updated 2 years ago
• jayleicn / mTVRetrieval
  [ACL 2021] mTVR: Multilingual Video Moment Retrieval
  ☆27Updated 2 years ago
• showlab / Region_Learner
  The Pytorch implementation for "Video-Text Pre-training with Learned Regions"
  ☆42Updated 3 years ago
• yashkant / sam-textvqa
  Official code for paper "Spatially Aware Multimodal Transformers for TextVQA" published at ECCV, 2020.
  ☆64Updated 3 years ago
• uakarsh / latr
  Implementation of LaTr: Layout-aware transformer for scene-text VQA,a novel multimodal architecture for Scene Text Visual Question Answer…
  ☆53Updated 9 months ago
• ChenyuGAO-CS / SMA
  The imdb files with SBD-Trans OCR for TextVQA dataset.
  ☆11Updated 3 years ago
• microsoft / UniTAB
  UniTAB: Unifying Text and Box Outputs for Grounded VL Modeling, ECCV 2022 (Oral Presentation)
  ☆87Updated 2 years ago
• FingerRec / OA-Transformer
  [CVPR 2022] The code for our paper 《Object-aware Video-language Pre-training for Retrieval》
  ☆62Updated 3 years ago
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆91Updated 2 years ago
• researchmm / soho
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆208Updated 2 years ago
• syuqings / video-paragraph
  Codes for paper "Towards Diverse Paragraph Captioning for Untrimmed Videos". CVPR 2021
  ☆65Updated 3 years ago
• zinengtang / DeCEMBERT
  Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)
  ☆17Updated 2 years ago
• VALUE-Leaderboard / DataRelease
  Data Release for VALUE Benchmark
  ☆31Updated 3 years ago
• fawazsammani / show-edit-tell
  Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020
  ☆80Updated 5 years ago
• jayleicn / TVCaption
  [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset
  ☆90Updated last year
• Gitsamshi / WeakVRD-Captioning
  Implementation of paper "Improving Image Captioning with Better Use of Caption"
  ☆33Updated 4 years ago
• fenglinliu98 / MIA
  Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）
  ☆65Updated 4 years ago
• tsujuifu / pytorch_violet
  A PyTorch implementation of VIOLET
  ☆137Updated last year
• hardyqr / HAL
  [AAAI'20] Code release for "HAL: Improved Text-Image Matching by Mitigating Visual Semantic Hubs".
  ☆38Updated last year
• giangnguyen2412 / nocaps
  nocaps: novel object captioning at scale
  ☆10Updated 6 years ago
• MILVLG / rosita
  ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
  ☆56Updated 2 years ago
• mad-red / VSR-guided-CIC
  Human-like Controllable Image Captioning with Verb-specific Semantic Roles.
  ☆36Updated 3 years ago
• zerovl / ZeroVL
  [ECCV2022] Contrastive Vision-Language Pre-training with Limited Resources
  ☆45Updated 2 years ago
• Deferf / CLIP_Video_Representation
  Use CLIP to represent video for Retrieval Task
  ☆70Updated 4 years ago