Alternatives and similar repositories for CNMT

Users that are interested in CNMT are comparing it to the libraries listed below

• ronghanghu / mmf
  A modular framework for Visual Question Answering research by the FAIR A-STAR team
  ☆45Updated 3 years ago
• FingerRec / OA-Transformer
  [CVPR 2022] The code for our paper 《Object-aware Video-language Pre-training for Retrieval》
  ☆62Updated 3 years ago
• microsoft / TAP
  TAP: Text-Aware Pre-training for Text-VQA and Text-Caption, CVPR 2021 (Oral)
  ☆72Updated 2 years ago
• ZephyrZhuQi / ssbaseline
  Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps[AAAI2021]
  ☆57Updated 3 years ago
• ChenyuGAO-CS / SMA
  The imdb files with SBD-Trans OCR for TextVQA dataset.
  ☆11Updated 3 years ago
• yashkant / sam-textvqa
  Official code for paper "Spatially Aware Multimodal Transformers for TextVQA" published at ECCV, 2020.
  ☆64Updated 3 years ago
• intersun / LightningDOT
  source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
  ☆72Updated 2 years ago
• VALUE-Leaderboard / DataRelease
  Data Release for VALUE Benchmark
  ☆31Updated 3 years ago
• microsoft / UniTAB
  UniTAB: Unifying Text and Box Outputs for Grounded VL Modeling, ECCV 2022 (Oral Presentation)
  ☆87Updated 2 years ago
• AndresPMD / StacMR
  Scene Text Aware Cross Modal Retrieval (StacMR)
  ☆25Updated 3 years ago
• uakarsh / latr
  Implementation of LaTr: Layout-aware transformer for scene-text VQA,a novel multimodal architecture for Scene Text Visual Question Answer…
  ☆53Updated 8 months ago
• researchmm / soho
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆208Updated 2 years ago
• jayleicn / mTVRetrieval
  [ACL 2021] mTVR: Multilingual Video Moment Retrieval
  ☆27Updated 2 years ago
• VALUE-Leaderboard / StarterCode
  Starter Code for VALUE benchmark
  ☆80Updated 2 years ago
• zhanxlin / Product1M
  Product1M
  ☆87Updated 2 years ago
• MILVLG / rosita
  ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
  ☆56Updated 2 years ago
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆90Updated 2 years ago
• ShiYaya / emscore
  Research code for CVPR 2022 paper: "EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching"
  ☆26Updated 2 years ago
• zyang-ur / ReSC
  Improving One-stage Visual Grounding by Recursive Sub-query Construction, ECCV 2020
  ☆85Updated 3 years ago
• showlab / Region_Learner
  The Pytorch implementation for "Video-Text Pre-training with Learned Regions"
  ☆42Updated 3 years ago
• syuqings / video-paragraph
  Codes for paper "Towards Diverse Paragraph Captioning for Untrimmed Videos". CVPR 2021
  ☆66Updated 3 years ago
• fenglinliu98 / MIA
  Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）
  ☆65Updated 4 years ago
• zerovl / ZeroVL
  [ECCV2022] Contrastive Vision-Language Pre-training with Limited Resources
  ☆45Updated 2 years ago
• xinke-wang / Awesome-Text-VQA
  ☆188Updated last year
• zinengtang / DeCEMBERT
  Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)
  ☆17Updated 2 years ago
• WangFei-2019 / Image-text-Retrieval
  ☆45Updated 2 years ago
• mad-red / VSR-guided-CIC
  Human-like Controllable Image Captioning with Verb-specific Semantic Roles.
  ☆36Updated 3 years ago
• bytedance / VTVQA
  Towards Video Text Visual Question Answering: Benchmark and Baseline
  ☆38Updated last year
• zmykevin / UVLP
  CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment
  ☆22Updated 3 years ago
• tzhhhh123 / HC-STVG
  The HC-STVG Dataset
  ☆56Updated 2 years ago