Alternatives and similar repositories for VinVL:

Users that are interested in VinVL are comparing it to the libraries listed below

• airsplay / py-bottom-up-attention
  PyTorch bottom-up attention with Detectron2
  ☆232Updated 3 years ago
• facebookresearch / grid-feats-vqa
  Grid features pre-training code for visual question answering
  ☆269Updated 3 years ago
• clip-vil / CLIP-ViL
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆411Updated 2 years ago
• microsoft / scene_graph_benchmark
  image scene graph generation benchmark
  ☆394Updated 2 years ago
• MILVLG / bottom-up-attention.pytorch
  A PyTorch reimplementation of bottom-up-attention models
  ☆298Updated 2 years ago
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆368Updated last year
• shilrley6 / Faster-R-CNN-with-model-pretrained-on-Visual-Genome
  Faster RCNN model in Pytorch version, pretrained on the Visual Genome with ResNet 101
  ☆235Updated 2 years ago
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆367Updated 2 years ago
• JDAI-CV / image-captioning
  Implementation of 'X-Linear Attention Networks for Image Captioning' [CVPR 2020]
  ☆273Updated 3 years ago
• cshizhe / asg2cap
  Code accompanying the paper "Say As You Wish: Fine-grained Control of Image Caption Generation with Abstract Scene Graphs" (Chen et al., …
  ☆198Updated 2 years ago
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆189Updated last year
• LuoweiZhou / VLP
  Vision-Language Pre-training for Image Captioning and Question Answering
  ☆417Updated 3 years ago
• yangxuntu / SGAE
  ☆220Updated 3 years ago
• jayleicn / ClipBERT
  [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…
  ☆716Updated last year
• forence / Awesome-Visual-Captioning
  This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP
  ☆413Updated 2 years ago
• yahoo / object_relation_transformer
  Implementation of the Object Relation Transformer for Image Captioning
  ☆177Updated 6 months ago
• BryanPlummer / flickr30k_entities
  Flickr30K Entities Dataset
  ☆169Updated 6 years ago
• yikuan8 / Transformers-VQA
  An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER
  ☆163Updated 2 years ago
• husthuaan / AoANet
  Code for paper "Attention on Attention for Image Captioning". ICCV 2019
  ☆333Updated 3 years ago
• luo3300612 / image-captioning-DLCT
  Official pytorch implementation of paper "Dual-Level Collaborative Transformer for Image Captioning" (AAAI 2021).
  ☆198Updated 2 years ago
• microsoft / Oscar
  Oscar and VinVL
  ☆1,045Updated last year
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆185Updated 2 years ago
• researchmm / soho
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆208Updated 2 years ago
• linjieli222 / HERO
  Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"
  ☆231Updated 3 years ago
• KunpengLi1994 / VSRN
  PyTorch code for ICCV'19 paper "Visual Semantic Reasoning for Image-Text Matching"
  ☆296Updated 5 years ago
• zhangxuying1004 / RSTNet
  Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)
  ☆122Updated 2 years ago
• linjieli222 / VQA_ReGAT
  Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"
  ☆182Updated 3 years ago
• woodfrog / vse_infty
  Code for "Learning the Best Pooling Strategy for Visual Semantic Embedding", CVPR 2021 (Oral)
  ☆160Updated 2 years ago
• krasserm / fairseq-image-captioning
  Transformer-based image captioning extension for pytorch/fairseq
  ☆314Updated 4 years ago
• salaniz / pycocoevalcap
  Python 3 support for the MS COCO caption evaluation tools
  ☆315Updated 7 months ago