Alternatives and similar repositories for vilbert-multi-task

Users that are interested in vilbert-multi-task are comparing it to the libraries listed below

• ChenRocks / UNITER
  Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
  ☆793Updated 3 years ago
• jackroos / VL-BERT
  Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".
  ☆741Updated 2 years ago
• airsplay / lxmert
  PyTorch code for EMNLP 2019 paper "LXMERT: Learning Cross-Modality Encoder Representations from Transformers".
  ☆954Updated 2 years ago
• uclanlp / visualbert
  Code for the paper "VisualBERT: A Simple and Performant Baseline for Vision and Language"
  ☆535Updated 2 years ago
• jiasenlu / vilbert_beta
  ☆478Updated 2 years ago
• microsoft / Oscar
  Oscar and VinVL
  ☆1,049Updated last year
• LuoweiZhou / VLP
  Vision-Language Pre-training for Image Captioning and Question Answering
  ☆419Updated 3 years ago
• jayleicn / ClipBERT
  [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…
  ☆722Updated last year
• MILVLG / mcan-vqa
  Deep Modular Co-Attention Networks for Visual Question Answering
  ☆453Updated 4 years ago
• pzzhang / VinVL
  project page for VinVL
  ☆355Updated last year
• MILVLG / openvqa
  A lightweight, scalable, and general framework for visual question answering research
  ☆325Updated 3 years ago
• yuewang-cuhk / awesome-vision-language-pretraining-papers
  Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
  ☆1,153Updated 2 years ago
• forence / Awesome-Visual-Captioning
  This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP
  ☆412Updated 2 years ago
• MILVLG / bottom-up-attention.pytorch
  A PyTorch reimplementation of bottom-up-attention models
  ☆301Updated 3 years ago
• facebookresearch / grid-feats-vqa
  Grid features pre-training code for visual question answering
  ☆268Updated 3 years ago
• clip-vil / CLIP-ViL
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆412Updated 2 years ago
• airsplay / py-bottom-up-attention
  PyTorch bottom-up attention with Detectron2
  ☆233Updated 3 years ago
• aimagelab / meshed-memory-transformer
  Meshed-Memory Transformer for Image Captioning. CVPR 2020
  ☆538Updated 2 years ago
• shilrley6 / Faster-R-CNN-with-model-pretrained-on-Visual-Genome
  Faster RCNN model in Pytorch version, pretrained on the Visual Genome with ResNet 101
  ☆238Updated 2 years ago
• peteanderson80 / bottom-up-attention
  Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome
  ☆1,453Updated 2 years ago
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆371Updated 2 years ago
• microsoft / scene_graph_benchmark
  image scene graph generation benchmark
  ☆397Updated 2 years ago
• google-research-datasets / conceptual-captions
  Conceptual Captions is a dataset containing (image-URL, caption) pairs designed for the training and evaluation of machine learned image …
  ☆539Updated 3 years ago
• dandelin / ViLT
  Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"
  ☆1,471Updated last year
• ashkamath / mdetr
  ☆1,009Updated 2 years ago
• microsoft / UniVL
  An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
  ☆357Updated 11 months ago
• Cadene / block.bootstrap.pytorch
  BLOCK (AAAI 2019), with a multimodal fusion library for deep learning models
  ☆352Updated 5 years ago
• kdexd / virtex
  [CVPR 2021] VirTex: Learning Visual Representations from Textual Annotations
  ☆563Updated last year
• yikuan8 / Transformers-VQA
  An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER
  ☆164Updated 2 years ago
• husthuaan / AoANet
  Code for paper "Attention on Attention for Image Captioning". ICCV 2019
  ☆333Updated 4 years ago