Alternatives and similar repositories for vilbert-multi-task:

Users that are interested in vilbert-multi-task are comparing it to the libraries listed below

• ChenRocks / UNITER
  Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
  ☆787Updated 3 years ago
• airsplay / lxmert
  PyTorch code for EMNLP 2019 paper "LXMERT: Learning Cross-Modality Encoder Representations from Transformers".
  ☆942Updated 2 years ago
• jiasenlu / vilbert_beta
  ☆474Updated 2 years ago
• uclanlp / visualbert
  Code for the paper "VisualBERT: A Simple and Performant Baseline for Vision and Language"
  ☆530Updated last year
• jackroos / VL-BERT
  Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".
  ☆741Updated last year
• microsoft / Oscar
  Oscar and VinVL
  ☆1,042Updated last year
• jayleicn / ClipBERT
  [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…
  ☆713Updated last year
• LuoweiZhou / VLP
  Vision-Language Pre-training for Image Captioning and Question Answering
  ☆417Updated 3 years ago
• airsplay / py-bottom-up-attention
  PyTorch bottom-up attention with Detectron2
  ☆231Updated 3 years ago
• MILVLG / bottom-up-attention.pytorch
  A PyTorch reimplementation of bottom-up-attention models
  ☆296Updated 2 years ago
• MILVLG / mcan-vqa
  Deep Modular Co-Attention Networks for Visual Question Answering
  ☆448Updated 4 years ago
• forence / Awesome-Visual-Captioning
  This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP
  ☆413Updated 2 years ago
• facebookresearch / mmbt
  Supervised Multimodal Bitransformers for Classifying Images and Text
  ☆249Updated 3 years ago
• MILVLG / openvqa
  A lightweight, scalable, and general framework for visual question answering research
  ☆321Updated 3 years ago
• pzzhang / VinVL
  project page for VinVL
  ☆351Updated last year
• yuewang-cuhk / awesome-vision-language-pretraining-papers
  Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
  ☆1,149Updated 2 years ago
• Cadene / block.bootstrap.pytorch
  BLOCK (AAAI 2019), with a multimodal fusion library for deep learning models
  ☆349Updated 5 years ago
• google-research-datasets / conceptual-captions
  Conceptual Captions is a dataset containing (image-URL, caption) pairs designed for the training and evaluation of machine learned image …
  ☆528Updated 3 years ago
• facebookresearch / grid-feats-vqa
  Grid features pre-training code for visual question answering
  ☆268Updated 3 years ago
• kdexd / virtex
  [CVPR 2021] VirTex: Learning Visual Representations from Textual Annotations
  ☆559Updated last year
• clip-vil / CLIP-ViL
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆410Updated 2 years ago
• dandelin / ViLT
  Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"
  ☆1,427Updated 10 months ago
• shilrley6 / Faster-R-CNN-with-model-pretrained-on-Visual-Genome
  Faster RCNN model in Pytorch version, pretrained on the Visual Genome with ResNet 101
  ☆234Updated 2 years ago
• yikuan8 / Transformers-VQA
  An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER
  ☆163Updated 2 years ago
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆367Updated 2 years ago
• microsoft / scene_graph_benchmark
  image scene graph generation benchmark
  ☆394Updated 2 years ago
• jokieleung / awesome-visual-question-answering
  A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Common…
  ☆659Updated last year
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆367Updated last year
• aimagelab / meshed-memory-transformer
  Meshed-Memory Transformer for Image Captioning. CVPR 2020
  ☆524Updated 2 years ago
• peteanderson80 / bottom-up-attention
  Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome
  ☆1,442Updated 2 years ago