Alternatives and similar repositories for vilbert-multi-task

Users that are interested in vilbert-multi-task are comparing it to the libraries listed below

• multimodal / multimodal
  A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"
  ☆83Updated 3 years ago
• Muennighoff / vilio
  🥶Vilio: State-of-the-art VL models in PyTorch & PaddlePaddle
  ☆90Updated 2 years ago
• facebookresearch / connect-caption-and-trace
  A unified framework to jointly model images, text, and human attention traces.
  ☆79Updated 4 years ago
• salesforce / VD-BERT
  ☆45Updated 3 months ago
• allenai / x-lxmert
  PyTorch code for EMNLP 2020 paper "X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers"
  ☆50Updated 4 years ago
• zhegan27 / LXMERT-AdvTrain
  Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…
  ☆21Updated 4 years ago
• VisionLearningGroup / MULE
  Implementation of "MULE: Multimodal Universal Language Embedding"
  ☆16Updated 5 years ago
• lichengunc / pretrain-vl-data
  Pre-trained V+L Data Preparation
  ☆46Updated 5 years ago
• zhegan27 / VILLA
  Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…
  ☆119Updated 4 years ago
• google-research-datasets / Image-Caption-Quality-Dataset
  A dataset of crowdsourced ratings for machine-generated image captions
  ☆36Updated 6 years ago
• researchmm / generate-it
  A collection of models for image<->text generation in ACM MM 2021.
  ☆67Updated 3 years ago
• Dong-JinKim / DenseRelationalCaptioning
  Code of Dense Relational Captioning
  ☆69Updated 2 years ago
• hassanhub / MultiGrounding
  This is the repo for Multi-level textual grounding
  ☆34Updated 5 years ago
• berniebear / Multi-HT100M
  ☆53Updated 3 years ago
• mesnico / TERN
  Code and Resources for the Transformer Encoder Reasoning Network (TERN) - https://arxiv.org/abs/2004.09144
  ☆58Updated last year
• jamespark3922 / lsmdc-baseline
  ☆15Updated 6 years ago
• satwikkottur / clevr-dialog
  Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog
  ☆49Updated 5 years ago
• jacobswan1 / Video2Commonsense
  Video captioning baseline models on Video2Commonsense Dataset.
  ☆57Updated 4 years ago
• bearcatt / LaBERT
  A length-controllable and non-autoregressive image captioning model.
  ☆68Updated 4 years ago
• alasdairtran / transform-and-tell
  [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning
  ☆92Updated last year
• airsplay / vokenization
  PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"
  ☆190Updated 4 years ago
• allenai / swig
  Situation With Groundings (SWiG) dataset and Joint Situation Localizer (JSL)
  ☆68Updated 4 years ago
• fawazsammani / show-edit-tell
  Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020
  ☆81Updated 5 years ago
• HimariO / HatefulMemesChallenge
  ☆93Updated 2 years ago
• intersun / LightningDOT
  source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
  ☆72Updated 2 years ago
• malihealikhani / Cross-modal_Coherence_Modeling
  Cross-modal Coherence Modeling for Caption Generation
  ☆11Updated 5 years ago
• google / localized-narratives
  Localized Narratives
  ☆85Updated 4 years ago
• yuweijiang / HGL-pytorch
  Code for the model "Heterogeneous Graph Learning for Visual Commonsense Reasoning (NeurlPS 2019)"
  ☆47Updated 5 years ago
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 4 years ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆224Updated 3 years ago