Alternatives and similar repositories for VILLA

Users that are interested in VILLA are comparing it to the libraries listed below

• zhegan27 / LXMERT-AdvTrain

  View on GitHub
  Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…
  ☆21Oct 20, 2020Updated 5 years ago
• ChenRocks / UNITER

  View on GitHub
  Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
  ☆800Jun 30, 2021Updated 4 years ago
• princetonvisualai / SPICE-U

  View on GitHub
  ☆11Sep 7, 2020Updated 5 years ago
• airsplay / lxmert

  View on GitHub
  PyTorch code for EMNLP 2019 paper "LXMERT: Learning Cross-Modality Encoder Representations from Transformers".
  ☆966Oct 22, 2022Updated 3 years ago
• intersun / LightningDOT

  View on GitHub
  source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
  ☆72Nov 14, 2022Updated 3 years ago
• facebookresearch / grid-feats-vqa

  View on GitHub
  Grid features pre-training code for visual question answering
  ☆269Sep 17, 2021Updated 4 years ago
• uclanlp / visualbert

  View on GitHub
  Code for the paper "VisualBERT: A Simple and Performant Baseline for Vision and Language"
  ☆540May 1, 2023Updated 2 years ago
• zmykevin / UC2

  View on GitHub
  CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training
  ☆34Nov 9, 2021Updated 4 years ago
• researchmm / soho

  View on GitHub
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆208Sep 30, 2022Updated 3 years ago
• ChenRocks / BUTD-UNITER-NLVR2

  View on GitHub
  Support extracting BUTD features for NLVR2 images.
  ☆18Sep 5, 2020Updated 5 years ago
• e-bug / volta

  View on GitHub
  [TACL 2021] Code and data for the framework in "Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-La…
  ☆114Mar 24, 2022Updated 3 years ago
• jackroos / VL-BERT

  View on GitHub
  Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".
  ☆746May 22, 2023Updated 2 years ago
• linjieli222 / HERO

  View on GitHub
  Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"
  ☆236Sep 16, 2021Updated 4 years ago
• ronghanghu / moco_v3_tpu

  View on GitHub
  ☆16Apr 10, 2022Updated 3 years ago
• LuoweiZhou / VLP

  View on GitHub
  Vision-Language Pre-training for Image Captioning and Question Answering
  ☆423Jan 18, 2022Updated 4 years ago
• facebookresearch / vilbert-multi-task

  View on GitHub
  Multi Task Vision and Language
  ☆825Feb 16, 2022Updated 4 years ago
• microsoft / Oscar

  View on GitHub
  Oscar and VinVL
  ☆1,052Aug 28, 2023Updated 2 years ago
• salesforce / VD-BERT

  View on GitHub
  ☆44Jun 16, 2025Updated 8 months ago
• zinengtang / VidLanKD

  View on GitHub
  Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))
  ☆56Feb 6, 2023Updated 3 years ago
• airsplay / vokenization

  View on GitHub
  PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"
  ☆192Mar 8, 2021Updated 4 years ago
• zaynmi / seada-vqa

  View on GitHub
  A pytorch implemetation of data augmentation method for visual question answering
  ☆21May 25, 2023Updated 2 years ago
• ShiYaya / emscore

  View on GitHub
  Research code for CVPR 2022 paper: "EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching"
  ☆26Oct 20, 2022Updated 3 years ago
• jayleicn / TVCaption

  View on GitHub
  [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset
  ☆90Sep 6, 2023Updated 2 years ago
• Deanplayerljx / tab-vcr

  View on GitHub
  Pytorch implementation for our NeurIPS 2019 paper "TAB-VCR: Tags and Attributes based VCR Baselines" https://arxiv.org/abs/1910.14671
  ☆18May 6, 2021Updated 4 years ago
• pzzhang / VinVL

  View on GitHub
  project page for VinVL
  ☆359Jul 26, 2023Updated 2 years ago
• bearcatt / LaBERT

  View on GitHub
  A length-controllable and non-autoregressive image captioning model.
  ☆69Jun 10, 2021Updated 4 years ago
• google-research-datasets / conceptual-12m

  View on GitHub
  Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
  ☆415Jul 14, 2025Updated 7 months ago
• j-min / VL-T5

  View on GitHub
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆374Jul 29, 2023Updated 2 years ago
• airsplay / vimpac

  View on GitHub
  ☆73Jun 3, 2022Updated 3 years ago
• BigRedT / info-ground

  View on GitHub
  Learning phrase grounding from captioned images through InfoNCE bound on mutual information
  ☆74Aug 22, 2020Updated 5 years ago
• medhini / clip_it

  View on GitHub
  CLIP-It! Language-Guided Video Summarization
  ☆75Jun 21, 2021Updated 4 years ago
• YiwuZhong / Sub-GC

  View on GitHub
  [ECCV 2020] Official code for "Comprehensive Image Captioning via Scene Graph Decomposition"
  ☆99Aug 20, 2024Updated last year
• UKPLab / MMT-Retrieval

  View on GitHub
  ☆131Dec 10, 2022Updated 3 years ago
• lil-lab / vgnsl_analysis

  View on GitHub
  "What is Learned in Visually Grounded Neural Syntax Acquisition", Noriyuki Kojima, Hadar Averbuch-Elor, Alexander Rush and Yoav Artzi (AC…
  ☆12Dec 30, 2021Updated 4 years ago
• wenhuchen / Meta-Module-Network

  View on GitHub
  Code for WACV 2021 Paper "Meta Module Network for Compositional Visual Reasoning"
  ☆43May 13, 2021Updated 4 years ago
• gsig / visual-grounding

  View on GitHub
  Project page for "Visual Grounding in Video for Unsupervised Word Translation" CVPR 2020
  ☆43Apr 26, 2020Updated 5 years ago
• jayleicn / ClipBERT

  View on GitHub
  [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…
  ☆723Aug 8, 2023Updated 2 years ago
• kdexd / virtex

  View on GitHub
  [CVPR 2021] VirTex: Learning Visual Representations from Textual Annotations
  ☆565Aug 22, 2025Updated 5 months ago
• facebookresearch / binary-image-selection

  View on GitHub
  BISON: Binary Image SelectiON
  ☆49Sep 15, 2021Updated 4 years ago