Cloud-CV / vilbert-multi-task
12-in-1: Multi-Task Vision and Language Representation Learning Web Demo
☆35Updated 2 years ago
Alternatives and similar repositories for vilbert-multi-task:
Users that are interested in vilbert-multi-task are comparing it to the libraries listed below
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…☆21Updated 4 years ago
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"☆81Updated 2 years ago
- PyTorch code for EMNLP 2020 paper "X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers"☆50Updated 3 years ago
- A collection of models for image<->text generation in ACM MM 2021.☆66Updated 3 years ago
- ☆15Updated 5 years ago
- Pre-trained V+L Data Preparation☆45Updated 4 years ago
- A unified framework to jointly model images, text, and human attention traces.☆78Updated 3 years ago
- ☆44Updated 2 years ago
- ☆53Updated 3 years ago
- Audio Visual Scene-Aware Dialog (AVSD) Challenge at the 10th Dialog System Technology Challenge (DSTC)☆27Updated 2 years ago
- A dataset of crowdsourced ratings for machine-generated image captions☆35Updated 5 years ago
- Code of Dense Relational Captioning☆68Updated last year
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…☆119Updated 4 years ago
- ☆44Updated 3 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆45Updated 4 years ago
- A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering☆40Updated 4 years ago
- Transfer Learning via Unsupervised Task Discovery for Visual Question Answering☆31Updated 5 years ago
- Connective Cognition Network for Directional Visual Commonsense Reasoning☆15Updated 3 years ago
- Implementation of "MULE: Multimodal Universal Language Embedding"☆16Updated 5 years ago
- Code for the model "Heterogeneous Graph Learning for Visual Commonsense Reasoning (NeurlPS 2019)"☆46Updated 4 years ago
- Pytorch implementation of https://arxiv.org/pdf/1909.10470.pdf☆32Updated 3 years ago
- PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)☆33Updated last year
- ☆26Updated 3 years ago
- A simple but well-performing "single-hop" visual attention model for the GQA dataset☆20Updated 5 years ago
- Cross-modal Coherence Modeling for Caption Generation☆11Updated 4 years ago
- Official code for the paper "Contrast and Classify: Training Robust VQA Models" published at ICCV, 2021☆19Updated 3 years ago
- Localized Narratives☆82Updated 3 years ago
- ☆24Updated 3 years ago
- Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…☆34Updated 4 years ago
- Data Release for VALUE Benchmark☆31Updated 2 years ago