Cloud-CV / vilbert-multi-taskLinks
12-in-1: Multi-Task Vision and Language Representation Learning Web Demo
☆35Updated 3 years ago
Alternatives and similar repositories for vilbert-multi-task
Users that are interested in vilbert-multi-task are comparing it to the libraries listed below
Sorting:
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"☆84Updated 3 years ago
- 🥶Vilio: State-of-the-art VL models in PyTorch & PaddlePaddle☆91Updated 2 years ago
- A unified framework to jointly model images, text, and human attention traces.☆79Updated 4 years ago
- ☆44Updated 7 months ago
- A dataset of crowdsourced ratings for machine-generated image captions☆38Updated 6 years ago
- PyTorch code for EMNLP 2020 paper "X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers"☆50Updated 4 years ago
- A length-controllable and non-autoregressive image captioning model.☆68Updated 4 years ago
- ☆93Updated 3 years ago
- A collection of models for image<->text generation in ACM MM 2021.☆67Updated 4 years ago
- MERLOT: Multimodal Neural Script Knowledge Models☆225Updated 3 years ago
- PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"☆192Updated 4 years ago
- Cross-modal Coherence Modeling for Caption Generation☆11Updated 5 years ago
- Pre-trained V+L Data Preparation☆46Updated 5 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…☆119Updated 5 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…☆21Updated 5 years ago
- ☆53Updated 4 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆49Updated 5 years ago
- Code and Resources for the Transformer Encoder Reasoning Network (TERN) - https://arxiv.org/abs/2004.09144☆58Updated 2 years ago
- source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT☆72Updated 3 years ago
- Code of Dense Relational Captioning☆69Updated 2 years ago
- An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER☆165Updated 3 years ago
- Localized Narratives☆86Updated 4 years ago
- Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO☆54Updated 5 years ago
- Video captioning baseline models on Video2Commonsense Dataset.☆57Updated 4 years ago
- Code associated with the "Natural Language Rationales with Full-Stack Visual Reasoning" EMNLP Findings 2020 paper☆24Updated 5 years ago
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 4 years ago
- Official code for WACV 2021 paper - Compositional Learning of Image-Text Query for Image Retrieval☆56Updated 4 years ago
- Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"☆162Updated 5 years ago
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning☆93Updated last year
- 🥉 Codalab-Microsoft-COCO-Image-Captioning-Challenge 3rd place solution(06.30.21)☆23Updated 3 years ago