Cloud-CV / vilbert-multi-task
12-in-1: Multi-Task Vision and Language Representation Learning Web Demo
☆35Updated last year
Related projects ⓘ
Alternatives and complementary repositories for vilbert-multi-task
- CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations☆25Updated last year
- Pre-trained V+L Data Preparation☆45Updated 4 years ago
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"☆79Updated 2 years ago
- A collection of models for image<->text generation in ACM MM 2021.☆66Updated 3 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆44Updated 4 years ago
- PyTorch code for EMNLP 2020 paper "X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers"☆50Updated 3 years ago
- A unified framework to jointly model images, text, and human attention traces.☆78Updated 3 years ago
- Connective Cognition Network for Directional Visual Commonsense Reasoning☆15Updated 3 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…☆21Updated 4 years ago
- A length-controllable and non-autoregressive image captioning model.☆66Updated 3 years ago
- Data Release for VALUE Benchmark☆31Updated 2 years ago
- ☆44Updated 2 years ago
- ☆44Updated 3 years ago
- Localized Narratives☆83Updated 3 years ago
- Transfer Learning via Unsupervised Task Discovery for Visual Question Answering☆32Updated 5 years ago
- Code for the model "Heterogeneous Graph Learning for Visual Commonsense Reasoning (NeurlPS 2019)"☆46Updated 4 years ago
- PyTorch Implementation for the paper "C3VQG: Category Consistent Cyclic Visual Question Generation" (ACM MM Asia'20).☆16Updated last year
- Pytorch implementation of https://arxiv.org/pdf/1909.10470.pdf☆32Updated 3 years ago
- ☆51Updated 2 years ago
- [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)☆57Updated 3 years ago
- 🥶Vilio: State-of-the-art VL models in PyTorch & PaddlePaddle☆89Updated last year
- ☆21Updated 11 months ago
- ☆30Updated 3 years ago
- ☆25Updated 3 years ago
- A dataset of crowdsourced ratings for machine-generated image captions☆33Updated 5 years ago
- A one-stop shop for YouCook2 info such as leaderboard and recent advances on (cooking) video retrieval and captioning.☆38Updated 2 years ago
- Visual Storytelling with Cross-Modal Rules☆7Updated 4 years ago
- MLPs for Vision and Langauge Modeling (Coming Soon)☆27Updated 2 years ago
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 3 years ago
- source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT☆73Updated 2 years ago