allenai / x-lxmert
PyTorch code for EMNLP 2020 paper "X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers"
☆50Updated 3 years ago
Related projects: ⓘ
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Updated last year
- Github repository for Plot and Rework: Modeling Storylines for Visual Storytelling (ACL-IJCNLP2021 Findings)☆20Updated 2 years ago
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning☆89Updated 5 months ago
- ☆45Updated last year
- Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO☆49Updated 4 years ago
- [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction☆47Updated 2 years ago
- PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)☆32Updated last year
- The code and output of our AAAI paper "Knowledge-Enriched Visual Storytelling"☆40Updated 3 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…☆21Updated 3 years ago
- A length-controllable and non-autoregressive image captioning model.☆66Updated 3 years ago
- A collection of models for image<->text generation in ACM MM 2021.☆64Updated 2 years ago
- ☆15Updated 5 years ago
- Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)☆17Updated last year
- Codes of AAAI 2020 paper "What Makes A Good Story? Designing Composite Rewards for Visual Storytelling"☆26Updated 3 years ago
- Code and data for the project "Visually grounded continual learning of compositional semantics"☆21Updated last year
- Multi-sense word embeddings from visual co-occurrences☆25Updated 5 years ago
- Official code repository for the EMNLP 2021 paper☆26Updated 2 years ago
- Pre-trained V+L Data Preparation☆45Updated 4 years ago
- ☆19Updated this week
- Code for "On diversity in image captioning: metrics and methods".☆8Updated 4 years ago
- MLPs for Vision and Langauge Modeling (Coming Soon)☆27Updated 2 years ago
- ☆24Updated 3 years ago
- Data Release for VALUE Benchmark☆32Updated 2 years ago
- Code for WACV 2021 Paper "Meta Module Network for Compositional Visual Reasoning"☆43Updated 3 years ago
- [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)☆57Updated 3 years ago
- Diverse Image Captioning with Context-Object Split Latent Spaces (NeurIPS 2020)☆37Updated 2 years ago
- This is the repo for Multi-level textual grounding☆33Updated 4 years ago
- ☆11Updated last year
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆44Updated 4 years ago
- ☆25Updated 3 years ago