Vision-Language Pre-training for Image Captioning and Question Answering
☆423Jan 18, 2022Updated 4 years ago
Alternatives and similar repositories for VLP
Users that are interested in VLP are comparing it to the libraries listed below
Sorting:
- Oscar and VinVL☆1,052Aug 28, 2023Updated 2 years ago
- Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".☆746May 22, 2023Updated 2 years ago
- Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"☆801Jun 30, 2021Updated 4 years ago
- PyTorch code for EMNLP 2019 paper "LXMERT: Learning Cross-Modality Encoder Representations from Transformers".☆966Oct 22, 2022Updated 3 years ago
- Code for paper "Attention on Attention for Image Captioning". ICCV 2019☆339May 2, 2021Updated 4 years ago
- Grid features pre-training code for visual question answering☆269Sep 17, 2021Updated 4 years ago
- Recent Advances in Vision and Language PreTrained Models (VL-PTMs)☆1,155Aug 19, 2022Updated 3 years ago
- project page for VinVL☆359Jul 26, 2023Updated 2 years ago
- Meshed-Memory Transformer for Image Captioning. CVPR 2020☆544Dec 21, 2022Updated 3 years ago
- ☆218Feb 26, 2022Updated 4 years ago
- ☆478Nov 21, 2022Updated 3 years ago
- A length-controllable and non-autoregressive image captioning model.☆69Jun 10, 2021Updated 4 years ago
- Code accompanying the paper "Say As You Wish: Fine-grained Control of Image Caption Generation with Abstract Scene Graphs" (Chen et al., …☆200Dec 1, 2022Updated 3 years ago
- Implementation of 'X-Linear Attention Networks for Image Captioning' [CVPR 2020]☆273Jul 27, 2021Updated 4 years ago
- Code for the paper "VisualBERT: A Simple and Performant Baseline for Vision and Language"☆540May 1, 2023Updated 2 years ago
- Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning. and others.☆1,007Oct 5, 2023Updated 2 years ago
- Show, Control and Tell: A Framework for Generating Controllable and Grounded Captions. CVPR 2019☆282Dec 21, 2022Updated 3 years ago
- Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020☆81Jul 17, 2020Updated 5 years ago
- ☆64Jan 5, 2022Updated 4 years ago
- Implementation of the Object Relation Transformer for Image Captioning☆180Sep 17, 2024Updated last year
- A curated list of image captioning and related area resources. :-)☆1,074Mar 28, 2023Updated 2 years ago
- Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome☆1,466Feb 3, 2023Updated 3 years ago
- Code for Unsupervised Image Captioning☆221Mar 24, 2023Updated 2 years ago
- Multi Task Vision and Language☆825Feb 16, 2022Updated 4 years ago
- Transformer-based image captioning extension for pytorch/fairseq☆318Dec 18, 2020Updated 5 years ago
- Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）☆65Oct 19, 2020Updated 5 years ago
- PyTorch code for: Learning to Generate Grounded Visual Captions without Localization Supervision☆46Jul 29, 2020Updated 5 years ago
- Code for paper "Adaptively Aligned Image Captioning via Adaptive Attention Time". NeurIPS 2019☆51Dec 18, 2019Updated 6 years ago
- [CVPR 2021] VirTex: Learning Visual Representations from Textual Annotations☆565Aug 22, 2025Updated 6 months ago
- Pytorch code of for our CVPR 2018 paper "Neural Baby Talk"☆525Mar 27, 2019Updated 6 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…☆119Jan 13, 2021Updated 5 years ago
- Automatic image captioning model based on Caffe, using features from bottom-up attention.☆249Feb 3, 2023Updated 3 years ago
- PyTorch bottom-up attention with Detectron2☆239Jan 4, 2022Updated 4 years ago
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning☆93Apr 19, 2024Updated last year
- Video Grounding and Captioning☆332Oct 12, 2021Updated 4 years ago
- [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning☆208Sep 30, 2022Updated 3 years ago
- I decide to sync up this repo and self-critical.pytorch. (The old master is in old master branch for archive)☆1,481Oct 5, 2023Updated 2 years ago
- ☆54Dec 13, 2019Updated 6 years ago
- A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)☆5,618Jan 12, 2026Updated last month