zarzouram / image_captioning_with_transformers
Pytorch implementation of image captioning using transformer-based model.
☆61Updated last year
Related projects ⓘ
Alternatives and complementary repositories for image_captioning_with_transformers
- Using LSTM or Transformer to solve Image Captioning in Pytorch☆75Updated 3 years ago
- Implementation of the paper CPTR : FULL TRANSFORMER NETWORK FOR IMAGE CAPTIONING☆27Updated 2 years ago
- GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)☆185Updated last year
- Implementation code of the work "Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning"☆84Updated 6 months ago
- Implementation of 'End-to-End Transformer Based Model for Image Captioning' [AAAI 2022]☆67Updated 5 months ago
- Image Captioning Using Transformer☆256Updated 2 years ago
- Hyperparameter analysis for Image Captioning using LSTMs and Transformers☆27Updated last year
- Implementation of the CPTR model by https://arxiv.org/pdf/2101.10804.pdf☆10Updated 2 years ago
- Transformer & CNN Image Captioning model in PyTorch.☆42Updated last year
- A paper list of image captioning.☆22Updated 2 years ago
- Image Captioning using CNN and Transformer.☆49Updated 3 years ago
- CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)☆186Updated 9 months ago
- Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for …☆60Updated 2 years ago
- Implementation for CVPR 2022 paper " Injecting Semantic Concepts into End-to-End Image Captionin".☆41Updated 2 years ago
- SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation☆95Updated 9 months ago
- Image captioning with Transformer☆15Updated 3 years ago
- An easy to use, user-friendly and efficient code for extracting OpenAI CLIP (Global/Grid) features from image and text respectively.☆111Updated 2 years ago
- A curated list of Multimodal Captioning related research(including image captioning, video captioning, and text captioning)☆108Updated 2 years ago
- Image Captioning through Image Transformer☆40Updated 3 years ago
- [AAAI 2023 Oral] VLTinT: Visual-Linguistic Transformer-in-Transformer for Coherent Video Paragraph Captioning☆64Updated 9 months ago
- End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)☆208Updated 10 months ago
- CaMEL: Mean Teacher Learning for Image Captioning. ICPR 2022☆29Updated last year
- Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)☆119Updated last year
- Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"☆237Updated 2 years ago
- Image Captioning Vision Transformers (ViTs) are transformer models that generate descriptive captions for images by combining the power o…☆27Updated last month
- [CVPR2022] Official code for Hierarchical Modular Network for Video Captioning. Our proposed HMN is implemented with PyTorch.☆52Updated 2 years ago
- natual language guided image captioning☆77Updated 9 months ago
- Official pytorch implementation of paper "Dual-Level Collaborative Transformer for Image Captioning" (AAAI 2021).☆195Updated 2 years ago
- Implemented 3 different architectures to tackle the Image Caption problem, i.e, Merged Encoder-Decoder - Bahdanau Attention - Transformer…☆41Updated 3 years ago
- Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Pe…☆116Updated last year