jsoft88 / cptr-vision-transformerLinks
Implementation of the CPTR model by https://arxiv.org/pdf/2101.10804.pdf
☆10Updated 3 years ago
Alternatives and similar repositories for cptr-vision-transformer
Users that are interested in cptr-vision-transformer are comparing it to the libraries listed below
Sorting:
- Pytorch implementation of image captioning using transformer-based model.☆68Updated 2 years ago
- Implemented 3 different architectures to tackle the Image Caption problem, i.e, Merged Encoder-Decoder - Bahdanau Attention - Transformer…☆40Updated 4 years ago
- Transformer-based image captioning extension for pytorch/fairseq☆317Updated 5 years ago
- Image Captioning Using Transformer☆271Updated 3 years ago
- Using LSTM or Transformer to solve Image Captioning in Pytorch☆79Updated 4 years ago
- Transformer & CNN Image Captioning model in PyTorch.☆44Updated 2 years ago
- Implementation of the paper CPTR : FULL TRANSFORMER NETWORK FOR IMAGE CAPTIONING☆31Updated 3 years ago
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 4 years ago
- Meshed-Memory Transformer for Image Captioning. CVPR 2020☆540Updated 3 years ago
- Baseline model for multimodal classification based on images and text. Text representation obtained from pretrained BERT base model and i…☆42Updated 3 years ago
- An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER☆165Updated 3 years ago
- Hyperparameter analysis for Image Captioning using LSTMs and Transformers☆26Updated 2 years ago
- Image captioning with Transformer☆14Updated 4 years ago
- BERT + Image Captioning☆135Updated 4 years ago
- A paper list of image captioning.☆22Updated 3 years ago
- Early solution for Google AI4Code competition☆76Updated 3 years ago
- Pytorch VQA : Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf)☆98Updated 2 years ago
- Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic☆280Updated 3 years ago
- Repository containing code from team Kingsterdam for the Hateful Memes Challenge☆22Updated 3 years ago
- PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)☆246Updated 6 months ago
- PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)☆374Updated 2 years ago
- Simple implementation of OpenAI CLIP model in PyTorch.☆716Updated 2 months ago
- A PyTorch Lightning solution to training OpenAI's CLIP from scratch.☆717Updated 3 years ago
- Vision-Language Pre-training for Image Captioning and Question Answering☆424Updated 3 years ago
- https://www.nlp.ecei.tohoku.ac.jp/projects/aio/☆16Updated 3 years ago
- Image Captioning through Image Transformer☆40Updated 4 years ago
- CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)☆202Updated last year
- ☆67Updated 2 years ago
- Facebook hateful memes challenge using multi-modal learning. More info about it here: https://ai.facebook.com/blog/hateful-memes-challeng…☆15Updated 3 years ago
- SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION☆36Updated 3 years ago