siddsriv / Image-captioning
Using a CNN-LSTM hybrid network to generate captions for images
☆17Updated 5 years ago
Alternatives and similar repositories for Image-captioning:
Users that are interested in Image-captioning are comparing it to the libraries listed below
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 3 years ago
- Pytorch implementation of image captioning using transformer-based model.☆62Updated last year
- Visual Question Answering in PyTorch with various Attention Models☆20Updated 4 years ago
- BERT + Image Captioning☆132Updated 4 years ago
- Implemented 3 different architectures to tackle the Image Caption problem, i.e, Merged Encoder-Decoder - Bahdanau Attention - Transformer…☆41Updated 4 years ago
- Code and dataset release for "PACS: A Dataset for Physical Audiovisual CommonSense Reasoning" (ECCV 2022)☆12Updated 2 years ago
- ☆12Updated last year
- Exploring multimodal fusion-type transformer models for visual question answering (on DAQUAR dataset)☆34Updated 3 years ago
- ☆22Updated last year
- Using LSTM or Transformer to solve Image Captioning in Pytorch☆76Updated 3 years ago
- Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…☆18Updated 4 years ago
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆50Updated 2 years ago
- VQA-Med 2020☆14Updated 2 years ago
- An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER☆163Updated 2 years ago
- Code release for ICCV 2021 paper "Anticipative Video Transformer"☆152Updated 3 years ago
- In-the-wild Question Answering☆15Updated last year
- Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)☆227Updated last year
- Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…☆47Updated 2 years ago
- Deep Learning model which uses Computer Vision and NLP to generate captions for images☆14Updated 4 years ago
- Used LSTM on Flickr dataset☆12Updated 6 years ago
- Video Captioning is an encoder decoder mode based on sequence to sequence learning☆134Updated 10 months ago
- ☆44Updated 3 years ago
- [TMM 2023] VideoXum: Cross-modal Visual and Textural Summarization of Videos☆41Updated 10 months ago
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"☆81Updated 3 years ago
- Sign Language Translation for Instructional Videos - CVPR WiCV 2023☆40Updated last year
- Public repo for the paper: "Modeling Intensification for Sign Language Generation: A Computational Approach" by Mert Inan*, Yang Zhong*, …☆13Updated 2 years ago
- NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)☆48Updated last year
- Code and dataset of "MEmoR: A Dataset for Multimodal Emotion Reasoning in Videos" in MM'20.☆53Updated last year
- Video Summarization With Spatiotemporal Vision Transformer☆19Updated last year
- A PyTorch implementation of the paper Show, Attend and Tell: Neural Image Caption Generation with Visual Attention☆82Updated 5 years ago