siddsriv / Image-captioningLinks
Using a CNN-LSTM hybrid network to generate captions for images
☆18Updated 5 years ago
Alternatives and similar repositories for Image-captioning
Users that are interested in Image-captioning are comparing it to the libraries listed below
Sorting:
- Implemented 3 different architectures to tackle the Image Caption problem, i.e, Merged Encoder-Decoder - Bahdanau Attention - Transformer…☆40Updated 4 years ago
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 4 years ago
- Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…☆20Updated 5 years ago
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆97Updated last year
- Visual Question Answering in PyTorch with various Attention Models☆20Updated 5 years ago
- Attention Based Multi-modal Emotion Recognition; Stanford Emotional Narratives Dataset☆17Updated 6 years ago
- ☆63Updated 4 years ago
- Contains additional materials for two keras.io blog posts.☆17Updated 4 years ago
- Humor Knowledge Enriched Transformer☆30Updated 3 years ago
- BERT + Image Captioning☆134Updated 4 years ago
- This repository shows how to implement a basic model for multimodal entailment.☆10Updated 4 years ago
- A Bert2Bert model which able to generate headlines!☆12Updated 4 years ago
- ☆66Updated 2 years ago
- Repo has PyTorch implementation "Attention is All you Need - Transformers" paper for Machine Translation from French queries to English.☆70Updated 5 years ago
- [TMLR 2022] High-Modality Multimodal Transformer☆117Updated 10 months ago
- Labeled Movie Trailer Dataset☆16Updated 7 years ago
- Image Captioning Using Transformer☆271Updated 3 years ago
- ☆17Updated 3 years ago
- A PyTorch implementation of the paper Show, Attend and Tell: Neural Image Caption Generation with Visual Attention☆84Updated 5 years ago
- Exploring multimodal fusion-type transformer models for visual question answering (on DAQUAR dataset)☆36Updated 3 years ago
- Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.☆73Updated 4 years ago
- PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)☆126Updated 2 years ago
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆52Updated 3 years ago
- Code repo for the EMOTIC dataset☆126Updated 4 months ago
- CNN+LSTM, Attention based, and MUTAN-based models for Visual Question Answering☆76Updated 5 years ago
- 12-in-1: Multi-Task Vision and Language Representation Learning Web Demo☆35Updated 2 years ago
- Easiest way of fine-tuning HuggingFace video classification models☆145Updated 2 years ago
- ☆22Updated last year
- This repository presents UR-FUNNY dataset: first dataset for multimodal humor detection☆146Updated 4 years ago
- Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification☆135Updated 4 years ago