gchochla / VAuLT
This repo contains the original implementation of VAuLT, the Vision-and-Augmented-Language Transformer. We provide instructions to download some multimodal social-media datasets, and scripts to experiment with. VAuLT is a stack of Transformers, a LM like BERT that preprocesses the text input of ViLT
☆17Updated last month
Alternatives and similar repositories for VAuLT:
Users that are interested in VAuLT are comparing it to the libraries listed below
- ACM MM '22: Unified Multi-modal Pre-training for Few-shot Sentiment Analysis with Prompt-based Learning☆15Updated 2 years ago
- ☆20Updated 2 years ago
- [ACM MM 2021 Oral] Exploiting BERT For Multimodal Target Sentiment Classification Through Input Space Translation"☆39Updated 3 years ago
- ☆118Updated last year
- Multi-Interactive Memory Network for Aspect Based Multimodal Sentiment Analysis - AAAI 2019☆97Updated 4 years ago
- ☆76Updated 2 years ago
- Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"☆80Updated 5 years ago
- [ACL 2022] The source code of Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network☆36Updated 2 years ago
- [COLING 2022] Learning from Adjective-Noun Pairs: A Knowledge-enhanced Framework for Target-Oriented Multimodal Sentiment Classification☆13Updated last year
- Paper List for Multimodal Sentiment Analysis☆99Updated 4 years ago
- ☆34Updated 3 years ago
- ICME 2022: Few-shot Multi-modal Sentiment Analysis with Prompt-based Vision-aware Language Modeling☆13Updated 2 years ago
- The code implementation of "M2DF: Multi-grained Multi-curriculum Denoising Framework for Multimodal Aspect-based Sentiment Analysis"☆15Updated last year
- It is the implementation of paper "Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model"☆15Updated last year
- Text-Image Relationships (ACL 2019)☆21Updated last year
- Code for Paper "SWAFN: Sentimental Words Aware Fusion Network for Multimodal Sentiment Analysis", COLING2020☆12Updated last year
- ☆168Updated 5 years ago
- ☆29Updated last year
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆75Updated 2 years ago
- MultiSentiNet-CIKM2017☆21Updated 7 years ago
- Codes for AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis☆40Updated last year
- Preprocessed Datasets for our Multimodal NER paper☆115Updated 2 years ago
- ☆16Updated last year
- Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning☆34Updated 9 months ago
- ☆20Updated last year
- [NAACL 2022 Findings] Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extrac…☆109Updated 3 weeks ago
- ☆22Updated last year
- Multi-modal Graph Fusion for Named Entity Recognition with Targeted Visual Guidance☆66Updated 5 months ago
- ☆15Updated 4 years ago
- A Few-Shot Learning based Approach to Multimodal Social Relation Extraction☆13Updated 2 years ago