gchochla / VAuLT
This repo contains the original implementation of VAuLT, the Vision-and-Augmented-Language Transformer. We provide instructions to download some multimodal social-media datasets, and scripts to experiment with. VAuLT is a stack of Transformers, a LM like BERT that preprocesses the text input of ViLT
☆17Updated last month
Alternatives and similar repositories for VAuLT:
Users that are interested in VAuLT are comparing it to the libraries listed below
- ☆118Updated last year
- ACM MM '22: Unified Multi-modal Pre-training for Few-shot Sentiment Analysis with Prompt-based Learning☆15Updated 2 years ago
- Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"☆80Updated 5 years ago
- [ACM MM 2021 Oral] Exploiting BERT For Multimodal Target Sentiment Classification Through Input Space Translation"☆39Updated 3 years ago
- [COLING 2022] Learning from Adjective-Noun Pairs: A Knowledge-enhanced Framework for Target-Oriented Multimodal Sentiment Classification☆13Updated last year
- ☆20Updated 2 years ago
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆75Updated 2 years ago
- ☆34Updated 3 years ago
- Text-Image Relationships (ACL 2019)☆21Updated last year
- ICME 2022: Few-shot Multi-modal Sentiment Analysis with Prompt-based Vision-aware Language Modeling☆13Updated 2 years ago
- It is the implementation of paper "Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model"☆15Updated last year
- Multi-modal Graph Fusion for Named Entity Recognition with Targeted Visual Guidance☆67Updated 5 months ago
- Preprocessed Datasets for our Multimodal NER paper☆115Updated 2 years ago
- [SemEval-2024 Task 3] Multimodal Emotion Cause Analysis in Conversations☆21Updated 4 months ago
- ☆76Updated 2 years ago
- Multi-Interactive Memory Network for Aspect Based Multimodal Sentiment Analysis - AAAI 2019☆97Updated 4 years ago
- The code implementation of "M2DF: Multi-grained Multi-curriculum Denoising Framework for Multimodal Aspect-based Sentiment Analysis"☆15Updated last year
- [NAACL 2022 Findings] Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extrac…☆109Updated 2 weeks ago
- MultiSentiNet-CIKM2017☆21Updated 7 years ago
- ☆20Updated last year
- [ACL 2022] The source code of Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network☆36Updated 2 years ago
- Codes for AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis☆40Updated last year
- ☆16Updated last year
- Cross-media Structured Common Space for Multimedia Event Extraction (ACL2020)☆71Updated last year
- [IEEE TAFFC 2022] Multimodal Emotion-Cause Pair Extraction in Conversations☆36Updated 2 weeks ago
- Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning☆34Updated 9 months ago
- This is code for Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Taggin…☆56Updated last year
- ☆22Updated last year
- ☆168Updated 5 years ago
- A Few-Shot Learning based Approach to Multimodal Social Relation Extraction☆13Updated 2 years ago