gchochla / VAuLT
This repo contains the original implementation of VAuLT, the Vision-and-Augmented-Language Transformer. We provide instructions to download some multimodal social-media datasets, and scripts to experiment with. VAuLT is a stack of Transformers, a LM like BERT that preprocesses the text input of ViLT
☆16Updated 4 months ago
Alternatives and similar repositories for VAuLT:
Users that are interested in VAuLT are comparing it to the libraries listed below
- ACM MM '22: Unified Multi-modal Pre-training for Few-shot Sentiment Analysis with Prompt-based Learning☆15Updated 2 years ago
- ☆19Updated 2 years ago
- [COLING 2022] Learning from Adjective-Noun Pairs: A Knowledge-enhanced Framework for Target-Oriented Multimodal Sentiment Classification☆13Updated last year
- ☆117Updated last year
- [ACM MM 2021 Oral] Exploiting BERT For Multimodal Target Sentiment Classification Through Input Space Translation"☆39Updated 3 years ago
- [SemEval-2024 Task 3] Multimodal Emotion Cause Analysis in Conversations☆22Updated 2 months ago
- [ACL 2022] The source code of Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network☆34Updated last year
- Text-Image Relationships (ACL 2019)☆20Updated last year
- Codes for AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis☆35Updated last year
- ICME 2022: Few-shot Multi-modal Sentiment Analysis with Prompt-based Vision-aware Language Modeling☆14Updated 2 years ago
- ☆35Updated 3 years ago
- Code for Paper "SWAFN: Sentimental Words Aware Fusion Network for Multimodal Sentiment Analysis", COLING2020☆12Updated last year
- [IEEE TAC 2022] Multimodal Emotion-Cause Pair Extraction in Conversations☆35Updated 2 months ago
- This repository hosts the code, data and model weight of PanoSent.☆18Updated 2 months ago
- Official implementation of Dynamic Routing Transformer Network for Multimodal Sarcasm Detection (ACL'23)☆34Updated last year
- Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"☆79Updated 4 years ago
- Official repository of the AAAI'2022 paper "Contrast and Generation Make BART a Good Dialogue Emotion Recognizer"☆48Updated 2 years ago
- NAACL 2022 paper on Analyzing Modality Robustness in Multimodal Sentiment Analysis☆31Updated last year
- ☆19Updated 9 months ago
- [COLING2022] A Multi-turn Machine Reading Comprehension Framework with Rethink Mechanism for Emotion-Cause Pair Extraction☆17Updated 2 years ago
- ☆22Updated 9 months ago
- The code implementation of "M2DF: Multi-grained Multi-curriculum Denoising Framework for Multimodal Aspect-based Sentiment Analysis"☆15Updated last year
- Multimodal Model for Memotion Dataset☆11Updated 3 years ago
- ☆73Updated 2 years ago
- The source code for "STAGE: Span Tagging and Greedy Inference Scheme for Aspect Sentiment Triplet Extraction".☆25Updated last year
- The code for "Past, Present, and Future: Conversational Emotion Recognition through Structural Modeling of Psychological Commonsense Know…☆21Updated 2 years ago
- [NAACL 2022 Findings] Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extrac…☆105Updated last year
- ☆16Updated last year
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆73Updated last year
- Multimodal Sentiment Detection Based on Multi-channel Graph Neural Networks☆37Updated 2 years ago