gchochla / VAuLT
This repo contains the original implementation of VAuLT, the Vision-and-Augmented-Language Transformer. We provide instructions to download some multimodal social-media datasets, and scripts to experiment with. VAuLT is a stack of Transformers, a LM like BERT that preprocesses the text input of ViLT
☆17Updated last month
Alternatives and similar repositories for VAuLT:
Users that are interested in VAuLT are comparing it to the libraries listed below
- ☆118Updated last year
- [COLING 2022] Learning from Adjective-Noun Pairs: A Knowledge-enhanced Framework for Target-Oriented Multimodal Sentiment Classification☆13Updated last year
- MultiSentiNet-CIKM2017☆21Updated 7 years ago
- Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"☆80Updated 5 years ago
- ☆34Updated 3 years ago
- ☆20Updated 2 years ago
- [ACM MM 2021 Oral] Exploiting BERT For Multimodal Target Sentiment Classification Through Input Space Translation"☆39Updated 3 years ago
- ☆75Updated 2 years ago
- [ACL 2022] The source code of Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network☆36Updated 2 years ago
- ACM MM '22: Unified Multi-modal Pre-training for Few-shot Sentiment Analysis with Prompt-based Learning☆14Updated 2 years ago
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆76Updated 2 years ago
- Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning☆34Updated 9 months ago
- It is the implementation of paper "Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model"☆15Updated last year
- [SemEval-2024 Task 3] Multimodal Emotion Cause Analysis in Conversations☆21Updated 4 months ago
- Resource and Code for ICME 2021 paper "MNRE: A Challenge Multimodal Dataset for Neural Relation Extraction with Visual Evidence in Social…☆54Updated 3 years ago
- ☆16Updated last year
- Multi-modal Graph Fusion for Named Entity Recognition with Targeted Visual Guidance☆67Updated 5 months ago
- ☆20Updated last year
- Preprocessed Datasets for our Multimodal NER paper☆115Updated 2 years ago
- Codes for AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis☆40Updated last year
- Text-Image Relationships (ACL 2019)☆21Updated last year
- The code implementation of "M2DF: Multi-grained Multi-curriculum Denoising Framework for Multimodal Aspect-based Sentiment Analysis"☆15Updated last year
- [IEEE TAFFC 2022] Multimodal Emotion-Cause Pair Extraction in Conversations☆36Updated last week
- [NAACL 2022 Findings] Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extrac…☆109Updated 2 weeks ago
- This is code for Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Taggin…☆56Updated last year
- ICME 2022: Few-shot Multi-modal Sentiment Analysis with Prompt-based Vision-aware Language Modeling☆13Updated 2 years ago
- ☆168Updated 5 years ago
- Code for ACM MM 2021 Paper "Multimodal Relation Extraction with Efficient Graph Alignment".☆95Updated 2 years ago
- Code for Paper "SWAFN: Sentimental Words Aware Fusion Network for Multimodal Sentiment Analysis", COLING2020☆12Updated last year
- Cross-media Structured Common Space for Multimedia Event Extraction (ACL2020)☆71Updated last year