thuiar / OpenVNA
[ACL 2024 SDT] OpenVNA is an open-source framework designed for analyzing the behavior of multimodal language understanding systems under noisy conditions.
☆16Updated 7 months ago
Alternatives and similar repositories for OpenVNA:
Users that are interested in OpenVNA are comparing it to the libraries listed below
- A Tool for extracting multimodal features from videos.☆152Updated last year
- Multi-Modality Multi-Loss Fusion Network☆82Updated 6 months ago
- Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis☆84Updated 3 months ago
- ☆178Updated last year
- ☆59Updated last month
- M-SENA: All-in-One Platform for Multimodal Sentiment Analysis☆85Updated 2 years ago
- Tag-assisted Multimodal Sentiment Analysis under Uncertain Missing Modalities, in SIGIR2022☆29Updated last year
- Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module☆65Updated 2 years ago
- Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis (TAC 2023)☆57Updated 4 months ago
- [TMM2022] Source codes of CENet☆27Updated last year
- MultiEMO: An Attention-Based Correlation-Aware Multimodal Fusion Framework for Emotion Recognition in Conversations (ACL 2023)☆61Updated last year
- Codebase for EMNLP 2024 Findings Paper "Knowledge-Guided Dynamic Modality Attention Fusion Framework for Multimodal Sentiment Analysis"☆22Updated 2 months ago
- Data parser for the CMU-MultimodalSDK package including parsing for CMU-MOSEI, CMU-MOSI, and POM datasets☆29Updated 5 months ago
- This repository contains the official implementation code of the paper Transformer-based Feature Reconstruction Network for Robust Multim…☆33Updated last year
- ☆55Updated 6 months ago
- ☆14Updated 7 months ago
- ☆12Updated 5 months ago
- Code for MMLatch: Bottom-up Top-down Fusion for Multimodal Sentiment Analysis https://arxiv.org/abs/2201.09828 (to be presented in ICASSP…☆32Updated last year
- Pytorch implementation for codes in Noise Imitation Based Adversarial Training for Robust Multimodal Sentiment Analysis (Accepted by IEEE…☆11Updated 11 months ago
- Towards Robust Multimodal Sentiment Analysis with Incomplete Data☆43Updated last month
- ☆22Updated last year
- [ICME 2023 Oral] Pytorch implementation for Multimodal Sentiment Analysis with Preferential Fusion and Distance-aware Contrastive Learnin…☆16Updated last year
- Code for Findings of ACL 2022 Paper "Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors"☆25Updated 2 years ago
- ☆206Updated last year
- ☆33Updated 3 years ago
- ☆26Updated 8 months ago
- ☆90Updated 4 months ago
- PS-Mixer: A Polar-Vector and Strength-Vector Mixer Model for Multimodal Sentiment Analysis☆31Updated last year
- M-SENA-frontend☆10Updated 2 years ago
- Source code for ICASSP 2022 paper "MM-DFN: Multimodal Dynamic Fusion Network For Emotion Recognition in Conversations".☆85Updated last year