Multimodal SER Model meant to be trained on recognising emotions from speech (text + acoustic data). Fine-tuned the DeBERTaV3 model, respectively the Wav2Vec2 model to extract the features and classify the emotions from the text, respectively audio data, then passed their features and their classification through an MLP to achieve better results…
☆11Jun 19, 2024Updated 2 years ago
Alternatives and similar repositories for multimodal-speech-emotion-recognition
Users that are interested in multimodal-speech-emotion-recognition are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition☆39Aug 12, 2024Updated 2 years ago
- Official PyTorch implementation of "Text-aware Speech Separation for Multi-talker Keyword Spotting" (Interspeech 2024)☆13Apr 1, 2025Updated last year
- Multimodal Analysis for Emotion Recognition☆10Nov 21, 2022Updated 3 years ago
- AD-TUNING: An Adaptive CHILD-TUNING Approach to Efficient Hyperparameter Optimization of Child Networks for Speech Processing Tasks in th…☆11Feb 23, 2024Updated 2 years ago
- "MULTIMODAL EMOTION RECOGNITION BASED ON DEEP TEMPORAL FEATURES USING CROSS-MODAL TRANSFORMER AND SELF-ATTENTION" ICASSP'23☆24Feb 26, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- FRAME-LEVEL EMOTIONAL STATE ALIGNMENT METHOD FOR SPEECH EMOTION RECOGNITION☆22Dec 22, 2024Updated last year
- Emo-CLIM: Emotion-Aligned Contrastive Learning Between Images and Music [ICASSP 2024]☆15Jan 15, 2024Updated 2 years ago
- Trustworthy Speech Emotion Recognition☆13May 22, 2023Updated 3 years ago
- Multimodal Emotion Recognition in a video using feature level fusion of audio and visual modalities☆15Jul 5, 2018Updated 8 years ago
- Code for IJCB 2023 paper - GaitRef: Gait Recognition with Refined Sequential Skeletons☆17Apr 22, 2023Updated 3 years ago
- [ICML 2026 AI4Law] Legal Multi-Agent System with Agentic Search and Citation-Faithfulness Audit https://arxiv.org/abs/2509.00761☆15Jul 20, 2026Updated 3 months ago
- MultiEMO: An Attention-Based Correlation-Aware Multimodal Fusion Framework for Emotion Recognition in Conversations (ACL 2023)☆100Nov 17, 2023Updated 2 years ago
- The repository for a coming gait recognition work.☆18Jun 8, 2023Updated 3 years ago
- IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"☆48Nov 29, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACL 2026] An interactive and comprehensive legal agent benchmark☆16Apr 7, 2026Updated 6 months ago
- Repository for my paper: Dimensional Speech Emotion Recognition Using Acoustic Features and Word Embeddings using Multitask Learning☆17Aug 2, 2024Updated 2 years ago
- alibaba dashscope qwen llm rust sdk☆12Sep 22, 2026Updated last month
- [ACM MM 2023] LandmarkGait: Intrinsic Human Parsing for Gait Recognition☆17Jun 13, 2024Updated 2 years ago
- Repository for my paper: Evaluation of Error and Correlation-Based Loss Functions For Multitask Learning Dimensional Speech Emotion Recog…☆20Mar 13, 2024Updated 2 years ago
- 一个基于传统信号处理和机器学习的语音情绪识别系统。项目通过提取音频的MFCC、过零率、能量等声学特征，使用SVM、KNN等传统分类器对语音情绪（如高兴、愤怒、中性）进行分类识别。无需深度学习，结构清晰，运行高效，适合教学演示或资源受限场景下的语音情感分析任务。☆21Jul 1, 2025Updated last year
- 基于IndexTTS二次开发的语音合成API服务，可以方便indextts语音合成可以进行API调用☆13May 20, 2025Updated last year
- Source code for the Gait Recognition using LSTM, presented in the paper "Multi-model Long Short-term Memory Network for Gait Recognition …☆19Apr 13, 2022Updated 4 years ago
- Coherent Deconfounding Autoencoder (CODE-AE) can extract both common biological signals shared by incoherent samples and private represen…☆20Oct 1, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Multimodal emotion recognition system of attention based vision network + audio network☆14Jul 21, 2020Updated 6 years ago
- MultiModal Sentiment Analysis (Text and Audio) (Pytorch)☆23Jul 27, 2022Updated 4 years ago
- A wrapper for Audeering's wav2vec-based dimensional speech emotion recognition☆23Aug 9, 2023Updated 3 years ago
- Lecture video segmentation dataset☆10Oct 15, 2018Updated 8 years ago
- 该仓库主要描述了CCAC2023多模态对话情绪识别评测第3名的实现过程☆12Aug 11, 2024Updated 2 years ago
- Data for the 2025 VAST Challenge☆10May 6, 2025Updated last year
- Aligning / Biasing Speech-to-Text models to a predefined set of words or phrases.☆16Jun 16, 2025Updated last year
- [ACL2026 Main] Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding☆22Jun 6, 2026Updated 4 months ago
- ☆11Nov 11, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [AAAI 2024] QAGait: Revisit Gait Recognition From a Quality Perspective☆24Aug 26, 2024Updated 2 years ago
- Auto Model Factorization☆12Sep 14, 2021Updated 5 years ago
- 多模态，语音和文本结合的情感识别，大模型finetune☆25Nov 19, 2023Updated 2 years ago
- Multimodal Sentiment Analysis using unified transformer☆25Oct 11, 2022Updated 4 years ago
- Pytorch implementation for the paper: Multivariate, Multi-frequency and Multimodal: Rethinking Graph Neural Networks for Emotion Recognit…☆58Dec 5, 2023Updated 2 years ago
- DWFormer: Dynamic Window Transformer for Speech Emotion Recognition(ICASSP 2023 Oral)☆68Jul 8, 2024Updated 2 years ago
- Code for the Interspeech 2023 paper "A Joint Model for Pronunciation Assessment and Mispronunciation Detection and Diagnosis with Multi-t…☆25Nov 9, 2023Updated 2 years ago