Multimodal SER Model meant to be trained on recognising emotions from speech (text + acoustic data). Fine-tuned the DeBERTaV3 model, respectively the Wav2Vec2 model to extract the features and classify the emotions from the text, respectively audio data, then passed their features and their classification through an MLP to achieve better results…
☆11Jun 19, 2024Updated 2 years ago
Alternatives and similar repositories for multimodal-speech-emotion-recognition
Users that are interested in multimodal-speech-emotion-recognition are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ICASSP 2023: "Recursive Joint Attention for Audio-Visual Fusion in Regression Based Emotion Recognition"☆14Nov 29, 2024Updated last year
- A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition☆39Aug 12, 2024Updated 2 years ago
- Official PyTorch implementation of "Text-aware Speech Separation for Multi-talker Keyword Spotting" (Interspeech 2024)☆13Apr 1, 2025Updated last year
- Multimodal Analysis for Emotion Recognition☆10Nov 21, 2022Updated 3 years ago
- AD-TUNING: An Adaptive CHILD-TUNING Approach to Efficient Hyperparameter Optimization of Child Networks for Speech Processing Tasks in th…☆11Feb 23, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- "MULTIMODAL EMOTION RECOGNITION BASED ON DEEP TEMPORAL FEATURES USING CROSS-MODAL TRANSFORMER AND SELF-ATTENTION" ICASSP'23☆24Feb 26, 2023Updated 3 years ago
- FRAME-LEVEL EMOTIONAL STATE ALIGNMENT METHOD FOR SPEECH EMOTION RECOGNITION☆22Dec 22, 2024Updated last year
- Emo-CLIM: Emotion-Aligned Contrastive Learning Between Images and Music [ICASSP 2024]☆15Jan 15, 2024Updated 2 years ago
- Official implementation of Slot3R☆15Oct 9, 2026Updated last month
- A multimodal SER project combining BERT and ECAPA-TDNN with cross-attention-based fusion on the IEMOCAP dataset.☆11Dec 9, 2024Updated last year
- Trustworthy Speech Emotion Recognition☆13May 22, 2023Updated 3 years ago
- Multimodal Emotion Recognition in a video using feature level fusion of audio and visual modalities☆15Jul 5, 2018Updated 8 years ago
- [ICML 2026 AI4Law] Legal Multi-Agent System with Agentic Search and Citation-Faithfulness Audit https://arxiv.org/abs/2509.00761☆15Jul 20, 2026Updated 3 months ago
- ☆76Jun 8, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- LegalOne-R1: A Family of Legal Foundation Models for Reliable Legal Reasoning☆17Jan 23, 2026Updated 9 months ago
- Code for IJCB 2023 paper - GaitRef: Gait Recognition with Refined Sequential Skeletons☆17Apr 22, 2023Updated 3 years ago
- MultiEMO: An Attention-Based Correlation-Aware Multimodal Fusion Framework for Emotion Recognition in Conversations (ACL 2023)☆100Nov 17, 2023Updated 3 years ago
- The repository for a coming gait recognition work.☆18Jun 8, 2023Updated 3 years ago
- ☆10Dec 12, 2024Updated last year
- Repository for my paper: Dimensional Speech Emotion Recognition Using Acoustic Features and Word Embeddings using Multitask Learning☆17Aug 2, 2024Updated 2 years ago
- [ACM MM 2023] LandmarkGait: Intrinsic Human Parsing for Gait Recognition☆17Jun 13, 2024Updated 2 years ago
- Repository for my paper: Evaluation of Error and Correlation-Based Loss Functions For Multitask Learning Dimensional Speech Emotion Recog…☆20Mar 13, 2024Updated 2 years ago
- IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"☆48Nov 29, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ULA – 从收案到文书的律师诉讼全流程 AI 工作台 · WorkBuddy多Expert并行 · 元认知自蒸馏 · 非代码律师友好☆20Jun 12, 2026Updated 5 months ago
- [ACL 2026] An interactive and comprehensive legal agent benchmark☆17Apr 7, 2026Updated 7 months ago
- Source code for the Gait Recognition using LSTM, presented in the paper "Multi-model Long Short-term Memory Network for Gait Recognition …☆19Apr 13, 2022Updated 4 years ago
- Lecture video segmentation dataset☆10Oct 15, 2018Updated 8 years ago
- 一个基于传统信号处理和机器学习的语音情绪识别系统。项目通过提取音频的MFCC、过零率、能量等声学特征,使用SVM、KNN等传统分类器对语音情绪(如高兴、愤怒、中性)进行分类识别。无需深度学习,结构清晰,运行高效,适合教学演示或资源受限场景下的语音情感分析任务。☆21Jul 1, 2025Updated last year
- MultiModal Sentiment Analysis (Text and Audio) (Pytorch)☆23Jul 27, 2022Updated 4 years ago
- 该仓库主要描述了CCAC2023多模态对话情绪识别评测第3名的实现过程☆12Aug 11, 2024Updated 2 years ago
- Data for the 2025 VAST Challenge☆10May 6, 2025Updated last year
- alibaba dashscope qwen llm rust sdk☆12Sep 22, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 【项目实战】基于RAG的法律条文智能助手☆13May 20, 2025Updated last year
- A wrapper for Audeering's wav2vec-based dimensional speech emotion recognition☆23Aug 9, 2023Updated 3 years ago
- 基于IndexTTS二次开发的语音合成API服务,可以方便indextts语音合成可以进行API调用☆13May 20, 2025Updated last year
- ☆15Jan 4, 2026Updated 10 months ago
- Coherent Deconfounding Autoencoder (CODE-AE) can extract both common biological signals shared by incoherent samples and private represen…☆20Oct 1, 2024Updated 2 years ago
- [AAAI 2024] QAGait: Revisit Gait Recognition From a Quality Perspective☆24Aug 26, 2024Updated 2 years ago
- Extract Unique Word Lists From Wikipedia Database☆13May 27, 2020Updated 6 years ago
Are these results useful?