Towards Fine-Grained Multi-Dimensional Speech Understanding: Data Pipeline, Benchmark, and Model
☆26May 21, 2026Updated 2 months ago
Alternatives and similar repositories for FMSU-Bench
Users that are interested in FMSU-Bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This challenge focuses on evaluating speech recognition and semantic understanding capabilities of AI glasses in complex real-world envir…☆18Jun 27, 2026Updated last month
- ☆35Jun 15, 2026Updated last month
- An Open-Source Multidimension Speech Understanding Foundation Model Built upon OpenPangu on Ascend NPUs☆33Mar 15, 2026Updated 4 months ago
- M7-TTS: A Mini-Scale Multilingual and Multi-Dialect Text-to-Speech Language Model with Mimi codec and Multi Token Prediction☆20Mar 19, 2026Updated 4 months ago
- ☆36May 19, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Speaker-Reasoner: Scaling Interaction Turns and Reasoning Patterns for Timestamped Speaker-Attributed ASR☆94May 13, 2026Updated 3 months ago
- ☆50May 2, 2026Updated 3 months ago
- Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillation☆70Jun 16, 2026Updated last month
- Open repository of "MSU-Bench: Towards Understanding the Conversational Multi-Speaker Scenarios"☆20Jul 7, 2026Updated last month
- ☆19Jun 16, 2026Updated last month
- OmniCodec: Low Frame Rate Universal Audio Codec with Semantic–Acoustic Disentanglement☆46Apr 17, 2026Updated 3 months ago
- Llasa Speed Up☆64Jan 18, 2026Updated 6 months ago
- ☆15Dec 14, 2025Updated 7 months ago
- Open-Source Turn-Taking Detection Model and Dataset for Full-Duplex Spoken Dialogue Systems☆132Jan 25, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆85Jun 12, 2026Updated 2 months ago
- ICASSP2026 HumDial Challenge☆51May 28, 2026Updated 2 months ago
- Multi-talker ASR based on DiCoW with Serialized Output Training☆21Sep 18, 2025Updated 10 months ago
- YingMusic-Singer-Plus: Controllable Singing Voice Synthesis with Flexible Lyric Manipulation and Annotation-free Melody Guidance☆91Apr 12, 2026Updated 4 months ago
- An instruct text-to-speech solution based on LLaSA and CosyVoice2 developed by the ASLP lab and collaborators.☆250Feb 26, 2026Updated 5 months ago
- The Full-Duplex Interaction Track of the ICASSP 2026 Human-like Spoken Dialogue Systems Challenge aims to advance the evaluation of full-…☆38Apr 27, 2026Updated 3 months ago
- A Large-scale Wu Dialect Speech Corpus with Multi-dimensional Annotations☆176Feb 6, 2026Updated 6 months ago
- A Robust Low-Latency Streaming Zero-Shot Voice Conversion☆125Updated this week
- Scaled diffusion transformer for text-to-speech synthesis (DiT + T5Gemma2 conditioning, TorchTitan & Megatron backends, tested up to 1024…☆24Mar 29, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- State-of-the-art continious audio tokenization☆41Mar 9, 2026Updated 5 months ago
- end-to-end text to audio scene generation model☆50Jun 16, 2026Updated last month
- Official repository for the WenetSpeech-Chuan dataset.☆227Jul 14, 2026Updated 3 weeks ago
- Code for CTC-TTS: LLM-based dual-streaming text-to-speech with CTC alignment, Interspeech 2026.☆20Jun 9, 2026Updated 2 months ago
- OSUM & OSUM-EChat, open speech understanding model and empathetic spoken chatbot based on it, open-sourced by ASLP@NPU.☆496Nov 23, 2025Updated 8 months ago
- Towards a general language-audio model for computational paralinguistic tasks☆31Dec 14, 2024Updated last year
- A Large-scale Cantonese Speech Corpus with Multi-dimensional Annotation☆350Jun 6, 2026Updated 2 months ago
- ☆19Apr 9, 2026Updated 4 months ago
- ☆168May 14, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"☆92Sep 18, 2025Updated 10 months ago
- The project is associated with the recently-launched INTERSPEECH 2025 Workshop on Multilingual Conversational Speech Language Model (MLC-…☆51May 14, 2025Updated last year
- An end-to-end framework for multi-speaker transcription that jointly models who spoke, when, and what.☆286Jun 22, 2026Updated last month
- We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…☆17Mar 3, 2025Updated last year
- We Speech Toolkit, LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction☆208Jul 17, 2026Updated 3 weeks ago
- 5Hz Deep-Compression Speech VAE for AR-Diffusion and CALMs☆57Nov 19, 2025Updated 8 months ago
- ☆29Apr 6, 2026Updated 4 months ago