Towards Fine-Grained Multi-Dimensional Speech Understanding: Data Pipeline, Benchmark, and Model
☆25May 21, 2026Updated last month
Alternatives and similar repositories for FMSU
Users that are interested in FMSU are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This challenge focuses on evaluating speech recognition and semantic understanding capabilities of AI glasses in complex real-world envir…☆18Jun 27, 2026Updated 2 weeks ago
- ☆31Jun 15, 2026Updated 3 weeks ago
- ☆33May 19, 2026Updated last month
- Speaker-Reasoner: Scaling Interaction Turns and Reasoning Patterns for Timestamped Speaker-Attributed ASR☆89May 13, 2026Updated 2 months ago
- ☆48May 2, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillation☆52Jun 16, 2026Updated 3 weeks ago
- ☆16Jun 16, 2026Updated 3 weeks ago
- OmniCodec: Low Frame Rate Universal Audio Codec with Semantic–Acoustic Disentanglement☆45Apr 17, 2026Updated 2 months ago
- Llasa Speed Up☆64Jan 18, 2026Updated 5 months ago
- ☆80Jun 12, 2026Updated last month
- YingMusic-Singer-Plus: Controllable Singing Voice Synthesis with Flexible Lyric Manipulation and Annotation-free Melody Guidance☆78Apr 12, 2026Updated 3 months ago
- A Large-scale Wu Dialect Speech Corpus with Multi-dimensional Annotations☆164Feb 6, 2026Updated 5 months ago
- ☆27Jun 9, 2026Updated last month
- The Full-Duplex Interaction Track of the ICASSP 2026 Human-like Spoken Dialogue Systems Challenge aims to advance the evaluation of full-…☆35Apr 27, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An instruct text-to-speech solution based on LLaSA and CosyVoice2 developed by the ASLP lab and collaborators.☆250Feb 26, 2026Updated 4 months ago
- Scaled diffusion transformer for text-to-speech synthesis (DiT + T5Gemma2 conditioning, TorchTitan & Megatron backends, tested up to 1024…☆24Mar 29, 2026Updated 3 months ago
- end-to-end text to audio scene generation model☆49Jun 16, 2026Updated 3 weeks ago
- OSUM & OSUM-EChat, open speech understanding model and empathetic spoken chatbot based on it, open-sourced by ASLP@NPU.☆494Nov 23, 2025Updated 7 months ago
- Code for CTC-TTS: LLM-based dual-streaming text-to-speech with CTC alignment, Interspeech 2026.☆19Jun 9, 2026Updated last month
- Official code of SenSE.☆90Oct 30, 2025Updated 8 months ago
- ☆17Apr 9, 2026Updated 3 months ago
- A song aesthetic evaluation toolkit trained on SongEval.☆313Apr 8, 2026Updated 3 months ago
- A Massive Contextual Speech Recognition Benchmark.☆107Aug 6, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An end-to-end framework for multi-speaker transcription that jointly models who spoke, when, and what.☆276Jun 22, 2026Updated 3 weeks ago
- A streaming audio reader, processor, and writer built on top of soundfile, and PyAV (bindings for FFmpeg)☆39Mar 31, 2026Updated 3 months ago
- We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…☆17Mar 3, 2025Updated last year
- Open, royalty free, lyrics2song / song generation data collection / cleaning pipeline.☆17May 9, 2025Updated last year
- AffectSpeech: A Large-Scale Emotional Speech Dataset with Fine-Grained Textual Descriptions for Speech Emotion Captioning and Synthesis☆68Jun 12, 2026Updated last month
- ☆47Apr 27, 2026Updated 2 months ago
- Official repository for the WenetSpeech-Chuan dataset.☆217Updated this week
- Open-Source Turn-Taking Detection Model and Dataset for Full-Duplex Spoken Dialogue Systems☆121Jan 25, 2026Updated 5 months ago
- We Speech Toolkit, LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction☆207Jun 26, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official code for "WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modeling"☆62Jun 27, 2026Updated 2 weeks ago
- LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement☆47Mar 10, 2025Updated last year
- Ming-omni-tts: Simple and Efficient Unified Generation of Speech, Music, and Sound with Precise Control☆260Feb 26, 2026Updated 4 months ago
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆68Dec 26, 2025Updated 6 months ago
- ☆42May 12, 2026Updated 2 months ago
- The inference and trainging code for WordVoice.☆41Updated this week
- [ASRU 2025] Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?☆47Nov 21, 2025Updated 7 months ago