xzf-thu / Mini-Omni-ReasonerLinks
Mini-Omni-Reasoner: a real-time speech reasoning framework that interleaves silent reasoning tokens with spoken response tokens (“thinking-in-speaking”), exploiting the LLM–audio throughput gap to keep speech fluent and low-latency while maintaining structured internal reasoning.
☆161Updated 5 months ago
Alternatives and similar repositories for Mini-Omni-Reasoner
Users that are interested in Mini-Omni-Reasoner are comparing it to the libraries listed below
Sorting:
- CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech☆363Updated 5 months ago
- AudioTrust: Benchmarking the Multi-faceted Trustworthiness of Audio Large Language Models☆209Updated 2 months ago
- Code for paper "Self-Taught Recognizer: Toward Unsupervised Adaptation for Speech Foundation Models"☆241Updated last year
- PyTorch Implementation of TCSinger 2(ACL 2025): Customizable Multilingual Zero-shot Singing Voice Synthesis☆164Updated 3 months ago
- A Unified Framework for Expressive Speech Synthesis with Voice Cloning☆406Updated last month
- Code for paper "Large Language Models are Efficient Learners of Noise-Robust Speech Recognition"☆139Updated last year
- [ICML 2025] PyTorch Implementation of "OmniAudio: Generating Spatial Audio from 360-Degree Video"☆347Updated 7 months ago
- ☆159Updated 3 months ago
- GenSE: Generative Speech Enhancement via Language Models using Hierarchical Modeling☆161Updated 11 months ago
- The first Large Audio Language Model that enables native in-depth thinking, which is trained on large-scale audio Chain-of-Thought data.☆276Updated 8 months ago
- Code for paper "GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators"☆198Updated last year
- PyTorch Implementation of StyleSinger(AAAI 2024): Style Transfer for Out-of-Domain Singing Voice Synthesis☆417Updated 5 months ago
- This is the demo of our paper "IIANet: An Intra- and Inter-Modality Attention Network for Audio-Visual Speech Separation".☆108Updated 10 months ago
- Official code of ICML 2025 paper "NTPP: Generative Speech Language Modeling for Dual-Channel Spoken Dialogue via Next-Token-Pair Predicti…☆134Updated 3 months ago
- PyTorch Implementation of TCSinger(EMNLP 2024): Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control☆372Updated 3 months ago
- Single-blind supplementary materials for NeurIPS 2023 submission☆92Updated last year
- The official Soundwave repository☆225Updated 10 months ago
- PyTorch Implementation of VersBand(EMNLP 2025): Versatile Framework for Song Generation with Prompt-based Control☆224Updated 4 months ago
- Official repo for WavCraft, an AI agent for audio creation and editing☆524Updated 11 months ago
- UniVoice: Unifying Autoregressive ASR and Flow-Matching based TTS with Large Language Models☆111Updated 3 months ago
- A song aesthetic evaluation toolkit trained on SongEval.☆274Updated 7 months ago
- [ICCV 2025] Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆305Updated last year
- Dataset and code of GTSinger(NeurIPS 2024 Spotlight): A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing…☆345Updated 5 months ago
- ☆100Updated 2 months ago
- ☆144Updated 7 months ago
- ☆14Updated 8 months ago
- ☆52Updated 2 months ago
- Official implementation of "JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronization"☆313Updated 3 weeks ago
- Image and video Tokenizer/VAE selection guide, text and face reconstruction evaluation.☆134Updated 2 months ago
- EvaLearn is a pioneering benchmark designed to evaluate large language models (LLMs) on their learning capability and efficiency in chall…☆431Updated last week