xingchensong / TouchNetLinks
A native-PyTorch library for large scale M-LLM (text/audio) training with tp/cp/dp/pp.
☆138Updated 3 weeks ago
Alternatives and similar repositories for TouchNet
Users that are interested in TouchNet are comparing it to the libraries listed below
Sorting:
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆96Updated 2 months ago
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆83Updated 2 months ago
- A Massive Contextual Speech Recognition Benchmark.☆78Updated 3 weeks ago
- ☆71Updated last year
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆50Updated last year
- ☆132Updated 3 months ago
- Inference code for Audiodec-Valle-Wenetspeech4TTS☆50Updated last year
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆50Updated 2 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆59Updated 6 months ago
- In-car multi-channel speech transcription system of AISHELL-5.☆30Updated last month
- Audio-FLAN☆157Updated 4 months ago
- ☆69Updated 10 months ago
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆126Updated 4 months ago
- AutoPrep: An Automatic Preprocessing Framework for In-the-Wild Speech Data☆31Updated last year
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆85Updated 8 months ago
- ☆87Updated 2 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆66Updated 2 weeks ago
- The open source code for LLM-Codec☆136Updated 11 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆160Updated 3 months ago
- Awesome Neural Codec Models, Text-to-Speech Synthesizers & Speech Language Models☆175Updated this week
- TTS FrontEnd DataSet: Polyphone / Prosody / TextNormalization☆99Updated last year
- A low-bitrate single-codebook 16 kHz speech codec based on focal modulation☆93Updated 5 months ago
- TTSAudioNormalizer is a specialized tool for TTS data production, featuring descriptive statistical analysis of audio loudness and loud…☆101Updated 7 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆148Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆61Updated 9 months ago
- A benchmark to evaluate full-duplex spoken dialogue models on pause handling, backchanneling, turn-taking, and user interruptions.☆52Updated last month
- ☆78Updated 3 weeks ago
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆79Updated 7 months ago
- Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆152Updated last month
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆70Updated 3 months ago