yangdongchao / RSTnet
Real-time Speech-Text Foundation Model Toolkit (wip)
☆119Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for RSTnet
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆157Updated 4 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆136Updated last year
- The open source code for SimpleSpeech series☆108Updated last month
- The open source code for LLM-Codec☆114Updated 2 months ago
- ☆62Updated 9 months ago
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆122Updated 5 months ago
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning☆114Updated 4 months ago
- Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆102Updated last month
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆44Updated 2 months ago
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆63Updated 8 months ago
- Reference-aware automatic speech evaluation toolkit☆106Updated 8 months ago
- ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations☆121Updated 8 months ago
- [InterSpeech 24] FreeV: Free Lunch For Vocoders Through Pseudo Inversed Mel Filter☆78Updated 4 months ago
- UTokyo-SaruLab MOS Prediction System☆90Updated this week
- ☆57Updated 2 months ago
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆65Updated last month
- [ICASSP 2024] StoryTTS: A Highly Expressive Text-to-Speech Dataset with Rich Textual Expressiveness Annotations☆135Updated 6 months ago
- Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice☆131Updated last month
- ☆53Updated 10 months ago
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆58Updated 7 months ago
- All generative model in one for better TTS model☆66Updated 2 months ago
- FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3☆166Updated 6 months ago
- Inference code for Audiodec-Valle-Wenetspeech4TTS☆46Updated 3 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 4 months ago
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆82Updated last month
- Unofficial SoundStream implementation of Pytorch with training code and 16kHz pretrained checkpoint☆57Updated last year
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆81Updated this week
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆38Updated last week
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆61Updated this week
- FlashSpeech: Efficient Zero-Shot Speech Synthesis☆94Updated last month