yangdongchao / RSTnet
Real-time Speech-Text Foundation Model Toolkit (wip)
☆171Updated last week
Alternatives and similar repositories for RSTnet:
Users that are interested in RSTnet are comparing it to the libraries listed below
- Codec for paper: LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆222Updated last week
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆136Updated 5 months ago
- Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice☆264Updated last month
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆138Updated last year
- AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆179Updated 2 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆121Updated last month
- ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations☆147Updated last year
- SSR-Speech: Towards Stable, Safe and Robust Zero-shot Speech Editing and Synthesis☆127Updated 2 months ago
- Training code for FAcodec presented in NaturalSpeech3☆194Updated 6 months ago
- FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3☆192Updated 10 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆140Updated this week
- [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"☆334Updated 6 months ago
- Implementation of SoundStorm built upon SpeechTokenizer.☆108Updated last year
- Train the next generation of TTS systems.☆163Updated 6 months ago
- Easy-to-Use Speech MOS predictors☆270Updated last year
- Ultra-low bitrate neural audio codec (0.31~1.40 kbps) with a better semantic in the latent space.☆192Updated this week
- Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context☆191Updated 6 months ago
- DEX-TTS: Diffusion-based EXpressive TTS with Style Modeling on Time Variability☆99Updated last month
- An unofficial PyTorch implementation of VALL-E☆88Updated this week
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆169Updated 8 months ago
- UTokyo-SaruLab MOS Prediction System☆154Updated 2 weeks ago
- The open source code for SimpleSpeech series☆132Updated 5 months ago
- It's a repository for implementations of neural speech editing algorithms.☆194Updated last year
- ACM MM 2024 FlashSpeech: Efficient Zero-Shot Speech Synthesis☆129Updated 5 months ago
- Awesome Neural Codec Models, Text-to-Speech Synthesizers & Speech Language Models☆118Updated this week
- [ICASSP 2024] StoryTTS: A Highly Expressive Text-to-Speech Dataset with Rich Textual Expressiveness Annotations☆139Updated 10 months ago
- TTSAudioNormalizer is a specialized tool for TTS data production, featuring descriptive statistical analysis of audio loudness and loud…☆93Updated 2 months ago
- ACM MM 2023 CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model☆205Updated 10 months ago
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆109Updated 3 weeks ago