thuhcsi / SpeechCraft
The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
☆49Updated last month
Related projects ⓘ
Alternatives and complementary repositories for SpeechCraft
- The open source code for LLM-Codec☆114Updated 2 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆119Updated 3 weeks ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆38Updated last week
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆63Updated 8 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆136Updated last year
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆64Updated last month
- SimVQ: Addressing Representation Collapse in Vector Quantized Models with One Linear Layer☆90Updated this week
- Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆102Updated last month
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆44Updated 2 months ago
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆58Updated 7 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆157Updated 3 months ago
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆47Updated 2 weeks ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 4 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆28Updated last month
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆51Updated 4 months ago
- ☆53Updated 10 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆33Updated last week
- ☆62Updated 9 months ago
- The open source code for SimpleSpeech series☆108Updated last month
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated 9 months ago
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆81Updated 2 weeks ago
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆122Updated 4 months ago
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆90Updated 2 weeks ago
- All generative model in one for better TTS model☆66Updated 2 months ago
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆32Updated 3 weeks ago
- ☆30Updated last year
- [InterSpeech 24] FreeV: Free Lunch For Vocoders Through Pseudo Inversed Mel Filter☆78Updated 4 months ago
- ☆41Updated 3 weeks ago
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆48Updated 2 weeks ago