kyegomez / USM
Implementation of Google's USM speech model in Pytorch
☆29Updated last month
Alternatives and similar repositories for USM:
Users that are interested in USM are comparing it to the libraries listed below
- Official release of StyleTalk dataset.☆61Updated 8 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆63Updated 4 months ago
- Speech-To-Text forced-alignment Speech processing Universal PERformance Benchmark☆25Updated 7 months ago
- ☆21Updated 3 weeks ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆15Updated 3 months ago
- ConMamba for Automatic Speech Recognition☆57Updated 6 months ago
- ☆28Updated last year
- ☆13Updated 11 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆24Updated 6 months ago
- ☆25Updated 2 years ago
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated last year
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆49Updated 4 months ago
- GPT for FACodec☆13Updated 11 months ago
- Temporary anonymous version☆22Updated 11 months ago
- Official Code for ParrotTTS☆48Updated 4 months ago
- ☆12Updated last month
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated 8 months ago
- ☆36Updated 5 months ago
- Collection of scripts from mHuBERT-147.☆24Updated 3 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated last month
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆50Updated 5 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆53Updated 4 months ago
- CML-TTS: A Multilingual Dataset for Speech Synthesis☆29Updated 7 months ago
- ☆18Updated 10 months ago
- [IJCAI'23] Learning to Speak from Text for Low-Resource TTS☆63Updated last year
- Just another FastSpeech 2 but cleaner code :)☆26Updated 8 months ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆49Updated last year
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆47Updated last year
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year