kyegomez / USM
Implementation of Google's USM speech model in Pytorch
☆31Updated 2 weeks ago
Alternatives and similar repositories for USM:
Users that are interested in USM are comparing it to the libraries listed below
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆52Updated 5 months ago
- Official release of StyleTalk dataset.☆62Updated 9 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆65Updated 5 months ago
- ☆18Updated 11 months ago
- ☆13Updated last year
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆51Updated last month
- Official Code for ParrotTTS☆48Updated 6 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆41Updated 2 months ago
- ☆35Updated last year
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆48Updated last year
- ☆26Updated 2 months ago
- ☆28Updated last year
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆52Updated last year
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆50Updated 5 months ago
- Collection of scripts from mHuBERT-147.☆24Updated 5 months ago
- ☆59Updated last year
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated last year
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Updated 5 months ago
- ☆23Updated last month
- ☆38Updated 7 months ago
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆39Updated 7 months ago
- Speaker change detection using SincNet and an LSTM/Transformer☆50Updated 9 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆48Updated this week
- ☆19Updated last year
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆35Updated last year
- Speech-To-Text forced-alignment Speech processing Universal PERformance Benchmark☆27Updated 9 months ago
- ☆25Updated 2 years ago
- ☆29Updated 9 months ago
- [IJCAI'23] Learning to Speak from Text for Low-Resource TTS☆63Updated last year
- LibriSpeech-Long is a benchmark dataset for long-form speech generation and processing. Released as part of "Long-Form Speech Generation …☆62Updated 3 months ago