kyegomez / USM
Implementation of Google's USM speech model in Pytorch
☆31Updated last month
Alternatives and similar repositories for USM
Users that are interested in USM are comparing it to the libraries listed below
Sorting:
- ☆13Updated last year
- Official release of StyleTalk dataset.☆62Updated 10 months ago
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆53Updated 3 weeks ago
- ☆18Updated last year
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆52Updated 6 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆35Updated last year
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆15Updated 5 months ago
- ☆35Updated last year
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆58Updated 3 weeks ago
- Official Code for ParrotTTS☆50Updated 7 months ago
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆48Updated last year
- ☆26Updated 3 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated 10 months ago
- Collection of scripts from mHuBERT-147.☆24Updated 5 months ago
- GPT for FACodec☆13Updated last year
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆52Updated last year
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆73Updated last year
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated 9 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆68Updated 6 months ago
- [IJCAI'23] Learning to Speak from Text for Low-Resource TTS☆63Updated last year
- ☆29Updated last month
- Temporary anonymous version☆22Updated last year
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆18Updated last year
- ☆25Updated 2 years ago
- （WIP）long form speech generatoins☆31Updated last month
- Contains the code associated with the ICLR submission for our text-to-speech diffusion model☆53Updated last year
- ☆20Updated 2 years ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆25Updated 5 months ago
- A native-PyTorch library for large scale M-LLM (text/audio) training with tp/cp/dp/pp.☆66Updated 3 weeks ago
- ☆68Updated 8 months ago