kyegomez / USMLinks
Implementation of Google's USM speech model in Pytorch
☆31Updated 3 weeks ago
Alternatives and similar repositories for USM
Users that are interested in USM are comparing it to the libraries listed below
Sorting:
- Collection of scripts from mHuBERT-147.☆29Updated 8 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆37Updated last year
- An official implementation of Style-Talker for Spoken Dialogue Generation☆21Updated 7 months ago
- Official release of StyleTalk dataset.☆67Updated last year
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Updated 8 months ago
- Official Code for ParrotTTS☆54Updated 9 months ago
- ☆60Updated last year
- Transcribing Speech with Multinomial Diffusion, training code and models.☆78Updated last year
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆60Updated 9 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated last year
- Speaker change detection using SincNet and an LSTM/Transformer☆53Updated 2 months ago
- ☆41Updated 10 months ago
- ☆13Updated last year
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated 2 years ago
- ☆25Updated 2 years ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆97Updated 2 months ago
- ☆29Updated 6 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆47Updated last year
- Official implementation of MelHuBERT☆66Updated 9 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated last year
- Towards Comprehensive Benchmark for End-to-End Spoken Dialogue Models☆35Updated last week
- Temporary anonymous version☆22Updated last year
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated 6 months ago
- Github repository for ACL 2025 paper: VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models☆17Updated last month
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆66Updated 3 weeks ago
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆48Updated last year
- GPT-style network for phonemization with durations of text☆67Updated last year
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆25Updated 7 months ago
- ☆29Updated 2 months ago
- Speech-To-Text forced-alignment Speech processing Universal PERformance Benchmark☆28Updated 3 months ago