kyegomez / USM
Implementation of Google's USM speech model in Pytorch
☆25Updated last week
Related projects ⓘ
Alternatives and complementary repositories for USM
- Official Code for ParrotTTS☆43Updated last month
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆15Updated this week
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆37Updated 3 weeks ago
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- Temporary anonymous version☆22Updated 8 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆39Updated last week
- ☆17Updated 3 months ago
- ConMamba for Automatic Speech Recognition☆45Updated 3 months ago
- ☆32Updated 2 months ago
- ☆31Updated 2 weeks ago
- Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11…☆42Updated 4 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆22Updated 3 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Speech-To-Text forced-alignment Speech processing Universal PERformance Benchmark☆22Updated 4 months ago
- ☆34Updated 7 months ago
- ☆26Updated last year
- GPT for FACodec☆13Updated 7 months ago
- ☆12Updated 8 months ago
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated last year
- This is the official implementation of our multi-channel multi-speaker multi-spatial neural audio codec architecture.☆42Updated 2 months ago
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated last year
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆36Updated 3 months ago
- ☆56Updated last year
- ☆16Updated 6 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆47Updated last month
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆71Updated 7 months ago
- ☆21Updated 4 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆57Updated 3 weeks ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆44Updated last year
- Streaming Audiotransformers for online Audio tagging☆41Updated 5 months ago