ErikEkstedt / TurnGPT
TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialog
☆41Updated 4 months ago
Related projects: ⓘ
- Datasets for turn-taking research☆11Updated 8 months ago
- vad☆14Updated last year
- Voice Activity Projection Models: Self-supervised learning of Turn-taking Events☆36Updated 3 months ago
- ☆19Updated 6 years ago
- ☆12Updated last year
- ☆32Updated 3 years ago
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation☆132Updated 8 months ago
- ☆18Updated last month
- Audio tokenization, in the fastest way possible!☆45Updated 3 weeks ago
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆223Updated 4 months ago
- asr2k☆48Updated 3 months ago
- Audio Large Language Models☆59Updated this week
- 56 language, 1 model Multilingual ASR☆23Updated 3 years ago
- JavaScript deployment for Howl, the wake word detection modeling toolkit for Firefox Voice☆10Updated 4 years ago
- Explore different way to mix speech model(wav2vec2, hubert) and nlp model(BART,T5,GPT) together☆42Updated last year
- Repository containing the open source code of works published at the FBK MT unit.☆41Updated 2 months ago
- Official code for Wav2Seq☆95Updated 2 years ago
- Phoneme segmentation using pre-trained speech models☆49Updated last year
- ☆37Updated 3 years ago
- A toolkit for Spoken Language Understanding Evaluation (SLUE) benchmark. Refer paper https://arxiv.org/abs/2111.10367 for more details. O…☆60Updated 6 months ago
- Various speech datasets made available to the public☆88Updated 2 weeks ago
- **Interspeech 2022** 《SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks》Speec…☆97Updated last year
- ☆48Updated last month
- Speech-MASSIVE is a multilingual Spoken Language Understanding (SLU) dataset comprising the speech counterpart for a portion of the MASSI…☆16Updated 3 weeks ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆33Updated 3 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆38Updated last week
- Implementation of Google's USM speech model in Pytorch☆23Updated last week
- An espeak-compatible, permissively-licensed IPA phonemizer (G2P) based on DeepPhonemizer. Usable as a drop-in replacement for espeak's GP…☆74Updated 2 months ago
- A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset (ACL 2024)☆12Updated last month
- INTERSPEECH 23 - Refunction Whisper to recognize new tasks with adapters!☆31Updated last year