Srijith-rkr / Whispering-LLaMALinks
EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction
☆264Updated last year
Alternatives and similar repositories for Whispering-LLaMA
Users that are interested in Whispering-LLaMA are comparing it to the libraries listed below
Sorting:
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation☆151Updated last year
- This repository contains the training, inference, evaluation code for SpeechLLM models and details about the model releases on huggingfac…☆124Updated last year
- AudioBench: A Universal Benchmark for Audio Large Language Models☆266Updated 4 months ago
- CVSS: A Massively Multilingual Speech-to-Speech Translation Corpus☆217Updated 3 years ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆297Updated 2 months ago
- Zero-shot Domain-sensitive Speech Recognition with Prompt-conditioning Fine-tuning (ASRU2023)☆27Updated 2 years ago
- Official repository for the "Powerset multi-class cross entropy loss for neural speaker diarization" paper published in Interspeech 2023.☆89Updated 2 years ago
- Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation☆187Updated 2 months ago
- Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context☆206Updated last year
- Official repository of DailyTalk: Spoken Dialogue Dataset for Conversational Text-to-Speech, ICASSP 2023☆242Updated 4 months ago
- ☆145Updated last week
- Update ASR paper everyday☆345Updated last week
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆284Updated 6 months ago
- Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.☆210Updated last year
- Multilingual G2P in 100 languages☆360Updated 2 years ago
- An evolving, large-scale and multi-domain ASR corpus for low-resource languages with automated crawling, transcription and refinement☆175Updated last month
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆78Updated 4 months ago
- Voice Activity Projection Models: Self-supervised learning of Turn-taking Events☆80Updated last year
- NeMo text processing for ASR and TTS☆379Updated last week
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆612Updated last year
- Various speech datasets made available to the public☆131Updated 10 months ago
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆458Updated last year
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆150Updated 2 years ago
- Code for our INTERSPEECH paper Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection☆92Updated 6 months ago
- Phoneme-Level BERT for Enhanced Prosody of Text-to-Speech with Grapheme Predictions☆261Updated 9 months ago
- Official release of StyleTalk dataset.☆70Updated last year
- ☆378Updated last year
- An Audio Language model for Audio Tasks☆316Updated last year
- Scripts for computing the Intelligibility and CLVP scores for evaluating TTS models☆163Updated last year
- Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch☆274Updated last year