jasonppy / PromptingWhisper
Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation
☆141Updated last year
Alternatives and similar repositories for PromptingWhisper:
Users that are interested in PromptingWhisper are comparing it to the libraries listed below
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆246Updated 9 months ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆109Updated 2 months ago
- Official repository for the "Powerset multi-class cross entropy loss for neural speaker diarization" paper published in Interspeech 2023.☆80Updated last year
- AudioBench: A Universal Benchmark for Audio Large Language Models☆124Updated this week
- Zero-shot Domain-sensitive Speech Recognition with Prompt-conditioning Fine-tuning (ASRU2023)☆27Updated last year
- Update ASR paper everyday☆134Updated this week
- Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context☆189Updated 5 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆111Updated 2 weeks ago
- Various speech datasets made available to the public☆113Updated 2 months ago
- Official repository of DailyTalk: Spoken Dialogue Dataset for Conversational Text-to-Speech, ICASSP 2023☆211Updated last year
- Official code for Wav2Seq☆96Updated 2 years ago
- This Repository surveys the paper focusing on Prompting and Adapters for Speech Processing.☆107Updated last year
- **Interspeech 2022** 《SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks》Speec…☆98Updated last year
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆129Updated last week
- A mini, simple, and fast end-to-end automatic speech recognition toolkit.☆50Updated 2 years ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- ☆70Updated 2 months ago
- Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"☆50Updated last month
- ☆71Updated last year
- Speaker change detection using SincNet and an LSTM/Transformer☆46Updated 7 months ago
- Phoneme-Level BERT for Enhanced Prosody of Text-to-Speech with Grapheme Predictions☆234Updated last month
- Unofficial implementation of NVIDIA P-Flow TTS paper☆220Updated last month
- A speaker embedding network in Pytorch that is very quick to set up and use for whatever purposes.☆88Updated last year
- Multilingual G2P in 100 languages☆299Updated last year
- INTERSPEECH 23 - Refunction Whisper to recognize new tasks with adapters!☆34Updated last year
- CVSS: A Massively Multilingual Speech-to-Speech Translation Corpus☆196Updated 2 years ago
- FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3☆187Updated 10 months ago
- Code for our INTERSPEECH paper Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection☆57Updated this week
- Clustering-based methods for overlapping diarization☆75Updated last year
- A sequence-to-sequence voice conversion toolkit.☆93Updated 7 months ago