jasonppy / PromptingWhisper
Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation
☆143Updated last year
Alternatives and similar repositories for PromptingWhisper:
Users that are interested in PromptingWhisper are comparing it to the libraries listed below
- AudioBench: A Universal Benchmark for Audio Large Language Models☆165Updated this week
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆251Updated 10 months ago
- Zero-shot Domain-sensitive Speech Recognition with Prompt-conditioning Fine-tuning (ASRU2023)☆27Updated last year
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆151Updated 2 weeks ago
- Various speech datasets made available to the public☆114Updated 3 months ago
- Official repository for the "Powerset multi-class cross entropy loss for neural speaker diarization" paper published in Interspeech 2023.☆82Updated last year
- Official repository of DailyTalk: Spoken Dialogue Dataset for Conversational Text-to-Speech, ICASSP 2023☆212Updated 2 years ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆117Updated 3 months ago
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆145Updated last month
- Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context☆192Updated 6 months ago
- ☆74Updated last year
- ☆78Updated this week
- Official code for Wav2Seq☆96Updated 2 years ago
- ☆64Updated 6 months ago
- Implementation of SoundStorm built upon SpeechTokenizer.☆108Updated last year
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆138Updated last year
- Reference-aware automatic speech evaluation toolkit☆144Updated 3 months ago
- CVSS: A Massively Multilingual Speech-to-Speech Translation Corpus☆194Updated 2 years ago
- Speaker change detection using SincNet and an LSTM/Transformer☆48Updated 8 months ago
- ☆277Updated 9 months ago
- This Repository surveys the paper focusing on Prompting and Adapters for Speech Processing.☆108Updated last year
- Multilingual G2P in 100 languages☆309Updated last year
- This repository contains the training, inference, evaluation code for SpeechLLM models and details about the model releases on huggingfac…☆89Updated 8 months ago
- This is a list of speech tasks and datasets, which can provide training data for Generative AI, AIGC, AI model training, intelligent spee…☆74Updated 9 months ago
- **Interspeech 2022** 《SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks》Speec…☆98Updated last year
- FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3☆194Updated 11 months ago
- VoiceLDM: Text-to-Speech with Environmental Context☆172Updated 7 months ago
- Predicts the level of noise and reverberation on your audiofiles☆146Updated 10 months ago
- Clustering-based methods for overlapping diarization☆77Updated last year
- Code for our INTERSPEECH paper Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection☆59Updated last month