roudimit / whisper-flamingoLinks
Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation
☆169Updated last month
Alternatives and similar repositories for whisper-flamingo
Users that are interested in whisper-flamingo are comparing it to the libraries listed below
Sorting:
- AudioBench: A Universal Benchmark for Audio Large Language Models☆227Updated last week
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆131Updated 6 months ago
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation☆146Updated last year
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆53Updated 2 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆224Updated last week
- VoiceLDM: Text-to-Speech with Environmental Context☆179Updated 10 months ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆40Updated 7 months ago
- [TAFFC 2025] The official implementation of EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech via Emotion-Adaptive Spherical Vec…☆94Updated 2 months ago
- Official repository for the "Powerset multi-class cross entropy loss for neural speaker diarization" paper published in Interspeech 2023.☆84Updated last year
- An Audio Language model for Audio Tasks☆309Updated last year
- ☆66Updated 9 months ago
- Official Implementation of EnCLAP (ICASSP 2024)☆92Updated last year
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆146Updated last month
- [INTERSPEECH 2024] The official implementation of EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for …☆152Updated last month
- Official Implementation of the work "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning"☆144Updated 7 months ago
- Codec for paper: LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆279Updated last week
- Official implementation of USR (NeurIPS 2024)☆30Updated 6 months ago
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆252Updated 2 months ago
- [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.☆52Updated last year
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆179Updated 11 months ago
- [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"☆346Updated 9 months ago
- ACM MM 2023 CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model☆209Updated last year
- FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3☆201Updated last year
- 😎 Awesome lists about Speech Emotion Recognition☆91Updated 6 months ago
- An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.☆171Updated 3 months ago
- SSR-Speech: Towards Stable, Safe and Robust Zero-shot Speech Editing and Synthesis☆135Updated 5 months ago
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆170Updated 9 months ago
- UTokyo-SaruLab MOS Prediction System☆195Updated 3 weeks ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆145Updated last year
- Versatile Evaluation of Speech and Audio☆282Updated this week