roudimit / whisper-flamingoLinks
Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation
☆166Updated 3 weeks ago
Alternatives and similar repositories for whisper-flamingo
Users that are interested in whisper-flamingo are comparing it to the libraries listed below
Sorting:
- AudioBench: A Universal Benchmark for Audio Large Language Models☆218Updated last week
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆127Updated 5 months ago
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation☆144Updated last year
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆52Updated 2 months ago
- Codec for paper: LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆271Updated 2 months ago
- 😎 Awesome lists about Speech Emotion Recognition☆89Updated 5 months ago
- VoiceLDM: Text-to-Speech with Environmental Context☆177Updated 9 months ago
- Official implementation of USR (NeurIPS 2024)☆30Updated 5 months ago
- [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"☆342Updated 9 months ago
- This repository contains the code and data for the paper EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control by Haozhe Chen,…☆73Updated 8 months ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆39Updated 7 months ago
- FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3☆200Updated last year
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆211Updated 3 weeks ago
- Official repository for the "Powerset multi-class cross entropy loss for neural speaker diarization" paper published in Interspeech 2023.☆83Updated last year
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆238Updated 2 months ago
- [TAFFC 2025] The official implementation of EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech via Emotion-Adaptive Spherical Vec…☆93Updated last month
- ☆67Updated 8 months ago
- Audio Codec Speech processing Universal PERformance Benchmark☆255Updated last month
- ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations☆159Updated last year
- Official Implementation of EnCLAP (ICASSP 2024)☆91Updated last year
- An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.☆163Updated 2 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆144Updated 3 weeks ago
- It's a repository for implementations of neural speech editing algorithms.☆198Updated last year
- Companion repo for the paper "PixIT: Joint Training of Speaker Diarization and Speech Separation from Real-world Multi-speaker Recordings…☆88Updated 4 months ago
- Scripts for computing the Intelligibility and CLVP scores for evaluating TTS models☆155Updated last year
- Official Pytorch Implementation for "DDDM-VC: Decoupled Denoising Diffusion Models with Disentangled Representation and Prior Mixup for V…☆225Updated 10 months ago
- Versatile Evaluation of Speech and Audio☆260Updated this week
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆40Updated last month
- ☆132Updated last month
- Official Pytorch Implementation of "Diff-HierVC: Diffusion-based Hierarchical Voice Conversion with Robust Pitch Generation and Masked Pr…☆220Updated 11 months ago