roudimit / whisper-flamingoLinks
Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation
β176Updated last week
Alternatives and similar repositories for whisper-flamingo
Users that are interested in whisper-flamingo are comparing it to the libraries listed below
Sorting:
- π Awesome lists about Speech Emotion Recognitionβ93Updated 7 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Modelsβ241Updated last month
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmarkβ262Updated 4 months ago
- VoiceLDM: Text-to-Speech with Environmental Contextβ181Updated 11 months ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilitiesβ138Updated 7 months ago
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translationβ148Updated last year
- Official Implementation of the work "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning"β147Updated 8 months ago
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronizationβ56Updated 4 months ago
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correctionβ254Updated last year
- β67Updated 10 months ago
- Official implementation of USR (NeurIPS 2024)β31Updated 7 months ago
- Codec for paper: LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesisβ284Updated 2 weeks ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".β149Updated last month
- [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"β352Updated 11 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistantsβ261Updated 3 weeks ago
- Update ASR paper everydayβ279Updated this week
- ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representationsβ171Updated last year
- Official repository for the "Powerset multi-class cross entropy loss for neural speaker diarization" paper published in Interspeech 2023.β88Updated last year
- An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.β186Updated 3 weeks ago
- [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.β52Updated last year
- Official Code implementation for the ICLR paper "LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading"β71Updated 10 months ago
- [TAFFC 2025] The official implementation of EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech via Emotion-Adaptive Spherical Vecβ¦β104Updated 3 months ago
- Official Implementation of EnCLAP (ICASSP 2024)β93Updated last year
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Unitsβ40Updated 9 months ago
- [INTERSPEECH 2024] The official implementation of EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for β¦β162Updated 2 months ago
- This repository contains the code and data for the paper EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control by Haozhe Chen,β¦β75Updated 10 months ago
- Training code for FAcodec presented in NaturalSpeech3β215Updated 11 months ago
- SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on Onβ¦β215Updated 2 months ago
- Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.β122Updated last year
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"β42Updated 3 months ago