roudimit / whisper-flamingoLinks
Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation
☆198Updated 6 months ago
Alternatives and similar repositories for whisper-flamingo
Users that are interested in whisper-flamingo are comparing it to the libraries listed below
Sorting:
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆150Updated last year
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆47Updated last year
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆60Updated 10 months ago
- VoiceLDM: Text-to-Speech with Environmental Context☆192Updated last year
- AudioBench: A Universal Benchmark for Audio Large Language Models☆294Updated 7 months ago
- 😎 Awesome lists about Speech Emotion Recognition☆100Updated last year
- [TAFFC 2025] The official implementation of EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech via Emotion-Adaptive Spherical Vec…☆117Updated 4 months ago
- Official Code implementation for the ICLR paper "LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading"☆85Updated last year
- This repository contains the code and data for the paper EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control by Haozhe Chen,…☆81Updated last year
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆307Updated 10 months ago
- Official implementation of USR (NeurIPS 2024)☆39Updated last year
- [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.☆58Updated 2 years ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Survey".☆205Updated last week
- Official Implementation of EnCLAP (ICASSP 2024)☆94Updated last year
- Official Implementation of the work "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning"☆166Updated last year
- Codec for paper: LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆347Updated 6 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆325Updated this week
- An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.☆197Updated 6 months ago
- This is the audio sample repository for speech separation model "MossFormer2".☆170Updated last year
- ☆70Updated last year
- Official repository for the "Powerset multi-class cross entropy loss for neural speaker diarization" paper published in Interspeech 2023.☆93Updated 2 years ago
- Speaker identification/verification models for Machine Learning for Computer Vision class at UNIBO☆68Updated 3 years ago
- The official Implementation of PeriodWave and PeriodWave-Turbo☆217Updated 9 months ago
- [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"☆366Updated last year
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆197Updated last week
- Ultra-low bitrate neural audio codec (0.31~1.40 kbps) with a better semantic in the latent space.☆244Updated 10 months ago
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆267Updated last year
- SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on On…☆228Updated 8 months ago
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆188Updated last month
- Official Pytorch Implementation for "DDDM-VC: Decoupled Denoising Diffusion Models with Disentangled Representation and Prior Mixup for V…☆243Updated last year