W-Wu / DEER
☆10Updated last year
Related projects ⓘ
Alternatives and complementary repositories for DEER
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆37Updated 3 months ago
- Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)☆8Updated last year
- Source code and speech samples for the DSU-AVO paper accepted to INTERSPEECH 2023☆11Updated 6 months ago
- Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…☆29Updated last year
- Code for paper "Cross-Modal Global Interaction and Local Alignment for Audio-Visual Speech Recognition"☆19Updated last year
- Transformer-based visually grounded speech models☆19Updated 2 years ago
- Source code for the paper 'Audio Captioning Transformer'☆50Updated 2 years ago
- Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'☆43Updated 2 years ago
- ☆22Updated 7 months ago
- ☆36Updated 2 years ago
- ☆35Updated last year
- Python scripts to create noisy and reverberant 2-speaker mixture audio with Libri-Light and WHAM☆15Updated 2 weeks ago
- ☆14Updated 7 months ago
- Implementation of multi-level Contrastive Predictive Coding (CPC) methods☆20Updated last year
- Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)☆14Updated last month
- Pytorch implementation for “V2C: Visual Voice Cloning”☆30Updated last year
- An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"☆28Updated last year
- Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)☆16Updated last year
- SRTNet☆24Updated last year
- PyTorch implementation of "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scorin…☆13Updated 7 months ago
- ☆11Updated 6 months ago
- Aty-TTS: Improving fairness for spoken language understanding in atypical speech with Text-to-Speech☆10Updated 11 months ago
- A spoken version of the textual story cloze benchmark☆14Updated last year
- This repo contains script to download MUSIC dataset from youtube☆8Updated 10 months ago
- The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…☆10Updated last year
- Test-time adaptation for speech recognition model by single utterance. The official implementation of "Listen, Adapt, Better WER: Source-…☆15Updated 2 years ago
- Official implementation for MGN☆20Updated last year
- DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning☆47Updated 10 months ago
- Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.☆35Updated 3 weeks ago
- Self-Supervised Speech/Sound Pre-training and Representation Learning Toolkit☆13Updated 2 years ago