msaadsaeed / SBNet
Official implementation of SBNet as described in "Single-branch Network for Multimodal Training".
☆9Updated last year
Alternatives and similar repositories for SBNet:
Users that are interested in SBNet are comparing it to the libraries listed below
- Official implementation of FOP method as described in "Fusion and Orthogonal Projection for Improved Face-Voice Association"☆16Updated 11 months ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆60Updated 5 months ago
- An official PyTorch implementation for CLIPPR☆29Updated last year
- The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…☆10Updated last year
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆18Updated last year
- [ACM MM 2023] Official PyTorch implementation of "Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion Reco…☆11Updated last year
- The code of the paper "Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation" (CVPR2023)☆18Updated last year
- Pytorch implementation of INTEGRATED PARAMETER-EFFICIENT TUNING FOR GENERAL-PURPOSE AUDIO MODELS☆10Updated last year
- ☆11Updated last year
- ☆20Updated 10 months ago
- Source code for the paper 'Audio Captioning Transformer'☆51Updated 2 years ago
- Sapsucker Woods 60 Audiovisual Dataset☆14Updated 2 years ago
- ☆15Updated 8 months ago
- INTERSPEECH2023: Target Active Speaker Detection with Audio-visual Cues☆47Updated last year
- ☆21Updated 5 months ago
- An official pytorch implementation of AAAI 2024 paper "Latent Space Editing in Transformer-based Flow Matching"☆34Updated 9 months ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 3 years ago
- Trustworthy Speech Emotion Recognition☆13Updated last year
- Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)☆9Updated last year
- [IJCAI2022] Unsupervised Voice-Face Representation Learning by Cross-Modal Prototype Contrast☆19Updated last year
- Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)☆14Updated 3 months ago
- Official implementation of OSSGAN [CVPR 2022]☆22Updated 2 years ago
- An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"☆30Updated last year
- ☆14Updated 3 years ago
- ☆15Updated 4 months ago
- Pytorch implementation for “V2C: Visual Voice Cloning”☆30Updated last year
- The official implementation of OpenSR (ACL2023 Oral)☆15Updated last year
- ☆16Updated 7 months ago
- ☆22Updated 9 months ago
- Self-Supervised Speech/Sound Pre-training and Representation Learning Toolkit☆13Updated 2 years ago