PeihaoChen / regnet
Official PyTorch implementation of the TIP paper "Generating Visually Aligned Sound from Videos" and the corresponding Visually Aligned Sound (VAS) dataset.
☆52Updated 4 years ago
Alternatives and similar repositories for regnet:
Users that are interested in regnet are comparing it to the libraries listed below
- ☆37Updated last year
- PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "☆39Updated 4 years ago
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆22Updated 2 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆52Updated last year
- ☆27Updated 3 years ago
- Source code for the paper 'Audio Captioning Transformer'☆52Updated 3 years ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆84Updated 2 years ago
- Codebase for the paper "Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation" (ECCV2020)☆69Updated 4 years ago
- A dataset for Audio-Visual Sound Event Detection in Movies☆26Updated 2 years ago
- Self-supervised VQ-VAE for One-Shot Music Style Transfer☆86Updated last year
- [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation☆71Updated 10 months ago
- ☆17Updated last year
- Official implementation of "Learning Music Audio Representations Via Weak Language Supervision" (ICASSP 2022)☆46Updated last month
- Repo for Visual Acoustic Matching, CVPR 2022☆66Updated last year
- Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)☆63Updated 3 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- A collection of audio autoencoders, in PyTorch.☆39Updated last year
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)☆41Updated 9 months ago
- Official implementation of the pipeline presented in I hear your true colors: Image Guided Audio Generation☆110Updated 2 years ago
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆42Updated last month
- WaveNet auto-ancoders for ZeroSpeech challenge 2020☆36Updated 2 years ago
- Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'☆43Updated 2 years ago
- Unofficial PyTorch implementation of Masked Autoencoders that Listen☆65Updated 2 years ago
- COLA contrastive pre-training method implemented in PyTorch☆42Updated 4 years ago
- Evaluation script for VoxMovies dataset in PyTorch☆22Updated last year
- Code for CVSSP submission to DCASE 2021 Task 6☆35Updated 2 years ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆19Updated last week
- Pytorch implementation for “V2C: Visual Voice Cloning”☆29Updated 2 years ago
- ☆46Updated 2 years ago
- Source code for models described in the paper "ESResNe(X)t-fbsp: Learning Robust Time-Frequency Transformation of Audio" (https://arxiv.o…☆45Updated 3 years ago