PeihaoChen / regnet
Official PyTorch implementation of the TIP paper "Generating Visually Aligned Sound from Videos" and the corresponding Visually Aligned Sound (VAS) dataset.
☆53Updated 4 years ago
Alternatives and similar repositories for regnet:
Users that are interested in regnet are comparing it to the libraries listed below
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆23Updated 2 years ago
- ☆27Updated 4 years ago
- PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "☆39Updated 4 years ago
- ☆40Updated 2 years ago
- A dataset for Audio-Visual Sound Event Detection in Movies☆27Updated 2 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆52Updated last year
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆360Updated 9 months ago
- Official implementation of the pipeline presented in I hear your true colors: Image Guided Audio Generation☆113Updated 2 years ago
- Official implementation of "Learning Music Audio Representations Via Weak Language Supervision" (ICASSP 2022)☆46Updated 4 months ago
- Codebase for the paper "Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation" (ECCV2020)☆71Updated 4 years ago
- N/A☆173Updated 2 years ago
- " Music Style Transfer with Time-Varying Inversion of Diffusion Models"☆41Updated 8 months ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated 2 years ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆88Updated 2 years ago
- [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation☆73Updated last year
- Pytorch implementation for “V2C: Visual Voice Cloning”☆32Updated 2 years ago
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆46Updated 2 months ago
- Repo for Visual Acoustic Matching, CVPR 2022☆66Updated 2 years ago
- Evaluation metrics for machine-composed symbolic music. Paper: "The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-…☆63Updated 4 years ago
- A collection of audio autoencoders, in PyTorch.☆40Updated 2 years ago
- Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)☆65Updated 3 years ago
- Code for paper Learning Audio-Visual Dereverberation☆27Updated 2 years ago
- million song dataset split for extended clean tag & artist-level stratified☆48Updated last year
- Long-Term Rhythmic Video Soundtracker, ICML2023☆58Updated 9 months ago
- Source code for training models and using the hyperbolic interface proposed in our ICASSP 2023 paper, “Hyperbolic Audio Source Separation…☆64Updated last year
- Self-supervised VQ-VAE for One-Shot Music Style Transfer☆90Updated last month
- This repo contains the code to reproduce the paper: "Enriched Music Representations with Multiple Cross-modal Contrastive Learning"☆15Updated last year
- ☆16Updated last year
- Source code for the paper 'Audio Captioning Transformer'☆54Updated 3 years ago
- Unofficial PyTorch implementation of Masked Autoencoders that Listen☆66Updated 2 years ago