joeljang / music2video
Making an AI-generated music video from any song with Wav2CLIP and VQGAN-CLIP
☆229Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for music2video
- PyTorch implementation of MuseMorphose (published at IEEE/ACM TASLP), a Transformer-based model for music style transfer.☆174Updated last year
- Word2Wave: a framework for generating short audio samples from a text prompt using WaveGAN and COALA.☆119Updated 2 years ago
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆348Updated 4 months ago
- A novel diffusion-based model for synthesizing long-context, high-fidelity music efficiently.☆194Updated last year
- [ECCV2022] D2M-GAN for music generation from dance videos☆85Updated 2 years ago
- Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP☆328Updated 2 years ago
- Implements VQGAN+CLIP for image and video generation, and style transfers, based on text and image prompts. Emphasis on ease-of-use, docu…☆113Updated 2 years ago
- Source code for "FIGARO: Generating Symbolic Music with Fine-Grained Artistic Control"☆142Updated last month
- Symphony Generation with Permutation Invariant Language Model☆250Updated 2 years ago
- [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer☆292Updated 3 months ago
- GPT3-based Multi-Instrumental MIDI Music AI Implementation☆45Updated 2 years ago
- [CVPR 2022] Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning☆193Updated 2 years ago
- Trainer for audio-diffusion-pytorch☆127Updated last year
- MusicTransformer written for MaestroV2 using the Pytorch framework for music generation☆239Updated 2 years ago
- Official implementation of compound word transformer (AAAI'21)☆271Updated 11 months ago
- Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch☆546Updated last year
- Transformer-XL for Jazz music composition. Paper: "The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-Composed Musi…☆125Updated last year
- Exploring the Efficacy of Pre-trained Checkpoints in Text-to-Music Generation Task [AAAI 2023 Workshop]☆74Updated last year
- ☆383Updated 6 months ago
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆285Updated 7 months ago
- Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transfo…☆80Updated 3 years ago
- A collection of pretrained models for StyleGAN3☆284Updated 2 years ago
- The latent diffusion model for text-to-music generation.☆156Updated 9 months ago
- Implementation of Stochastic Image-to-Video Synthesis using cINNs.☆184Updated 2 years ago
- MelGAN-VC: Voice Conversion and Audio Style Transfer on arbitrarily long samples using Spectrograms☆228Updated 2 years ago
- Symbolic Music Generation with Diffusion Models☆221Updated this week
- tools to manipulate audio with riffusion☆87Updated last year
- ☆53Updated 2 weeks ago
- Website for tutorial "Generating Music with GANs: An Overview and Case Studies"☆78Updated 3 years ago
- DeepAFx-ST - Style transfer of audio effects with differentiable signal processing. Please see https://csteinmetz1.github.io/DeepAFx-ST/☆369Updated last year