joeljang / music2video
Making an AI-generated music video from any song with Wav2CLIP and VQGAN-CLIP
☆235Updated 2 years ago
Alternatives and similar repositories for music2video:
Users that are interested in music2video are comparing it to the libraries listed below
- Implements VQGAN+CLIP for image and video generation, and style transfers, based on text and image prompts. Emphasis on ease-of-use, docu…☆113Updated 3 years ago
- [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer☆303Updated 3 months ago
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆358Updated 8 months ago
- Symphony Generation with Permutation Invariant Language Model☆255Updated 2 years ago
- Word2Wave: a framework for generating short audio samples from a text prompt using WaveGAN and COALA.☆119Updated 3 years ago
- This is the repo for my experiments with StyleGAN2. There are many like it, but this one is mine. Contains code for the paper Audio-react…☆179Updated 3 years ago
- A novel diffusion-based model for synthesizing long-context, high-fidelity music efficiently.☆194Updated last year
- Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP☆338Updated 3 years ago
- Source code for "FIGARO: Generating Symbolic Music with Fine-Grained Artistic Control"☆151Updated 5 months ago
- GPT3-based Multi-Instrumental MIDI Music AI Implementation☆48Updated 2 years ago
- PyTorch implementation of MuseMorphose (published at IEEE/ACM TASLP), a Transformer-based model for music style transfer.☆179Updated 2 years ago
- [ECCV2022] D2M-GAN for music generation from dance videos☆85Updated 2 years ago
- Website for tutorial "Generating Music with GANs: An Overview and Case Studies"☆81Updated 4 years ago
- Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch☆546Updated 2 years ago
- VQGAN+CLIP Colab Notebook with user-friendly interface.☆230Updated 2 years ago
- Trainer for audio-diffusion-pytorch☆128Updated 2 years ago
- Create music videos using CLIP with BigGAN, DALL-E and StyleGAN☆53Updated 3 years ago
- A collection of pretrained models for StyleGAN3☆289Updated 2 years ago
- Official implementation of compound word transformer (AAAI'21)☆277Updated last year
- [ICLR 2021 Spotlight] A Good Image Generator Is What You Need for High-Resolution Video Synthesis☆246Updated 3 years ago
- State of the Art of Music Generation with Deep Learning and AI☆284Updated 2 years ago
- This code extends the neural style transfer image processing technique to video by generating smooth transitions between several referenc…☆169Updated 3 years ago
- Learning the Beauty in Songs: Neural Singing Voice Beautifier; ACL 2022 (Main conference); Official code☆433Updated last year
- Local image generation using VQGAN-CLIP or CLIP guided diffusion☆102Updated 2 years ago
- Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transfo…☆84Updated 4 years ago
- This is the official repository for the paper, MidiBERT-Piano: Large-scale Pre-training for Symbolic Music Understanding.☆189Updated 11 months ago
- A notebook for text-based guided image generation using StyleGANXL and CLIP.☆58Updated last year
- MusicTransformer written for MaestroV2 using the Pytorch framework for music generation☆254Updated 2 years ago
- Symbolic Music Generation with Diffusion Models☆240Updated last week
- ☆54Updated 3 months ago