joeljang / music2video
Making an AI-generated music video from any song with Wav2CLIP and VQGAN-CLIP
☆231Updated 2 years ago
Alternatives and similar repositories for music2video:
Users that are interested in music2video are comparing it to the libraries listed below
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆355Updated 7 months ago
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆301Updated 10 months ago
- AI Music Generation for the Real World☆245Updated last year
- [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer☆302Updated 2 months ago
- PyTorch implementation of MuseMorphose (published at IEEE/ACM TASLP), a Transformer-based model for music style transfer.☆178Updated 2 years ago
- Symphony Generation with Permutation Invariant Language Model☆253Updated 2 years ago
- Implementation of MusicLM, a text to music model published by Google Research, with a few modifications.☆536Updated last year
- Word2Wave: a framework for generating short audio samples from a text prompt using WaveGAN and COALA.☆119Updated 3 years ago
- Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP☆335Updated 3 years ago
- Exploring the Efficacy of Pre-trained Checkpoints in Text-to-Music Generation Task [AAAI 2023 Workshop]☆73Updated last year
- GPT3-based Multi-Instrumental MIDI Music AI Implementation☆48Updated 2 years ago
- Trainer for audio-diffusion-pytorch☆128Updated 2 years ago
- A novel diffusion-based model for synthesizing long-context, high-fidelity music efficiently.☆194Updated last year
- Source code for "FIGARO: Generating Symbolic Music with Fine-Grained Artistic Control"☆149Updated 4 months ago
- Symbolic Music Generation with Diffusion Models☆231Updated last month
- This is the official repository for the paper, MidiBERT-Piano: Large-scale Pre-training for Symbolic Music Understanding.☆187Updated 10 months ago
- Implements VQGAN+CLIP for image and video generation, and style transfers, based on text and image prompts. Emphasis on ease-of-use, docu…☆113Updated 3 years ago
- ☆389Updated last month
- State of the Art of Music Generation with Deep Learning and AI☆284Updated last year
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆114Updated last year
- [ECCV2022] D2M-GAN for music generation from dance videos☆85Updated 2 years ago
- Learning the Beauty in Songs: Neural Singing Voice Beautifier; ACL 2022 (Main conference); Official code☆431Updated last year
- Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transfo…☆83Updated 3 years ago
- Download the MusicCaps dataset for music captioning☆105Updated last week
- List of academic resources on Multimodal ML for Music☆289Updated last year
- Official implementation of compound word transformer (AAAI'21)☆274Updated last year
- Official Implementation of "Multitrack Music Transformer" (ICASSP 2023)☆142Updated 11 months ago
- Transformer-XL for Jazz music composition. Paper: "The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-Composed Musi…☆127Updated last year
- Apply diffusion models using the new Hugging Face diffusers package to synthesize music instead of images.☆744Updated 4 months ago
- MusicTransformer written for MaestroV2 using the Pytorch framework for music generation☆249Updated 2 years ago