wzk1015 / Awesome-Vision-to-Music-Generation
A curated list of vision-to-music generation: methods, datasets, evaluation and challenges.
☆56Updated last week
Alternatives and similar repositories for Awesome-Vision-to-Music-Generation:
Users that are interested in Awesome-Vision-to-Music-Generation are comparing it to the libraries listed below
- Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".☆177Updated 3 months ago
- The official GitHub page for the survey paper "Foundation Models for Music: A Survey".☆201Updated 7 months ago
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆459Updated last week
- Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…☆182Updated last year
- The Song Describer dataset is an evaluation dataset made of ~1.1k captions for 706 permissively licensed music recordings.☆151Updated last year
- [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation☆73Updated last year
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆184Updated 10 months ago
- official code for CVPR'24 paper Diff-BGM☆62Updated 6 months ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆95Updated 6 months ago
- Metrics for evaluating music and audio generative models – with a focus on long-form, full-band, and stereo generations.☆211Updated last week
- Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model☆163Updated 8 months ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025)☆22Updated 3 months ago
- ☆55Updated 9 months ago
- ☆219Updated last month
- MU-LLaMA: Music Understanding Large Language Model☆276Updated last year
- ☆64Updated 3 weeks ago
- small audio language model for reasoning☆58Updated last week
- Long-Term Rhythmic Video Soundtracker, ICML2023☆58Updated 9 months ago
- ☆164Updated 3 months ago
- The official implementation of the IJCAI 2024 paper "MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models".☆41Updated 7 months ago
- ☆40Updated 8 months ago
- ☆49Updated 6 months ago
- Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation: A framework for generating multimodal music by bridging dif…☆24Updated 3 months ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆37Updated this week
- CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages☆142Updated last month
- AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆205Updated last week
- ☆40Updated last year
- This repository aims to collect Transformer-based sound event detection (SED) algorithms.☆55Updated last week
- CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models [NAACL 2025]☆53Updated last month
- Refactored / updated version of `stable-audio-tools` which is an open-source code for audio/music generative models originally by Stabili…☆172Updated 9 months ago