justivanr / art2mus_
Art2Mus is a system that generates music based on digitized artworks and text by using the AudioLDM2 architecture with an added projection layer for integrating visual and textual inputs.
☆16Updated 4 months ago
Alternatives and similar repositories for art2mus_:
Users that are interested in art2mus_ are comparing it to the libraries listed below
- ☆23Updated 7 months ago
- Implementation of Multi-Source Music Generation with Latent Diffusion.☆24Updated 7 months ago
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)☆38Updated 10 months ago
- Event Relation in Text-to-Audio (TTA) Generation☆17Updated 2 months ago
- Implementation of the paper, T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesis, ac…☆31Updated 11 months ago
- FastSAG: Towards Fast Non-Autoregressive Singing Accompaniment Generation☆18Updated 4 months ago
- Official repo for DiscoDiff: Coarse-to-Fine Text-to-Music Latent Diffusion presented at ICASSP 2025☆12Updated 3 weeks ago
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆45Updated 6 months ago
- Audio Prompt Adapter: Unleashing music editing abilities for text-to-music with lightweight finetuning [ISMIR 2024]☆51Updated 6 months ago
- ☆12Updated last year
- ☆13Updated 3 months ago
- Variable Bitrate Residual Vector Quantization for Audio Coding☆22Updated this week
- Source code for DM-Codec.☆41Updated 6 months ago
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆36Updated last year
- (ICASSP 2025) Learning Source Disentanglement in Neural Audio Codec☆32Updated last week
- Findings of ACL 2023 | AlignSTS: a speech-to-singing (STS) model based on modality disentanglement and cross-modal alignment☆68Updated 10 months ago
- Video Background Music Generation Using Unpaired Audio-Visual Data☆23Updated 6 months ago
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated last year
- Code for ICLR 2024 Paper: CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models☆17Updated 9 months ago
- Streaming Vocos☆24Updated 3 months ago
- This is the accompanying repository to the paper - Automatic Estimation of Singing Voice Musical Dynamics☆13Updated 6 months ago
- The implementation of paper "SpeechTripleNet: End-to-End Disentangled Speech Representation Learning for Content, Timbre and Prosody"☆32Updated last year
- Timbre Transfer using Denoising Diffusion Implicit Models (ISMIR 2023)☆27Updated last month
- ☆23Updated last month
- Audio Generation model working with GPT-2 and VQVAE compressed representation of MelSpectrograms☆18Updated last year
- A standardized toolkit of Kernel Audio Distance (KAD)—a distribution-free, unbiased, and computationally efficient metric for evaluating …☆67Updated last month
- ☆10Updated last year
- A spoken version of the textual story cloze benchmark☆16Updated last year
- ☆36Updated last month
- ☆76Updated last week