justivanr / art2mus_Links
Art2Mus is a system that generates music based on digitized artworks and text by using the AudioLDM2 architecture with an added projection layer for integrating visual and textual inputs.
☆18Updated this week
Alternatives and similar repositories for art2mus_
Users that are interested in art2mus_ are comparing it to the libraries listed below
Sorting:
- ☆24Updated last month
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆48Updated last year
- A repo that builds text to music datasets from scratch, used in MuseContorlLite [ICML2025]☆26Updated 5 months ago
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)☆41Updated last year
- Implementation of the paper, T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesis, ac…☆34Updated last year
- ☆13Updated 2 years ago
- [ICASSP2025] Official code for VoiceDiT: Dual-Condition Diffusion Transformer for Environment-Aware Speech Synthesis☆24Updated 6 months ago
- ☆39Updated 6 months ago
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)☆52Updated 6 months ago
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆71Updated last year
- ☆54Updated 3 months ago
- Video Background Music Generation Using Unpaired Audio-Visual Data☆29Updated last year
- The open-source code of UniAudio2.0☆74Updated last month
- FastSAG: Towards Fast Non-Autoregressive Singing Accompaniment Generation☆26Updated 10 months ago
- A Singing Style Conversion Framework Based On Audio Infilling☆27Updated 5 months ago
- Elucidated Text-To-Audio (ETTA) is a SOTA text-to-audio model with a holistic understanding of the design space and trained with syntheti…☆70Updated last week
- Training, validation, and inference code for various SSL approaches and architectures.☆67Updated this week
- Official implementation of Mozart's Touch: A Lightweight Multi-modal Music Generation Framework Based on Pre-Trained Large Models☆41Updated 7 months ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)☆29Updated 9 months ago
- Implementation of Multi-Source Music Generation with Latent Diffusion.☆26Updated last year
- The MIR-MLPop dataset and the official implementation of the paper "MIR-MLPop: A Multilingual Pop Music Dataset with Time-Aligned Lyrics …☆29Updated last year
- Code for ICLR 2024 Paper: CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models☆19Updated last year
- Findings of ACL 2023 | AlignSTS: a speech-to-singing (STS) model based on modality disentanglement and cross-modal alignment☆68Updated last year
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆58Updated last year
- ☆43Updated 9 months ago
- Official repository for the paper Singing Voice Graph Modeling for SingFake Detection (Interspeech 2024).☆25Updated last month
- VAE modified from Descript Audio Codec, which replaces the RVQ with VAE☆81Updated last year
- Inference code for Interspeech 2025 paper, "LSCodec: Low-Bitrate and Speaker-Decoupled Discrete Speech Codec"☆29Updated last month
- The implementation of paper "SpeechTripleNet: End-to-End Disentangled Speech Representation Learning for Content, Timbre and Prosody"☆35Updated last year
- Event Relation in Text-to-Audio (TTA) Generation☆20Updated 8 months ago