justivanr / art2mus_Links
Art2Mus is a system that generates music based on digitized artworks and text by using the AudioLDM2 architecture with an added projection layer for integrating visual and textual inputs.
☆17Updated 9 months ago
Alternatives and similar repositories for art2mus_
Users that are interested in art2mus_ are comparing it to the libraries listed below
Sorting:
- ☆23Updated 3 weeks ago
- Implementation of the paper, T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesis, ac…☆33Updated last year
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)☆39Updated last year
- ☆38Updated 6 months ago
- A repo that builds text to music datasets from scratch, used in MuseContorlLite [ICML2025]☆25Updated 4 months ago
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆48Updated 11 months ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)☆28Updated 9 months ago
- Video Background Music Generation Using Unpaired Audio-Visual Data☆29Updated 11 months ago
- [ICASSP2025] Official code for VoiceDiT: Dual-Condition Diffusion Transformer for Environment-Aware Speech Synthesis☆23Updated 5 months ago
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆71Updated last year
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)☆52Updated 6 months ago
- The open-source code of UniAudio2.0☆73Updated last month
- Source code for the EMNLP 2025 paper “DM-Codec: Distilling Multimodal Representations for Speech Tokenization”☆53Updated 4 months ago
- Official implementation of Mozart's Touch: A Lightweight Multi-modal Music Generation Framework Based on Pre-Trained Large Models☆41Updated 7 months ago
- ☆13Updated 2 years ago
- ☆54Updated 2 months ago
- Implementation of Multi-Source Music Generation with Latent Diffusion.☆26Updated last year
- Findings of ACL 2023 | AlignSTS: a speech-to-singing (STS) model based on modality disentanglement and cross-modal alignment☆68Updated last year
- Elucidated Text-To-Audio (ETTA) is a SOTA text-to-audio model with a holistic understanding of the design space and trained with syntheti…☆55Updated 3 months ago
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated last year
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆58Updated last year
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆90Updated 10 months ago
- VAE modified from Descript Audio Codec, which replaces the RVQ with VAE☆81Updated last year
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆32Updated 2 weeks ago
- The implementation of paper "SpeechTripleNet: End-to-End Disentangled Speech Representation Learning for Content, Timbre and Prosody"☆34Updated last year
- Code for ICLR 2024 Paper: CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models☆19Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆61Updated 11 months ago
- Inference code for Interspeech 2025 paper, "LSCodec: Low-Bitrate and Speaker-Decoupled Discrete Speech Codec"☆25Updated 3 weeks ago
- Audio Prompt Adapter: Unleashing music editing abilities for text-to-music with lightweight finetuning [ISMIR 2024]☆56Updated 11 months ago
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows☆95Updated last month