Alternatives and similar repositories for Awesome-Vison2Audio:

Users that are interested in Awesome-Vison2Audio are comparing it to the libraries listed below

• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆94Updated 5 months ago
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆32Updated last week
• RainBowLuoCS / OpenOmni
  OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…
  ☆40Updated 2 weeks ago
• ariesssxu / vta-ldm
  ☆54Updated 8 months ago
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆59Updated 5 months ago
• NZqian / RapBank
  ☆63Updated 6 months ago
• LiuZH-19 / SongGen
  ☆210Updated last week
• cyanbx / Frieren-V2A
  Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)
  ☆31Updated 4 months ago
• ZeyueT / VidMuse
  ☆57Updated 3 weeks ago
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆160Updated 10 months ago
• Hannieliao / Baton
  Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"
  ☆23Updated 3 weeks ago
• zhuole1025 / SymMV
  [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation
  ☆71Updated last year
• tencent-ailab / MuQ
  Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".
  ☆169Updated 2 months ago
• Sakshi113 / MMAU
  ☆54Updated this week
• Haoqiu-Yan / PerceptiveAgent
  Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))
  ☆42Updated 7 months ago
• baichuan-inc / Baichuan-Audio
  Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction
  ☆166Updated last month
• PeiwenSun2000 / Both-Ears-Wide-Open
  The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
  ☆33Updated last week
• qiuqiangkong / music_llm
  ☆46Updated 2 months ago
• sanderwood / clamp3
  CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages
  ☆129Updated last month
• Ceaglex / LoVA
  The code and weight for LoVA. LoVA is a novel model for Long-form Video-to-Audio generation. Based on the Diffusion Transformer (DiT) arc…
  ☆12Updated last month
• lmxue / Audio-FLAN
  Audio-FLAN
  ☆140Updated 3 weeks ago
• zihaod / MusiLingo
  ☆38Updated 7 months ago
• lsfhuihuiff / Dance-to-music_Siggraph_Asia_2024
  The official code for “Dance-to-Music Generation with Encoder-based Textual Inversion“
  ☆20Updated 2 weeks ago
• yangdongchao / LLM-Codec
  The open source code for LLM-Codec
  ☆132Updated 7 months ago
• multimodal-art-projection / Open-Suno
  trying to reproduce suno v3
  ☆32Updated 2 months ago
• TiffanyBlews / MozartsTouch
  Official implementation of Mozart's Touch: A Lightweight Multi-modal Music Generation Framework Based on Pre-Trained Large Models
  ☆31Updated 3 weeks ago
• ddlBoJack / Awesome-Speech-Language-Model
  Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.
  ☆163Updated 4 months ago
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆186Updated 2 months ago
• youngsheen / GPST
  [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer
  ☆52Updated 4 months ago
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆179Updated 10 months ago