Alternatives and similar repositories for Awesome-Vison2Audio

Users that are interested in Awesome-Vison2Audio are comparing it to the libraries listed below

• ddlBoJack / MMAR
  Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
  ☆139Updated 3 weeks ago
• lmxue / Audio-FLAN
  Audio-FLAN
  ☆157Updated 3 months ago
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆42Updated 2 months ago
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆100Updated last month
• PeiwenSun2000 / Both-Ears-Wide-Open
  The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
  ☆40Updated last month
• cyanbx / Frieren-V2A
  Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)
  ☆43Updated 2 months ago
• soham97 / mellow
  small audio language model for reasoning
  ☆64Updated 2 months ago
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆166Updated last year
• ZeyueT / VidMuse
  ☆77Updated 3 weeks ago
• tencent-ailab / MuQ
  Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".
  ☆210Updated 5 months ago
• Sakshi113 / MMAU
  ☆84Updated 3 weeks ago
• thuhcsi / SpeechCraft
  The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
  ☆154Updated 2 months ago
• Lollipop / Qwen2-Audio
  The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆35Updated 9 months ago
• heng-hw / V2A-Mapper
  [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
  ☆25Updated last year
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆64Updated 8 months ago
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆156Updated 6 months ago
• zhuole1025 / SymMV
  [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation
  ☆74Updated last year
• ariesssxu / vta-ldm
  ☆61Updated 2 weeks ago
• Hannieliao / Baton
  Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"
  ☆28Updated 3 months ago
• NZqian / RapBank
  ☆66Updated 9 months ago
• tencent-ailab / MuCodec
  ☆105Updated 7 months ago
• qiuqiangkong / music_llm
  ☆51Updated 5 months ago
• sanderwood / clamp3
  CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages [ACL 2025]
  ☆164Updated last month
• xiquan-li / Awesome-Audio-Generation
  Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation
  ☆53Updated this week
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆219Updated 2 months ago
• baichuan-inc / Baichuan-Audio
  Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction
  ☆198Updated 4 months ago
• NKU-HLT / AudioEditor
  ☆37Updated 2 months ago
• OpenBMB / UltraEval-Audio
  An easy-to-use, fast, and easily integrable tool for evaluating audio LLM
  ☆115Updated 3 weeks ago
• Jiang-Yidi / UniCodec
  [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…
  ☆123Updated 3 weeks ago
• yangdongchao / LLM-Codec
  The open source code for LLM-Codec
  ☆135Updated 10 months ago