Alternatives and similar repositories for Awesome-Vison2Audio

Users that are interested in Awesome-Vison2Audio are comparing it to the libraries listed below

• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆38Updated last month
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆95Updated 6 months ago
• Sakshi113 / MMAU
  ☆72Updated last month
• cyanbx / Frieren-V2A
  Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)
  ☆36Updated last month
• sanderwood / clamp3
  CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages
  ☆151Updated last week
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆162Updated 11 months ago
• lmxue / Audio-FLAN
  Audio-FLAN
  ☆150Updated 2 months ago
• ZeyueT / VidMuse
  ☆65Updated last month
• ariesssxu / vta-ldm
  ☆57Updated 10 months ago
• soham97 / mellow
  small audio language model for reasoning
  ☆63Updated last month
• PeiwenSun2000 / Both-Ears-Wide-Open
  The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
  ☆37Updated last week
• heng-hw / V2A-Mapper
  [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
  ☆23Updated last year
• qiuqiangkong / music_llm
  ☆46Updated 4 months ago
• NZqian / RapBank
  ☆64Updated 8 months ago
• OpenBMB / UltraEval-Audio
  An easy-to-use, fast, and easily integrable tool for evaluating audio LLM
  ☆96Updated this week
• ilpoviertola / V-AURA
  The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025)
  ☆25Updated 4 months ago
• tencent-ailab / MuQ
  Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".
  ☆182Updated 4 months ago
• ddlBoJack / MMAR
  Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
  ☆64Updated last week
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆61Updated 7 months ago
• qiuqiangkong / mini_llm
  ☆24Updated 4 months ago
• Hannieliao / Baton
  Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"
  ☆27Updated 2 months ago
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆131Updated 5 months ago
• zhuole1025 / SymMV
  [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation
  ☆74Updated last year
• Lollipop / Qwen2-Audio
  The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆34Updated 8 months ago
• LiuZH-19 / SongGen
  [ICML 2025] SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song Generation
  ☆224Updated 2 months ago
• hkchengrex / av-benchmark
  Benchmarking for Audio-Text and Audio-Visual Generation; Supports FAD, FD_VGG, FD_PANNs, FD_PaSST, IS_PaSST, IS_PANNs, KL_PaSST, KL_PANNs…
  ☆15Updated 2 months ago
• liuhuadai / OmniAudio
  PyTorch Implementation of "OmniAudio: Generating Spatial Audio from 360-Degree Video"
  ☆25Updated this week
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆206Updated 3 weeks ago
• RainBowLuoCS / OpenOmni
  OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…
  ☆49Updated this week
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆97Updated 5 months ago