Alternatives and similar repositories for Awesome-Vison2Audio

Users that are interested in Awesome-Vison2Audio are comparing it to the libraries listed below

• ddlBoJack / MMAR
  [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
  ☆192Updated last month
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆118Updated 8 months ago
• cyanbx / Frieren-V2A
  Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)
  ☆59Updated 9 months ago
• lmxue / Audio-FLAN
  Audio-FLAN
  ☆160Updated 4 months ago
• ddlBoJack / Omni-Captioner
  Data Pipeline, Models, and Benchmark for Omni-Captioner.
  ☆115Updated 3 months ago
• DragonLiu1995 / video-to-audio-through-text
  [NeurIPS 2024] Code, Dataset, Samples for the VATT paper “ Tell What You Hear From What You See - Video to Audio Generation Through Text”
  ☆35Updated 6 months ago
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆188Updated last year
• soham97 / mellow
  small audio language model for reasoning
  ☆86Updated last month
• Sakshi113 / MMAU
  ☆132Updated 4 months ago
• heng-hw / V2A-Mapper
  [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
  ☆27Updated 2 years ago
• Jiang-Yidi / UniCodec
  [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…
  ☆153Updated 8 months ago
• wzk1015 / Awesome-Vision-to-Music-Generation
  [ISMIR 2025] A curated list of vision-to-music generation: methods, datasets, evaluation and challenges.
  ☆118Updated 5 months ago
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆58Updated 9 months ago
• tencent-ailab / MuQ
  Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".
  ☆301Updated 5 months ago
• yanghaha0908 / EmoVoice
  Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"
  ☆107Updated 3 months ago
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆104Updated 4 months ago
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆288Updated 3 months ago
• PeiwenSun2000 / Both-Ears-Wide-Open
  The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
  ☆58Updated 6 months ago
• XiaomiMiMo / MiMo-Audio-Tokenizer
  A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.
  ☆131Updated 4 months ago
• ilpoviertola / V-AURA
  The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)
  ☆32Updated last year
• XinhaoMei / WavCaps
  This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.
  ☆255Updated last year
• imxtx / awesome-controllable-speech-synthesis
  This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Survey".
  ☆205Updated last week
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆127Updated last year
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆194Updated last year
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆200Updated last year
• ZhikangNiu / encodec-pytorch
  unofficial implementation of the High Fidelity Neural Audio Compression
  ☆173Updated last year
• MorenoLaQuatra / audiocaps-download
  This package aims at simplifying the download of the AudioCaps dataset.
  ☆36Updated 2 years ago
• zhuole1025 / SymMV
  [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation
  ☆78Updated last year
• happylittlecat2333 / Auffusion
  Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…
  ☆194Updated last year
• facebookresearch / FlowDec
  An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.
  ☆197Updated 6 months ago