Alternatives and similar repositories for Awesome-Vison2Audio

Users that are interested in Awesome-Vison2Audio are comparing it to the libraries listed below

• ddlBoJack / MMAR
  Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
  ☆159Updated 2 months ago
• cyanbx / Frieren-V2A
  Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)
  ☆48Updated 4 months ago
• lmxue / Audio-FLAN
  Audio-FLAN
  ☆157Updated 5 months ago
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆233Updated 3 months ago
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆105Updated 2 months ago
• tencent-ailab / MuQ
  Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".
  ☆236Updated last week
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆169Updated last year
• Jiang-Yidi / UniCodec
  [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…
  ☆137Updated 2 months ago
• Sakshi113 / MMAU
  ☆96Updated last month
• soham97 / mellow
  small audio language model for reasoning
  ☆71Updated 3 months ago
• PeiwenSun2000 / Both-Ears-Wide-Open
  The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
  ☆42Updated last month
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆54Updated 3 months ago
• baichuan-inc / Baichuan-Audio
  Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction
  ☆206Updated 5 months ago
• heng-hw / V2A-Mapper
  [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
  ☆25Updated last year
• facebookresearch / FlowDec
  An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.
  ☆186Updated 3 weeks ago
• stepfun-ai / Step-Audio2
  Step-Audio 2 is an end-to-end multi-modal large language model designed for industry-strength audio understanding and speech conversation…
  ☆327Updated 2 weeks ago
• imxtx / awesome-controllable-speech-synthesis
  This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".
  ☆150Updated last month
• yangdongchao / LLM-Codec
  The open source code for LLM-Codec
  ☆137Updated 11 months ago
• ddlBoJack / Awesome-Speech-Language-Model
  Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.
  ☆174Updated 9 months ago
• JimmyMa99 / train-higgs-audio
  Text-audio foundation model from Boson AI
  ☆34Updated last week
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆175Updated 7 months ago
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆67Updated 9 months ago
• qiuqiangkong / mini_llm
  ☆27Updated last month
• happylittlecat2333 / Auffusion
  Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…
  ☆187Updated last year
• OpenBMB / UltraEval-Audio
  An easy-to-use, fast, and easily integrable tool for evaluating audio LLM
  ☆132Updated 2 weeks ago
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆192Updated last year
• dreamtheater123 / Awesome-SpeechLM-Survey
  Github repository for ACL 2025 paper: Recent Advances in Speech Language Models: A Survey.
  ☆125Updated last month
• tencent-ailab / MuCodec
  ☆120Updated 8 months ago
• DragonLiu1995 / video-to-audio-through-text
  [NeurIPS 2024] Code, Dataset, Samples for the VATT paper “ Tell What You Hear From What You See - Video to Audio Generation Through Text”
  ☆24Updated 2 weeks ago
• thuhcsi / SpeechCraft
  The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
  ☆161Updated 3 months ago