Alternatives and similar repositories for Awesome-Vison2Audio

Users that are interested in Awesome-Vison2Audio are comparing it to the libraries listed below

• ddlBoJack / MMAR
  Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
  ☆167Updated 3 months ago
• lmxue / Audio-FLAN
  Audio-FLAN
  ☆158Updated 6 months ago
• cyanbx / Frieren-V2A
  Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)
  ☆51Updated 5 months ago
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆109Updated 4 months ago
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆248Updated 5 months ago
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆177Updated last year
• tencent-ailab / MuQ
  Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".
  ☆256Updated last month
• Sakshi113 / MMAU
  ☆110Updated 3 weeks ago
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆55Updated 5 months ago
• PeiwenSun2000 / Both-Ears-Wide-Open
  The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
  ☆48Updated 2 months ago
• baichuan-inc / Baichuan-Audio
  Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction
  ☆211Updated 6 months ago
• Jiang-Yidi / UniCodec
  [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…
  ☆143Updated 3 months ago
• yanghaha0908 / EmoVoice
  Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"
  ☆80Updated 4 months ago
• soham97 / mellow
  small audio language model for reasoning
  ☆74Updated 5 months ago
• ariesssxu / vta-ldm
  ☆61Updated 3 months ago
• heng-hw / V2A-Mapper
  [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
  ☆25Updated last year
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆117Updated 9 months ago
• ddlBoJack / Awesome-Speech-Language-Model
  Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.
  ☆181Updated 10 months ago
• ZeyueT / VidMuse
  ☆91Updated 3 months ago
• EIT-NLP / LLaSO
  ☆91Updated last week
• imxtx / awesome-controllable-speech-synthesis
  This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".
  ☆162Updated this week
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆70Updated 11 months ago
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆182Updated 9 months ago
• xiquan-li / Awesome-Audio-Generation
  Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation
  ☆61Updated last month
• SparkAudio / VoxBox
  A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.
  ☆87Updated 4 months ago
• facebookresearch / FlowDec
  An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.
  ☆188Updated 2 months ago
• qiuqiangkong / mini_llm
  ☆27Updated 2 months ago
• yangdongchao / LLM-Codec
  The open source code for LLM-Codec
  ☆139Updated last year
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆195Updated last year
• thuhcsi / SpeechCraft
  The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
  ☆166Updated 5 months ago