Alternatives and similar repositories for Video-to-Audio-and-Piano

Users that are interested in Video-to-Audio-and-Piano are comparing it to the libraries listed below

• XiaomiMiMo / MiMo-Audio-Training
  ☆95Updated 3 months ago
• soham97 / mellow
  small audio language model for reasoning
  ☆84Updated last month
• ilpoviertola / V-AURA
  The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)
  ☆32Updated last year
• WangHelin1997 / SoloAudio
  SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer.
  ☆113Updated last year
• NKU-HLT / AudioEditor
  ☆40Updated 9 months ago
• XZWY / MSLDM
  Implementation of Multi-Source Music Generation with Latent Diffusion.
  ☆27Updated last year
• gwh22 / LAFMA
  LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)
  ☆43Updated last year
• facebookresearch / FlowDec
  An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.
  ☆196Updated 6 months ago
• wsntxxn / UniFlow-Audio
  ☆68Updated 3 weeks ago
• Audio-AGI / FlowSep
  Official implementation for FlowSep
  ☆69Updated last year
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆118Updated 8 months ago
• yanghaha0908 / EmoVoice
  Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"
  ☆105Updated 3 months ago
• qiuk2 / AAR
  [Official Implementation] Acoustic Autoregressive Modeling 🔥
  ☆74Updated last year
• Jiang-Yidi / UniCodec
  [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…
  ☆152Updated 7 months ago
• roudimit / Omni-R1
  [ASRU 2025] Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?
  ☆38Updated 2 months ago
• snap-research / GenAU
  ☆47Updated 9 months ago
• ZhikangNiu / Semantic-VAE
  Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"
  ☆106Updated last month
• zeyuxie29 / PicoAudio
  ☆43Updated last year
• PeiwenSun2000 / Both-Ears-Wide-Open
  The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
  ☆58Updated 6 months ago
• ddlBoJack / Omni-Captioner
  Data Pipeline, Models, and Benchmark for Omni-Captioner.
  ☆115Updated 3 months ago
• cyanbx / Frieren-V2A
  Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)
  ☆59Updated 9 months ago
• chouliuzuo / GVMGen
  ☆29Updated 2 months ago
• yangdongchao / SimpleSpeech
  The open source code for SimpleSpeech series
  ☆145Updated last year
• DragonLiu1995 / video-to-audio-through-text
  [NeurIPS 2024] Code, Dataset, Samples for the VATT paper “ Tell What You Hear From What You See - Video to Audio Generation Through Text”
  ☆34Updated 5 months ago
• FreedomIntelligence / FusionAudio
  Towards Fine-grained Audio Captioning with Multimodal Contextual Cues
  ☆86Updated 2 weeks ago
• xiaomi-research / diffrhythm2
  ☆107Updated 2 months ago
• HeCheng0625 / Diffusion-Speech-Tokenizer
  This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…
  ☆196Updated 4 months ago
• xiquan-li / MeanAudio
  MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows
  ☆122Updated 4 months ago
• qiuqiangkong / audio_understanding
  ☆124Updated 11 months ago
• Soul-AILab / SAC
  Trainging, inference, and testing of the SAC speech codec model.
  ☆93Updated 2 months ago