Alternatives and similar repositories for action2sound

Users that are interested in action2sound are comparing it to the libraries listed below

• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆84Updated last year
• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆90Updated last year
• GalaxyCong / EmoDubber
  Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.
  ☆29Updated 5 months ago
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆195Updated last year
• ilpoviertola / V-AURA
  The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)
  ☆30Updated 10 months ago
• FreedomIntelligence / EchoX
  EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs
  ☆40Updated last month
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆86Updated last year
• snap-research / GenAU
  ☆42Updated 6 months ago
• Ego4DSounds / Ego4DSounds
  Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence
  ☆18Updated last year
• sukun1045 / video-physics-sound-diffusion
  ☆47Updated last year
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆93Updated last month
• lzhangbj / ASVA
  [ECCV 2024 Oral] Audio-Synchronized Visual Animation
  ☆56Updated last year
• schowdhury671 / melfusion
  ☆58Updated last year
• ldzhangyx / MusicMagus
  The official implementation of the IJCAI 2024 paper "MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models".
  ☆45Updated last year
• happylittlecat2333 / Auffusion
  Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…
  ☆188Updated last year
• OpenGVLab / LORIS
  [ICML2023] Long-Term Rhythmic Video Soundtracker
  ☆60Updated 3 months ago
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆112Updated 5 months ago
• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆47Updated last year
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆178Updated last year
• showlab / AVA-AVD
  ☆19Updated 2 years ago
• qiuk2 / AAR
  [Official Implementation] Acoustic Autoregressive Modeling 🔥
  ☆71Updated last year
• X-LANCE / VQTalker
  [AAAI 2025] VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization
  ☆51Updated 10 months ago
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆70Updated last year
• Hannieliao / Baton
  Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"
  ☆29Updated 7 months ago
• zszheng147 / Spatial-AST
  🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)
  ☆63Updated 8 months ago
• guyyariv / TempoTokens
  This repo contains the official PyTorch implementation of: Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptati…
  ☆128Updated 8 months ago
• soham97 / mellow
  small audio language model for reasoning
  ☆80Updated 6 months ago
• ZeyueT / VidMuse
  ☆100Updated 4 months ago
• SheldonTsui / PseudoBinaural_CVPR2021
  Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)
  ☆66Updated 4 years ago
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆39Updated 2 years ago