heng-hw / V2A-Mapper

Related projects: ⓘ

• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆69Updated 9 months ago
• v-iashin / Synchformer
  Efficient synchronization from sparse cues
  ☆25Updated 4 months ago
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆148Updated 3 months ago
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆38Updated 5 months ago
• ZeyueT / VidMuse
  ☆23Updated last month
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆50Updated 7 months ago
• zhuole1025 / SymMV
  [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation
  ☆65Updated 5 months ago
• OpenGVLab / LORIS
  Long-Term Rhythmic Video Soundtracker, ICML2023
  ☆54Updated 2 months ago
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆68Updated 2 months ago
• ariesssxu / vta-ldm
  ☆40Updated 2 months ago
• happylittlecat2333 / Auffusion
  Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…
  ☆141Updated 5 months ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆75Updated 3 months ago
• DavidMChan / Anim400K
  Anim-400K: A dataset designed from the ground up for automated dubbing of video
  ☆97Updated 2 months ago
• sony / CLIPSep
  ☆35Updated last year
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆30Updated last year
• naver-ai / facetts
  ☆45Updated last year
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆55Updated last year
• vskadandale / vocalist
  Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices
  ☆61Updated 5 months ago
• zhenye234 / CoMoSpeech
  CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model
  ☆177Updated 4 months ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆47Updated 2 years ago
• XinhaoMei / WavCaps
  This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.
  ☆194Updated last month
• jaeyeonkim99 / EnCLAP
  Official Implementation of EnCLAP (ICASSP 2024)
  ☆88Updated 3 months ago
• glory20h / VoiceLDM
  VoiceLDM: Text-to-Speech with Environmental Context
  ☆157Updated last month
• yzxing87 / Seeing-and-Hearing
  [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
  ☆113Updated 2 months ago
• schowdhury671 / melfusion
  ☆24Updated 2 weeks ago
• akoepke / audio-retrieval-benchmark
  Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".
  ☆45Updated 2 years ago
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆38Updated last year
• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆99Updated 5 months ago
• chuangg / Foley-Music
  PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "
  ☆41Updated 3 years ago
• RetroCirce / MusicLDM
  The latent diffusion model for text-to-music generation.
  ☆151Updated 7 months ago