ChanganVR / action2sound
Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
☆21Updated 6 months ago
Alternatives and similar repositories for action2sound:
Users that are interested in action2sound are comparing it to the libraries listed below
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025)☆22Updated 3 months ago
- Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence☆18Updated 10 months ago
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)☆34Updated 2 weeks ago
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆67Updated 7 months ago
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆46Updated 2 months ago
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)☆58Updated 2 months ago
- SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer.☆84Updated 3 months ago
- The official implementation of the IJCAI 2024 paper "MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models".☆41Updated 7 months ago
- small audio language model for reasoning☆55Updated 3 weeks ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆94Updated 5 months ago
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆26Updated last month
- Long-Term Rhythmic Video Soundtracker, ICML2023☆58Updated 9 months ago
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".☆86Updated last year
- ☆11Updated 8 months ago
- This is the official implementation of our multi-channel multi-speaker multi-spatial neural audio codec architecture.☆49Updated last month
- Implementation of Multi-Source Music Generation with Latent Diffusion.☆23Updated 7 months ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆81Updated 9 months ago
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆182Updated 10 months ago
- Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.☆13Updated 3 months ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆32Updated 5 months ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆51Updated last year
- ☆49Updated 6 months ago
- ☆34Updated 2 weeks ago
- Pytorch implementation for “V2C: Visual Voice Cloning”☆32Updated 2 years ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆36Updated last week
- ☆106Updated 2 months ago
- ☆20Updated last month
- This repository contains the code and data for the paper EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control by Haozhe Chen,…☆69Updated 6 months ago
- ☆24Updated last week
- Codebase and project page for EDMSound☆34Updated last year