ICML 2024 "From Vision to Audio and Beyond: A Unified Model for Audio-Visual Representation and Generation"
☆10Oct 13, 2024Updated 2 years ago
Alternatives and similar repositories for Vision-to-Audio-and-Beyond
Users that are interested in Vision-to-Audio-and-Beyond are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2024] Code, Dataset, Samples for the VATT paper “ Tell What You Hear From What You See - Video to Audio Generation Through Text”☆37Jul 24, 2025Updated last year
- A curated list of Vision (video/image) to Audio Generation☆112Aug 24, 2026Updated 2 months ago
- ☆12Apr 30, 2025Updated last year
- ☆31Feb 4, 2021Updated 5 years ago
- PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "☆40Dec 15, 2020Updated 5 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Video Background Music Generation Using Unpaired Audio-Visual Data☆36Oct 8, 2024Updated 2 years ago
- Open SingSong - Implementation of 'SingSong: Generating Musical Accompaniments from Singing' by Google Research, with a few modifications☆17Jun 10, 2024Updated 2 years ago
- [CVPR 2025] Pytorch implementation of the paper "Hearing Anywhere in Any Environment"☆36Sep 18, 2025Updated last year
- Solos: A Dataset for Audio-Visual Music Analysis☆24Feb 17, 2023Updated 3 years ago
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆44Jul 16, 2026Updated 3 months ago
- Repository for SAVVY(Spatial Awareness via Audio-Visual LLMs through Seeing and Hearing) Benchmark and SAVVY model☆30May 30, 2026Updated 5 months ago
- Embedded segmental K-means (ES-KMeans) in Python.☆14Apr 22, 2024Updated 2 years ago
- ☆44Apr 14, 2025Updated last year
- Official Code for "Rethinking Diffusion Model in High Dimension"☆27May 20, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions☆34Feb 6, 2025Updated last year
- Official implementation of "Video-Foley: Two-Stage Video-To-Sound Generation via Temporal Event Condition For Foley Sound". IEEE TASLP 20…☆19Feb 27, 2026Updated 8 months ago
- This is a third party implementation of the paper "The Audio-Visual Conversational Graph: From an Egocentric-Exocentric Perspective".☆12Apr 1, 2025Updated last year
- [ICML2023] Long-Term Rhythmic Video Soundtracker☆64Jul 28, 2025Updated last year
- [ICLR'25] MDSGen: Fast and Efficient Masked Diffusion Temporal-Aware Transformers for Open-Domain Sound Generation☆39Dec 25, 2025Updated 10 months ago
- code for "When Counterpoints Meet Chinese Folk Melody"☆11Feb 19, 2021Updated 5 years ago
- [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models☆29Dec 14, 2023Updated 2 years ago
- Code used in our NeurIPS 2022 paper 'AVLEN: Audio-Visual-Language Embodied Navigation in 3D Environments'☆12Jul 13, 2023Updated 3 years ago
- Cross-Linguistic Transcription Systems☆18Oct 27, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Model : Give me a silent video...And I'm gonna to tell you what's happening in the video.. Will also add a new relevant background audio …☆20Sep 5, 2022Updated 4 years ago
- Korean stereoypte detector with TUNiB-Electra and K-StereoSet☆13Oct 15, 2021Updated 5 years ago
- [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners☆154Jul 6, 2024Updated 2 years ago
- ☆31Nov 24, 2023Updated 2 years ago
- A MacOS app built using Swift, Appkit, RealityKit Object capture which uses a series of 2D images to construct a 3D Mesh with textures, l…☆24Oct 9, 2022Updated 4 years ago
- VAE modified from Descript Audio Codec, which replaces the RVQ with VAE☆92Apr 2, 2024Updated 2 years ago
- Pytorch implementation for “V2C: Visual Voice Cloning”☆35Jan 28, 2023Updated 3 years ago
- Evaluation code for RBench-V. Based on https://github.com/open-compass/VLMEvalKit.☆12May 24, 2025Updated last year
- A collection of tools and guides for preparing popular lipreading and audio-visual speech recognition datasets into a unified, standardiz…☆13Oct 28, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆144Jan 24, 2026Updated 9 months ago
- ☆33Nov 10, 2025Updated last year
- ☆32Apr 1, 2023Updated 3 years ago
- Repository for the graduate course "Practical Introduction to Neural Networks" at the University of Washington☆13May 30, 2019Updated 7 years ago
- Merge Diffusion Tool is an open-source solution for merging LoRA models, integrating LoRA into checkpoints, and blending Flux And Stable …☆29Sep 17, 2024Updated 2 years ago
- ☆13May 2, 2025Updated last year
- Paper card and HF model link for Adaptation of Whisper models to child speech recognition☆12May 23, 2023Updated 3 years ago
Are these results useful?