ICML 2024 "From Vision to Audio and Beyond: A Unified Model for Audio-Visual Representation and Generation"
☆10Oct 13, 2024Updated 2 years ago
Alternatives and similar repositories for Vision-to-Audio-and-Beyond
Users that are interested in Vision-to-Audio-and-Beyond are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Apr 30, 2025Updated last year
- A curated list of Vision (video/image) to Audio Generation☆111Aug 24, 2026Updated last month
- Video Background Music Generation Using Unpaired Audio-Visual Data☆35Oct 8, 2024Updated 2 years ago
- [NeurIPS 2024] Code, Dataset, Samples for the VATT paper “ Tell What You Hear From What You See - Video to Audio Generation Through Text”☆38Jul 24, 2025Updated last year
- Open SingSong - Implementation of 'SingSong: Generating Musical Accompaniments from Singing' by Google Research, with a few modifications☆17Jun 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆44Jul 16, 2026Updated 3 months ago
- ☆43Apr 14, 2025Updated last year
- Solos: A Dataset for Audio-Visual Music Analysis☆24Feb 17, 2023Updated 3 years ago
- [ICML2023] Long-Term Rhythmic Video Soundtracker☆64Jul 28, 2025Updated last year
- Embedded segmental K-means (ES-KMeans) in Python.☆14Apr 22, 2024Updated 2 years ago
- Official Code for "Rethinking Diffusion Model in High Dimension"☆27May 20, 2025Updated last year
- [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models☆29Dec 14, 2023Updated 2 years ago
- Repository for SAVVY(Spatial Awareness via Audio-Visual LLMs through Seeing and Hearing) Benchmark and SAVVY model☆29May 30, 2026Updated 4 months ago
- Official implementation of "Video-Foley: Two-Stage Video-To-Sound Generation via Temporal Event Condition For Foley Sound". IEEE TASLP 20…☆19Feb 27, 2026Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- code for "When Counterpoints Meet Chinese Folk Melody"☆11Feb 19, 2021Updated 5 years ago
- [ICLR'25] MDSGen: Fast and Efficient Masked Diffusion Temporal-Aware Transformers for Open-Domain Sound Generation☆39Dec 25, 2025Updated 9 months ago
- ☆33Nov 10, 2025Updated 11 months ago
- Model : Give me a silent video...And I'm gonna to tell you what's happening in the video.. Will also add a new relevant background audio …☆20Sep 5, 2022Updated 4 years ago
- Record desktop workflows once and compile them into reusable AI-agent skills for reliable replay.☆40Jul 10, 2026Updated 3 months ago
- VAE modified from Descript Audio Codec, which replaces the RVQ with VAE☆92Apr 2, 2024Updated 2 years ago
- PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "☆39Dec 15, 2020Updated 5 years ago
- ☆31Nov 24, 2023Updated 2 years ago
- Pytorch implementation for “V2C: Visual Voice Cloning”☆35Jan 28, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A MacOS app built using Swift, Appkit, RealityKit Object capture which uses a series of 2D images to construct a 3D Mesh with textures, l…☆24Oct 9, 2022Updated 4 years ago
- ☆32Apr 1, 2023Updated 3 years ago
- ☆11May 30, 2025Updated last year
- ☆144Jan 24, 2026Updated 8 months ago
- Repository for the graduate course "Practical Introduction to Neural Networks" at the University of Washington☆13May 30, 2019Updated 7 years ago
- ☆11Apr 12, 2024Updated 2 years ago
- ☆12Feb 2, 2024Updated 2 years ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)☆37Feb 11, 2026Updated 8 months ago
- Official PyTorch implementation of CVPR2022 paper “Learning to Imagine: Diversify Memory for Incremental Learning using Unlabeled Data”☆13Jul 25, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- collection with description of super-resolution related papers, repositories, datasets, loss functions and etc.☆11Dec 12, 2023Updated 2 years ago
- A curated list of resources in audio visual question answering and related area. :-)☆18Jun 29, 2025Updated last year
- Official repository for "Structure-Enhanced Pop Music Generation via Harmony-Aware Learning", ACM MM 2022.☆14Mar 22, 2023Updated 3 years ago
- Implementation of the paper, T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesis, ac…☆34May 25, 2024Updated 2 years ago
- A gitmoji-cli written in rust to be independent of Node.js☆10Apr 18, 2021Updated 5 years ago
- Privacy-Preserving Image Features via Adversarial Affine Subspace Embeddings☆14Dec 20, 2022Updated 3 years ago
- 3D Gaussian Splat Easily Attacked to Cause Harm☆13Aug 5, 2025Updated last year