A curated list of Vision (video/image) to Audio Generation
☆106Feb 10, 2026Updated 4 months ago
Alternatives and similar repositories for Awesome-Vison2Audio
Users that are interested in Awesome-Vison2Audio are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [KDD 2025] Fine-tuning Multimodal Large Language Models for Product Bundling☆16Sep 20, 2025Updated 9 months ago
- [MM 2025] Towards Modality Generalization: A Benchmark and Prospective Analysis☆30May 22, 2025Updated last year
- The implementation of paper "EliMRec: Eliminating single-modal bias in multimedia recommendation", MM'22.☆24Dec 7, 2023Updated 2 years ago
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)☆61Apr 3, 2025Updated last year
- [NeurIPS 2025] L-MTP: Leap Multi-Token Prediction Beyond Adjacent Context for Large Language Models☆31May 8, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆31Nov 10, 2025Updated 7 months ago
- The implementation of paper "Leveraging Multimodal Features and Item-level User Feedback for Bundle Construction", WSDM'24.☆18Oct 30, 2025Updated 8 months ago
- A curated list of papers, tools, and resources on Multi-Token Prediction (MTP) and related techniques in Large Language Models (LLMs), Sp…☆169Jun 13, 2026Updated 3 weeks ago
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆31Dec 23, 2024Updated last year
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆348Apr 8, 2024Updated 2 years ago
- The official code for “Dance-to-Music Generation with Encoder-based Textual Inversion“☆23Jun 17, 2025Updated last year
- ☆20Apr 26, 2024Updated 2 years ago
- [ACMMM 2024] An Inverse Partial Optimal Transport Framework for Music-guided Movie Trailer Generation☆16Mar 15, 2025Updated last year
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆65Jul 2, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Audio-FLAN☆161Sep 23, 2025Updated 9 months ago
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆214Feb 25, 2026Updated 4 months ago
- [NeurIPS 2024] The implementation of paper "On Softmax Direct Preference Optimization for Recommendation"☆101Nov 29, 2024Updated last year
- [Interspeech 2024] LiteFocus is a tool designed to accelerate diffusion-based TTA model, now implemented with the base model AudioLDM2.☆34Mar 11, 2025Updated last year
- ☆43Feb 21, 2023Updated 3 years ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆207Dec 13, 2024Updated last year
- [CVPR 2024] Code and datasets for 'Learning Spatial Features from Audio-Visual Correspondence in Egocentric Videos'☆13Jun 16, 2024Updated 2 years ago
- [NeurIPS 2025] Continual Multimodal Contrastive Learning☆30Dec 18, 2025Updated 6 months ago
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆204May 29, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [2025 ACL Findings] Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalization☆25Oct 29, 2025Updated 8 months ago
- [ICLR 2025 Oral 🏆] The implementation of paper "Language Representations Can be What Recommenders Need: Findings and Potentials"☆108May 16, 2025Updated last year
- a text-conditional diffusion probabilistic model capable of generating high fidelity audio.☆199May 29, 2024Updated 2 years ago
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)☆44Jun 13, 2024Updated 2 years ago
- [KDD'25] LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential Recommendation.☆68Sep 6, 2025Updated 10 months ago
- [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners☆155Jul 6, 2024Updated 2 years ago
- ☆193Nov 19, 2025Updated 7 months ago
- [ICML2023] Long-Term Rhythmic Video Soundtracker☆63Jul 28, 2025Updated 11 months ago
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)☆130Sep 15, 2025Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The implementation of paper "Strategy-aware Bundle Recommender System", SIGIR'23.☆17Sep 4, 2023Updated 2 years ago
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆390Sep 29, 2024Updated last year
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)☆46Sep 10, 2025Updated 9 months ago
- ☆52Sep 10, 2024Updated last year
- ☆152Mar 31, 2026Updated 3 months ago
- ☆20Aug 11, 2025Updated 10 months ago
- [CVPR 2025] Repository of VidMuse☆138Jun 7, 2025Updated last year