Xiaohao-Liu / Awesome-Vison2AudioLinks
A curated list of Video to Audio Generation
☆45Updated last month
Alternatives and similar repositories for Awesome-Vison2Audio
Users that are interested in Awesome-Vison2Audio are comparing it to the libraries listed below
Sorting:
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆41Updated last month
- Audio-FLAN☆156Updated 3 months ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆98Updated 2 weeks ago
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)☆40Updated 2 months ago
- [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models☆25Updated last year
- ☆80Updated last week
- small audio language model for reasoning☆64Updated last month
- ☆59Updated 10 months ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆38Updated 3 weeks ago
- Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆118Updated 2 weeks ago
- a text-conditional diffusion probabilistic model capable of generating high fidelity audio.☆164Updated last year
- AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆211Updated last month
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆169Updated 6 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆102Updated 5 months ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025)☆27Updated 5 months ago
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆27Updated 3 months ago
- Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".☆198Updated 4 months ago
- CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages [ACL 2025]☆159Updated 3 weeks ago
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆74Updated last month
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆104Updated this week
- ☆47Updated 4 months ago
- official code for CVPR'24 paper Diff-BGM☆63Updated 7 months ago
- The code and weight for LoVA. LoVA is a novel model for Long-form Video-to-Audio generation. Based on the Diffusion Transformer (DiT) arc…☆14Updated 3 months ago
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆118Updated last week
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆196Updated 3 months ago
- llama-omni训练代码复现☆63Updated 4 months ago
- The open source code for LLM-Codec☆134Updated 9 months ago
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆35Updated 9 months ago
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆45Updated 10 months ago
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea …☆53Updated this week