DragonLiu1995 / video-to-audio-through-textView external linksLinks
[NeurIPS 2024] Code, Dataset, Samples for the VATT paper “ Tell What You Hear From What You See - Video to Audio Generation Through Text”
☆35Jul 24, 2025Updated 6 months ago
Alternatives and similar repositories for video-to-audio-through-text
Users that are interested in video-to-audio-through-text are comparing it to the libraries listed below
Sorting:
- ☆19Aug 11, 2025Updated 6 months ago
- ☆11Apr 30, 2025Updated 9 months ago
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)☆59Apr 3, 2025Updated 10 months ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)☆32Updated this week
- A deepfake audio dataset for detecting fake speech from codec-based speech synthesis systems, Interspeech 2024☆20Jul 27, 2024Updated last year
- ☆49Apr 13, 2025Updated 10 months ago
- Code for ICLR 2024 Paper: CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models☆22Jul 10, 2024Updated last year
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆69Jan 22, 2026Updated 3 weeks ago
- Official Code for "Rethinking Diffusion Model in High Dimension"☆24May 20, 2025Updated 8 months ago
- official implementation of MGA-CLAP (ACM MM 2024)☆28Oct 25, 2024Updated last year
- ☆50Aug 27, 2024Updated last year
- [ASRU 2025] Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?☆43Nov 21, 2025Updated 2 months ago
- Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"☆41Jun 28, 2025Updated 7 months ago
- Solos: A Dataset for Audio-Visual Music Analysis☆24Feb 17, 2023Updated 3 years ago
- [EMNLP 2024] Official code repository of paper titled "PALM: Few-Shot Prompt Learning for Audio Language Models" accepted in EMNLP 2024 c…☆29Dec 22, 2024Updated last year
- The official UniVerse-1 code.☆119Oct 13, 2025Updated 4 months ago
- small audio language model for reasoning☆86Dec 4, 2025Updated 2 months ago
- ☆24Sep 10, 2025Updated 5 months ago
- [ICLR'25] MDSGen: Fast and Efficient Masked Diffusion Temporal-Aware Transformers for Open-Domain Sound Generation☆38Dec 25, 2025Updated last month
- Understanding and Tackling Hallucinations in Large Audio-Language Models | ICASSP 2025, Interspeech 2024☆32Mar 14, 2025Updated 11 months ago
- Official Implementation of "Prefix tuning for Automated Audio Captioning(ICASSP 2023)"☆31Dec 6, 2023Updated 2 years ago
- PAM is a no-reference audio quality metric for audio generation tasks☆77Jul 19, 2024Updated last year
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆32Mar 4, 2025Updated 11 months ago
- Prediction of sound event bounding boxes (SEBBs)☆32Aug 2, 2024Updated last year
- ☆30Feb 4, 2021Updated 5 years ago
- ☆31Nov 24, 2023Updated 2 years ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆152Dec 5, 2024Updated last year
- Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models☆50Sep 2, 2025Updated 5 months ago
- Implementation of the paper, T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesis, ac…☆34May 25, 2024Updated last year
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".☆93Dec 8, 2023Updated 2 years ago
- Pytorch implementation for “V2C: Visual Voice Cloning”☆33Jan 28, 2023Updated 3 years ago
- Pytorch implementation of SoundCTM☆100Mar 31, 2025Updated 10 months ago
- [ICLR 2025] Enhancing Self-Supervised Models with Audio Mixtures for Polyphonic Soundscapes☆57Oct 8, 2025Updated 4 months ago
- [ICLR 2024] This is the official implementation for the paper: "Beyond imitation: Leveraging fine-grained quality signals for alignment"☆10May 5, 2024Updated last year
- [ICASSP'24] Investigating Personalization Methods in Text to Music Generation☆45Mar 27, 2024Updated last year
- ☆13Aug 28, 2024Updated last year
- ☆11Oct 31, 2024Updated last year
- Package pymcd☆40Sep 8, 2022Updated 3 years ago
- Official PyTorch implementation of ReWaS (AAAI'25) "Read, Watch and Scream! Sound Generation from Text and Video"☆43Dec 13, 2024Updated last year