hkchengrex / av-benchmarkLinks
Benchmarking for Audio-Text and Audio-Visual Generation; Supports FAD, FD_VGG, FD_PANNs, FD_PaSST, IS_PaSST, IS_PANNs, KL_PaSST, KL_PANNs, LAION-CLAP, MS-CLAP, DeSync
β47Updated 4 months ago
Alternatives and similar repositories for av-benchmark
Users that are interested in av-benchmark are comparing it to the libraries listed below
Sorting:
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)β58Updated 9 months ago
- [Official Implementation] Acoustic Autoregressive Modeling π₯β74Updated last year
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generationβ56Updated 6 months ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)β31Updated last year
- [NeurIPS 2024] Code, Dataset, Samples for the VATT paper β Tell What You Hear From What You See - Video to Audio Generation Through Textββ34Updated 5 months ago
- β41Updated 9 months ago
- Data Pipeline, Models, and Benchmark for Omni-Captioner.β114Updated 2 months ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformersβ117Updated 7 months ago
- A curated list of Video to Audio Generationβ90Updated last month
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"β95Updated last year
- small audio language model for reasoningβ84Updated last month
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipelineβ193Updated last year
- π¦ Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)β70Updated 10 months ago
- [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Modelsβ27Updated 2 years ago
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)β39Updated 4 months ago
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and sβ¦β151Updated 7 months ago
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)β101Updated 3 months ago
- Audio-FLANβ160Updated 3 months ago
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Modelsβ200Updated last year
- β24Updated 4 months ago
- [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluationβ77Updated last year
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".β93Updated 2 years ago
- A collections of audio codecs with a standardized APIβ34Updated 7 months ago
- β68Updated last week
- Visually-Aware Audio Captioningβ43Updated 2 years ago
- Ego4DSounds: A diverse egocentric dataset with high action-audio correspondenceβ18Updated last year
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"β82Updated 3 months ago
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flowsβ118Updated 4 months ago
- Code for Audio-Visual Target Speaker Extraction with Selective Auditory Attention (TASLP)β29Updated 10 months ago
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)β43Updated last year