hkchengrex / av-benchmarkLinks
Benchmarking for Audio-Text and Audio-Visual Generation; Supports FAD, FD_VGG, FD_PANNs, FD_PaSST, IS_PaSST, IS_PANNs, KL_PaSST, KL_PANNs, LAION-CLAP, MS-CLAP, DeSync
β54Updated 5 months ago
Alternatives and similar repositories for av-benchmark
Users that are interested in av-benchmark are comparing it to the libraries listed below
Sorting:
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)β59Updated 9 months ago
- [Official Implementation] Acoustic Autoregressive Modeling π₯β74Updated last year
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generationβ58Updated 7 months ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)β32Updated last year
- [NeurIPS 2024] Code, Dataset, Samples for the VATT paper β Tell What You Hear From What You See - Video to Audio Generation Through Textββ35Updated 6 months ago
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)β104Updated 4 months ago
- Code for Audio-Visual Target Speaker Extraction with Selective Auditory Attention (TASLP)β29Updated 11 months ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformersβ118Updated 8 months ago
- small audio language model for reasoningβ86Updated last month
- β40Updated 10 months ago
- A curated list of Vision (video/image) to Audio Generationβ96Updated 2 months ago
- A collections of audio codecs with a standardized APIβ34Updated 8 months ago
- Data Pipeline, Models, and Benchmark for Omni-Captioner.β115Updated 3 months ago
- [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Modelsβ27Updated 2 years ago
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Modelsβ200Updated last year
- π¦ Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)β72Updated 11 months ago
- Audio-FLANβ160Updated 4 months ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipelineβ194Updated last year
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"β97Updated last year
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)β40Updated 4 months ago
- β24Updated 4 months ago
- Official PyTorch implementation of ReWaS (AAAI'25) "Read, Watch and Scream! Sound Generation from Text and Video"β43Updated last year
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and sβ¦β154Updated 8 months ago
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".β93Updated 2 years ago
- Official implementation for FlowSepβ69Updated last year
- β68Updated last month
- [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representationβ44Updated last year
- β48Updated 9 months ago
- Visually-Aware Audio Captioningβ43Updated 2 years ago
- β151Updated last year