ExplainableML / ZerAuCap
[NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords
☆16Updated last month
Alternatives and similar repositories for ZerAuCap:
Users that are interested in ZerAuCap are comparing it to the libraries listed below
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆36Updated last year
- ☆9Updated 7 months ago
- An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"☆30Updated last year
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)☆39Updated 8 months ago
- Official source codes of airsep☆35Updated 9 months ago
- ☆36Updated last year
- Solos: A Dataset for Audio-Visual Music Analysis☆21Updated last year
- Evaluation script for VoxMovies dataset in PyTorch☆22Updated last year
- " Music Style Transfer with Time-Varying Inversion of Diffusion Models"☆37Updated 5 months ago
- Project for MIDI to Audio Synthesis☆22Updated last year
- Implementation of Multi-Source Music Generation with Latent Diffusion.☆21Updated 4 months ago
- ☆11Updated 5 months ago
- Event Relation in Text-to-Audio (TTA) Generation☆17Updated this week
- Musical Word Embedding for Music Tagging and Retrieval [IEEE TASLP]☆23Updated 8 months ago
- A spoken version of the textual story cloze benchmark☆14Updated last year
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 3 years ago
- Codebase and project page for EDMSound☆33Updated last year
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- Long-Term Rhythmic Video Soundtracker, ICML2023☆55Updated 6 months ago
- Pytorch implementation for “V2C: Visual Voice Cloning”☆29Updated last year
- Source code for the paper 'Audio Captioning Transformer'☆52Updated 3 years ago
- ☆25Updated 5 months ago
- The official implementation of DMEL the method presented in the paper "DMEL: The differentiable log-Mel spectrogram as a trainable layer …☆18Updated 3 weeks ago
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆18Updated 4 months ago
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆39Updated last year
- Landing Page for All Things Source Separation☆19Updated 2 months ago
- Audio Generation model working with GPT-2 and VQVAE compressed representation of MelSpectrograms☆18Updated last year
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆41Updated 3 months ago
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆19Updated last year