ExplainableML / ZerAuCapLinks
[NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords
☆17Updated 10 months ago
Alternatives and similar repositories for ZerAuCap
Users that are interested in ZerAuCap are comparing it to the libraries listed below
Sorting:
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆25Updated last year
- A unified model for zero-shot singing voice conversion and synthesis☆21Updated 2 years ago
- ☆17Updated 5 months ago
- Repo of the paper "Towards Building an End-to-End Multilingual Automatic Lyrics Transcription Model""☆13Updated last year
- A spoken version of the textual story cloze benchmark☆19Updated 2 years ago
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆38Updated last year
- This repo contains the code to reproduce the paper: "Enriched Music Representations with Multiple Cross-modal Contrastive Learning"☆15Updated 2 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆55Updated 2 years ago
- Codebase and project page for EDMSound☆34Updated last year
- Temporary anonymous version☆22Updated last year
- Evaluation script for VoxMovies dataset in PyTorch☆23Updated last year
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆48Updated 11 months ago
- ☆20Updated last year
- This is the official implementation of our multi-channel multi-speaker multi-spatial neural audio codec architecture.☆50Updated 6 months ago
- Source code for the paper 'Audio Captioning Transformer'☆57Updated 3 years ago
- ☆30Updated 6 months ago
- Implementation of multi-level Contrastive Predictive Coding (CPC) methods☆19Updated 2 years ago
- ☆41Updated 5 months ago
- Solos: A Dataset for Audio-Visual Music Analysis☆24Updated 2 years ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 4 years ago
- Official Implementation of EnCLAP (ICASSP 2024)☆94Updated last year
- ☆15Updated 4 years ago
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆20Updated 2 years ago
- ☆13Updated 3 years ago
- Project for MIDI to Audio Synthesis☆25Updated 2 years ago
- music semantic understanding evaluation benchmark☆25Updated 2 years ago
- ☆84Updated 2 years ago
- Code for the paper "MULTI-BAND MASKING FOR WAVEFORM-BASED SINGING VOICE SEPARATION" that was accepted on EUSIPCO2022☆15Updated 3 years ago
- Frechet Audio Distance evaluation in PyTorch☆35Updated 2 years ago
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆23Updated 3 years ago