ExplainableML / ZerAuCapLinks
[NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords
☆18Updated last year
Alternatives and similar repositories for ZerAuCap
Users that are interested in ZerAuCap are comparing it to the libraries listed below
Sorting:
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆26Updated last year
- This repo contains the code to reproduce the paper: "Enriched Music Representations with Multiple Cross-modal Contrastive Learning"☆15Updated 2 years ago
- Source code for the paper 'Audio Captioning Transformer'☆57Updated 3 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆57Updated 2 years ago
- ☆43Updated 7 months ago
- ☆18Updated 7 months ago
- Solos: A Dataset for Audio-Visual Music Analysis☆24Updated 2 years ago
- Official source codes of airsep☆38Updated last year
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆48Updated last year
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆38Updated last year
- Project for MIDI to Audio Synthesis☆25Updated 2 years ago
- Repo of the paper "Towards Building an End-to-End Multilingual Automatic Lyrics Transcription Model""☆14Updated last year
- ☆32Updated 8 months ago
- ☆42Updated 2 years ago
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆24Updated 3 years ago
- Codebase and project page for EDMSound☆35Updated 2 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆53Updated last year
- music semantic understanding evaluation benchmark☆25Updated 2 years ago
- ☆72Updated last year
- [ICML2023] Long-Term Rhythmic Video Soundtracker☆61Updated 4 months ago
- Tools for the evaluation of audio captioning.☆18Updated 5 years ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 4 years ago
- Official implementation of "Learning Music Audio Representations Via Weak Language Supervision" (ICASSP 2022)☆47Updated last year
- Implementation of Multi-Source Music Generation with Latent Diffusion.☆27Updated last year
- A unified model for zero-shot singing voice conversion and synthesis☆22Updated 3 years ago
- A spoken version of the textual story cloze benchmark☆19Updated 2 years ago
- ☆13Updated 3 years ago
- Textless Speech-to-Music Retrieval Using Emotion Similarity [ICASSP23]☆17Updated 2 years ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆87Updated last year
- ☆55Updated 4 months ago