swarupbehera / awesome-audio-visual-question-answeringLinks
A curated list of resources in audio visual question answering and related area. :-)
☆10Updated 3 weeks ago
Alternatives and similar repositories for awesome-audio-visual-question-answering
Users that are interested in awesome-audio-visual-question-answering are comparing it to the libraries listed below
Sorting:
- The official implementation of the IJCAI 2024 paper "MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models".☆44Updated 10 months ago
- Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos☆22Updated 9 months ago
- ☆55Updated 9 months ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆84Updated last year
- Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language☆83Updated last year
- Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"☆31Updated 5 months ago
- official code for CVPR'24 paper Diff-BGM☆66Updated 9 months ago
- Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.☆24Updated last month
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆25Updated 10 months ago
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆29Updated 4 months ago
- Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence☆18Updated last year
- Simple, Unified Repository for Retrieval-based Voice Conversion☆17Updated last year
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆40Updated last year
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)☆19Updated last year
- The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"☆32Updated last year
- ☆18Updated 2 years ago
- Long-Term Rhythmic Video Soundtracker, ICML2023☆59Updated last year
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025)☆27Updated 6 months ago
- Official PyTorch implementation for "MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens…☆32Updated last month
- small audio language model for reasoning☆71Updated 3 months ago
- Towards Long Form Audio-visual Video Understanding☆15Updated 3 months ago
- ☆47Updated 10 months ago
- NeurIPS'2023 official implementation code☆64Updated last year
- Source code for the paper 'Audio Captioning Transformer'☆54Updated 3 years ago
- [ACM MM 2023] Official PyTorch implementation of "Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion Reco…☆11Updated last year
- Pytorch implementation for “V2C: Visual Voice Cloning”☆32Updated 2 years ago
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆75Updated last month
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated 11 months ago
- The repository provides links to collections of influential and interesting research papers from top AI conferences, with open-source cod…☆109Updated last week
- ☆24Updated 4 months ago