swarupbehera / awesome-audio-visual-question-answeringLinks
A curated list of resources in audio visual question answering and related area. :-)
☆14Updated 3 months ago
Alternatives and similar repositories for awesome-audio-visual-question-answering
Users that are interested in awesome-audio-visual-question-answering are comparing it to the libraries listed below
Sorting:
- Official Repository for "Audio-Visual Spatial Integration and Recursive Attention for Robust Sound Source Localization" (ACM MM 2023)☆17Updated last year
- Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos☆24Updated last year
- The official implementation of the IJCAI 2024 paper "MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models".☆45Updated last year
- Demo page of TAVGBench: Benchmarking Text to Audible-Video Generation☆14Updated 6 months ago
- NeurIPS'2023 official implementation code☆66Updated last year
- Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language☆83Updated last year
- Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.☆28Updated 4 months ago
- ☆58Updated last year
- ☆19Updated last year
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆85Updated last year
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆29Updated 7 months ago
- [ICML2023] Long-Term Rhythmic Video Soundtracker☆60Updated 2 months ago
- official code for CVPR'24 paper Diff-BGM☆69Updated 11 months ago
- [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation☆76Updated last year
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆25Updated last year
- Pytorch implementation for “V2C: Visual Voice Cloning”☆32Updated 2 years ago
- Official PyTorch implementation for "MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens…☆34Updated 3 months ago
- ☆26Updated 7 months ago
- Towards Long Form Audio-visual Video Understanding☆15Updated 5 months ago
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆40Updated last year
- Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"☆32Updated 7 months ago
- ☆47Updated last year
- ☆19Updated 2 years ago
- A list of current Audio-Vision Multimodal with awesome resources (paper, application, data, review, survey, etc.).☆26Updated last year
- ☆44Updated 4 months ago
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆46Updated last year
- Source code for the paper 'Audio Captioning Transformer'☆57Updated 3 years ago
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆81Updated last week
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆53Updated last year
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated last year