swarupbehera / awesome-audio-visual-question-answeringLinks
A curated list of resources in audio visual question answering and related area. :-)
☆15Updated 4 months ago
Alternatives and similar repositories for awesome-audio-visual-question-answering
Users that are interested in awesome-audio-visual-question-answering are comparing it to the libraries listed below
Sorting:
- The official implementation of the IJCAI 2024 paper "MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models".☆45Updated last year
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆86Updated last year
- Official Repository for "Audio-Visual Spatial Integration and Recursive Attention for Robust Sound Source Localization" (ACM MM 2023)☆17Updated last year
- NeurIPS'2023 official implementation code☆68Updated last year
- Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos☆25Updated last year
- [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation☆76Updated last year
- official code for CVPR'24 paper Diff-BGM☆70Updated last year
- [ICML2023] Long-Term Rhythmic Video Soundtracker☆60Updated 3 months ago
- ☆17Updated 2 years ago
- Simple, Unified Repository for Retrieval-based Voice Conversion☆17Updated last year
- Implementation of the paper: "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning" in pytorch☆13Updated this week
- SMILE: A Multimodal Dataset for Understanding Laughter☆12Updated 2 years ago
- The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"☆34Updated last year
- [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆54Updated 4 months ago
- Demo page of TAVGBench: Benchmarking Text to Audible-Video Generation☆14Updated 7 months ago
- A list of current Audio-Vision Multimodal with awesome resources (paper, application, data, review, survey, etc.).☆27Updated 2 years ago
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆26Updated last year
- ☆58Updated last year
- Towards Long Form Audio-visual Video Understanding☆15Updated 6 months ago
- Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language☆84Updated last year
- Source code for the paper 'Audio Captioning Transformer'☆57Updated 3 years ago
- This repository is for The Power of Sound(TPoS): Audio Reactive Video Generation with Stable Diffusion (ICCV2023)☆23Updated last year
- Official PyTorch implementation for "MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens…☆37Updated 4 months ago
- ☆27Updated 8 months ago
- " Music Style Transfer with Time-Varying Inversion of Diffusion Models"☆57Updated last year
- ☆45Updated 5 months ago
- Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.☆29Updated 5 months ago
- ☆47Updated last year
- Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation: A framework for generating multimodal music by bridging dif…☆28Updated 9 months ago
- Official implementation of FOP method as described in "Fusion and Orthogonal Projection for Improved Face-Voice Association"☆19Updated last year