Alternatives and similar repositories for awesome-audio-visual-question-answering

Users that are interested in awesome-audio-visual-question-answering are comparing it to the libraries listed below

• zhuole1025 / SymMV
  [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation
  ☆77Updated last year
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆68Updated 2 years ago
• ldzhangyx / MusicMagus
  The official implementation of the IJCAI 2024 paper "MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models".
  ☆46Updated last year
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆87Updated last year
• GeWu-Lab / LFAV
  Towards Long Form Audio-visual Video Understanding
  ☆15Updated 7 months ago
• VisualAIKHU / SIRA-SSL
  Official Repository for "Audio-Visual Spatial Integration and Recursive Attention for Robust Sound Source Localization" (ACM MM 2023)
  ☆17Updated 2 years ago
• BriansIDP / AudioVisualLLM
  ☆19Updated last year
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆25Updated last year
• OpenNLPLab / TAVGBench
  Demo page of TAVGBench: Benchmarking Text to Audible-Video Generation
  ☆14Updated 7 months ago
• swimmiing / ACL-SSL
  Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"
  ☆33Updated 9 months ago
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆71Updated last year
• schowdhury671 / melfusion
  ☆58Updated last year
• GalaxyCong / EmoDubber
  Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.
  ☆31Updated 5 months ago
• nickjw0205 / Improving-ASR-with-LLM-Description
  ☆19Updated last year
• MCR-PEFT / Ex-MCR
  ☆45Updated 6 months ago
• zihaod / MusiLingo
  ☆49Updated last year
• yyysjz1997 / Awesome-AudioVision-Multimodal
  A list of current Audio-Vision Multimodal with awesome resources (paper, application, data, review, survey, etc.).
  ☆30Updated 2 years ago
• ZZDoog / Avatar
  Avatar: An easy-to-use digital portrait PPT presentation video generation system based on Gradio
  ☆20Updated 2 years ago
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆51Updated 8 months ago
• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆84Updated last year
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆54Updated 4 months ago
• Hannieliao / Baton
  Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"
  ☆30Updated 8 months ago
• OpenGVLab / LORIS
  [ICML2023] Long-Term Rhythmic Video Soundtracker
  ☆61Updated 4 months ago
• rxtan2 / AVSeT
  ☆17Updated 2 years ago
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆22Updated last year
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆57Updated 3 years ago
• XinhaoMei / audio-text_retrieval
  Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'
  ☆50Updated 3 years ago
• LoieSun / Auto-ACD
  code for A Large-scale Dataset for Audio-Language Representation Learning
  ☆14Updated last year
• BriansIDP / video-SALMONN-o1
  ☆37Updated 3 months ago
• JacobChalk / TIM
  Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"
  ☆48Updated last year