TengdaHan / AutoAD

Related projects ⓘ

Alternatives and complementary repositories for AutoAD

• Jyxarthur / AutoAD-Zero
  [ACCV 2024] Official Implementation of "AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description". Junyu Xie, Tengda Han, M…
  ☆17Updated last month
• ninatu / howtocaption
  Official implementation of "HowToCaption: Prompting LLMs to Transform Video Annotations at Scale." ECCV 2024
  ☆45Updated last month
• Lzq5 / Video-Text-Alignment
  ☆21Updated last month
• rxtan2 / Koala-video-llm
  ☆30Updated last month
• Soldelli / MAD
  MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptions
  ☆149Updated last year
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆52Updated last year
• j-min / HiREST
  Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)
  ☆90Updated last year
• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆39Updated 2 months ago
• facebookresearch / EgoVLPv2
  Code release for "EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone" [ICCV, 2023]
  ☆90Updated 4 months ago
• showlab / cosmo
  ☆72Updated 5 months ago
• GenjiB / ECLIPSE
  ☆31Updated last year
• YoadTew / zero-shot-video-to-text
  ☆73Updated 2 years ago
• ailab-kyunghee / CM2_DVC
  [CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval
  ☆44Updated 4 months ago
• schowdhury671 / meerkat
  ☆18Updated last month
• JacobChalk / TIM
  Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"
  ☆37Updated this week
• tsujuifu / pytorch_empirical-mvm
  A PyTorch implementation of EmpiricalMVM
  ☆39Updated 10 months ago
• Becomebright / GroundVQA
  Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.
  ☆50Updated last month
• CeeZh / LLoVi
  Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"
  ☆83Updated last week
• zhaoyue-zephyrus / AVION
  [arXiv:2309.16669] Code release for "Training a Large Video Model on a Single Machine in a Day"
  ☆114Updated 3 months ago
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆43Updated 11 months ago
• Hritikbansal / videocon
  ☆55Updated 6 months ago
• md-mohaiminul / ViS4mer
  ☆52Updated 2 years ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆35Updated last year
• klauscc / VindLU
  ☆101Updated last year
• PardoAlejo / MovieCuts
  Learning to cut end-to-end pretrained modules
  ☆28Updated 3 months ago
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆27Updated 4 months ago
• Yui010206 / SeViLA
  [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering
  ☆178Updated 9 months ago
• facebookresearch / ego4d-goalstep
  Ego4D Goal-Step: Toward Hierarchical Understanding of Procedural Activities (NeurIPS 2023)
  ☆37Updated 6 months ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆85Updated last year
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆69Updated 9 months ago