zinengtang / TVLT

Related projects: ⓘ

• klauscc / VindLU
  ☆100Updated last year
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆185Updated 2 years ago
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆136Updated 2 years ago
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆127Updated last year
• xuguohai / X-CLIP
  An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"
  ☆127Updated 5 months ago
• tsujuifu / pytorch_empirical-mvm
  A PyTorch implementation of EmpiricalMVM
  ☆39Updated 9 months ago
• jssprz / video_captioning_datasets
  Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Pe…
  ☆109Updated 10 months ago
• ninatu / everything_at_once
  This is the official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval". CVPR 2022
  ☆93Updated 2 years ago
• Yui010206 / SeViLA
  [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering
  ☆175Updated 8 months ago
• j-min / HiREST
  Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)
  ☆88Updated 10 months ago
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆112Updated 2 years ago
• md-mohaiminul / ViS4mer
  ☆51Updated 2 years ago
• mzhaoshuai / CenterCLIP
  [SIGIR 2022] CenterCLIP: Token Clustering for Efficient Text-Video Retrieval. Also, a text-video retrieval toolbox based on CLIP + fast p…
  ☆121Updated 2 years ago
• TXH-mercury / VALOR
  Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
  ☆254Updated 3 months ago
• YoadTew / zero-shot-video-to-text
  ☆73Updated last year
• GeWu-Lab / MUSIC-AVQA
  MUSIC-AVQA, CVPR2022 (ORAL)
  ☆66Updated last year
• TengdaHan / AutoAD
  [CVPR'23 Highlight] AutoAD: Movie Description in Context.
  ☆85Updated last month
• layer6ai-labs / xpool
  https://layer6ai-labs.github.io/xpool/
  ☆111Updated last year
• yangbang18 / MultiCapCLIP
  (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
  ☆34Updated last month
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆68Updated 7 months ago
• foolwood / DRL
  [arXiv22] Disentangled Representation Learning for Text-Video Retrieval
  ☆89Updated 2 years ago
• antoyang / FrozenBiLM
  [NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Models
  ☆153Updated 11 months ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆202Updated last year
• liveseongho / Awesome-Video-Language-Understanding
  A Survey on video and language understanding.
  ☆47Updated last year
• Soldelli / MAD
  MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptions
  ☆147Updated 10 months ago
• LiuRicky / ts2_net
  [ECCV2022] A pytorch implementation for TS2-Net: Token Shift and Selection Transformer for Text-Video Retrieval
  ☆75Updated last year
• HuiGuanLab / ms-sl
  Source code of our MM'22 paper Partially Relevant Video Retrieval
  ☆51Updated 2 years ago
• antoyang / just-ask
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆117Updated 11 months ago
• tsujuifu / pytorch_violet
  A PyTorch implementation of VIOLET
  ☆136Updated 9 months ago
• yanbeic / CCL
  PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
  ☆86Updated 3 years ago