microsoft / SwinBERT
Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"
☆238Updated 2 years ago
Alternatives and similar repositories for SwinBERT:
Users that are interested in SwinBERT are comparing it to the libraries listed below
- End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)☆219Updated last year
- [CVPR2023] All in One: Exploring Unified Video-Language Pre-training☆281Updated 2 years ago
- [CVPR2022] Official code for Hierarchical Modular Network for Video Captioning. Our proposed HMN is implemented with PyTorch.☆52Updated 2 years ago
- [CVPR 2022 Oral] TubeDETR: Spatio-Temporal Video Grounding with Transformers☆178Updated last year
- GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)☆189Updated last year
- [arXiv22] Disentangled Representation Learning for Text-Video Retrieval☆95Updated 3 years ago
- ☆193Updated 2 years ago
- An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"☆154Updated last year
- Span-based Localizing Network for Natural Language Video Localization (ACL 2020)☆107Updated 3 years ago
- Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Pe…☆122Updated last year
- ☆244Updated 2 years ago
- https://layer6ai-labs.github.io/xpool/☆122Updated last year
- An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆350Updated 8 months ago
- 前沿论文持续更新--视频时刻定位 or 时域语言定位 or 视频片段检索。☆249Updated last year
- Align and Prompt: Video-and-Language Pre-training with Entity Prompts☆187Updated 2 years ago
- Video Feature Extraction Code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"☆107Updated 3 years ago
- [NeurIPS 2021] Moment-DETR code and QVHighlights dataset☆301Updated 11 months ago
- PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)☆144Updated 2 years ago
- Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)☆122Updated 2 years ago
- PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529☆159Updated 2 years ago
- A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.☆70Updated last year
- Repository for the CVPR-20 paper "Local-Global Video-Text Interactions for Temporal Grounding"☆131Updated 3 years ago
- Using VideoBERT to tackle video prediction☆124Updated 3 years ago
- Temporal Moment(Action) Localization via Language / Temporal Language Grounding / Video Moment Retrieval☆97Updated 3 years ago
- [TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆286Updated 3 months ago
- [ECCV2022] A pytorch implementation for TS2-Net: Token Shift and Selection Transformer for Text-Video Retrieval☆74Updated 2 years ago
- [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos☆120Updated last year
- [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"☆134Updated last year
- Official code for "Bridging Video-text Retrieval with Multiple Choice Questions", CVPR 2022 (Oral).☆138Updated 2 years ago
- A PyTorch implementation of VIOLET☆137Updated last year