microsoft / SwinBERT
Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"
☆239Updated 2 years ago
Related projects: ⓘ
- End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)☆201Updated 8 months ago
- [CVPR2023] All in One: Exploring Unified Video-Language Pre-training☆278Updated last year
- [NeurIPS 2021] Moment-DETR code and QVHighlights dataset☆260Updated 5 months ago
- [arXiv22] Disentangled Representation Learning for Text-Video Retrieval☆89Updated 2 years ago
- GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)☆177Updated last year
- ☆182Updated last year
- An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"☆127Updated 5 months ago
- ☆227Updated last year
- https://layer6ai-labs.github.io/xpool/☆111Updated last year
- 前沿论文持续更新--视频时刻定位 or 时域语言定位 or 视频片段检索。☆223Updated last year
- UMT is a unified and flexible framework which can handle different input modality combinations, and output video moment retrieval and/or …☆187Updated 5 months ago
- [CVPR2022] Official code for Hierarchical Modular Network for Video Captioning. Our proposed HMN is implemented with PyTorch.☆52Updated last year
- Official code for "Bridging Video-text Retrieval with Multiple Choice Questions", CVPR 2022 (Oral).☆136Updated 2 years ago
- PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529☆157Updated 2 years ago
- Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)☆119Updated last year
- [CVPR 2022 Oral] TubeDETR: Spatio-Temporal Video Grounding with Transformers☆166Updated 11 months ago
- Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆254Updated 3 months ago
- [ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models☆282Updated 3 months ago
- Video Feature Extraction Code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"☆95Updated 3 years ago
- Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"☆228Updated 3 years ago
- An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆335Updated last month
- [NeurIPS 2022 Spotlight] Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations☆113Updated 5 months ago
- Align and Prompt: Video-and-Language Pre-training with Entity Prompts☆185Updated last year
- Implementation of 'End-to-End Transformer Based Model for Image Captioning' [AAAI 2022]☆64Updated 3 months ago
- Multi-Modal Transformer for Video Retrieval☆253Updated 3 years ago
- A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.☆68Updated last year
- [ICCV2023] UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormer☆282Updated 5 months ago
- ☆165Updated 2 years ago
- [ECCV2022] A pytorch implementation for TS2-Net: Token Shift and Selection Transformer for Text-Video Retrieval☆75Updated last year
- The first unofficial implementation of CLIP4Caption: CLIP for Video Caption (ACMMM 2021)☆13Updated last year