v-iashin / BMT
Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)
☆227Updated last year
Alternatives and similar repositories for BMT:
Users that are interested in BMT are comparing it to the libraries listed below
- PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)☆144Updated last year
- A repository for extract CNN features from videos using pytorch☆69Updated 2 years ago
- COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning☆288Updated 2 years ago
- Easy to use video deep features extractor☆314Updated 4 years ago
- S3D Text-Video model trained on HowTo100M using MIL-NCE☆194Updated 4 years ago
- Video embeddings for retrieval with natural language queries☆339Updated 2 years ago
- End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)☆215Updated last year
- Video Grounding and Captioning☆325Updated 3 years ago
- Multi-Modal Transformer for Video Retrieval☆258Updated 5 months ago
- Second-place solution to dense video captioning task in ActivityNet Challenge (CVPR 2020 workshop)☆75Updated 3 years ago
- Code for the HowTo100M paper☆262Updated 5 years ago
- [ACL 2020] PyTorch code for MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning☆169Updated 4 years ago
- [ECCV 2020] PyTorch code for XML on TVRetrieval dataset - TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrieval☆157Updated 9 months ago
- An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆347Updated 7 months ago
- ☆189Updated 3 years ago
- A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.☆70Updated last year
- A Pytorch implementation of "Reconstruction Network for Video Captioning", CVPR 2018☆54Updated 4 years ago
- PyTorch implementation of the ACCV 2018-AIU2018 paper Video Summarization with Attention☆183Updated 2 years ago
- Using VideoBERT to tackle video prediction☆124Updated 3 years ago
- Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"☆239Updated 2 years ago
- Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"☆231Updated 3 years ago
- [NeurIPS 2021] Moment-DETR code and QVHighlights dataset☆292Updated 11 months ago
- A curated list of research papers in Video Captioning☆120Updated 4 years ago
- TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks (ICCVW 2021)☆112Updated last year
- Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and T…☆579Updated last month
- Release of the pretrained S3D Network in PyTorch (ECCV 2018)☆132Updated last year
- DSNet: A Flexible Detect-to-Summarize Network for Video Summarization☆213Updated 3 years ago
- Video captioning baseline models on Video2Commonsense Dataset.☆56Updated 3 years ago
- Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)☆132Updated 7 months ago
- A PyTorch Implementation of PGL-SUM from "Combining Global and Local Attention with Positional Encoding for Video Summarization" (IEEE IS…☆87Updated 2 years ago