facebookresearch / connect-caption-and-traceLinks
A unified framework to jointly model images, text, and human attention traces.
☆78Updated 4 years ago
Alternatives and similar repositories for connect-caption-and-trace
Users that are interested in connect-caption-and-trace are comparing it to the libraries listed below
Sorting:
- [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos☆122Updated last year
- A PyTorch implementation of VIOLET☆137Updated last year
- [ACL 2020] PyTorch code for MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning☆171Updated 4 years ago
- CLIP-It! Language-Guided Video Summarization☆74Updated 4 years ago
- Code of Dense Relational Captioning☆69Updated 2 years ago
- PyTorch code for: Learning to Generate Grounded Visual Captions without Localization Supervision☆44Updated 4 years ago
- Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"☆162Updated 5 years ago
- Localized Narratives☆84Updated 3 years ago
- [CVPR20] Video Object Grounding using Semantic Roles in Language Description (https://arxiv.org/abs/2003.10606)☆67Updated 5 years ago
- [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset☆90Updated last year
- Use CLIP to represent video for Retrieval Task☆69Updated 4 years ago
- Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020☆80Updated 4 years ago
- A Dataset for Grounded Video Description☆162Updated 3 years ago
- A length-controllable and non-autoregressive image captioning model.☆68Updated 4 years ago
- Code voor mijn Master project omtrent VideoBERT☆38Updated 4 years ago
- ☆26Updated 4 years ago
- [ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answering☆129Updated 2 years ago
- S3D Text-Video model trained on HowTo100M using MIL-NCE☆195Updated 4 years ago
- ☆35Updated 6 years ago
- ☆73Updated 3 years ago
- [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"☆134Updated 2 years ago
- PyTorch GPU distributed training code for MIL-NCE HowTo100M☆218Updated 2 years ago
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning☆91Updated last year
- [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)☆60Updated 3 years ago
- Learning phrase grounding from captioned images through InfoNCE bound on mutual information☆73Updated 4 years ago
- A one-stop shop for YouCook2 info such as leaderboard and recent advances on (cooking) video retrieval and captioning.☆40Updated 2 years ago
- A task-agnostic vision-language architecture as a step towards General Purpose Vision☆92Updated 3 years ago
- source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT☆72Updated 2 years ago
- [CVPR 2022] The code for our paper 《Object-aware Video-language Pre-training for Retrieval》☆62Updated 3 years ago
- Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)☆133Updated 11 months ago