facebookresearch / connect-caption-and-trace
A unified framework to jointly model images, text, and human attention traces.
☆78Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for connect-caption-and-trace
- ☆74Updated 2 years ago
- Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"☆159Updated 4 years ago
- A length-controllable and non-autoregressive image captioning model.☆66Updated 3 years ago
- [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos☆117Updated last year
- A one-stop shop for YouCook2 info such as leaderboard and recent advances on (cooking) video retrieval and captioning.☆38Updated 2 years ago
- Localized Narratives☆83Updated 3 years ago
- ☆25Updated 3 years ago
- PyTorch GPU distributed training code for MIL-NCE HowTo100M☆214Updated 2 years ago
- [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)☆57Updated 3 years ago
- Dense video captioning in PyTorch☆41Updated 5 years ago
- Data Release for VALUE Benchmark☆31Updated 2 years ago
- CLIP-It! Language-Guided Video Summarization☆73Updated 3 years ago
- [ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answering☆124Updated 2 years ago
- Code of Dense Relational Captioning☆67Updated last year
- S3D Text-Video model trained on HowTo100M using MIL-NCE☆191Updated 4 years ago
- source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT☆73Updated 2 years ago
- PyTorch code for: Learning to Generate Grounded Visual Captions without Localization Supervision☆44Updated 4 years ago
- Learning phrase grounding from captioned images through InfoNCE bound on mutual information☆72Updated 4 years ago
- A PyTorch implementation of VIOLET☆137Updated 11 months ago
- Starter Code for VALUE benchmark☆79Updated 2 years ago
- Use CLIP to represent video for Retrieval Task☆69Updated 3 years ago
- [ECCV 2020] PyTorch code for XML on TVRetrieval dataset - TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrieval☆153Updated 5 months ago
- [SIGIR 2022] CenterCLIP: Token Clustering for Efficient Text-Video Retrieval. Also, a text-video retrieval toolbox based on CLIP + fast p…☆126Updated 2 years ago
- Video captioning baseline models on Video2Commonsense Dataset.☆57Updated 3 years ago
- [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset☆88Updated last year
- We present a framework for training multi-modal deep learning models on unlabelled video data by forcing the network to learn invariances…☆45Updated 3 years ago
- Code and Resources for the Transformer Encoder Reasoning Network (TERN) - https://arxiv.org/abs/2004.09144☆57Updated 11 months ago
- The Holistic Video Understanding Dataset (ECCV 2020 Spotlight presentation)☆70Updated 3 years ago
- [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"☆130Updated last year
- A task-agnostic vision-language architecture as a step towards General Purpose Vision☆92Updated 3 years ago