facebookresearch / connect-caption-and-traceLinks
A unified framework to jointly model images, text, and human attention traces.
☆79Updated 4 years ago
Alternatives and similar repositories for connect-caption-and-trace
Users that are interested in connect-caption-and-trace are comparing it to the libraries listed below
Sorting:
- A length-controllable and non-autoregressive image captioning model.☆68Updated 4 years ago
- source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT☆72Updated 2 years ago
- PyTorch code for: Learning to Generate Grounded Visual Captions without Localization Supervision☆46Updated 5 years ago
- Localized Narratives☆86Updated 4 years ago
- CLIP-It! Language-Guided Video Summarization☆75Updated 4 years ago
- Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"☆162Updated 5 years ago
- [ACL 2020] PyTorch code for MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning☆171Updated 4 years ago
- A PyTorch implementation of VIOLET☆138Updated last year
- ☆73Updated 3 years ago
- Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020☆81Updated 5 years ago
- This is the repo for Multi-level textual grounding☆34Updated 5 years ago
- ☆64Updated 3 years ago
- Learning phrase grounding from captioned images through InfoNCE bound on mutual information☆74Updated 5 years ago
- Video captioning baseline models on Video2Commonsense Dataset.☆57Updated 4 years ago
- Data Release for VALUE Benchmark☆31Updated 3 years ago
- Dense video captioning in PyTorch☆41Updated 6 years ago
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning☆92Updated last year
- A task-agnostic vision-language architecture as a step towards General Purpose Vision☆92Updated 4 years ago
- PyTorch code for EMNLP 2020 paper "X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers"☆50Updated 4 years ago
- Code and Resources for the Transformer Encoder Reasoning Network (TERN) - https://arxiv.org/abs/2004.09144☆58Updated last year
- Code of Dense Relational Captioning☆69Updated 2 years ago
- [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos☆123Updated last year
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…☆119Updated 4 years ago
- Diverse Image Captioning with Context-Object Split Latent Spaces (NeurIPS 2020)☆37Updated 3 years ago
- Use CLIP to represent video for Retrieval Task☆70Updated 4 years ago
- ☆26Updated 4 years ago
- Project page for "Visual Grounding in Video for Unsupervised Word Translation" CVPR 2020☆42Updated 5 years ago
- [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)☆61Updated 4 years ago
- Starter code for the VMT task and challenge☆51Updated 5 years ago
- Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)☆17Updated 2 years ago