iral-lab / gold
Multimodal grounded language dataset
☆10Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for gold
- ☆17Updated 4 years ago
- Feature resources of "Diagnosing the Environment Bias in Vision-and-Language Navigation"☆17Updated 4 years ago
- PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World [ACL 2021]☆54Updated 3 years ago
- Dataset for Bilingual VLN☆11Updated 3 years ago
- ReaSCAN is a synthetic navigation task that requires models to reason about surroundings over syntactically difficult languages. (NeurIPS…☆20Updated 2 years ago
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Updated last year
- Code and data for "Inferring Rewards from Language in Context" [ACL 2022].☆15Updated 2 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆44Updated 4 years ago
- Official codebase for ICLR oral paper Unsupervised Vision-Language Grammar Induction with Shared Structure Modeling☆35Updated 2 years ago
- Official code for the ACL 2021 Findings paper "Yichi Zhang and Joyce Chai. Hierarchical Task Learning from Language Instructions with Uni…☆24Updated 3 years ago
- Project page for "Visual Grounding in Video for Unsupervised Word Translation" CVPR 2020☆42Updated 4 years ago
- Differentiable First-Order Logic Reasoning for Visual Question Answering☆39Updated 3 years ago
- PyTorch code for the ACL 2020 paper: "BabyWalk: Going Farther in Vision-and-Language Navigationby Taking Baby Steps"☆40Updated 2 years ago
- Cooperative Vision-and-Dialog Navigation☆66Updated 2 years ago
- Repository for DialFRED.☆41Updated last year
- ☆24Updated 2 years ago
- ☆44Updated 2 years ago
- Code used to run experiments for the ICLR 2023 paper "Computational Language Acquisition with Theory of Mind".☆14Updated last year
- Code for EmBERT, a transformer model for embodied, language-guided visual task completion.☆57Updated 7 months ago
- Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal tra…☆87Updated last year
- ☆22Updated 3 years ago
- PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)☆32Updated last year
- MLPs for Vision and Langauge Modeling (Coming Soon)☆27Updated 2 years ago
- Cornell Instruction Following Framework☆33Updated 3 years ago
- DSTC8-AVSD: Sentence generation task for Audio Visual Scene-aware Dialog☆14Updated 3 years ago
- EMNLP 2021: Visual Goal-Step Inference using wikiHow☆14Updated 2 years ago
- TEACh is a dataset of human-human interactive dialogues to complete tasks in a simulated household environment.☆135Updated 6 months ago
- PyTorch code for Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles (DANCE)☆24Updated last year
- [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction☆48Updated 2 years ago
- VisualCOMET: Reasoning about the Dynamic Context of a Still Image☆85Updated last year