iral-lab / gold
Multimodal grounded language dataset
☆10Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for gold
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Updated last year
- ☆17Updated 4 years ago
- Feature resources of "Diagnosing the Environment Bias in Vision-and-Language Navigation"☆17Updated 4 years ago
- PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World [ACL 2021]☆54Updated 3 years ago
- Cooperative Vision-and-Dialog Navigation☆66Updated last year
- Dataset for Bilingual VLN☆11Updated 3 years ago
- Repository for DialFRED.☆41Updated last year
- [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction☆48Updated 2 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆44Updated 4 years ago
- Code and data for "Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning" (EMNLP 2021).☆28Updated 3 years ago
- PyTorch code for the ACL 2020 paper: "BabyWalk: Going Farther in Vision-and-Language Navigationby Taking Baby Steps"☆40Updated 2 years ago
- Cornell Instruction Following Framework☆33Updated 3 years ago
- Implementation of "Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation"☆24Updated 3 years ago
- Official codebase for ICLR oral paper Unsupervised Vision-Language Grammar Induction with Shared Structure Modeling☆35Updated 2 years ago
- Evaluating and improving the faithfulness of the interpretations offered by Neural Module Networks☆13Updated last year
- Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal tra…☆86Updated last year
- GuessWhat?! Baselines☆73Updated 2 years ago
- Official code for our EMNLP2021 Outstanding Paper MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks☆20Updated last year
- Code for EmBERT, a transformer model for embodied, language-guided visual task completion.☆57Updated 6 months ago
- [EMNLP 2021] Code and data for our paper "Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers…☆20Updated 2 years ago
- A mini-framework for running AI2-Thor with Docker.☆30Updated 6 months ago
- MLPs for Vision and Langauge Modeling (Coming Soon)☆27Updated 2 years ago
- ☆40Updated 2 years ago
- [ACL 2019] Visually Grounded Neural Syntax Acquisition☆89Updated 8 months ago
- EMNLP 2021: Visual Goal-Step Inference using wikiHow☆14Updated 2 years ago
- ☆26Updated last year
- Code and data for "Inferring Rewards from Language in Context" [ACL 2022].☆15Updated 2 years ago
- A video retrieval dataset How2R and a video QA dataset How2QA☆24Updated 4 years ago
- Code and models of MOCA (Modular Object-Centric Approach) proposed in "Factorizing Perception and Policy for Interactive Instruction Foll…☆37Updated 4 months ago
- ☆24Updated 2 years ago