amazon-science / embert
Code for EmBERT, a transformer model for embodied, language-guided visual task completion.
☆57Updated 11 months ago
Alternatives and similar repositories for embert:
Users that are interested in embert are comparing it to the libraries listed below
- PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World [ACL 2021]☆54Updated 3 years ago
- Repository for DialFRED.☆42Updated last year
- Vision and Language Agent Navigation☆76Updated 4 years ago
- ☆24Updated 2 years ago
- Visual Navigation with Natural Multimodal Assistance (EMNLP 2019)☆28Updated 4 years ago
- Evaluating and improving the faithfulness of the interpretations offered by Neural Module Networks☆13Updated last year
- TEACh is a dataset of human-human interactive dialogues to complete tasks in a simulated household environment.☆138Updated 10 months ago
- [ICLR 2022] Linking Emergent and Natural Languages via Corpus Transfer☆30Updated 9 months ago
- Official code for our EMNLP2021 Outstanding Paper MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks☆22Updated last year
- Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings☆16Updated last year
- ReaSCAN is a synthetic navigation task that requires models to reason about surroundings over syntactically difficult languages. (NeurIPS…☆20Updated 3 years ago
- Implementation of "Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation"☆25Updated 4 years ago
- A visual semantic planner for the ALFRED virtual agent challenge using the GPT-2 language model☆14Updated 4 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆46Updated 5 years ago
- Official code for the ACL 2021 Findings paper "Yichi Zhang and Joyce Chai. Hierarchical Task Learning from Language Instructions with Uni…☆24Updated 3 years ago
- Feature resources of "Diagnosing the Environment Bias in Vision-and-Language Navigation"☆17Updated 4 years ago
- Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal tra…☆90Updated last year
- Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action☆36Updated last year
- ☆13Updated 2 years ago
- Code and data for "Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning" (EMNLP 2021).☆28Updated 3 years ago
- Code for the ACL 2022 paper "Continual Sequence Generation with Adaptive Compositional Modules"☆38Updated 2 years ago
- [EMNLP 2021] Code and data for our paper "Visually Grounded Reasoning across Languages and Cultures"☆30Updated 3 years ago
- VaLM: Visually-augmented Language Modeling. ICLR 2023.☆56Updated 2 years ago
- ☆20Updated 3 years ago
- Cornell Instruction Following Framework☆34Updated 3 years ago
- Code for the paper "Improving Vision-and-Language Navigation with Image-Text Pairs from the Web" (ECCV 2020)☆53Updated 2 years ago
- ☆44Updated 2 years ago
- Dataset for Bilingual VLN☆11Updated 4 years ago
- Systematic generalization test for CLEVR☆15Updated 5 years ago
- Multi-Target Embodied Question Answering☆26Updated 4 years ago