amazon-science / embert
Code for EmBERT, a transformer model for embodied, language-guided visual task completion.
☆57Updated 9 months ago
Alternatives and similar repositories for embert:
Users that are interested in embert are comparing it to the libraries listed below
- PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World [ACL 2021]☆54Updated 3 years ago
- Evaluating and improving the faithfulness of the interpretations offered by Neural Module Networks☆13Updated last year
- Repository for DialFRED.☆42Updated last year
- Vision and Language Agent Navigation☆73Updated 3 years ago
- ☆24Updated 2 years ago
- Evaluating Machines by their Real-World Language Use☆33Updated last year
- ☆20Updated 3 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆44Updated 4 years ago
- Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action☆35Updated last year
- ReaSCAN is a synthetic navigation task that requires models to reason about surroundings over syntactically difficult languages. (NeurIPS…☆20Updated 3 years ago
- Cornell Instruction Following Framework☆34Updated 3 years ago
- Code and data for "Inferring Rewards from Language in Context" [ACL 2022].☆15Updated 2 years ago
- Code and data for "Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning" (EMNLP 2021).☆28Updated 3 years ago
- A visual semantic planner for the ALFRED virtual agent challenge using the GPT-2 language model☆14Updated 4 years ago
- A PyTorch Implementation of Neural Symbolic Machines by Liang et al. (2018)☆59Updated 4 years ago
- Systematic generalization test for CLEVR☆15Updated 4 years ago
- TEACh is a dataset of human-human interactive dialogues to complete tasks in a simulated household environment.☆135Updated 8 months ago
- ☆44Updated 2 years ago
- [ICLR 2022 Spotlight] Multi-Stage Episodic Control for Strategic Exploration in Text Games☆14Updated 2 years ago
- [EMNLP 2021] Code and data for our paper "Visually Grounded Reasoning across Languages and Cultures"☆30Updated 3 years ago
- ☆35Updated 6 months ago
- Official code for the ACL 2021 Findings paper "Yichi Zhang and Joyce Chai. Hierarchical Task Learning from Language Instructions with Uni…☆24Updated 3 years ago
- Solving reinforcement learning tasks which require language and vision☆32Updated last year
- Multi-Target Embodied Question Answering☆26Updated 4 years ago
- Dataset and documentation for paper on explaining solutions to physical reasoning tasks (ESPRIT))☆21Updated 3 years ago
- Official code for our EMNLP2021 Outstanding Paper MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks☆21Updated last year
- Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal tra…☆88Updated last year
- Implementation of "Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation"☆25Updated 3 years ago
- ☆50Updated 3 years ago
- Visual Navigation with Natural Multimodal Assistance (EMNLP 2019)☆27Updated 4 years ago