gistvision / mocaLinks
Code and models of MOCA (Modular Object-Centric Approach) proposed in "Factorizing Perception and Policy for Interactive Instruction Following" (ICCV 2021). We address the task of long horizon instruction following with a modular architecture that decouples a task into visual perception and action policy prediction.
☆40Updated last year
Alternatives and similar repositories for moca
Users that are interested in moca are comparing it to the libraries listed below
Sorting:
- Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal tra…☆93Updated 2 years ago
- Official code for the ACL 2021 Findings paper "Yichi Zhang and Joyce Chai. Hierarchical Task Learning from Language Instructions with Uni…☆24Updated 4 years ago
- Official Repository of NeurIPS2021 paper: PTR☆32Updated 4 years ago
- SNARE Dataset with MATCH and LaGOR models☆23Updated last year
- Code for "Learning Affordance Landscapes for Interaction Exploration in 3D Environments" (NeurIPS 20)☆38Updated 2 years ago
- Code for NeurIPS 2022 Datasets and Benchmarks paper - EgoTaskQA: Understanding Human Tasks in Egocentric Videos.☆36Updated 2 years ago
- 3D household task-based dataset created using customised AI2-THOR.☆14Updated 3 years ago
- 🔀 Visual Room Rearrangement☆123Updated 2 years ago
- Official codebase for EmbCLIP☆131Updated 2 years ago
- General-purpose Visual Understanding Evaluation☆20Updated 2 years ago
- Visual Grounding of Referring Expressions for Human-Robot Interaction☆26Updated 7 years ago
- Code for the paper Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration☆104Updated 3 years ago
- 🐍 A Python Package for Seamless Data Distribution in AI Workflows☆25Updated 2 years ago
- Learning about objects and their properties by interacting with them☆12Updated 5 years ago
- code for TIDEE: Novel Room Reorganization using Visuo-Semantic Common Sense Priors☆40Updated 2 years ago
- Implementation of "Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation"☆26Updated 4 years ago
- Official repository of ICLR 2022 paper FILM: Following Instructions in Language with Modular Methods☆127Updated 2 years ago
- NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"☆98Updated 8 months ago
- large scale pretrain for navigation task☆93Updated 2 years ago
- The repository of ECCV 2020 paper `Active Visual Information Gathering for Vision-Language Navigation`☆43Updated 3 years ago
- ☆40Updated 3 years ago
- Code and Data for our CVPR 2021 paper "Structured Scene Memory for Vision-Language Navigation"☆42Updated 4 years ago
- Cooperative Vision-and-Dialog Navigation☆72Updated 3 years ago
- Official Code for Neural Systematic Binder☆34Updated 2 years ago
- ☆45Updated 3 years ago
- A Model for Embodied Adaptive Object Detection☆45Updated 3 years ago
- [ACM MM 2022] Target-Driven Structured Transformer Planner for Vision-Language Navigation☆17Updated 3 years ago
- Pytorch code for ICRA'21 paper: "Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation"☆87Updated last year
- Feature resources of "Diagnosing the Environment Bias in Vision-and-Language Navigation"☆16Updated 5 years ago
- This repository is the official implementation of *Silver-Bullet-3D* Solution for SAPIEN ManiSkill Challenge 2021☆20Updated 4 years ago