gistvision / moca
Code and models of MOCA (Modular Object-Centric Approach) proposed in "Factorizing Perception and Policy for Interactive Instruction Following" (ICCV 2021). We address the task of long horizon instruction following with a modular architecture that decouples a task into visual perception and action policy prediction.
☆37Updated 2 months ago
Related projects: ⓘ
- Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal tra…☆83Updated last year
- Official code for the ACL 2021 Findings paper "Yichi Zhang and Joyce Chai. Hierarchical Task Learning from Language Instructions with Uni…☆24Updated 3 years ago
- SNARE Dataset with MATCH and LaGOR models☆23Updated 5 months ago
- 3D household task-based dataset created using customised AI2-THOR.☆14Updated 2 years ago
- Implementation (R2R part) for the paper "Iterative Vision-and-Language Navigation"☆13Updated 5 months ago
- Code and data of the Fine-Grained R2R Dataset proposed in the EMNLP 2021 paper Sub-Instruction Aware Vision-and-Language Navigation☆42Updated 2 years ago
- Official Repository of NeurIPS2021 paper: PTR☆33Updated 2 years ago
- ☆39Updated 2 years ago
- Official codebase for EmbCLIP☆111Updated last year
- NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"☆79Updated last year
- The repository of ECCV 2020 paper `Active Visual Information Gathering for Vision-Language Navigation`☆43Updated 2 years ago
- [ICCV'21] Curious Representation Learning for Embodied Intelligence☆27Updated 2 years ago
- A mini-framework for running AI2-Thor with Docker.☆29Updated 4 months ago
- Code and Data for our CVPR 2021 paper "Structured Scene Memory for Vision-Language Navigation"☆36Updated 3 years ago
- Code for NeurIPS 2022 Datasets and Benchmarks paper - EgoTaskQA: Understanding Human Tasks in Egocentric Videos.☆28Updated last year
- 🐍 A Python Package for Seamless Data Distribution in AI Workflows☆19Updated 9 months ago
- This repository is the official implementation of *Silver-Bullet-3D* Solution for SAPIEN ManiSkill Challenge 2021☆20Updated 2 years ago
- ☆22Updated 2 years ago
- Pytorch code for ICRA'21 paper: "Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation"☆66Updated 2 months ago
- Code for MM 22 "Target-Driven Structured Transformer Planner for Vision-Language Navigation"☆14Updated last year
- PyTorch code for the ACL 2020 paper: "BabyWalk: Going Farther in Vision-and-Language Navigationby Taking Baby Steps"☆40Updated 2 years ago
- Pytorch Code and Data for EnvEdit: Environment Editing for Vision-and-Language Navigation (CVPR 2022)☆32Updated 2 years ago
- Codebase for the Airbert paper☆41Updated last year
- Code for "Learning Affordance Landscapes for Interaction Exploration in 3D Environments" (NeurIPS 20)☆34Updated last year
- Code for the paper "Improving Vision-and-Language Navigation with Image-Text Pairs from the Web" (ECCV 2020)☆52Updated last year
- Dataset and baseline for Scenario Oriented Object Navigation (SOON)☆17Updated 2 years ago
- Official Code for Neural Systematic Binder☆28Updated last year
- PyTorch code for ICLR 2019 paper: Self-Monitoring Navigation Agent via Auxiliary Progress Estimation☆118Updated 11 months ago
- Code for training embodied agents using imitation learning at scale in Habitat-Lab☆32Updated 2 years ago
- Implementation of "Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation"☆24Updated 3 years ago