Code and models of MOCA (Modular Object-Centric Approach) proposed in "Factorizing Perception and Policy for Interactive Instruction Following" (ICCV 2021). We address the task of long horizon instruction following with a modular architecture that decouples a task into visual perception and action policy prediction.
☆40Jun 21, 2024Updated 2 years ago
Alternatives and similar repositories for moca
Users that are interested in moca are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official code for the ACL 2021 Findings paper "Yichi Zhang and Joyce Chai. Hierarchical Task Learning from Language Instructions with Uni…☆24Jun 28, 2021Updated 5 years ago
- Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal tra…☆93Jul 11, 2023Updated 3 years ago
- 3D household task-based dataset created using customised AI2-THOR.☆14Apr 14, 2022Updated 4 years ago
- ☆48Jun 24, 2022Updated 4 years ago
- Official repository of ICLR 2022 paper FILM: Following Instructions in Language with Modular Methods☆131Apr 9, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for EmBERT, a transformer model for embodied, language-guided visual task completion.☆60Apr 10, 2024Updated 2 years ago
- Prompter for Embodied Instruction Following☆18Nov 30, 2023Updated 2 years ago
- A visual semantic planner for the ALFRED virtual agent challenge using the GPT-2 language model☆16Oct 1, 2020Updated 6 years ago
- ☆17Mar 26, 2021Updated 5 years ago
- Official Implementation of CL-ALFRED (ICLR'24)☆32Oct 24, 2024Updated 2 years ago
- TEACh is a dataset of human-human interactive dialogues to complete tasks in a simulated household environment.☆146May 6, 2024Updated 2 years ago
- Official PyTorch Implementation of "Learning Architectures for Binary Networks" (ECCV2020)☆26Nov 15, 2020Updated 5 years ago
- Official Implementation of ReALFRED (ECCV'24)☆48Oct 11, 2024Updated 2 years ago
- Official Implementation of ISR-DPO:Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO (AAAI'25)☆23Nov 25, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Enhance robot task understanding ability through visual semantic graph☆10May 20, 2021Updated 5 years ago
- ManipulaTHOR, a framework that facilitates visual manipulation of objects using a robotic arm☆97Feb 7, 2023Updated 3 years ago
- Official Repository of NeurIPS2021 paper: PTR☆32Dec 17, 2021Updated 4 years ago
- Codebase and tutorial of ContPhy dataset generation for ICML 2024 paper "ContPhy: Continuum Physical Concept Learning and Reasoning from …☆11Aug 31, 2024Updated 2 years ago
- Official Pytorch Implementation of Unsupervised Representation Learning for Binary Networks by Joint Classifier Training (CVPR 2022)☆11Apr 10, 2022Updated 4 years ago
- Code for "Learning Affordance Landscapes for Interaction Exploration in 3D Environments" (NeurIPS 20)☆38Jul 6, 2023Updated 3 years ago
- RoboTHOR Challenge☆99May 17, 2021Updated 5 years ago
- code for TIDEE: Novel Room Reorganization using Visuo-Semantic Common Sense Priors☆40Nov 21, 2023Updated 2 years ago
- Codes of CVPR2022 paper: Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction☆32Aug 23, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Panoramic Graph Environment Annotation toolkit, for collecting audio and text annotations in panoramic graph environments such as Matterp…☆19Mar 5, 2021Updated 5 years ago
- GMAN: Generative Meta-Adversarial Network for Unseen Object Navigation (ECCV 2022)☆22Jan 13, 2024Updated 2 years ago
- An open source framework for research in Embodied-AI from AI2.☆384May 19, 2026Updated 5 months ago
- Visual Navigation with Natural Multimodal Assistance (EMNLP 2019)☆29Jun 30, 2020Updated 6 years ago
- NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"☆102May 8, 2025Updated last year
- Official implementation of Layout-aware Dreamer for Embodied Referring Expression Grounding [AAAI 23].☆15Apr 13, 2023Updated 3 years ago
- Repository containing code for the paper "IQA: Visual Question Answering in Interactive Environments"☆126Feb 11, 2020Updated 6 years ago
- ☆13Dec 6, 2018Updated 7 years ago
- Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)☆16Apr 23, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Preprocess raster dem files to work with the elasticterrain map.☆14May 10, 2019Updated 7 years ago
- Repository of our accepted NeurIPS-2022 paper "Towards Versatile Embodied Navigation"☆22Dec 8, 2022Updated 3 years ago
- Intepretability method to find what navigation agents learn☆19Jun 16, 2022Updated 4 years ago
- The code for 'COVID-19 Lung Infection Segmentation with A Novel Two-Stage Cross-Domain Transfer Learning Framework'☆11Aug 16, 2021Updated 5 years ago
- DEM-scripts☆13May 29, 2023Updated 3 years ago
- Embedded Jupyter Notebook for NVIDIA Omniverse☆21Aug 4, 2024Updated 2 years ago
- Pytorch implementation of "Move to See Better: Self-Improving Embodied Object Detection" (https://arxiv.org/abs/2012.00057)☆25Apr 5, 2021Updated 5 years ago