Code and models of MOCA (Modular Object-Centric Approach) proposed in "Factorizing Perception and Policy for Interactive Instruction Following" (ICCV 2021). We address the task of long horizon instruction following with a modular architecture that decouples a task into visual perception and action policy prediction.
☆40Jun 21, 2024Updated last year
Alternatives and similar repositories for moca
Users that are interested in moca are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 3D household task-based dataset created using customised AI2-THOR.☆14Apr 14, 2022Updated 3 years ago
- Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal tra…☆93Jul 11, 2023Updated 2 years ago
- Official Implementation of CAPEAM (ICCV'23)☆16Nov 30, 2024Updated last year
- Official code for the ACL 2021 Findings paper "Yichi Zhang and Joyce Chai. Hierarchical Task Learning from Language Instructions with Uni…☆24Jun 28, 2021Updated 4 years ago
- ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks☆501Feb 5, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Prompter for Embodied Instruction Following☆18Nov 30, 2023Updated 2 years ago
- Implementation of "Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation"☆27Mar 4, 2021Updated 5 years ago
- Official repository of ICLR 2022 paper FILM: Following Instructions in Language with Modular Methods☆127Apr 9, 2023Updated 2 years ago
- A visual semantic planner for the ALFRED virtual agent challenge using the GPT-2 language model☆16Oct 1, 2020Updated 5 years ago
- Code for EmBERT, a transformer model for embodied, language-guided visual task completion.☆60Apr 10, 2024Updated last year
- Official Implementation of ISR-DPO:Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO (AAAI'25)☆23Nov 25, 2025Updated 4 months ago
- TEACh is a dataset of human-human interactive dialogues to complete tasks in a simulated household environment.☆143May 6, 2024Updated last year
- ☆17Jan 19, 2026Updated 2 months ago
- Official Implementation of CL-ALFRED (ICLR'24)☆31Oct 24, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Enhance robot task understanding ability through visual semantic graph☆10May 20, 2021Updated 4 years ago
- ☆45Jun 24, 2022Updated 3 years ago
- Official Implementation of ReALFRED (ECCV'24)☆45Oct 11, 2024Updated last year
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆77Sep 12, 2024Updated last year
- Official Pytorch Implementation of Unsupervised Representation Learning for Binary Networks by Joint Classifier Training (CVPR 2022)☆11Apr 10, 2022Updated 3 years ago
- ManipulaTHOR, a framework that facilitates visual manipulation of objects using a robotic arm☆98Feb 7, 2023Updated 3 years ago
- Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding☆10Jan 5, 2026Updated 2 months ago
- An open source framework for research in Embodied-AI from AI2.☆379Aug 22, 2025Updated 7 months ago
- Panoramic Graph Environment Annotation toolkit, for collecting audio and text annotations in panoramic graph environments such as Matterp…☆20Mar 5, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)☆16Apr 23, 2024Updated last year
- ☆13Dec 6, 2018Updated 7 years ago
- ☆19Nov 7, 2020Updated 5 years ago
- https://robotmlcourse.github.io/SP20/index.html☆14Aug 27, 2020Updated 5 years ago
- The code for 'COVID-19 Lung Infection Segmentation with A Novel Two-Stage Cross-Domain Transfer Learning Framework'☆11Aug 16, 2021Updated 4 years ago
- RoboTHOR Challenge☆97May 17, 2021Updated 4 years ago
- ☆38Jul 13, 2022Updated 3 years ago
- Code for EMNLP 2022 Paper DANLI: Deliberative Agent for Following Natural Language Instructions☆18May 1, 2025Updated 10 months ago
- Repository of our accepted NeurIPS-2022 paper "Towards Versatile Embodied Navigation"☆21Dec 8, 2022Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Official Repository of NeurIPS2021 paper: PTR☆32Dec 17, 2021Updated 4 years ago
- Intepretability method to find what navigation agents learn☆19Jun 16, 2022Updated 3 years ago
- GMAN: Generative Meta-Adversarial Network for Unseen Object Navigation (ECCV 2022)☆23Jan 13, 2024Updated 2 years ago
- Code of the CVPR 2022 paper "HOP: History-and-Order Aware Pre-training for Vision-and-Language Navigation"☆30Aug 21, 2023Updated 2 years ago
- ☆37Jun 15, 2021Updated 4 years ago
- Preprocess raster dem files to work with the elasticterrain map.☆14May 10, 2019Updated 6 years ago
- Repository containing code for the paper "IQA: Visual Question Answering in Interactive Environments"☆126Feb 11, 2020Updated 6 years ago