Code and models of MOCA (Modular Object-Centric Approach) proposed in "Factorizing Perception and Policy for Interactive Instruction Following" (ICCV 2021). We address the task of long horizon instruction following with a modular architecture that decouples a task into visual perception and action policy prediction.
☆40Jun 21, 2024Updated last year
Alternatives and similar repositories for moca
Users that are interested in moca are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 3D household task-based dataset created using customised AI2-THOR.☆14Apr 14, 2022Updated 4 years ago
- Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal tra…☆93Jul 11, 2023Updated 2 years ago
- Official code for the ACL 2021 Findings paper "Yichi Zhang and Joyce Chai. Hierarchical Task Learning from Language Instructions with Uni…☆24Jun 28, 2021Updated 4 years ago
- ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks☆512Feb 5, 2026Updated 3 months ago
- Prompter for Embodied Instruction Following☆18Nov 30, 2023Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆17Mar 26, 2021Updated 5 years ago
- Implementation of "Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation"☆27Mar 4, 2021Updated 5 years ago
- Official repository of ICLR 2022 paper FILM: Following Instructions in Language with Modular Methods☆128Apr 9, 2023Updated 3 years ago
- Code for EmBERT, a transformer model for embodied, language-guided visual task completion.☆60Apr 10, 2024Updated 2 years ago
- Official Implementation of ISR-DPO:Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO (AAAI'25)☆23Nov 25, 2025Updated 6 months ago
- Official PyTorch Implementation of "Learning Architectures for Binary Networks" (ECCV2020)☆26Nov 15, 2020Updated 5 years ago
- TEACh is a dataset of human-human interactive dialogues to complete tasks in a simulated household environment.☆145May 6, 2024Updated 2 years ago
- Official Implementation of CL-ALFRED (ICLR'24)☆31Oct 24, 2024Updated last year
- ☆48Jun 24, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆77Sep 12, 2024Updated last year
- Official Implementation of ReALFRED (ECCV'24)☆45Oct 11, 2024Updated last year
- Official Pytorch Implementation of Unsupervised Representation Learning for Binary Networks by Joint Classifier Training (CVPR 2022)☆11Apr 10, 2022Updated 4 years ago
- code for TIDEE: Novel Room Reorganization using Visuo-Semantic Common Sense Priors☆40Nov 21, 2023Updated 2 years ago
- Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding☆10Jan 5, 2026Updated 4 months ago
- Codes of CVPR2022 paper: Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction☆32Aug 23, 2022Updated 3 years ago
- An open source framework for research in Embodied-AI from AI2.☆382Updated this week
- Panoramic Graph Environment Annotation toolkit, for collecting audio and text annotations in panoramic graph environments such as Matterp…☆19Mar 5, 2021Updated 5 years ago
- Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)☆16Apr 23, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆13Dec 6, 2018Updated 7 years ago
- ☆19Nov 7, 2020Updated 5 years ago
- https://robotmlcourse.github.io/SP20/index.html☆14Aug 27, 2020Updated 5 years ago
- RoboTHOR Challenge☆98May 17, 2021Updated 5 years ago
- PyTorch code for ICLR 2019 paper: Self-Monitoring Navigation Agent via Auxiliary Progress Estimation☆123Oct 3, 2023Updated 2 years ago
- Repository of our accepted NeurIPS-2022 paper "Towards Versatile Embodied Navigation"☆22Dec 8, 2022Updated 3 years ago
- Official Repository of NeurIPS2021 paper: PTR☆32Dec 17, 2021Updated 4 years ago
- ☆39Jul 13, 2022Updated 3 years ago
- Code of the CVPR 2022 paper "HOP: History-and-Order Aware Pre-training for Vision-and-Language Navigation"☆31Aug 21, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆38Jun 15, 2021Updated 4 years ago
- Preprocess raster dem files to work with the elasticterrain map.☆14May 10, 2019Updated 7 years ago
- GMAN: Generative Meta-Adversarial Network for Unseen Object Navigation (ECCV 2022)☆23Jan 13, 2024Updated 2 years ago
- Repository containing code for the paper "IQA: Visual Question Answering in Interactive Environments"☆126Feb 11, 2020Updated 6 years ago
- ☆60Apr 21, 2022Updated 4 years ago
- A project designed to build and render a full Minecraft crafting tree.☆10Aug 10, 2021Updated 4 years ago
- DEM-scripts☆13May 29, 2023Updated 2 years ago