CraftJarvis / JarvisVLA
Official Implementation of "JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse"
☆57Updated this week
Alternatives and similar repositories for JarvisVLA:
Users that are interested in JarvisVLA are comparing it to the libraries listed below
- ☆37Updated last month
- Official repo of EmbodiedBench, a comprehensive benchmark designed to evaluate MLLMs as embodied agents.☆92Updated last week
- ☆75Updated 7 months ago
- Evaluate Multimodal LLMs as Embodied Agents☆39Updated last month
- Code for "Interactive Task Planning with Language Models"☆27Updated last year
- GROOT: Learning to Follow Instructions by Watching Gameplay Videos☆64Updated last year
- Official implementation of "Self-Improving Video Generation"☆62Updated 3 weeks ago
- ☆27Updated 9 months ago
- [NeurIPSw'24] This repo is the official implementation of "MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simu…☆86Updated 2 months ago
- ☆84Updated last month
- MetaSpatial leverages reinforcement learning to enhance 3D spatial reasoning in vision-language models (VLMs), enabling more structured, …☆81Updated this week
- (VillagerAgent ACL 2024) A Graph based Minecraft multi agents framework☆53Updated 2 months ago
- Official repository of S-Agents: Self-organizing Agents in Open-ended Environment☆21Updated last year
- [ECCV 2024] STEVE in Minecraft is for See and Think: Embodied Agent in Virtual Environment☆36Updated last year
- Official PyTorch Implementation for Task Vectors are Cross-Modal☆22Updated 3 months ago
- [ICLR 2025] Official implementation and benchmark evaluation repository of <PhysBench: Benchmarking and Enhancing Vision-Language Models …☆44Updated 2 weeks ago
- [CVPR2024] This is the official implement of MP5☆99Updated 9 months ago
- OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement☆30Updated this week
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆29Updated 8 months ago
- [NeurIPS-2024] The offical Implementation of "Instruction-Guided Visual Masking"☆33Updated 4 months ago
- ☆37Updated 3 months ago
- ☆122Updated 2 months ago
- This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]☆60Updated this week
- Official Repo of LangSuitE☆83Updated 7 months ago
- ☆36Updated last week
- ☆39Updated this week
- ☆31Updated last week
- The PyTorch implementation of paper: "AdaWorld: Learning Adaptable World Models with Latent Actions".☆36Updated this week
- [NeurIPS 2024] Official Implementation for Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks☆70Updated 2 weeks ago
- Multimodal RewardBench☆32Updated last month