PzySeere / MetaSpatial
MetaSpatial leverages reinforcement learning to enhance 3D spatial reasoning in vision-language models (VLMs), enabling more structured, realistic, and adaptive scene generation for applications in the metaverse, AR/VR, and game development.
☆104Updated 3 weeks ago
Alternatives and similar repositories for MetaSpatial:
Users that are interested in MetaSpatial are comparing it to the libraries listed below
- Code&Data for Grounded 3D-LLM with Referent Tokens☆109Updated 3 months ago
- [NeurIPS'24] This repository is the implementation of "SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models"☆170Updated 4 months ago
- A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D World☆249Updated 4 months ago
- [CVPR 2025] The code for paper ''Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understanding''.☆80Updated last month
- Spatial-R1: The first MLLM trained using GRPO for spatial reasoning in videos☆22Updated last week
- [ECCV 2024] Empowering 3D Visual Grounding with Reasoning Capabilities☆71Updated 6 months ago
- The official implementation of The paper "Exploring the Potential of Encoder-free Architectures in 3D LMMs"☆51Updated 2 weeks ago
- A paper list for spatial reasoning☆56Updated 2 weeks ago
- EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation☆102Updated 5 months ago
- ☆25Updated 2 weeks ago
- [ICLR 2023] SQA3D for embodied scene understanding and reasoning☆131Updated last year
- ☆49Updated 6 months ago
- [CVPR 2024] Situational Awareness Matters in 3D Vision Language Reasoning☆37Updated 4 months ago
- ☆126Updated 3 months ago
- [NeurIPS 2024] Official code repository for MSR3D paper☆50Updated last month
- Code of 3DMIT: 3D MULTI-MODAL INSTRUCTION TUNING FOR SCENE UNDERSTANDING☆30Updated 8 months ago
- [CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Lan…☆58Updated 3 weeks ago
- Code for "Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers" (NeurIPS 2024)☆154Updated 3 weeks ago
- ☆117Updated last year
- Official implementation of "Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awareness".☆18Updated 2 weeks ago
- ☆69Updated 4 months ago
- [World-Model-Survey-2024] Paper list and projects for World Model☆9Updated 5 months ago
- Official implementation of ECCV24 paper "SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding"☆240Updated last month
- Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World☆128Updated 5 months ago
- Code for "Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenes"☆54Updated last year
- Official implementation for WorldScore: A Unified Evaluation Benchmark for World Generation☆90Updated this week
- Official code implementation of Perception R1: Pioneering Perception Policy with Reinforcement Learning☆84Updated last week
- [CVPR2024] This is the official implement of MP5☆99Updated 9 months ago
- [ECCV 2024] M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts.☆60Updated 6 months ago
- The PyTorch implementation of paper: "AdaWorld: Learning Adaptable World Models with Latent Actions".☆53Updated 3 weeks ago