facebookresearch / Multi-SpatialMLLMLinks
Multi-SpatialMLLM Multi-Frame Spatial Understanding with Multi-Modal Large Language Models
☆144Updated 3 months ago
Alternatives and similar repositories for Multi-SpatialMLLM
Users that are interested in Multi-SpatialMLLM are comparing it to the libraries listed below
Sorting:
- Source codes for the paper "MindJourney: Test-Time Scaling with World Models for Spatial Reasoning"☆78Updated 3 weeks ago
- EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation☆113Updated 3 weeks ago
- VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction☆247Updated 3 weeks ago
- Official implementation of Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence☆320Updated 2 months ago
- Official implementation for WorldScore: A Unified Evaluation Benchmark for World Generation☆127Updated last month
- Unifying 2D and 3D Vision-Language Understanding☆99Updated last month
- A list of works on video generation towards world model☆162Updated 2 weeks ago
- ☆85Updated 3 weeks ago
- [ARXIV’25] Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Control☆75Updated last month
- From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D☆54Updated 3 months ago
- [ECCV 2024] M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts.☆61Updated 10 months ago
- Self-reimplemented version of 4D-LRM.☆50Updated 2 months ago
- [CVPR 2024] Situational Awareness Matters in 3D Vision Language Reasoning☆39Updated 8 months ago
- 4D Panoptic Scene Graph Generation (NeurIPS'23 Spotlight)☆112Updated 5 months ago
- [ICLR 2025] Where Am I and What Will I See : An Auto-Regressive Model for Spatial Localization and View Prediction☆38Updated 2 weeks ago
- Generative World Explorer☆154Updated 2 months ago
- WideRange4D: Enabling High-Quality 4D Reconstruction with Wide-Range Movements and Scenes☆98Updated 5 months ago
- 3D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understanding☆240Updated this week
- Official implementation of EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidance☆41Updated 2 months ago
- The official implementation of The paper "Exploring the Potential of Encoder-free Architectures in 3D LMMs"☆55Updated 3 months ago
- LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPS☆96Updated last month
- [ICLR 2025] Official Implementation of M3: 3D-Spatial Multimodal Memory☆171Updated 4 months ago
- ☆136Updated 7 months ago
- MetaSpatial leverages reinforcement learning to enhance 3D spatial reasoning in vision-language models (VLMs), enabling more structured, …☆187Updated 3 months ago
- OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understanding☆59Updated last month
- UniUGG: Unified 3D Understanding and Generation via Geometric-Semantic Encoding☆32Updated last week
- The code for paper 'Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priors'☆107Updated 3 weeks ago
- Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning☆106Updated this week
- Code for "BoxDreamer: Dreaming Box Corners for Generalizable Object Pose Estimation", ICCV 2025.☆78Updated 2 months ago
- [ICCV 2025] A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D World☆306Updated last month