facebookresearch / Multi-SpatialMLLMLinks
Multi-SpatialMLLM Multi-Frame Spatial Understanding with Multi-Modal Large Language Models
☆149Updated 3 months ago
Alternatives and similar repositories for Multi-SpatialMLLM
Users that are interested in Multi-SpatialMLLM are comparing it to the libraries listed below
Sorting:
- Source codes for the paper "MindJourney: Test-Time Scaling with World Models for Spatial Reasoning"☆82Updated last month
- Official implementation of Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence☆345Updated 2 months ago
- EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation☆115Updated last month
- VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction☆260Updated 2 weeks ago
- The official implementation of The paper "Exploring the Potential of Encoder-free Architectures in 3D LMMs"☆55Updated 3 months ago
- Official implementation for WorldScore: A Unified Evaluation Benchmark for World Generation☆135Updated last month
- ☆88Updated last month
- Unifying 2D and 3D Vision-Language Understanding☆103Updated last month
- MetaSpatial leverages reinforcement learning to enhance 3D spatial reasoning in vision-language models (VLMs), enabling more structured, …☆188Updated 4 months ago
- A list of works on video generation towards world model☆165Updated last month
- From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D☆56Updated 3 months ago
- Generative World Explorer☆154Updated 3 months ago
- [CVPR 2024] Situational Awareness Matters in 3D Vision Language Reasoning☆41Updated 9 months ago
- [ARXIV’25] Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Control☆78Updated 2 months ago
- 4D Panoptic Scene Graph Generation (NeurIPS'23 Spotlight)☆114Updated 6 months ago
- ☆139Updated 8 months ago
- [ICLR 2025] Official Implementation of M3: 3D-Spatial Multimodal Memory☆176Updated 4 months ago
- [ICCV 2025] A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D World☆317Updated 2 months ago
- [CVPR 2025] The code for paper ''Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understanding''.☆158Updated 3 months ago
- [ICCV'25] Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awareness☆53Updated last month
- LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPS☆101Updated 2 months ago
- Self-reimplemented version of 4D-LRM.☆52Updated 3 months ago
- OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understanding☆59Updated last month
- The code for paper 'Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priors'☆116Updated last month
- [ECCV 2024] M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts.☆61Updated 11 months ago
- 3D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understanding☆286Updated 2 weeks ago
- [ICLR 2025] Dataset and Code for Paper "Learning to Generate Diverse Pedestrian Movements from Web Videos with Noisy Labels"☆43Updated 2 months ago
- [ICLR 2025] Where Am I and What Will I See : An Auto-Regressive Model for Spatial Localization and View Prediction☆39Updated last month
- Official Reporsitory of "EgoMono4D: Self-Supervised Monocular 4D Scene Reconstruction for Egocentric Videos"☆33Updated 3 weeks ago
- ☆33Updated 4 months ago