diankun-wu / Spatial-MLLMLinks
Official implementation of Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence
☆235Updated this week
Alternatives and similar repositories for Spatial-MLLM
Users that are interested in Spatial-MLLM are comparing it to the libraries listed below
Sorting:
- MetaSpatial leverages reinforcement learning to enhance 3D spatial reasoning in vision-language models (VLMs), enabling more structured, …☆133Updated last month
- A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D World☆273Updated 6 months ago
- [CVPR 2025] The code for paper ''Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understanding''.☆117Updated 3 weeks ago
- VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction☆167Updated 2 weeks ago
- Multi-SpatialMLLM Multi-Frame Spatial Understanding with Multi-Modal Large Language Models☆123Updated last month
- EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation☆108Updated 7 months ago
- ☆47Updated last month
- Code&Data for Grounded 3D-LLM with Referent Tokens☆120Updated 5 months ago
- The official implementation of The paper "Exploring the Potential of Encoder-free Architectures in 3D LMMs"☆53Updated last month
- Unifying 2D and 3D Vision-Language Understanding☆86Updated 2 months ago
- [NeurIPS 2024] Official code repository for MSR3D paper☆60Updated last week
- [ICLR 2025] Official Implementation of M3: 3D-Spatial Multimodal Memory☆164Updated 2 months ago
- [NeurIPS'24] This repository is the implementation of "SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models"☆211Updated 6 months ago
- [CVPR'25] SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Grounding☆131Updated 2 months ago
- [CVPR 2024] Situational Awareness Matters in 3D Vision Language Reasoning☆38Updated 6 months ago
- 4D Panoptic Scene Graph Generation (NeurIPS'23 Spotlight)☆109Updated 3 months ago
- SpaceR: The first MLLM empowered by SG-RLVR for video spatial reasoning☆63Updated 2 weeks ago
- SpatialScore: Towards Unified Evaluation for Multimodal Spatial Understanding☆48Updated 3 weeks ago
- [CoRL 2024] VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Grounding☆107Updated last month
- Official implementation of ECCV24 paper "SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding"☆245Updated 3 months ago
- Code for "Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers" (NeurIPS 2024)☆170Updated 2 months ago
- Aether: Geometric-Aware Unified World Modeling☆358Updated 3 weeks ago
- [NeurIPS 2024] Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene Understanding☆93Updated 4 months ago
- Generative World Explorer☆146Updated last week
- 3DGraphLLM is a model that uses a 3D scene graph and an LLM to perform 3D vision-language tasks.☆61Updated last month
- Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs☆41Updated last month
- Official implementation of "Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awareness".☆29Updated 2 weeks ago
- SceneFun3D ToolKit☆142Updated 2 months ago
- Official implementation of “4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models” (CVPR 2025)☆112Updated 2 months ago
- Official implementation for WorldScore: A Unified Evaluation Benchmark for World Generation☆110Updated this week