Code for 3D-LLM: Injecting the 3D World into Large Language Models
☆1,181Jun 6, 2024Updated last year
Alternatives and similar repositories for 3D-LLM
Users that are interested in 3D-LLM are comparing it to the libraries listed below
Sorting:
- Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources☆2,120Feb 3, 2026Updated last month
- [CVPR 2024] "LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning"; an interactive Large Langu…☆311Jul 17, 2024Updated last year
- [ECCV 2024 Best Paper Candidate & TPAMI 2025] PointLLM: Empowering Large Language Models to Understand Point Clouds☆979Aug 14, 2025Updated 6 months ago
- [ICLR'24 Spotlight] Uni3D: 3D Visual Representation from BAAI☆645Jan 12, 2026Updated last month
- [ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model☆623Oct 29, 2024Updated last year
- [ICCV 2025] A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D World☆373Oct 21, 2025Updated 4 months ago
- Align 3D Point Cloud with Multi-modalities for Large Language Models☆460Dec 9, 2023Updated 2 years ago
- [CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI☆654Jun 13, 2025Updated 8 months ago
- [ICML 2024] LEO: An Embodied Generalist Agent in 3D World☆477Apr 20, 2025Updated 10 months ago
- Code for "Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers" (NeurIPS 2024)☆206Oct 20, 2025Updated 4 months ago
- Official implementation of ECCV24 paper "SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding"☆278Mar 19, 2025Updated 11 months ago
- Official implementation of ICCV 2023 paper "3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment"☆217Sep 7, 2023Updated 2 years ago
- [CVPR'23] OpenScene: 3D Scene Understanding with Open Vocabularies☆799Oct 27, 2023Updated 2 years ago
- [ICCV'23 Workshop] SAM3D: Segment Anything in 3D Scenes☆1,307Apr 21, 2024Updated last year
- ☆152Aug 23, 2023Updated 2 years ago
- Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World☆133Oct 24, 2024Updated last year
- [ECCV 2024] ShapeLLM: Universal 3D Object Understanding for Embodied Interaction☆225Oct 8, 2024Updated last year
- (CVPR 2023) PLA: Language-Driven Open-Vocabulary 3D Scene Understanding & (CVPR2024) RegionPLC: Regional Point-Language Contrastive Learn…☆298Jun 28, 2024Updated last year
- [CVPR 2023] Code for "3D Concept Learning and Reasoning from Multi-View Images"☆84Jan 20, 2024Updated 2 years ago
- [ICRA 2024] Chat with NeRF enables users to interact with a NeRF model by typing in natural language.☆320Oct 10, 2025Updated 4 months ago
- [T-PAMI 2025] PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm☆369Sep 30, 2025Updated 5 months ago
- Code release for ConceptFusion [RSS 2023]☆228Sep 23, 2023Updated 2 years ago
- Code&Data for Grounded 3D-LLM with Referent Tokens☆132Jan 5, 2025Updated last year
- Code for "Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenes"☆56Mar 28, 2024Updated last year
- [CVPR 2024] Probing the 3D Awareness of Visual Foundation Models☆349Dec 1, 2025Updated 3 months ago
- Official implementation of the paper "LangSplat: 3D Language Gaussian Splatting" [CVPR2024 Highlight]☆1,002Oct 10, 2025Updated 4 months ago
- Official repo and evaluation implementation of VSI-Bench☆675Aug 5, 2025Updated 7 months ago
- [ CVPR 2023 Award Candidate ] OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generation☆516Sep 2, 2024Updated last year
- Code of 3DMIT: 3D MULTI-MODAL INSTRUCTION TUNING FOR SCENE UNDERSTANDING☆31Jul 26, 2024Updated last year
- Code for LERF: Language Embedded Radiance Fields☆722Jul 9, 2024Updated last year
- Mask3D predicts accurate 3D semantic instances achieving state-of-the-art on ScanNet, ScanNet200, S3DIS and STPLS3D.☆712Oct 29, 2023Updated 2 years ago
- [NeurIPS'23 Spotlight] Segment Any Point Cloud Sequences by Distilling Vision Foundation Models☆640Dec 16, 2023Updated 2 years ago
- ☆585Jan 21, 2026Updated last month
- [ICCV 2023] Multi3DRefer: Grounding Text Description to Multiple 3D Objects☆94Oct 18, 2025Updated 4 months ago
- [CVPR'24 Highlight] GPT4Point: A Unified Framework for Point-Language Understanding and Generation.☆438Apr 27, 2024Updated last year
- Segment-Anything + 3D. Let's lift anything to 3D.☆1,604Jun 12, 2023Updated 2 years ago
- DUSt3R: Geometric 3D Vision Made Easy☆6,975Sep 24, 2025Updated 5 months ago
- [ICCV 2023] Single-Stage Diffusion NeRF☆447Apr 20, 2024Updated last year
- Official implementation of Continuous 3D Perception Model with Persistent State☆1,345Aug 27, 2025Updated 6 months ago