Alternatives and similar repositories for thinking-in-space:

Users that are interested in thinking-in-space are comparing it to the libraries listed below

• ZCMax / LLaVA-3D
  A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D World
  ☆193Updated last month
• remyxai / VQASynth
  Compose multimodal datasets 🎹
  ☆256Updated last month
• mit-han-lab / vila-u
  VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
  ☆194Updated 2 months ago
• dvlab-research / VisionZip
  Official repo for "VisionZip: Longer is Better but Not Necessary in Vision Language Models"
  ☆213Updated last week
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆353Updated last month
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆306Updated 8 months ago
• Open3DA / LL3DA
  [CVPR 2024] "LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning"; an interactive Large Langu…
  ☆257Updated 5 months ago
• showlab / Awesome-Unified-Multimodal-Models
  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.
  ☆315Updated 2 weeks ago
• ZzZZCHS / Chat-Scene
  Code for "Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers" (NeurIPS 2024)
  ☆126Updated this week
• AnjieCheng / SpatialRGPT
  [NeurIPS'24] This repository is the implementation of "SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models"
  ☆89Updated 3 weeks ago
• ByteFlow-AI / TokenFlow
  🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
  ☆219Updated last week
• showlab / videollm-online
  VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)
  ☆278Updated 4 months ago
• MLLM-Tool / MLLM-Tool
  MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning
  ☆104Updated 8 months ago
• scene-verse / SceneVerse
  Official implementation of ECCV24 paper "SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding"
  ☆219Updated last week
• GigaAI-research / General-World-Models-Survey
  ☆327Updated 8 months ago
• embodied-generalist / embodied-generalist
  [ICML 2024] Official code repository for 3D embodied generalist agent LEO
  ☆389Updated 2 months ago
• UMass-Foundation-Model / MultiPLY
  Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World
  ☆123Updated 2 months ago
• BAAI-DCAI / SpatialBot
  The official repo for "SpatialBot: Precise Spatial Understanding with Vision Language Models.
  ☆190Updated 3 weeks ago
• OpenRobotLab / Grounded_3D-LLM
  Code&Data for Grounded 3D-LLM with Referent Tokens
  ☆97Updated this week
• ShareGPT4Omni / ShareGPT4V
  [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
  ☆186Updated 6 months ago
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆408Updated last month
• YueFan1014 / VideoAgent
  This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)
  ☆160Updated last month
• ChaofanTao / Autoregressive-Models-in-Vision-Survey
  The paper collections for the autoregressive models in vision.
  ☆350Updated 2 weeks ago
• qizekun / ShapeLLM
  [ECCV 2024] ShapeLLM: Universal 3D Object Understanding for Embodied Interaction
  ☆160Updated 3 months ago
• YingqingHe / Awesome-LLMs-meet-Multimodal-Generation
  🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
  ☆402Updated 2 weeks ago
• behavior-vision-suite / behavior-vision-suite.github.io
  ☆150Updated 6 months ago
• IVGSZ / Flash-VStream
  This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"
  ☆145Updated 2 weeks ago
• Beckschen / genex
  Generative World Explorer
  ☆119Updated last month
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆131Updated 4 months ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆145Updated last month