vision-x-nyu / thinking-in-space
Official repo and evaluation implementation of VSI-Bench
β375Updated 3 weeks ago
Alternatives and similar repositories for thinking-in-space:
Users that are interested in thinking-in-space are comparing it to the libraries listed below
- β348Updated 9 months ago
- Compose multimodal datasets πΉβ279Updated 2 weeks ago
- A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D Worldβ214Updated 2 months ago
- π This is a repository for organizing papers, codes and other resources related to unified multimodal models.β372Updated last month
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ223Updated 3 weeks ago
- [ICML 2024] Official code repository for 3D embodied generalist agent LEOβ412Updated 3 weeks ago
- The paper collections for the autoregressive models in vision.β404Updated this week
- [NeurIPS'24] This repository is the implementation of "SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models"β114Updated 2 months ago
- Official repo for "VisionZip: Longer is Better but Not Necessary in Vision Language Models"β235Updated last month
- π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β250Updated last month
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought β¦β227Updated last month
- [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agentsβ306Updated 10 months ago
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creationβ415Updated 2 months ago
- This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)β169Updated 2 months ago
- [CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIβ543Updated last month
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Surveyβ351Updated last month
- Long Context Transfer from Language to Visionβ360Updated 2 months ago
- OpenEQA Embodied Question Answering in the Era of Foundation Modelsβ254Updated 4 months ago
- π₯π₯π₯ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).β427Updated last month
- Code for "Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers" (NeurIPS 2024)β135Updated last month
- Official implementation of the Law of Vision Representation in MLLMsβ149Updated 3 months ago
- The official repo for "SpatialBot: Precise Spatial Understanding with Vision Language Models.β201Updated 3 weeks ago
- Official implementation of ECCV24 paper "SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding"β224Updated this week
- VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)β317Updated 6 months ago
- [CVPR 2024] "LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning"; an interactive Large Languβ¦β264Updated 7 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAIβ294Updated last week
- β308Updated last year
- β153Updated 7 months ago
- SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Modelsβ202Updated 5 months ago