remyxai / VQASynth
Compose multimodal datasets 🎹
☆261Updated last month
Alternatives and similar repositories for VQASynth:
Users that are interested in VQASynth are comparing it to the libraries listed below
- Official repo and evaluation implementation of VSI-Bench☆326Updated this week
- A flexible and efficient codebase for training visually-conditioned language models (VLMs)☆543Updated 6 months ago
- OpenEQA Embodied Question Answering in the Era of Foundation Models☆250Updated 3 months ago
- [ICML 2024] Official code repository for 3D embodied generalist agent LEO☆396Updated 3 months ago
- The official repo for "SpatialBot: Precise Spatial Understanding with Vision Language Models.☆192Updated 3 weeks ago
- [ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model☆403Updated 2 months ago
- Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model☆348Updated 6 months ago
- Theia: Distilling Diverse Vision Foundation Models for Robot Learning☆200Updated 3 months ago
- Code for "Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers" (NeurIPS 2024)☆128Updated last week
- A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D World☆195Updated last month
- 🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.☆278Updated 7 months ago
- This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)☆161Updated last month
- Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World☆124Updated 2 months ago
- [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs☆132Updated 4 months ago
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆202Updated 3 weeks ago
- Official implementation of ECCV24 paper "SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding"☆221Updated 2 weeks ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆308Updated 6 months ago
- ☆235Updated this week
- [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents☆306Updated 9 months ago
- Official repo for "VisionZip: Longer is Better but Not Necessary in Vision Language Models"☆219Updated 2 weeks ago
- ☆304Updated 11 months ago
- ☆150Updated 6 months ago
- [CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI☆524Updated last week
- VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆199Updated this week
- Embodied Agent Interface (EAI): Benchmarking LLMs for Embodied Decision Making (NeurIPS D&B 2024 Oral)☆151Updated this week
- [CVPR 2024] "LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning"; an interactive Large Langu…☆258Updated 6 months ago
- Official repository of Learning to Act from Actionless Videos through Dense Correspondences.☆191Updated 8 months ago
- This is a repository for listing papers on scene graph generation and application.☆141Updated last week
- [ECCV 2024] ShapeLLM: Universal 3D Object Understanding for Embodied Interaction☆162Updated 3 months ago