DCDmllm / WorldGPT
WorldGPT: Empowering LLM as Multimodal World Model
☆123Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for WorldGPT
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆86Updated 7 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆108Updated 3 weeks ago
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache☆46Updated 3 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆108Updated 6 months ago
- Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆109Updated 3 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆148Updated last month
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆122Updated last week
- u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model☆137Updated 3 months ago
- This is the official code repository of MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tas…☆62Updated 2 months ago
- The official code for "BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities"☆149Updated 2 weeks ago
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆102Updated this week
- GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Recognition?☆207Updated 5 months ago
- 🚀 [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'2…☆60Updated last week
- [ICCV23] Bird’s-Eye-View Scene Graph for Vision-Language Navigation☆117Updated 6 months ago
- [MM'24 Oral] Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval☆139Updated 2 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆119Updated this week
- ☆338Updated 6 months ago
- SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆236Updated this week
- Official implementation of Bootstrap3D: Improving Multi-view Diffusion Model with Synthetic Data☆84Updated 2 weeks ago
- MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆286Updated this week
- This is the official reproduction of Qihoo-T2X.☆243Updated last week
- ☆67Updated 3 months ago
- OmniTokenizer: one model and one weight for image-video joint tokenization.☆255Updated 4 months ago
- SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation☆96Updated 3 weeks ago
- [NeurIPS 2022] TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation☆122Updated last year
- Reasoning 3D Segmentation - "segment anything"/grounding/part seperation in 3D with natural conversations.☆75Updated 5 months ago
- Visualization of DiT self attention features☆151Updated 2 months ago
- [CVPR 2023] Official implementation of the paper: Fine-grained Audible Video Description☆74Updated 11 months ago
- [NeurIPS'24] Leveraging Hallucinations to Reduce Manual Prompt Dependency in Promptable Segmentation☆65Updated last month
- [ICLR'24] Democratizing Fine-grained Visual Recognition with Large Language Models☆150Updated 3 months ago