DCDmllm / WorldGPT
WorldGPT: Empowering LLM as Multimodal World Model
☆114Updated 8 months ago
Alternatives and similar repositories for WorldGPT:
Users that are interested in WorldGPT are comparing it to the libraries listed below
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆93Updated last year
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆107Updated 3 weeks ago
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache☆42Updated 8 months ago
- 🚀 [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'2…☆80Updated 2 weeks ago
- [ICLR 2025] BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities☆140Updated 2 months ago
- (NeurIPS 2024) Official PyTorch implementation of LOVA3☆82Updated 3 weeks ago
- GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Recognition?☆186Updated 10 months ago
- Official implementation of X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models☆154Updated 4 months ago
- RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response☆40Updated 4 months ago
- A post-training method to enhance CLIP's fine-grained visual representations with generative models.☆47Updated 3 weeks ago
- u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model☆131Updated last week
- [ICLR 2025] Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆137Updated 4 months ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆155Updated 3 months ago
- SemiEvol: Semi-supervised Fine-tuning for LLM Adaptation☆52Updated 4 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆113Updated last year
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆159Updated 6 months ago
- [MM'24 Oral] Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval☆124Updated 7 months ago
- CoS: Chain-of-Shot Prompting for Long Video Understanding☆47Updated 2 months ago
- Official code base for paper EZIGen: Enhancing zero-shot personalized image generation with precise subject encoding and decoupled guidan…☆104Updated 3 weeks ago
- [CVPR 2023] Official implementation of the paper: Fine-grained Audible Video Description☆72Updated last year
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆170Updated 5 months ago
- [NeurIPS 2022] TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation☆114Updated 2 years ago
- ☆28Updated 5 months ago
- R1-like Computer-use Agent☆67Updated 3 weeks ago
- Code and dataset of CodeSteer☆54Updated 3 weeks ago
- ☆64Updated last month
- [NAACL 2025 Oral] 🎉 From redundancy to relevance: Enhancing explainability in multimodal large language models☆94Updated 2 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆302Updated last month
- [3DV 2025]🐱🐶🐲🐮🐷Official Implementation of DreamBeast: Distilling 3D Fantastical Animals with Part-Aware Knowledge Transfer☆67Updated last month
- A curated list of awesome papers on the platonic representation hypothesis.☆20Updated this week