TRI-ML / prismatic-vlms
A flexible and efficient codebase for training visually-conditioned language models (VLMs)
☆467Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for prismatic-vlms
- Compose multimodal datasets 🎹☆204Updated this week
- Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference☆255Updated 2 months ago
- OpenEQA Embodied Question Answering in the Era of Foundation Models☆233Updated last month
- ☆287Updated 9 months ago
- When do we not need larger vision models?☆333Updated 2 months ago
- ☆569Updated 8 months ago
- [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs☆123Updated 2 months ago
- VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning☆85Updated last month
- [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents☆300Updated 6 months ago
- [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …☆457Updated 3 months ago
- LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images☆318Updated last month
- Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning☆199Updated last month
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆244Updated 4 months ago
- A Framework of Small-scale Large Multimodal Models☆635Updated 3 weeks ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆294Updated 3 months ago
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆523Updated 10 months ago
- (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.☆317Updated 3 months ago
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆777Updated 5 months ago
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆264Updated this week
- Aligning LMMs with Factually Augmented RLHF☆318Updated last year
- RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness☆230Updated this week
- Implementation of "PaLM-E: An Embodied Multimodal Language Model"☆271Updated 9 months ago
- [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models☆227Updated last month
- Famous Vision Language Models and Their Architectures☆401Updated 2 months ago
- [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(…☆242Updated this week
- LLaRA: Large Language and Robotics Assistant☆153Updated last month
- Long Context Transfer from Language to Vision☆328Updated 2 weeks ago
- Theia: Distilling Diverse Vision Foundation Models for Robot Learning☆160Updated 3 weeks ago
- The official repo for "SpatialBot: Precise Spatial Understanding with Vision Language Models.☆158Updated 3 weeks ago