TRI-ML / prismatic-vlmsLinks
A flexible and efficient codebase for training visually-conditioned language models (VLMs)
☆693Updated 11 months ago
Alternatives and similar repositories for prismatic-vlms
Users that are interested in prismatic-vlms are comparing it to the libraries listed below
Sorting:
- Compose multimodal datasets 🎹☆393Updated this week
- Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning☆359Updated 5 months ago
- Implementation of "PaLM-E: An Embodied Multimodal Language Model"☆305Updated last year
- Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.☆499Updated 6 months ago
- VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning☆112Updated 8 months ago
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success☆415Updated last month
- Official repo and evaluation implementation of VSI-Bench☆492Updated 3 months ago
- Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Goo…☆640Updated 2 months ago
- Embodied Chain of Thought: A robotic policy that reason to solve the task.☆254Updated 2 months ago
- Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long c…☆435Updated last week
- Code for the Molmo Vision-Language Model☆431Updated 5 months ago
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆619Updated last year
- A Framework of Small-scale Large Multimodal Models☆825Updated last month
- [ICLR 2025] LAPA: Latent Action Pretraining from Videos☆293Updated 4 months ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆546Updated last week
- [AAAI-25] Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference☆276Updated 4 months ago
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆330Updated last month
- ☆354Updated 4 months ago
- A curated list of awesome papers on Embodied AI and related research/industry-driven resources.☆440Updated last month
- Embodied Reasoning Question Answer (ERQA) Benchmark☆159Updated 2 months ago
- OpenEQA Embodied Question Answering in the Era of Foundation Models☆283Updated 8 months ago
- [ICLR'25] LLaRA: Supercharging Robot Learning Data for Vision-Language Policy☆212Updated 2 months ago
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆323Updated 5 months ago
- Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"☆208Updated 2 weeks ago
- When do we not need larger vision models?☆396Updated 3 months ago
- Democratization of RT-2 "RT-2: New model translates vision and language into action"☆458Updated 10 months ago
- ☆334Updated last year
- This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…☆438Updated 2 weeks ago
- ☆613Updated last year
- CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks☆573Updated 3 months ago