TRI-ML / prismatic-vlmsLinks
A flexible and efficient codebase for training visually-conditioned language models (VLMs)
☆730Updated last year
Alternatives and similar repositories for prismatic-vlms
Users that are interested in prismatic-vlms are comparing it to the libraries listed below
Sorting:
- Implementation of "PaLM-E: An Embodied Multimodal Language Model"☆314Updated last year
- Compose multimodal datasets 🎹☆438Updated last month
- Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.☆503Updated 7 months ago
- Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning☆372Updated 7 months ago
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success☆530Updated 2 months ago
- Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long c…☆542Updated last week
- Embodied Chain of Thought: A robotic policy that reason to solve the task.☆273Updated 3 months ago
- OpenEQA Embodied Question Answering in the Era of Foundation Models☆299Updated 9 months ago
- Embodied Reasoning Question Answer (ERQA) Benchmark☆183Updated 4 months ago
- Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Goo…☆686Updated 3 months ago
- Democratization of RT-2 "RT-2: New model translates vision and language into action"☆483Updated 11 months ago
- Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model☆365Updated last year
- [ICLR 2025] LAPA: Latent Action Pretraining from Videos☆326Updated 5 months ago
- Code for the Molmo Vision-Language Model☆557Updated 7 months ago
- ☆372Updated 5 months ago
- Recent LLM-based CV and related works. Welcome to comment/contribute!☆868Updated 4 months ago
- Official repo and evaluation implementation of VSI-Bench☆541Updated 2 weeks ago
- world modeling challenge for humanoid robots☆494Updated 8 months ago
- Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"☆217Updated last month
- CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks☆609Updated last week
- [ICLR'25] LLaRA: Supercharging Robot Learning Data for Vision-Language Policy☆214Updated 3 months ago
- A curated list of awesome papers on Embodied AI and related research/industry-driven resources.☆451Updated last month
- Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence☆458Updated last week
- ☆616Updated last year
- VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning☆117Updated 9 months ago
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆644Updated last year
- Code for RoboFlamingo☆393Updated last year
- ☆1,277Updated 7 months ago
- Suite of human-collected datasets and a multi-task continuous control benchmark for open vocabulary visuolinguomotor learning.☆318Updated 3 weeks ago
- Theia: Distilling Diverse Vision Foundation Models for Robot Learning☆239Updated 3 months ago