TRI-ML / prismatic-vlmsLinks
A flexible and efficient codebase for training visually-conditioned language models (VLMs)
☆895Updated last year
Alternatives and similar repositories for prismatic-vlms
Users that are interested in prismatic-vlms are comparing it to the libraries listed below
Sorting:
- Compose multimodal datasets 🎹☆532Updated 4 months ago
- Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.☆522Updated last year
- Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long c…☆868Updated 2 weeks ago
- Implementation of "PaLM-E: An Embodied Multimodal Language Model"☆331Updated last year
- Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning☆404Updated last year
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success☆951Updated 3 months ago
- Embodied Chain of Thought: A robotic policy that reason to solve the task.☆350Updated 9 months ago
- Code for the Molmo Vision-Language Model☆852Updated last year
- Embodied Reasoning Question Answer (ERQA) Benchmark☆254Updated 9 months ago
- Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Goo…☆914Updated 2 weeks ago
- OpenEQA Embodied Question Answering in the Era of Foundation Models☆336Updated last year
- [ICLR 2025] LAPA: Latent Action Pretraining from Videos☆431Updated 11 months ago
- ☆420Updated last month
- world modeling challenge for humanoid robots☆527Updated last year
- Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence☆543Updated this week
- Embodied Agent Interface (EAI): Benchmarking LLMs for Embodied Decision Making (NeurIPS D&B 2024 Oral)☆276Updated 10 months ago
- Democratization of RT-2 "RT-2: New model translates vision and language into action"☆539Updated last year
- CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks☆792Updated 3 months ago
- SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning☆1,173Updated 2 months ago
- Official repo and evaluation implementation of VSI-Bench☆657Updated 5 months ago
- VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning☆133Updated last year
- Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"☆233Updated last month
- A curated list of awesome papers on Embodied AI and related research/industry-driven resources.☆490Updated 7 months ago
- A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation☆394Updated 2 months ago
- [AAAI-25] Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference☆290Updated 11 months ago
- Latest Advances on Vison-Language-Action Models.☆124Updated 10 months ago
- Benchmarking Knowledge Transfer in Lifelong Robot Learning☆1,337Updated 9 months ago
- OpenVLA: An open-source vision-language-action model for robotic manipulation.☆323Updated 9 months ago
- ☆423Updated 2 weeks ago
- A Framework of Small-scale Large Multimodal Models☆942Updated 8 months ago