kyegomez / PALM-E
Implementation of "PaLM-E: An Embodied Multimodal Language Model"
☆299Updated last year
Alternatives and similar repositories for PALM-E:
Users that are interested in PALM-E are comparing it to the libraries listed below
- Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model☆359Updated 10 months ago
- Democratization of RT-2 "RT-2: New model translates vision and language into action"☆442Updated 8 months ago
- Code for RoboFlamingo☆369Updated 11 months ago
- Official Task Suite Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"☆298Updated last year
- Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"☆201Updated 2 weeks ago
- [arXiv 2023] Embodied Task Planning with Large Language Models☆182Updated last year
- Suite of human-collected datasets and a multi-task continuous control benchmark for open vocabulary visuolinguomotor learning.☆313Updated this week
- ☆332Updated 2 months ago
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success☆321Updated 3 weeks ago
- Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Goo…☆585Updated 3 weeks ago
- OmniGibson: a platform for accelerating Embodied AI research built upon NVIDIA's Omniverse engine. Join our Discord for support: https://…☆669Updated this week
- Embodied Chain of Thought: A robotic policy that reason to solve the task.☆219Updated 2 weeks ago
- Official Algorithm Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"☆803Updated last year
- ☆227Updated 3 months ago
- Official Code for RVT-2 and RVT☆335Updated 2 months ago
- [ICML 2024] Official code repository for 3D embodied generalist agent LEO☆433Updated this week
- Embodied Agent Interface (EAI): Benchmarking LLMs for Embodied Decision Making (NeurIPS D&B 2024 Oral)☆189Updated last month
- Generating Robotic Simulation Tasks via Large Language Models☆325Updated last year
- [ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model☆475Updated 5 months ago
- Benchmarking Knowledge Transfer in Lifelong Robot Learning☆496Updated last month
- ☆172Updated last year
- Code for "Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation"☆245Updated last year
- Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo, and OpenVLA) in simulation under common setu…☆102Updated 3 weeks ago
- A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation☆239Updated 2 months ago
- Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.☆485Updated 4 months ago
- VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models☆668Updated 2 months ago
- A flexible and efficient codebase for training visually-conditioned language models (VLMs)☆652Updated 9 months ago
- CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks☆539Updated 2 months ago
- OpenEQA Embodied Question Answering in the Era of Foundation Models☆272Updated 7 months ago
- Paper list in the survey paper: Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis☆425Updated 3 months ago