We use self-supervision to learn a compact and multimodal representation of our sensory inputs, which can then be used to improve the sample efficiency of our policy learning. We train a policy in PyBullet (on the a Kuka LBR iiwa robot arm) using PPO for peg-in-hole tasks.
☆12Feb 8, 2024Updated 2 years ago
Alternatives and similar repositories for Multi-Modal-Manipulation
Users that are interested in Multi-Modal-Manipulation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- IERG5350 Reinforcement Learning Course Project based on the Stanford AI lab's work on multimodal representation.☆31Apr 2, 2021Updated 5 years ago
- Fast robust peg-in-hole insertion with continuous visual servoing (CORL 2020)☆32Sep 3, 2020Updated 6 years ago
- ☆15Oct 3, 2023Updated 3 years ago
- Learning to Fill the Seam by Vision: Sub-millimeter Peg-in-hole on Unseen Shapes in Real World☆43Jul 24, 2023Updated 3 years ago
- Deep reinforcement learning for robotic peg-in-hole assembly task☆37Oct 5, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- code for paper 'Learning View and Target Invariant Visual Servoing for Navigation'☆12Apr 28, 2021Updated 5 years ago
- Reproducing results from Deep Flow Guided Scene Agnostic Image Based Visual Servoing submission at ICRA'20☆10Aug 30, 2020Updated 6 years ago
- Needs update☆21Sep 6, 2019Updated 7 years ago
- ☆53Jul 5, 2021Updated 5 years ago
- Efficiency, Stability and Generalization Analysis for Reinforcement Learning on Robotic Peg-in-hole Assembly☆27Mar 6, 2020Updated 6 years ago
- Autodesk Deep Reinforcement Learning for Robotic Assembly☆46Dec 18, 2020Updated 5 years ago
- ☆12May 27, 2024Updated 2 years ago
- Code release for paper : EmbodiedAgent: A Scalable Hierarchical Approach to Overcome Practical Challenge in Multi-Robot Control☆13Sep 23, 2025Updated last year
- ☆14Apr 15, 2020Updated 6 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- fuzzy q learning for peg-in-hole assembly☆11Jan 17, 2020Updated 6 years ago
- Polishing experiments☆11Oct 30, 2018Updated 8 years ago
- Rank TD: End-to-End Robotic Reinforcement Learning without Reward Engineering and Demonstrations☆14Oct 8, 2022Updated 4 years ago
- Suite of PyBullet reinforcement learning environments targeted towards using tactile data as the main form of observation. This repo has …☆25May 21, 2023Updated 3 years ago
- Source codes for the paper "MRBTP: Efficient Multi-Robot Behavior Tree Planning and Collaboration" (AAAI 2025)☆17Dec 22, 2025Updated 10 months ago
- A dataset named Ship Collection in Complex Optical Scene (SCCOS), which is obtained from multiple platform sources including Google Earth…☆11Oct 13, 2024Updated 2 years ago
- Generate Rain / Haze synthetic data for training☆10Nov 14, 2016Updated 10 years ago
- The implementation of Action Chunking Transformer (ACT) from scratch and validate/test trained models in Bigym and Maniskill simulators.☆14Mar 26, 2025Updated last year
- Implementation of some usefull filters used in ROS☆13Oct 29, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆10Feb 7, 2022Updated 4 years ago
- Peg-in-hole assembly with RL☆18May 19, 2024Updated 2 years ago
- [ICML 2022] Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculum☆12Jul 15, 2022Updated 4 years ago
- MIDS Capstone Project, Duke University, 2021☆10Apr 28, 2021Updated 5 years ago
- [ACL 2025] "World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning." https://arxiv.org/abs/2503.1…☆18Jul 22, 2025Updated last year
- Generate reachability and base placement maps for mobile manipulators using pytorch_kinematics☆45Nov 24, 2022Updated 3 years ago
- ☆13Sep 15, 2020Updated 6 years ago
- The test code for the paper "Attention-based advantage actor-critic algorithm with prioritized experience replay for complex 2-D robotic …☆10Aug 7, 2022Updated 4 years ago
- Code for keypoint-based visual servo IROS2020☆65Aug 11, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [CVPR 2025] Source codes for the paper "Collaborative Tree Search for Enhancing Embodied Multi-Agent Collaboration"☆19Nov 10, 2025Updated last year
- This is a summary of robot skills learning and the computer vision involved, including papers and code!☆10Jun 2, 2020Updated 6 years ago
- Code for the IROS 2021 paper "Learning of Parameters in Behavior Trees for Movement Skills". In short, we combine behavior trees (BT), a …☆13Jan 8, 2024Updated 2 years ago
- ☆11Jan 10, 2020Updated 6 years ago
- ☆10Mar 6, 2026Updated 8 months ago
- Active Vision Tracking of a Tendon-driven continuum robot by using efficient model-based Reinforcement Learning☆12Aug 25, 2023Updated 3 years ago
- Here is the code and saliency maps for the paper 'Saliency Pattern Detection by Ranking Structured Trees' in ICCV 2017.☆12Nov 1, 2017Updated 9 years ago
Are these results useful?