We use self-supervision to learn a compact and multimodal representation of our sensory inputs, which can then be used to improve the sample efficiency of our policy learning. We train a policy in PyBullet (on the a Kuka LBR iiwa robot arm) using PPO for peg-in-hole tasks.
☆12Feb 8, 2024Updated 2 years ago
Alternatives and similar repositories for Multi-Modal-Manipulation
Users that are interested in Multi-Modal-Manipulation are comparing it to the libraries listed below
Sorting:
- Fast robust peg-in-hole insertion with continuous visual servoing (CORL 2020)☆28Sep 3, 2020Updated 5 years ago
- ☆13Oct 3, 2023Updated 2 years ago
- Learning to Fill the Seam by Vision: Sub-millimeter Peg-in-hole on Unseen Shapes in Real World☆41Jul 24, 2023Updated 2 years ago
- Deep reinforcement learning for robotic peg-in-hole assembly task☆34Oct 5, 2018Updated 7 years ago
- IERG5350 Reinforcement Learning Course Project based on the Stanford AI lab's work on multimodal representation.☆31Apr 2, 2021Updated 4 years ago
- code for paper 'Learning View and Target Invariant Visual Servoing for Navigation'☆12Apr 28, 2021Updated 4 years ago
- Needs update☆22Sep 6, 2019Updated 6 years ago
- ☆54Jul 5, 2021Updated 4 years ago
- ROS wrapper of Nvidia Contact-graspnet model.☆17Jul 3, 2023Updated 2 years ago
- Efficiency, Stability and Generalization Analysis for Reinforcement Learning on Robotic Peg-in-hole Assembly☆28Mar 6, 2020Updated 6 years ago
- ☆14Apr 15, 2020Updated 5 years ago
- fuzzy q learning for peg-in-hole assembly☆11Jan 17, 2020Updated 6 years ago
- Rank TD: End-to-End Robotic Reinforcement Learning without Reward Engineering and Demonstrations☆14Oct 8, 2022Updated 3 years ago
- Peg-in-hole assembly with RL☆15May 19, 2024Updated last year
- This repository provides the code for training the position constrained generative grasp sampler from the paper Constrained Generative Sa…☆22Dec 4, 2024Updated last year
- Code for keypoint-based visual servo IROS2020☆60Aug 11, 2021Updated 4 years ago
- Code for the IROS 2021 paper "Learning of Parameters in Behavior Trees for Movement Skills". In short, we combine behavior trees (BT), a …☆13Jan 8, 2024Updated 2 years ago
- Online Semantic Planning for Missions with Incomplete Natural Language Specifications in Unstructured Environments☆27Oct 14, 2025Updated 5 months ago
- Suite of PyBullet reinforcement learning environments targeted towards using tactile data as the main form of observation. This repo has …☆23May 21, 2023Updated 2 years ago
- [ICML 2022] Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculum☆11Jul 15, 2022Updated 3 years ago
- Generate Rain / Haze synthetic data for training☆10Nov 14, 2016Updated 9 years ago
- A paper list of sample-efficient reinforcement learning☆18Jan 12, 2022Updated 4 years ago
- MiniTouch is a ServiceNow Research project that was started at Element AI.☆14Jul 5, 2023Updated 2 years ago
- Official Implementation of FLARE (AAAI'25 Oral)☆30Nov 27, 2025Updated 3 months ago
- This is a summary of robot skills learning and the computer vision involved, including papers and code!☆10Jun 2, 2020Updated 5 years ago
- Mobile Robot Control via Goal-Conditioned Reinforcement Learning☆23Oct 13, 2023Updated 2 years ago
- MIDS Capstone Project, Duke University, 2021☆10Apr 28, 2021Updated 4 years ago
- ☆10Feb 7, 2022Updated 4 years ago
- Portable library for binary (bi-valued) image processing☆14Jun 12, 2024Updated last year
- Code for Information Fusion 2025 Paper "Multi-Source Multi-Modal Domain Adaptation"☆20Feb 4, 2025Updated last year
- ☆14Sep 1, 2022Updated 3 years ago
- The test code for the paper "Attention-based advantage actor-critic algorithm with prioritized experience replay for complex 2-D robotic …☆10Aug 7, 2022Updated 3 years ago
- Simulation and training a UR5 robot to accurately insert a pin into a hole using the CoppeliaSim simulator and catalyst-rl reinforcement …☆24Nov 10, 2023Updated 2 years ago
- Autodesk Deep Reinforcement Learning for Robotic Assembly☆44Dec 18, 2020Updated 5 years ago
- Vision-based robotic arm grasping using deep reinforcement learning☆28Aug 19, 2023Updated 2 years ago
- ☆14Sep 15, 2020Updated 5 years ago
- Implementation of some usefull filters used in ROS☆13Oct 29, 2021Updated 4 years ago
- CNS: Correspondence encoded Neural image Servo policy☆26Aug 20, 2024Updated last year
- Here is the code and saliency maps for the paper 'Saliency Pattern Detection by Ranking Structured Trees' in ICCV 2017.☆12Nov 1, 2017Updated 8 years ago