We use self-supervision to learn a compact and multimodal representation of our sensory inputs, which can then be used to improve the sample efficiency of our policy learning. We train a policy in PyBullet (on the a Kuka LBR iiwa robot arm) using PPO for peg-in-hole tasks.
☆12Feb 8, 2024Updated 2 years ago
Alternatives and similar repositories for Multi-Modal-Manipulation
Users that are interested in Multi-Modal-Manipulation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast robust peg-in-hole insertion with continuous visual servoing (CORL 2020)☆30Sep 3, 2020Updated 5 years ago
- ☆13Oct 3, 2023Updated 2 years ago
- Learning to Fill the Seam by Vision: Sub-millimeter Peg-in-hole on Unseen Shapes in Real World☆43Jul 24, 2023Updated 2 years ago
- Deep reinforcement learning for robotic peg-in-hole assembly task☆37Oct 5, 2018Updated 7 years ago
- IERG5350 Reinforcement Learning Course Project based on the Stanford AI lab's work on multimodal representation.☆31Apr 2, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- code for paper 'Learning View and Target Invariant Visual Servoing for Navigation'☆12Apr 28, 2021Updated 5 years ago
- Needs update☆21Sep 6, 2019Updated 6 years ago
- ☆54Jul 5, 2021Updated 5 years ago
- Efficiency, Stability and Generalization Analysis for Reinforcement Learning on Robotic Peg-in-hole Assembly☆27Mar 6, 2020Updated 6 years ago
- fuzzy q learning for peg-in-hole assembly☆11Jan 17, 2020Updated 6 years ago
- ☆14Apr 15, 2020Updated 6 years ago
- Rank TD: End-to-End Robotic Reinforcement Learning without Reward Engineering and Demonstrations☆14Oct 8, 2022Updated 3 years ago
- Peg-in-hole assembly with RL☆18May 19, 2024Updated 2 years ago
- Code for keypoint-based visual servo IROS2020☆63Aug 11, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for the IROS 2021 paper "Learning of Parameters in Behavior Trees for Movement Skills". In short, we combine behavior trees (BT), a …☆13Jan 8, 2024Updated 2 years ago
- Suite of PyBullet reinforcement learning environments targeted towards using tactile data as the main form of observation. This repo has …☆25May 21, 2023Updated 3 years ago
- [ICML 2022] Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculum☆12Jul 15, 2022Updated 4 years ago
- Source codes for the paper "MRBTP: Efficient Multi-Robot Behavior Tree Planning and Collaboration" (AAAI 2025)☆17Dec 22, 2025Updated 6 months ago
- Generate Rain / Haze synthetic data for training☆10Nov 14, 2016Updated 9 years ago
- Implementation of some usefull filters used in ROS☆13Oct 29, 2021Updated 4 years ago
- This is a summary of robot skills learning and the computer vision involved, including papers and code!☆10Jun 2, 2020Updated 6 years ago
- [CVPR 2025] Source codes for the paper "Collaborative Tree Search for Enhancing Embodied Multi-Agent Collaboration"☆17Nov 10, 2025Updated 8 months ago
- ☆10Feb 7, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MIDS Capstone Project, Duke University, 2021☆10Apr 28, 2021Updated 5 years ago
- ☆15Sep 1, 2022Updated 3 years ago
- The test code for the paper "Attention-based advantage actor-critic algorithm with prioritized experience replay for complex 2-D robotic …☆10Aug 7, 2022Updated 3 years ago
- Autodesk Deep Reinforcement Learning for Robotic Assembly☆45Dec 18, 2020Updated 5 years ago
- Mobile Robot Control via Goal-Conditioned Reinforcement Learning☆23Oct 13, 2023Updated 2 years ago
- ☆13Sep 15, 2020Updated 5 years ago
- Simulation and training a UR5 robot to accurately insert a pin into a hole using the CoppeliaSim simulator and catalyst-rl reinforcement …☆24Nov 10, 2023Updated 2 years ago
- MiniTouch is a ServiceNow Research project that was started at Element AI.☆14Jul 5, 2023Updated 3 years ago
- CNS: Correspondence encoded Neural image Servo policy☆28Aug 20, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Vision-based robotic arm grasping using deep reinforcement learning☆28Aug 19, 2023Updated 2 years ago
- Deep Visual MPC-Policy Learning for Navigation☆30May 19, 2022Updated 4 years ago
- Here is the code and saliency maps for the paper 'Saliency Pattern Detection by Ranking Structured Trees' in ICCV 2017.☆12Nov 1, 2017Updated 8 years ago
- ROS wrapper of Nvidia Contact-graspnet model.☆18Jul 3, 2023Updated 3 years ago
- ☆14Aug 16, 2021Updated 4 years ago
- Code base for NeurIPS 2022 paper Curriculum Reinforcement Learning using Optimal Transport via Gradual Domain Adaptation.☆11Aug 21, 2023Updated 2 years ago
- A Saliency Detection Model Using Low-Level Features Based on Wavelet Transform☆11Nov 14, 2017Updated 8 years ago