We use self-supervision to learn a compact and multimodal representation of our sensory inputs, which can then be used to improve the sample efficiency of our policy learning. We train a policy in PyBullet (on the a Kuka LBR iiwa robot arm) using PPO for peg-in-hole tasks.
☆12Feb 8, 2024Updated 2 years ago
Alternatives and similar repositories for Multi-Modal-Manipulation
Users that are interested in Multi-Modal-Manipulation are comparing it to the libraries listed below
Sorting:
- ☆13Oct 3, 2023Updated 2 years ago
- Fast robust peg-in-hole insertion with continuous visual servoing (CORL 2020)☆27Sep 3, 2020Updated 5 years ago
- Learning to Fill the Seam by Vision: Sub-millimeter Peg-in-hole on Unseen Shapes in Real World☆40Jul 24, 2023Updated 2 years ago
- ☆53Jul 5, 2021Updated 4 years ago
- ☆14Apr 15, 2020Updated 5 years ago
- code for paper 'Learning View and Target Invariant Visual Servoing for Navigation'☆12Apr 28, 2021Updated 4 years ago
- Deep reinforcement learning for robotic peg-in-hole assembly task☆33Oct 5, 2018Updated 7 years ago
- IERG5350 Reinforcement Learning Course Project based on the Stanford AI lab's work on multimodal representation.☆30Apr 2, 2021Updated 4 years ago
- Code for keypoint-based visual servo IROS2020☆60Aug 11, 2021Updated 4 years ago
- CNS: Correspondence encoded Neural image Servo policy☆26Aug 20, 2024Updated last year
- Suite of PyBullet reinforcement learning environments targeted towards using tactile data as the main form of observation. This repo has …☆23May 21, 2023Updated 2 years ago
- Needs update☆22Sep 6, 2019Updated 6 years ago
- Efficiency, Stability and Generalization Analysis for Reinforcement Learning on Robotic Peg-in-hole Assembly☆28Mar 6, 2020Updated 5 years ago
- Deep Visual MPC-Policy Learning for Navigation☆30May 19, 2022Updated 3 years ago
- Match celebrity users with their respective tweets by making use of Semantic Textual Similarity on over 900+ celebrity users' 2.5 million…☆13Nov 21, 2023Updated 2 years ago
- Autodesk Deep Reinforcement Learning for Robotic Assembly☆42Dec 18, 2020Updated 5 years ago
- This is an unofficial python implement of nonlinear model predictive control with control Lyapunov functions and control barrier function…☆39Aug 25, 2021Updated 4 years ago
- This is a summary of robot skills learning and the computer vision involved, including papers and code!☆10Jun 2, 2020Updated 5 years ago
- Segment Anything with Webcam in Real-Time with FastSAM☆10Nov 19, 2023Updated 2 years ago
- Portable library for binary (bi-valued) image processing☆14Jun 12, 2024Updated last year
- [AAAI 2026 Poster] TOSC: Task-Oriented Shape Completion for Open-World Dexterous Grasp Generation from Partial Point Clouds☆19Feb 2, 2026Updated last month
- fuzzy q learning for peg-in-hole assembly☆11Jan 17, 2020Updated 6 years ago
- A fork of BlenderProc used in the GRADE framework to generate environments and export some additional information for processing.☆10Mar 9, 2023Updated 2 years ago
- Integrating opencv with mujoco.☆11Mar 25, 2025Updated 11 months ago
- Robotic arm with multirotor☆12May 18, 2022Updated 3 years ago
- Code for the IROS 2021 paper "Learning of Parameters in Behavior Trees for Movement Skills". In short, we combine behavior trees (BT), a …☆13Jan 8, 2024Updated 2 years ago
- Learning-based multi-fingered grasp planners.☆10Mar 5, 2020Updated 5 years ago
- A notational semantic for documenting neural networks through diagrams☆15Aug 5, 2023Updated 2 years ago
- 🤖在树莓派zero上开发tensorflow-lite的C++环境 | a C++ Environment for Building Tensorflow-lite Projects on Raspberry Pi Zero (armv6)☆10Apr 13, 2021Updated 4 years ago
- Isaac Gym Reinforcement Learning Environments for humanoid robot Bez☆10Jul 27, 2022Updated 3 years ago
- [MICCAI 2024] Embracing Massive Medical Data☆19Jul 5, 2024Updated last year
- Examples demonstrating contact force modeling in Simscape Multibody☆12Jan 13, 2026Updated last month
- React.js application for Covid19-SG☆11Jun 4, 2024Updated last year
- MIDS Capstone Project, Duke University, 2021☆10Apr 28, 2021Updated 4 years ago
- ROS wrapper of Nvidia Contact-graspnet model.☆17Jul 3, 2023Updated 2 years ago
- ☆14Feb 19, 2023Updated 3 years ago
- Use multiple cameras to track a target pedestrian☆12Jan 21, 2020Updated 6 years ago
- Active Vision Tracking of a Tendon-driven continuum robot by using efficient model-based Reinforcement Learning☆11Aug 25, 2023Updated 2 years ago
- A Saliency Detection Model Using Low-Level Features Based on Wavelet Transform☆11Nov 14, 2017Updated 8 years ago