We use self-supervision to learn a compact and multimodal representation of our sensory inputs, which can then be used to improve the sample efficiency of our policy learning. We train a policy in PyBullet (on the a Kuka LBR iiwa robot arm) using PPO for peg-in-hole tasks.
☆12Feb 8, 2024Updated 2 years ago
Alternatives and similar repositories for Multi-Modal-Manipulation
Users that are interested in Multi-Modal-Manipulation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- IERG5350 Reinforcement Learning Course Project based on the Stanford AI lab's work on multimodal representation.☆31Apr 2, 2021Updated 5 years ago
- ☆15Oct 3, 2023Updated 3 years ago
- Fast robust peg-in-hole insertion with continuous visual servoing (CORL 2020)☆32Sep 3, 2020Updated 6 years ago
- Learning to Fill the Seam by Vision: Sub-millimeter Peg-in-hole on Unseen Shapes in Real World☆43Jul 24, 2023Updated 3 years ago
- Deep reinforcement learning for robotic peg-in-hole assembly task☆37Oct 5, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- code for paper 'Learning View and Target Invariant Visual Servoing for Navigation'☆12Apr 28, 2021Updated 5 years ago
- Reproducing results from Deep Flow Guided Scene Agnostic Image Based Visual Servoing submission at ICRA'20☆10Aug 30, 2020Updated 6 years ago
- Needs update☆21Sep 6, 2019Updated 7 years ago
- ☆53Jul 5, 2021Updated 5 years ago
- Efficiency, Stability and Generalization Analysis for Reinforcement Learning on Robotic Peg-in-hole Assembly☆27Mar 6, 2020Updated 6 years ago
- ☆14Apr 15, 2020Updated 6 years ago
- Rank TD: End-to-End Robotic Reinforcement Learning without Reward Engineering and Demonstrations☆14Oct 8, 2022Updated 4 years ago
- The implementation of Action Chunking Transformer (ACT) from scratch and validate/test trained models in Bigym and Maniskill simulators.☆14Mar 26, 2025Updated last year
- fuzzy q learning for peg-in-hole assembly☆11Jan 17, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A dataset named Ship Collection in Complex Optical Scene (SCCOS), which is obtained from multiple platform sources including Google Earth…☆11Oct 13, 2024Updated 2 years ago
- Peg-in-hole assembly with RL☆18May 19, 2024Updated 2 years ago
- [ICML 2022] Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculum☆12Jul 15, 2022Updated 4 years ago
- Source codes for the paper "MRBTP: Efficient Multi-Robot Behavior Tree Planning and Collaboration" (AAAI 2025)☆17Dec 22, 2025Updated 10 months ago
- Generate Rain / Haze synthetic data for training☆10Nov 14, 2016Updated 9 years ago
- Suite of PyBullet reinforcement learning environments targeted towards using tactile data as the main form of observation. This repo has …☆25May 21, 2023Updated 3 years ago
- Implementation of some usefull filters used in ROS☆13Oct 29, 2021Updated 5 years ago
- Code for the IROS 2021 paper "Learning of Parameters in Behavior Trees for Movement Skills". In short, we combine behavior trees (BT), a …☆13Jan 8, 2024Updated 2 years ago
- ☆10Feb 7, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [CVPR 2025] Source codes for the paper "Collaborative Tree Search for Enhancing Embodied Multi-Agent Collaboration"☆19Nov 10, 2025Updated 11 months ago
- Generate reachability and base placement maps for mobile manipulators using pytorch_kinematics☆45Nov 24, 2022Updated 3 years ago
- Code for CEM-GD paper☆10Feb 4, 2022Updated 4 years ago
- MIDS Capstone Project, Duke University, 2021☆10Apr 28, 2021Updated 5 years ago
- ☆13Sep 15, 2020Updated 6 years ago
- Code for keypoint-based visual servo IROS2020☆65Aug 11, 2021Updated 5 years ago
- The test code for the paper "Attention-based advantage actor-critic algorithm with prioritized experience replay for complex 2-D robotic …☆10Aug 7, 2022Updated 4 years ago
- This is a summary of robot skills learning and the computer vision involved, including papers and code!☆10Jun 2, 2020Updated 6 years ago
- ☆11Jan 10, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10Mar 6, 2026Updated 7 months ago
- Vision-based robotic arm grasping using deep reinforcement learning☆28Aug 19, 2023Updated 3 years ago
- Active Vision Tracking of a Tendon-driven continuum robot by using efficient model-based Reinforcement Learning☆12Aug 25, 2023Updated 3 years ago
- Deep Visual MPC-Policy Learning for Navigation☆30May 19, 2022Updated 4 years ago
- Here is the code and saliency maps for the paper 'Saliency Pattern Detection by Ranking Structured Trees' in ICCV 2017.☆12Nov 1, 2017Updated 8 years ago
- ☆14Aug 16, 2021Updated 5 years ago
- Mobile Robot Control via Goal-Conditioned Reinforcement Learning☆24Oct 13, 2023Updated 3 years ago