Hu, W; Huang, B; Lee, WW; Yang, S; Zheng, Y; Li, Z; (2025) Dexterous in-hand manipulation of slender cylindrical objects through deep reinforcement learning with tactile sensing. Robotics and Autonomous Systems , 186 , Article 104904. 10.1016/j.robot.2024.104904.

Text 2023_Inhand_Manipulation__online_.pdf - Accepted Version Access restricted to UCL open access staff until 24 January 2026. Download (5MB)

Abstract

Continuous in-hand manipulation is an important physical interaction skill, where tactile sensing provides indispensable contact information to enable dexterous manipulation of objects. In this work, we propose a learning-based framework for dexterous in-hand manipulation that controls the pose of a thin cylindrical object, such as a long stick, to track various continuous trajectories, through multiple contacts of three fingertips of a dexterous robot hand with tactile sensor arrays. We extract the contact information between the stick and each fingertip from the high-dimensional tactile information and show that the robot can effectively learn a policy to achieve the task. The policies are trained with deep reinforcement learning in simulation and successfully transferred to real-world experiments, using coordinated model calibration and domain randomization. We compare the effectiveness of different types of tactile information and find out that the policies trained with contact center positions achieve best tracking results. The sim-to-real performances are validated through real-world experiments.

Download activity - last month

Export as JSONXMLCSV

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as XMLJSONCSV

Archive Staff Only

View Item