UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Grasp Independent Indirect Tool Force Estimation using Vision-based Tactile Sensors

Li, L; Thuruthel, TG; (2025) Grasp Independent Indirect Tool Force Estimation using Vision-based Tactile Sensors. IEEE Robotics and Automation Letters , 11 (1) pp. 73-80. 10.1109/LRA.2025.3629985. Green open access

[thumbnail of _RAL_Grasp_Independent_Tool_Force_Estimation_with_Tactile_Sensing (4).pdf]
Preview
Text
_RAL_Grasp_Independent_Tool_Force_Estimation_with_Tactile_Sensing (4).pdf - Accepted Version

Download (4MB) | Preview

Abstract

Humans possess the capability to seamlessly integrate tools into their body schema, enabling precise and adaptive interactions with the environment. This touch-mediated ability allows us to dexterously use tools in everyday tasks, an ability currently lacking in robotic systems. In this work, we propose a novel method for indirect force estimation in robotic tool use, a prerequisite for advanced tool use, leveraging vision-based tactile sensing (VTS) and deep learning techniques. By capturing high-resolution spatial deformations from tactile images, our model implicitly infers force transmission dynamics without requiring explicit knowledge of tool properties or material characteristics. We validate our approach across multiple tool types using a single trained machine learning model, demonstrating its generalization capability. This work represents the first demonstration of indirect force estimation for tool-mediated robotic interactions, offering a pathway toward more dexterous and adaptive robotic tool use in real-world applications.

Type: Article
Title: Grasp Independent Indirect Tool Force Estimation using Vision-based Tactile Sensors
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/LRA.2025.3629985
Publisher version: https://doi.org/10.1109/lra.2025.3629985
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions.
Keywords: Force and tactile sensing, soft sensors and actuators, deep learning in grasping and manipulation, perception for grasping and manipulation, sensorimotor learning
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10217859
Downloads since deposit
0Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item