UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Local Path Planning among Pushable Objects based on Reinforcement Learning

Yao, Linghong; Modugno, Valerio; Delfaki, Andromachi Maria; Liu, Yuanchang; Stoyanov, Danail; Kanoulas, Dimitrios; (2024) Local Path Planning among Pushable Objects based on Reinforcement Learning. In: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (pp. pp. 3062-3068). IEEE: Abu Dhabi, United Arab Emirates. Green open access

[thumbnail of 2303.02407v3.pdf]
Preview
Text
2303.02407v3.pdf - Accepted Version

Download (5MB) | Preview

Abstract

In this paper, we introduce a method to tackle the problem of robot local path planning among pushable objects –an open problem in robotics. In particular, we simultaneously train multiple agents in a physics-based simulation environment, utilizing an Advantage Actor-Critic algorithm coupled with a deep neural network. The developed online policy enables these agents to push obstacles in ways that are not limited to axial alignments, adapt to unforeseen changes in obstacle dynamics instantaneously, and effectively tackle local path planning in confined areas. We tested the method in various simulated environments to prove the adaptation effectiveness to various unseen scenarios in unfamiliar settings. Moreover, we have successfully applied this policy on an actual quadruped robot, confirming its capability to handle the unpredictability and noise associated with real-world sensors and the inherent uncertainties in unexplored object-pushing tasks.

Type: Proceedings paper
Title: Local Path Planning among Pushable Objects based on Reinforcement Learning
Event: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
ISBN-13: 979-8-3503-7770-5
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/IROS58592.2024.10802257
Publisher version: https://doi.org/10.1109/IROS58592.2024.10802257
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Training; Uncertainty; Navigation; Refining; Noise; Layout; Robot sensing systems; Path planning; Quadrupedal robots; Intelligent sensors
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10203740
Downloads since deposit
Loading...
20Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
Loading...

Archive Staff Only

View Item View Item