UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Rendezvous Planning for Multiple Autonomous Underwater Vehicles using a Markov Decision Process

Yordanova, V; Griffiths, H; Hailes, S; (2017) Rendezvous Planning for Multiple Autonomous Underwater Vehicles using a Markov Decision Process. IET Radar, Sonar & Navigation 10.1049/iet-rsn.2017.0098. (In press). Green open access

[thumbnail of Yordanova_rendezvous planning_Markov decision process.pdf]
Preview
Text
Yordanova_rendezvous planning_Markov decision process.pdf - Accepted Version

Download (2MB) | Preview

Abstract

Multiple Autonomous Underwater Vehicles (AUVs) are a potential alternative to conventional large manned vessels for mine countermeasure (MCM) operations. Online mission planning for cooperative multi-AUV network often relies or predefined contingency on reactive methods and do not deliver an optimal end-goal performance. Markov Decision Process (MDP) is a decision-making framework that allows an optimal solution, taking into account future decision estimates, rather than having a myopic view. However, most real-world problems are too complex to be represented by this framework. We deal with the complexity problem by abstracting the MCM scenario with a reduced state and action space, yet retaining the information that defines the goal and constraints coming from the application. Another critical part of the model is the ability of the vehicles to communicate and enable a cooperative mission. We use the Rendezvous Point (RP) method. The RP schedules meeting points for the vehicles throughput the mission. Our model provides an optimal action selection solution for the multi-AUV MCM problem. The computation of the mission plan is performed in the order of minutes. This quick execution demonstrates the model is feasible for real-time applications.

Type: Article
Title: Rendezvous Planning for Multiple Autonomous Underwater Vehicles using a Markov Decision Process
Open access status: An open access version is available from UCL Discovery
DOI: 10.1049/iet-rsn.2017.0098
Publisher version: http://doi.org/10.1049/iet-rsn.2017.0098
Language: English
Additional information: This is an open access article published by the IET under the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/3.0/)
Keywords: Planning, multi-vehicle, mine countermeasures, autonomous underwater vehicles, markov decision process
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/1565592
Downloads since deposit
202Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item