Yordanova, V;
Griffiths, H;
Hailes, S;
(2017)
Rendezvous Planning for Multiple Autonomous Underwater Vehicles using a Markov Decision Process.
IET Radar, Sonar & Navigation
10.1049/iet-rsn.2017.0098.
(In press).
Preview |
Text
Yordanova_rendezvous planning_Markov decision process.pdf - Accepted Version Download (2MB) | Preview |
Abstract
Multiple Autonomous Underwater Vehicles (AUVs) are a potential alternative to conventional large manned vessels for mine countermeasure (MCM) operations. Online mission planning for cooperative multi-AUV network often relies or predefined contingency on reactive methods and do not deliver an optimal end-goal performance. Markov Decision Process (MDP) is a decision-making framework that allows an optimal solution, taking into account future decision estimates, rather than having a myopic view. However, most real-world problems are too complex to be represented by this framework. We deal with the complexity problem by abstracting the MCM scenario with a reduced state and action space, yet retaining the information that defines the goal and constraints coming from the application. Another critical part of the model is the ability of the vehicles to communicate and enable a cooperative mission. We use the Rendezvous Point (RP) method. The RP schedules meeting points for the vehicles throughput the mission. Our model provides an optimal action selection solution for the multi-AUV MCM problem. The computation of the mission plan is performed in the order of minutes. This quick execution demonstrates the model is feasible for real-time applications.
Type: | Article |
---|---|
Title: | Rendezvous Planning for Multiple Autonomous Underwater Vehicles using a Markov Decision Process |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1049/iet-rsn.2017.0098 |
Publisher version: | http://doi.org/10.1049/iet-rsn.2017.0098 |
Language: | English |
Additional information: | This is an open access article published by the IET under the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/3.0/) |
Keywords: | Planning, multi-vehicle, mine countermeasures, autonomous underwater vehicles, markov decision process |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng |
URI: | https://discovery.ucl.ac.uk/id/eprint/1565592 |
Archive Staff Only
View Item |