UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Reactive control of a two-body point absorber using reinforcement learning

Anderlini, E; Forehand, DIM; Bannon, E; Xiao, Q; Abusara, M; (2017) Reactive control of a two-body point absorber using reinforcement learning. Ocean Engineering 10.1016/j.oceaneng.2017.08.017. (In press). Green open access

[thumbnail of Reactive control of a two-body.pdf]
Preview
Text
Reactive control of a two-body.pdf - Published version

Download (1MB) | Preview

Abstract

In this article, reinforcement learning is used to obtain optimal reactive control of a two-body point absorber. In particular, the Q-learning algorithm is adopted for the maximization of the energy extraction in each sea state. The controller damping and stiffness coefficients are varied in steps, observing the associated reward, which corresponds to an increase in the absorbed power, or penalty, owing to large displacements. The generated power is averaged over a time horizon spanning several wave cycles due to the periodicity of ocean waves, discarding the transient effects at the start of each new episode. The model of a two-body point absorber is developed in order to validate the control strategy in both regular and irregular waves. In all analysed sea states, the controller learns the optimal damping and stiffness coefficients. Furthermore, the scheme is independent of internal models of the device response, which means that it can adapt to variations in the unit dynamics with time and does not suffer from modelling errors.

Type: Article
Title: Reactive control of a two-body point absorber using reinforcement learning
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.oceaneng.2017.08.017
Publisher version: https://doi.org/10.1016/j.oceaneng.2017.08.017
Language: English
Additional information: © 2017 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/BY/4.0/)
Keywords: Reinforcement learning (RL), Q-learning, Reactive control, Point absorber, Wave energy converter (WEC)
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Mechanical Engineering
URI: https://discovery.ucl.ac.uk/id/eprint/10027923
Downloads since deposit
84Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item