UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Control of a Point Absorber Using Reinforcement Learning

Anderlini, E; Forehand, DIM; Stansell, P; Xiao, Q; Abusara, M; (2016) Control of a Point Absorber Using Reinforcement Learning. IEEE Transactions on Sustainable Energy , 7 (4) pp. 1681-1690. 10.1109/TSTE.2016.2568754. Green open access

[thumbnail of 07482650.pdf]
Preview
Text
07482650.pdf - Published Version

Download (1MB) | Preview

Abstract

This work presents the application of reinforcement learning for the optimal resistive control of a point absorber. The model-free Q-learning algorithm is selected in order to maximise energy absorption in each sea state. Step changes are made to the controller damping, observing the associated penalty, for excessive motions, or reward, i.e. gain in associated power. Due to the general periodicity of gravity waves, the absorbed power is averaged over a time horizon lasting several wave periods. The performance of the algorithm is assessed through the numerical simulation of a point absorber subject to motions in heave in both regular and irregular waves. The algorithm is found to converge towards the optimal controller damping in each sea state. Additionally, the model-free approach ensures the algorithm can adapt to changes to the device hydrodynamics over time and is unbiased by modelling errors.

Type: Article
Title: Control of a Point Absorber Using Reinforcement Learning
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/TSTE.2016.2568754
Publisher version: http://doi.org/10.1109/TSTE.2016.2568754
Language: English
Additional information: This version is the version of record. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Science & Technology, Technology, GREEN & SUSTAINABLE SCIENCE & TECHNOLOGY, Energy & Fuels, Engineering, Electrical & Electronic, Science & Technology - Other Topics, Engineering, Wave energy converter (WEC), power take-off (PTO) system, reinforcement learning (RL), Q-learning, WAVE-ENERGY CONVERTERS, POWER TAKE-OFF, CONTROL STRATEGIES, LATCHING CONTROL, SYSTEM, OPERATION, DEVICE, SEA
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Mechanical Engineering
URI: https://discovery.ucl.ac.uk/id/eprint/10027954
Downloads since deposit
190Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item