Grande, Davide;
Peruffo, Andrea;
Anderlini, Enrico;
Salavasidis, Georgios;
(2023)
Augmented Neural Lyapunov Control.
IEEE Access
, 11
pp. 67979-67986.
10.1109/access.2023.3291349.
Preview |
PDF
Grande_Augmented Neural Lyapunov Control_VoR.pdf - Published Version Download (2MB) | Preview |
Abstract
Machine learning-based methodologies have recently been adapted to solve control problems. The Neural Lyapunov Control (NLC) method is one such example. This approach combines Artificial Neural Networks (ANNs) with Satisfiability Modulo Theories (SMT) solvers to synthesise stabilising control laws and to prove their formal correctness. The ANNs are trained over a dataset of state-space samples to generate candidate control and Lyapunov functions, while the SMT solvers are tasked with certifying the correctness of the Lyapunov function over a continuous domain or by returning a counterexample. Despite the approach’s attractiveness, issues can occur due to subsequent calls of the SMT module at times returning similar counterexamples, which can turn out to be uninformative and may lead to dataset overfitting. Additionally, the control network weights are usually initialised with pre-computed gains from state-feedback controllers, e.g. Linear-Quadratic Regulators. To properly perform the initialisation requires user time and control expertise. In this work, we present an Augmented NLC method that mitigates these drawbacks, removes the need for the control initialisation and further improves counterexample generation. As a result, the proposed method allows the synthesis of nonlinear (as well as linear) control laws with the sole requirement being the knowledge of the system dynamics. The ANLC is tested over challenging benchmarks such as the Lorenz attractor and outperformed existing methods in terms of successful synthesis rate. The developed framework is released open-source at: https://github.com/grande-dev/Augmented-Neural-Lyapunov-Control .
| Type: | Article |
|---|---|
| Title: | Augmented Neural Lyapunov Control |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/access.2023.3291349 |
| Publisher version: | https://doi.org/10.1109/access.2023.3291349 |
| Language: | English |
| Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third-party material in this article are included in the Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
| Keywords: | Computer architecture , Stability analysis , Task analysis , Regulators , Numerical stability , Lyapunov methods , Design automation , Neural networks |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Mechanical Engineering |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10173596 |
Archive Staff Only
 |
View Item |
