Online Model‐Free Reinforcement Learning for the Automatic Control of a Flexible Wing Aircraft

Description
Title: Online Model‐Free Reinforcement Learning for the Automatic Control of a Flexible Wing Aircraft
Authors: Abouheaf, Mohammed
Gueaieb, Wail
Lewis, Frank
Date: 2020
Abstract: The control problem of the flexible wing aircraft is challenging due to the prevailing and high nonlinear deformations in the flexible wing system. This urged for new control mechanisms that are robust to the real-time variations in the wing's aerodynamics. An online control mechanism based on a value iteration reinforcement learning process is developed for flexible wing aerial structures. It employs a model-free control policy framework and a guaranteed convergent adaptive learning architecture to solve the system's Bellman optimality equation. A Riccati equation is derived and shown to be equivalent to solving the underlying Bellman equation. The online reinforcement learning solution is implemented using means of an adaptive-critic mechanism. The controller is proven to be asymptotically stable in the Lyapunov sense. It is assessed through computer simulations and its superior performance is demonstrated on two scenarios under different operating conditions.
URL: http://hdl.handle.net/10393/41947
DOI: 10.1049/iet-cta.2018.6163
CollectionScience informatique et génie électrique - Publications // Electrical Engineering and Computer Science - Publications
Files
IET_CTA_Postprint.pdfPaper's postprint1.36 MBAdobe PDFOpen