Online Model‐Free Reinforcement Learning for the Automatic Control of a Flexible Wing Aircraft

dc.contributor.authorAbouheaf, Mohammed
dc.contributor.authorGueaieb, Wail
dc.contributor.authorLewis, Frank
dc.description.abstractThe control problem of the flexible wing aircraft is challenging due to the prevailing and high nonlinear deformations in the flexible wing system. This urged for new control mechanisms that are robust to the real-time variations in the wing's aerodynamics. An online control mechanism based on a value iteration reinforcement learning process is developed for flexible wing aerial structures. It employs a model-free control policy framework and a guaranteed convergent adaptive learning architecture to solve the system's Bellman optimality equation. A Riccati equation is derived and shown to be equivalent to solving the underlying Bellman equation. The online reinforcement learning solution is implemented using means of an adaptive-critic mechanism. The controller is proven to be asymptotically stable in the Lyapunov sense. It is assessed through computer simulations and its superior performance is demonstrated on two scenarios under different operating conditions.
dc.description.sponsorshipThis work was partially funded by Ontario Center of Excellence (OCE) (Funding Reference Number:27404)
dc.subjectOptimal Control
dc.subjectReinforcement Learning
dc.subjectValue Iteration
dc.subjectAdaptive Critics
dc.subjectAircraft Control
dc.subjectDynamic Programming
dc.titleOnline Model‐Free Reinforcement Learning for the Automatic Control of a Flexible Wing Aircraft
CollectionScience informatique et génie électrique - Publications // Electrical Engineering and Computer Science - Publications

IET_CTA_Postprint.pdfPaper's postprint1.36 MBAdobe PDFOpen