Probabilistic message passing control for complex stochastic switching systems

Zhou, Yuyang; Herzallah, Randa

Abstract

In this paper, we propose a general decentralised probabilistic control framework for a class of complex stochastic systems with switching modes. Probabilistic state space models are exploited to characterise the subsystems’ dynamical behaviours constituting a complex dynamical system, thus providing a complete description of the subsystems components. To address the variations in the operational modes of the subsystems, the Mixture Density Network (MDN) is applied here to identify the subsystems modes and provides estimates for the system dynamic distributions. Besides, to harmonise the actions between the subsystems, the probabilistic message passing methodology is utilised to provide communication between neighbouring subsystems. Based on the MDN model and the neighbours subsystems information via message passing, the general solution of the fully probabilistic decentralised randomised controller which minimises the Kullback-Leibler divergence (KLD) between the actual and its ideal distributions is then obtained. Moreover, a numerical example is presented to illustrate the effectiveness and the usefulness of our novel proposed framework.

Citation

Zhou, Y., & Herzallah, R. (2021). Probabilistic message passing control for complex stochastic switching systems. Journal of The Franklin Institute, 358(10), 5451-5469. https://doi.org/10.1016/j.jfranklin.2021.04.040

• Journal Article Type: Article
• Acceptance Date: Apr 22, 2021
• Online Publication Date: Jun 4, 2021
• Publication Date: 2021-07
• Deposit Date: Nov 22, 2021
• Journal: Journal of the Franklin Institute
• Print ISSN: 0016-0032
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 358
• Issue: 10
• Pages: 5451-5469
• DOI: https://doi.org/10.1016/j.jfranklin.2021.04.040
• Public URL: http://researchrepository.napier.ac.uk/Output/2817849