Towards Secure Multi-Agent Deep Reinforcement Learning: Adversarial Attacks and Countermeasures

Zheng, Changgang; Zhen, Chen; Xie, Haiyong; Yang, Shufan

Abstract

Reinforcement Learning (RL) is one of the most popular methods for solving complex sequential decision-making problems. Deep RL needs careful sensing of the environment, selecting algorithms as well as hyper-parameters via soft agents, and simultaneously predicting which best actions should be. The RL computing paradigm is progressively becoming a popular solution in numerous fields. However, many deployment decisions, such as security of distributed computing, the defence system of network communication and algorithms details such as frequency of batch updating and the number of time steps, are typically not treated as an integrated system. This makes it difficult to have appropriate vulnerability management when applying deep RL in real life problems. For these reasons, we propose a framework that allows users to focus on the algorithm of reasoning, trust, and explainability in accordance with human perception, followed by exploring potential threats, especially adversarial attacks and countermeasures.

Citation

Zheng, C., Zhen, C., Xie, H., & Yang, S. (2022, June). Towards Secure Multi-Agent Deep Reinforcement Learning: Adversarial Attacks and Countermeasures. Presented at 2022 IEEE Conference on Dependable and Secure Computing (DSC), Edinburgh, United Kingdom

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2022 IEEE Conference on Dependable and Secure Computing (DSC)
• Start Date: Jun 22, 2022
• End Date: Jun 24, 2022
• Online Publication Date: Sep 26, 2022
• Publication Date: 2022
• Deposit Date: Nov 30, 2022
• Publicly Available Date: Nov 30, 2022
• Publisher: Institute of Electrical and Electronics Engineers
• Book Title: 2022 IEEE Conference on Dependable and Secure Computing (DSC)
• DOI: https://doi.org/10.1109/dsc54232.2022.9888828
• Public URL: http://researchrepository.napier.ac.uk/Output/2967570