Liang Zhao
Multi-Agent Deep Reinforcement Learning-Based Cooperative Perception and Computation in VEC
Zhao, Liang; Li, Longjia; Tan, Zhiyuan; Hawbani, Ammar; He, Qiang; Liu, Zhi
Authors
Abstract
Connected and autonomous vehicles (CAVs) are an important paradigm of intelligent transportation systems. Cooperative perception (CP) and vehicular edge computing (VEC) enhance CAVs’ perception capacity of the region of interest (RoI) while alleviating the pressure of intensive computation on onboard resources. However, existing CP and computation schemes are based on inefficient broadcast communications and still face challenges such as highly dynamic communication link channel conditions caused by vehicle mobility, and limited computing resources in VEC environments. Considering the delay sensitivity of CAVs’ perception tasks and the need for enhanced perception, we propose a unicast-based cooperative perception and computation scheme to achieve more efficient resource utilization and perception task execution in VEC scenarios. Our goal is to maximize CP gain and minimize task execution delay by optimizing the decision of each ego CAVs. To solve the sequential decision-making problem of multi-objective optimization, we propose a solution based on improved multi-agent proximal policy optimization deep reinforcement learning, where CAVs agents make adaptive decisions distributed based on partial observations. Simulation results show that compared with the baseline algorithm, our proposed scheme effectively reduces the execution delay of ego CAVs perception tasks and ensures a high perception gain.
Citation
Zhao, L., Li, L., Tan, Z., Hawbani, A., He, Q., & Liu, Z. (online). Multi-Agent Deep Reinforcement Learning-Based Cooperative Perception and Computation in VEC. IEEE Internet of Things, https://doi.org/10.1109/jiot.2025.3546915
Journal Article Type | Article |
---|---|
Acceptance Date | Feb 25, 2025 |
Online Publication Date | Mar 3, 2025 |
Deposit Date | Mar 9, 2025 |
Publicly Available Date | Apr 22, 2025 |
Journal | IEEE Internet of Things Journal |
Print ISSN | 2327-4662 |
Electronic ISSN | 2327-4662 |
Publisher | Institute of Electrical and Electronics Engineers |
Peer Reviewed | Peer Reviewed |
DOI | https://doi.org/10.1109/jiot.2025.3546915 |
Keywords | Connected and autonomous vehicles, Cooperative perception, Vehicular edge computing, Multi-agent deep reinforcement learning |
Public URL | http://researchrepository.napier.ac.uk/Output/4169147 |
Build resilient infrastructure, promote inclusive and sustainable industrialisation and foster innovation
Files
Multi-Agent Deep Reinforcement Learning-Based Cooperative Perception and Computation in VEC (accepted version)
(6.9 Mb)
PDF
You might also like
Machine Un-learning: An Overview of Techniques, Applications, and Future Directions
(2023)
Journal Article
A Digital Twin-Assisted Intelligent Partial Offloading Approach for Vehicular Edge Computing
(2023)
Journal Article
An omnidirectional approach to touch-based continuous authentication
(2023)
Journal Article
Special Issue on Adversarial AI to IoT Security and Privacy Protection: Attacks and Defenses
(2022)
Journal Article