Skip to main content

Research Repository

Advanced Search

Multi-Agent Deep Reinforcement Learning-Based Cooperative Perception and Computation in VEC

Zhao, Liang; Li, Longjia; Tan, Zhiyuan; Hawbani, Ammar; He, Qiang; Liu, Zhi

Authors

Liang Zhao

Longjia Li

Ammar Hawbani

Qiang He

Zhi Liu



Abstract

Connected and autonomous vehicles (CAVs) are an important paradigm of intelligent transportation systems. Cooperative perception (CP) and vehicular edge computing (VEC) enhance CAVs’ perception capacity of the region of interest (RoI) while alleviating the pressure of intensive computation on onboard resources. However, existing CP and computation schemes are based on inefficient broadcast communications and still face challenges such as highly dynamic communication link channel conditions caused by vehicle mobility, and limited computing resources in VEC environments. Considering the delay sensitivity of CAVs’ perception tasks and the need for enhanced perception, we propose a unicast-based cooperative perception and computation scheme to achieve more efficient resource utilization and perception task execution in VEC scenarios. Our goal is to maximize CP gain and minimize task execution delay by optimizing the decision of each ego CAVs. To solve the sequential decision-making problem of multi-objective optimization, we propose a solution based on improved multi-agent proximal policy optimization deep reinforcement learning, where CAVs agents make adaptive decisions distributed based on partial observations. Simulation results show that compared with the baseline algorithm, our proposed scheme effectively reduces the execution delay of ego CAVs perception tasks and ensures a high perception gain.

Citation

Zhao, L., Li, L., Tan, Z., Hawbani, A., He, Q., & Liu, Z. (online). Multi-Agent Deep Reinforcement Learning-Based Cooperative Perception and Computation in VEC. IEEE Internet of Things, https://doi.org/10.1109/jiot.2025.3546915

Journal Article Type Article
Acceptance Date Feb 25, 2025
Online Publication Date Mar 3, 2025
Deposit Date Mar 9, 2025
Publicly Available Date Apr 22, 2025
Journal IEEE Internet of Things Journal
Print ISSN 2327-4662
Electronic ISSN 2327-4662
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
DOI https://doi.org/10.1109/jiot.2025.3546915
Keywords Connected and autonomous vehicles, Cooperative perception, Vehicular edge computing, Multi-agent deep reinforcement learning
Public URL http://researchrepository.napier.ac.uk/Output/4169147
This output contributes to the following UN Sustainable Development Goals:

SDG 9 - Industry, Innovation and Infrastructure

Build resilient infrastructure, promote inclusive and sustainable industrialisation and foster innovation

Files

Multi-Agent Deep Reinforcement Learning-Based Cooperative Perception and Computation in VEC (accepted version) (6.9 Mb)
PDF








You might also like



Downloadable Citations