PAF-Net: A Progressive and Adaptive Fusion Network for Pavement Crack Segmentation

Yang, Lei; Huang, Hanyun; Kong, Shuyi; Liu, Yanhong; Yu, Hongnian

Abstract

Automatic crack detection remains challenging due to factors such as irregular crack shapes and sizes, uneven illumination, complex backgrounds, and image noise. Deep learning has shown promise in computer vision for pixel-wise crack detection, but existing methods still suffer from limitations such as information loss, insufficient feature fusion, and semantic gap issues. To address these challenges, a novel pavement crack segmentation network, called PAF-Net, is proposed, which incorporates progressive and adaptive feature fusion. To mitigate information loss caused by feature downsampling, a progressive context fusion (PCF) block is introduced to capture context information from adjacent scales. To better capture strong features from local regions, a dual attention (DA) block is proposed that leverages both global and local context information, reducing the semantic gap issue. Furthermore, to achieve effective multi-scale feature fusion, a dynamic weight learning (DWL) block is proposed that enables efficient fusion of feature maps from different network layers. Additionally, a multi-scale input unit is incorporated to provide the proposed segmentation network with more contextual information. To evaluate the performance of PAF-Net, we conduct experiments using four common evaluation metrics and compare it with multiple mainstream segmentation models on three public datasets. The proposed PAF-Net demonstrates superior segmentation accuracy for pixel-level crack detection compared to other segmentation models, as evident from qualitative and quantitative experimental results.

Citation

Yang, L., Huang, H., Kong, S., Liu, Y., & Yu, H. (2023). PAF-Net: A Progressive and Adaptive Fusion Network for Pavement Crack Segmentation. IEEE Transactions on Intelligent Transportation Systems, 24(11), 12686-12700. https://doi.org/10.1109/tits.2023.3287533

• Journal Article Type: Article
• Acceptance Date: Jun 15, 2023
• Online Publication Date: Jun 27, 2023
• Publication Date: 2023-11
• Deposit Date: Jul 13, 2023
• Journal: IEEE Transactions on Intelligent Transportation Systems
• Print ISSN: 1524-9050
• Electronic ISSN: 1558-0016
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 24
• Issue: 11
• Pages: 12686-12700
• DOI: https://doi.org/10.1109/tits.2023.3287533
• Keywords: Pavement crack segmentation, progressive fusion, adaptive feature fusion multi-scale input strategy, deep supervision
• Public URL: http://researchrepository.napier.ac.uk/Output/3136370