DBMA-Net: A Dual-Branch Multi-Attention Network for Polyp Segmentation

Zhai, Chenxu; Yang, Lei; Liu, Yanhong; Yu, Hongnian

Abstract

In the early prevention stage of colorectal cancer, the utilization of automatic polyp segmentation techniques from colonoscopy images has demonstrated efficacy in mitigating the misdiagnosis rate. Nonetheless, accurate polyp segmentation is always against with various challenges, including the presence of inconsistent size and morphological changes within polyp classes, limited inter-class contrast, and high levels of interference. In recent years, much methodologies based on convolutional neural networks (CNNs) have been widely introduced to enhance the precision of polyp segmentation. However, two significant hurdles persist: (1) These methods frequently suffer from an inadequate acquisition of contextual features, causing insufficient feature representation. (2) There is a deficiency in recognizing intricate information, such as precise polyp boundaries. Addressing these issues, this paper introduces a novel dual-branch multi-attention network, denoted as DBMA-Net. Specifically, proposed DBMA-Net primarily introduces a dual-encoding path that combines CNN and Transformer-based approaches to enrich feature representation. Additionally, an attention-based fusion module (AFM) is incorporated between the dual-encoding path, aimed at optimizing features by supplementing local information with global insights. Subsequently, two distinct attention mechanisms are introduced to enhance features: the attention-based enhancement module (AEM) and the multi-view attention module (MAM), to acquire stronger local features. These modules serve to enrich the finer details while extensively exploring and enhancing the lesion region, thereby further elevating segmentation accuracy. Following the above feature optimization, the enhanced feature maps are hierarchically integrated across multiple scales based on the proposed multi-scale feature integration module (MFIM) for accurate feature reconstruction. This strategy not only curtails feature loss but also aids in restoring featur...

Citation

Zhai, C., Yang, L., Liu, Y., & Yu, H. (2024). DBMA-Net: A Dual-Branch Multi-Attention Network for Polyp Segmentation. IEEE Transactions on Instrumentation and Measurement, 73, Article 2512316. https://doi.org/10.1109/tim.2024.3379418

• Journal Article Type: Article
• Online Publication Date: Mar 19, 2024
• Publication Date: Mar 27, 2024
• Deposit Date: May 31, 2024
• Journal: IEEE Transactions on Instrumentation and Measurement
• Print ISSN: 0018-9456
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 73
• Article Number: 2512316
• DOI: https://doi.org/10.1109/tim.2024.3379418
• Keywords: polyp segmentation, attention mechanism, feature integration mechanism, dual-branch encoder
• Public URL: http://researchrepository.napier.ac.uk/Output/3574125