Skip to main content

Research Repository

Advanced Search

Computer-aided diagnosis of Alzheimer’s disease and neurocognitive disorders with multimodal Bi-Vision Transformer (BiViT)

Shah, S. Muhammad Ahmed Hassan; Jan, Sana Ullah; Khan, Muhammad Qasim; Rizwan, Atif; Samee, Nagwan Abdel; Jamjoom, Mona M.

Authors

S. Muhammad Ahmed Hassan Shah

Muhammad Qasim Khan

Atif Rizwan

Nagwan Abdel Samee

Mona M. Jamjoom



Abstract

Cognitive disorders affect various cognitive functions that can have a substantial impact on individual’s daily life. Alzheimer’s disease (AD) is one of such well-known cognitive disorders. Early detection and treatment of cognitive diseases using artificial intelligence can help contain them. However, the complex spatial relationships and long-range dependencies found in medical imaging data present challenges in achieving the objective. Moreover, for a few years, the application of transformers in imaging has emerged as a promising area of research. A reason can be transformer’s impressive capabilities of tackling spatial relationships and long-range dependency challenges in two ways, i.e., (1) using their self-attention mechanism to generate comprehensive features, and (2) capture complex patterns by incorporating global context and long-range dependencies. In this work, a Bi-Vision Transformer (BiViT) architecture is proposed for classifying different stages of AD, and multiple types of cognitive disorders from 2-dimensional MRI imaging data. More specifically, the transformer is composed of two novel modules, namely Mutual Latent Fusion (MLF) and Parallel Coupled Encoding Strategy (PCES), for effective feature learning. Two different datasets have been used to evaluate the performance of proposed BiViT-based architecture. The first dataset contain several classes such as mild or moderate demented stages of the AD. The other dataset is composed of samples from patients with AD and different cognitive disorders such as mild, early, or moderate impairments. For comprehensive comparison, a multiple transfer learning algorithm and a deep autoencoder have been each trained on both datasets. The results show that the proposed BiViT-based model achieves an accuracy of 96.38% on the AD dataset. However, when applied to cognitive disease data, the accuracy slightly decreases below 96% which can be resulted due to smaller amount of data and imbalance in data distribution. Nevertheless, given the results, it can be hypothesized that the proposed algorithm can perform better if the imbalanced distribution and limited availability problems in data can be addressed. Graphical abstract:

Citation

Shah, S. M. A. H., Jan, S. U., Khan, M. Q., Rizwan, A., Samee, N. A., & Jamjoom, M. M. (2024). Computer-aided diagnosis of Alzheimer’s disease and neurocognitive disorders with multimodal Bi-Vision Transformer (BiViT). Pattern Analysis and Applications, 27, Article 76. https://doi.org/10.1007/s10044-024-01297-6

Journal Article Type Article
Acceptance Date Jun 14, 2024
Online Publication Date Jul 1, 2024
Publication Date 2024
Deposit Date Jun 27, 2024
Publicly Available Date Jul 8, 2024
Print ISSN 1433-7541
Electronic ISSN 1433-755X
Publisher Springer
Peer Reviewed Peer Reviewed
Volume 27
Article Number 76
DOI https://doi.org/10.1007/s10044-024-01297-6
Keywords Alzheimer disease, Cognitive disorders, Medical image processing, Deep learning, Computer vision, Vision transformers

Files





You might also like



Downloadable Citations