1
|
Sudha G, Saravanan N, Muthalakshmi M, Birunda M. Dynamically stabilized recurrent neural network optimized with Artificial Gorilla Troops espoused Alzheimer's disorder detection using EEG signals. Health Inf Sci Syst 2024; 12:25. [PMID: 38495674 PMCID: PMC10942965 DOI: 10.1007/s13755-024-00284-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 02/21/2024] [Indexed: 03/19/2024] Open
Abstract
Alzheimer's disease is an incurable neurological disorder that damages cognitive abilities, but early identification reduces the symptoms significantly. The absence of competent healthcare professionals has made automatic identification of Alzheimer's disease more crucial since it lessens the amount of work for staff members and improves diagnostic outcomes. The major aim of this work is "to develop a computer diagnostic scheme that makes it possible to identify AD using the Electroencephalogram (EEG) signal". Therefore, Dynamically Stabilized Recurrent Neural Network Optimized with Artificial Gorilla Troops espoused Alzheimer's Disorder Detection using EEG signals (DSRNN-AGTO-ADD) is proposed in this paper. Here, Dynamic Context-Sensitive Filter (DCSF) is considered to eliminate the noise, and interference from the EEG signal. Then Adaptive and Concise Empirical Wavelet Transform (ACEWT) is utilized to separate the filtered signals from the frequency bands, and to feature extraction from the EEG signals. Signal's characteristics, like logarithmic bandwidth power, standard deviation, variance, kurtosis, mean energy, mean square, norm are combined to ACEWT method to create feature vectors and enhance diagnostic performance. After that, the extracted features are fed to Dynamically Stabilized Recurrent Neural Network (DSRNN) for task classification. Weight parameter of DSRNN is enhanced using Artificial Gorilla Troops Optimization Algorithm (AGTOA). The proposed DSRNN-AGTOA-ADD algorithm is activated in MATLAB. The metrics including accuracy, specificity, sensitivity, precision, computation time, ROC are examined for AD diagnosis. The performance of the proposed DSRNN-AGTOA-ADD approach attains 12.98%, 5.98% and 23.45% high specificity; 29.98%, 23.32% and 19.76% lower computation Time and 29.29%, 8.365%, 8.551% and 7.915% higher ROC compared with the existing methods.
Collapse
Affiliation(s)
- G. Sudha
- Department of Biomedical Engineering, Muthayammal Engineering College, Rasipuram, Namakkal, Tamil Nadu India
| | - N. Saravanan
- Department of Biotechnology, Muthayammal Engineering College, Rasipuram, Namakkal, Tamil Nadu India
| | - M. Muthalakshmi
- Department of Bio Medical Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai, 62 Tamil Nadu India
| | - M. Birunda
- Department of Biomedical Engineering, Muthayammal Engineering College, Rasipuram, Namakkal, Tamil Nadu India
| |
Collapse
|
2
|
Gautam P, Singh M. 3-1-3 Weight averaging technique-based performance evaluation of deep neural networks for Alzheimer's disease detection using structural MRI. Biomed Phys Eng Express 2024; 10:065027. [PMID: 39178890 DOI: 10.1088/2057-1976/ad72f7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2024] [Accepted: 08/23/2024] [Indexed: 08/26/2024]
Abstract
Alzheimer's disease (AD) is a progressive neurological disorder. It is identified by the gradual shrinkage of the brain and the loss of brain cells. This leads to cognitive decline and impaired social functioning, making it a major contributor to dementia. While there are no treatments to reverse AD's progression, spotting the disease's onset can have a significant impact in the medical field. Deep learning (DL) has revolutionized medical image classification by automating feature engineering, removing the requirement for human experts in feature extraction. DL-based solutions are highly accurate but demand a lot of training data, which poses a common challenge. Transfer learning (TL) has gained attention for its knack for handling limited data and expediting model training. This study uses TL to classify AD using T1-weighted 3D Magnetic Resonance Imaging (MRI) from the Alzheimer's Disease Neuroimaging (ADNI) database. Four modified pre-trained deep neural networks (DNN), VGG16, MobileNet, DenseNet121, and NASNetMobile, are trained and evaluated on the ADNI dataset. The 3-1-3 weight averaging technique and fine-tuning improve the performance of the classification models. The evaluated accuracies for AD classification are VGG16: 98.75%; MobileNet: 97.5%; DenseNet: 97.5%; and NASNetMobile: 96.25%. The receiver operating characteristic (ROC), precision-recall (PR), and Kolmogorov-Smirnov (KS) statistic plots validate the effectiveness of the modified pre-trained model. Modified VGG16 excels with area under the curve (AUC) values of 0.99 for ROC and 0.998 for PR curves. The proposed approach shows effective AD classification by achieving high accuracy using the 3-1-3 weight averaging technique and fine-tuning.
Collapse
Affiliation(s)
- Priyanka Gautam
- ECE Department, Dr B R Ambedkar National Institute of Technology, Jalandhar, Punjab, India
| | - Manjeet Singh
- ECE Department, Dr B R Ambedkar National Institute of Technology, Jalandhar, Punjab, India
| |
Collapse
|
3
|
Seerangan K, Nandagopal M, Nair RR, Periyasamy S, Jhaveri RH, Balusamy B, Selvarajan S. ERABiLNet: enhanced residual attention with bidirectional long short-term memory. Sci Rep 2024; 14:20622. [PMID: 39232053 PMCID: PMC11374906 DOI: 10.1038/s41598-024-71299-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2024] [Accepted: 08/27/2024] [Indexed: 09/06/2024] Open
Abstract
Alzheimer's Disease (AD) causes slow death in brain cells due to shrinkage of brain cells which is more prevalent in older people. In most cases, the symptoms of AD are mistaken as age-related stresses. The most widely utilized method to detect AD is Magnetic Resonance Imaging (MRI). Along with Artificial Intelligence (AI) techniques, the efficacy of identifying diseases related to the brain has become easier. But, the identical phenotype makes it challenging to identify the disease from the neuro-images. Hence, a deep learning method to detect AD at the beginning stage is suggested in this work. The newly implemented "Enhanced Residual Attention with Bi-directional Long Short-Term Memory (Bi-LSTM) (ERABi-LNet)" is used in the detection phase to identify the AD from the MRI images. This model is used for enhancing the performance of the Alzheimer's detection in scale of 2-5%, minimizing the error rates, increasing the balance of the model, so that the multi-class problems are supported. At first, MRI images are given to "Residual Attention Network (RAN)", which is specially developed with three convolutional layers, namely atrous, dilated and Depth-Wise Separable (DWS), to obtain the relevant attributes. The most appropriate attributes are determined by these layers, and subjected to target-based fusion. Then the fused attributes are fed into the "Attention-based Bi-LSTM". The final outcome is obtained from this unit. The detection efficiency based on median is 26.37% and accuracy is 97.367% obtained by tuning the parameters in the ERABi-LNet with the help of Modified Search and Rescue Operations (MCDMR-SRO). The obtained results are compared with ROA-ERABi-LNet, EOO-ERABi-LNet, GTBO-ERABi-LNet and SRO-ERABi-LNet respectively. The ERABi_LNet thus provides enhanced accuracy and other performance metrics compared to such deep learning models. The proposed method has the better sensitivity, specificity, F1-Score and False Positive Rate compared with all the above mentioned competing models with values such as 97.49%.97.84%,97.74% and 2.616 respective;y. This ensures that the model has better learning capabilities and provides lesser false positives with balanced prediction.
Collapse
Affiliation(s)
| | - Malarvizhi Nandagopal
- Department of Computer Science and Engineering, School of Computing, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai, Tamil Nadu, 600062, India
| | - Resmi R Nair
- Department of Electronics and Communication Engineering, Saveetha Engineering College (Autonomous), Chennai, Tamil Nadu, 602105, India
| | - Sakthivel Periyasamy
- Department of Electronics and Communication Engineering, Anna University, Chennai, Tamil Nadu, 600025, India
| | - Rutvij H Jhaveri
- Department of Computer Science and Engineering, School of Technology, Pandit Deendayal Energy University, Gandhinagar, Gujarat, India
| | - Balamurugan Balusamy
- Shiv Nadar (Institution of Eminence Deemed to Be University), Noida, Uttar Pradesh, 201314, India
| | - Shitharth Selvarajan
- Department of Computer Science, Kebri Dehar University, 250, Kebri Dehar, Ethiopia.
- School of Built Environment, Engineering and Computing, Leeds Beckett University, Leeds, LS6 3QS, United Kingdom.
| |
Collapse
|
4
|
Mehmood A, Shahid F, Khan R, Ibrahim MM, Zheng Z. Utilizing Siamese 4D-AlzNet and Transfer Learning to Identify Stages of Alzheimer's Disease. Neuroscience 2024; 545:69-85. [PMID: 38492797 DOI: 10.1016/j.neuroscience.2024.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 03/05/2024] [Accepted: 03/10/2024] [Indexed: 03/18/2024]
Abstract
Alzheimer's disease (AD) is the general form of dementia, leading to a progressive neurological disorder characterized by memory loss due to brain cell damage. Artificial Intelligence (AI) assists in the early identification and prediction of AD patients, determining future risks and benefits for radiologists and doctors to save time and cost. Since deep learning (DL) approaches work well with massive datasets and have recently become helpful for AD detection, there remains an area for improvement in automating detection performance. Present approaches somehow addressed the challenges of limited annotated data samples for binary classification. This contrasts with prior state-of-the-art techniques, which were constrained by their incapacity to capture abstract-level information. In this paper, we proposed a Siamese 4D-AlzNet model comprised of four parallel convolutional neural network (CNN) streams (Five CNN layer blocks) and customized transfer learning models (Frozen VGG-19, Frozen VGG-16, and customized AlexNet). Siamese 4D-AlzNet was vertically and horizontally stored, and the spatial features were passed to the final layer for classification. For experiments, T1-weighted MRI images comprised of four distinct subject classes, normal control (NC), mild cognitive impairment (MCI), late mild cognitive impairment (LMCI), and AD, have been employed. Our proposed models achieved outstanding accuracy, with a remarkable 95.05% accuracy distinguishing between normal and AD subjects. The performance across remaining binary class pairs consistently exceeded 90%. We thoroughly compared our model with the latest methods using the same dataset as our reference. Our proposed model improved NC-AD and MCI-AD classification accuracy by 2% 7%.
Collapse
Affiliation(s)
- Atif Mehmood
- School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; Zhejiang Institute of Photoelectronics & Zhejiang Institute for Advanced Light Source, Zhejiang Normal University, Jinhua, Zhejiang 321004, China
| | - Farah Shahid
- School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; Zhejiang Institute of Photoelectronics & Zhejiang Institute for Advanced Light Source, Zhejiang Normal University, Jinhua, Zhejiang 321004, China.
| | - Rizwan Khan
- School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China
| | - Mostafa M Ibrahim
- Department of Electrical Engineering, Faculty of Engineering, Minia University, Minia 61519, Egypt
| | - Zhonglong Zheng
- School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China.
| |
Collapse
|
5
|
Yamao T, Miwa K, Kaneko Y, Takahashi N, Miyaji N, Hasegawa K, Wagatsuma K, Kamitaka Y, Ito H, Matsuda H. Deep Learning-Driven Estimation of Centiloid Scales from Amyloid PET Images with 11C-PiB and 18F-Labeled Tracers in Alzheimer's Disease. Brain Sci 2024; 14:406. [PMID: 38672055 PMCID: PMC11048447 DOI: 10.3390/brainsci14040406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Revised: 04/16/2024] [Accepted: 04/19/2024] [Indexed: 04/28/2024] Open
Abstract
BACKGROUND Standard methods for deriving Centiloid scales from amyloid PET images are time-consuming and require considerable expert knowledge. We aimed to develop a deep learning method of automating Centiloid scale calculations from amyloid PET images with 11C-Pittsburgh Compound-B (PiB) tracer and assess its applicability to 18F-labeled tracers without retraining. METHODS We trained models on 231 11C-PiB amyloid PET images using a 50-layer 3D ResNet architecture. The models predicted the Centiloid scale, and accuracy was assessed using mean absolute error (MAE), linear regression analysis, and Bland-Altman plots. RESULTS The MAEs for Alzheimer's disease (AD) and young controls (YC) were 8.54 and 2.61, respectively, using 11C-PiB, and 8.66 and 3.56, respectively, using 18F-NAV4694. The MAEs for AD and YC were higher with 18F-florbetaben (39.8 and 7.13, respectively) and 18F-florbetapir (40.5 and 12.4, respectively), and the error rate was moderate for 18F-flutemetamol (21.3 and 4.03, respectively). Linear regression yielded a slope of 1.00, intercept of 1.26, and R2 of 0.956, with a mean bias of -1.31 in the Centiloid scale prediction. CONCLUSIONS We propose a deep learning means of directly predicting the Centiloid scale from amyloid PET images in a native space. Transferring the model trained on 11C-PiB directly to 18F-NAV4694 without retraining was feasible.
Collapse
Affiliation(s)
- Tensho Yamao
- Department of Radiological Sciences, School of Health Science, Fukushima Medical University, Fukushima 960-8516, Japan; (T.Y.)
| | - Kenta Miwa
- Department of Radiological Sciences, School of Health Science, Fukushima Medical University, Fukushima 960-8516, Japan; (T.Y.)
| | - Yuta Kaneko
- Department of Radiology, Fukushima Medical University Hospital, Fukushima 960-1295, Japan
| | - Noriyuki Takahashi
- Department of Radiological Sciences, School of Health Science, Fukushima Medical University, Fukushima 960-8516, Japan; (T.Y.)
| | - Noriaki Miyaji
- Department of Radiological Sciences, School of Health Science, Fukushima Medical University, Fukushima 960-8516, Japan; (T.Y.)
| | - Koki Hasegawa
- Department of Radiological Sciences, School of Health Science, Fukushima Medical University, Fukushima 960-8516, Japan; (T.Y.)
| | - Kei Wagatsuma
- School of Allied Health Sciences, Kitasato University, Tokyo 252-0373, Japan
| | - Yuto Kamitaka
- Research Team for Neuroimaging, Tokyo Metropolitan Institute for Geriatrics and Gerontology, Tokyo 173-0015, Japan
| | - Hiroshi Ito
- Department of Radiology and Nuclear Medicine, Fukushima Medical University, Fukushima 960-1295, Japan
| | - Hiroshi Matsuda
- Department of Biofunctional Imaging, Fukushima Medical University, Fukushima 960-1295, Japan
| |
Collapse
|
6
|
Liu S, Zheng Y, Li H, Pan M, Fang Z, Liu M, Qiao Y, Pan N, Jia W, Ge X. Improving Alzheimer Diagnoses With An Interpretable Deep Learning Framework: Including Neuropsychiatric Symptoms. Neuroscience 2023; 531:86-98. [PMID: 37709003 DOI: 10.1016/j.neuroscience.2023.09.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Revised: 08/31/2023] [Accepted: 09/07/2023] [Indexed: 09/16/2023]
Abstract
Alzheimer's disease (AD) is a prevalent neurodegenerative disorder characterized by the progressive cognitive decline. Among the various clinical symptoms, neuropsychiatric symptoms (NPS) commonly occur during the course of AD. Previous researches have demonstrated a strong association between NPS and severity of AD, while the research methods are not sufficiently intuitive. Here, we report a hybrid deep learning framework for AD diagnosis using multimodal inputs such as structural MRI, behavioral scores, age, and gender information. The framework uses a 3D convolutional neural network to automatically extract features from MRI. The imaging features are passed to the Principal Component Analysis for dimensionality reduction, which fuse with non-imaging information to improve the diagnosis of AD. According to the experimental results, our model achieves an accuracy of 0.91 and an area under the curve of 0.97 in the task of classifying AD and cognitively normal individuals. SHapley Additive exPlanations are used to visually exhibit the contribution of specific NPS in the proposed model. Among all behavioral symptoms, apathy plays a particularly important role in the diagnosis of AD, which can be considered a valuable factor in further studies, as well as clinical trials.
Collapse
Affiliation(s)
- Shujuan Liu
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Yuanjie Zheng
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Hongzhuang Li
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Minmin Pan
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Zhicong Fang
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Mengting Liu
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
| | - Yuchuan Qiao
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
| | - Ningning Pan
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Weikuan Jia
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Xinting Ge
- School of Information Science and Engineering, Shandong Normal University, Shandong, China.
| |
Collapse
|
7
|
Mandal PK, Mahto RV. Deep Multi-Branch CNN Architecture for Early Alzheimer's Detection from Brain MRIs. SENSORS (BASEL, SWITZERLAND) 2023; 23:8192. [PMID: 37837027 PMCID: PMC10574860 DOI: 10.3390/s23198192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Revised: 09/25/2023] [Accepted: 09/26/2023] [Indexed: 10/15/2023]
Abstract
Alzheimer's disease (AD) is a neurodegenerative disease that can cause dementia and result in a severe reduction in brain function, inhibiting simple tasks, especially if no preventative care is taken. Over 1 in 9 Americans suffer from AD-induced dementia, and unpaid care for people with AD-related dementia is valued at USD 271.6 billion. Hence, various approaches have been developed for early AD diagnosis to prevent its further progression. In this paper, we first review other approaches that could be used for the early detection of AD. We then give an overview of our dataset and propose a deep convolutional neural network (CNN) architecture consisting of 7,866,819 parameters. This model comprises three different convolutional branches, each having a different length. Each branch is comprised of different kernel sizes. This model can predict whether a patient is non-demented, mild-demented, or moderately demented with a 99.05% three-class accuracy. In summary, the deep CNN model demonstrated exceptional accuracy in the early diagnosis of AD, offering a significant advancement in the field and the potential to improve patient care.
Collapse
Affiliation(s)
- Paul K. Mandal
- Department of Computer Science, University of Texas, Austin, TX 78712, USA
| | - Rakeshkumar V. Mahto
- Department of Electrical and Computer Engineering, California State University, Fullerton, CA 92831, USA;
| |
Collapse
|
8
|
Wen J, Li Y, Fang M, Zhu L, Feng DD, Li P. Fine-Grained and Multiple Classification for Alzheimer's Disease With Wavelet Convolution Unit Network. IEEE Trans Biomed Eng 2023; 70:2592-2603. [PMID: 37030751 DOI: 10.1109/tbme.2023.3256042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
Abstract
In this article, we propose a novel wavelet convolution unit for the image-oriented neural network to integrate wavelet analysis with a vanilla convolution operator to extract deep abstract features more efficiently. On one hand, in order to acquire non-local receptive fields and avoid information loss, we define a new convolution operation by composing a traditional convolution function and approximate and detailed representations after single-scale wavelet decomposition of source images. On the other hand, multi-scale wavelet decomposition is introduced to obtain more comprehensive multi-scale feature information. Then, we fuse all these cross-scale features to improve the problem of inaccurate localization of singular points. Given the novel wavelet convolution unit, we further design a network based on it for fine-grained Alzheimer's disease classifications (i.e., Alzheimer's disease, Normal controls, early mild cognitive impairment, late mild cognitive impairment). Up to now, only a few methods have studied one or several fine-grained classifications, and even fewer methods can achieve both fine-grained and multi-class classifications. We adopt the novel network and diffuse tensor images to achieve fine-grained classifications, which achieved state-of-the-art accuracy for all eight kinds of fine-grained classifications, up to 97.30%, 95.78%, 95.00%, 94.00%, 97.89%, 95.71%, 95.07%, 93.79%. In order to build a reference standard for Alzheimer's disease classifications, we actually implemented all twelve coarse-grained and fine-grained classifications. The results show that the proposed method achieves solidly high accuracy for them. Its classification ability greatly exceeds any kind of existing Alzheimer's disease classification method.
Collapse
|
9
|
Yan Q, Li F, Cui Y, Wang Y, Wang X, Jia W, Liu X, Li Y, Chang H, Shi F, Xia Y, Zhou Q, Zeng Q. Discrimination Between Glioblastoma and Solitary Brain Metastasis Using Conventional MRI and Diffusion-Weighted Imaging Based on a Deep Learning Algorithm. J Digit Imaging 2023; 36:1480-1488. [PMID: 37156977 PMCID: PMC10406764 DOI: 10.1007/s10278-023-00838-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 04/13/2023] [Accepted: 04/18/2023] [Indexed: 05/10/2023] Open
Abstract
This study aims to develop and validate a deep learning (DL) model to differentiate glioblastoma from single brain metastasis (BM) using conventional MRI combined with diffusion-weighted imaging (DWI). Preoperative conventional MRI and DWI of 202 patients with solitary brain tumor (104 glioblastoma and 98 BM) were retrospectively obtained between February 2016 and September 2022. The data were divided into training and validation sets in a 7:3 ratio. An additional 32 patients (19 glioblastoma and 13 BM) from a different hospital were considered testing set. Single-MRI-sequence DL models were developed using the 3D residual network-18 architecture in tumoral (T model) and tumoral + peritumoral regions (T&P model). Furthermore, the combination model based on conventional MRI and DWI was developed. The area under the receiver operating characteristic curve (AUC) was used to assess the classification performance. The attention area of the model was visualized as a heatmap by gradient-weighted class activation mapping technique. For the single-MRI-sequence DL model, the T2WI sequence achieved the highest AUC in the validation set with either T models (0.889) or T&P models (0.934). In the combination models of the T&P model, the model of DWI combined with T2WI and contrast-enhanced T1WI showed increased AUC of 0.949 and 0.930 compared with that of single-MRI sequences in the validation set, respectively. And the highest AUC (0.956) was achieved by combined contrast-enhanced T1WI, T2WI, and DWI. In the heatmap, the central region of the tumoral was hotter and received more attention than other areas and was more important for differentiating glioblastoma from BM. A conventional MRI-based DL model could differentiate glioblastoma from solitary BM, and the combination models improved classification performance.
Collapse
Affiliation(s)
- Qingqing Yan
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, China
- Shandong First Medical University, Jinan, China
| | - Fuyan Li
- Department of Radiology, Shandong Provincial Hospital affiliated to Shandong First Medical University, Jinan, China
| | - Yi Cui
- Department of Radiology, Qilu Hospital of Shandong University, Jinan, China
| | - Yong Wang
- Shandong Cancer Hospital and Institute, Shandong First Medical University, Shandong Academy of Medical Sciences, Jinan, China
| | - Xiao Wang
- Department of Radiology, Jining NO.1 People's Hospital, Jining, China
| | - Wenjing Jia
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, China
| | - Xinhui Liu
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, China
| | - Yuting Li
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, China
| | - Huan Chang
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, China
| | - Feng Shi
- Shanghai United Imaging Intelligence, Shanghai, China
| | - Yuwei Xia
- Shanghai United Imaging Intelligence, Shanghai, China
| | - Qing Zhou
- Shanghai United Imaging Intelligence, Shanghai, China
| | - Qingshi Zeng
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, China.
| |
Collapse
|
10
|
Azeem M, Javaid S, Khalil RA, Fahim H, Althobaiti T, Alsharif N, Saeed N. Neural Networks for the Detection of COVID-19 and Other Diseases: Prospects and Challenges. Bioengineering (Basel) 2023; 10:850. [PMID: 37508877 PMCID: PMC10416184 DOI: 10.3390/bioengineering10070850] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 07/09/2023] [Accepted: 07/12/2023] [Indexed: 07/30/2023] Open
Abstract
Artificial neural networks (ANNs) ability to learn, correct errors, and transform a large amount of raw data into beneficial medical decisions for treatment and care has increased in popularity for enhanced patient safety and quality of care. Therefore, this paper reviews the critical role of ANNs in providing valuable insights for patients' healthcare decisions and efficient disease diagnosis. We study different types of ANNs in the existing literature that advance ANNs' adaptation for complex applications. Specifically, we investigate ANNs' advances for predicting viral, cancer, skin, and COVID-19 diseases. Furthermore, we propose a deep convolutional neural network (CNN) model called ConXNet, based on chest radiography images, to improve the detection accuracy of COVID-19 disease. ConXNet is trained and tested using a chest radiography image dataset obtained from Kaggle, achieving more than 97% accuracy and 98% precision, which is better than other existing state-of-the-art models, such as DeTraC, U-Net, COVID MTNet, and COVID-Net, having 93.1%, 94.10%, 84.76%, and 90% accuracy and 94%, 95%, 85%, and 92% precision, respectively. The results show that the ConXNet model performed significantly well for a relatively large dataset compared with the aforementioned models. Moreover, the ConXNet model reduces the time complexity by using dropout layers and batch normalization techniques. Finally, we highlight future research directions and challenges, such as the complexity of the algorithms, insufficient available data, privacy and security, and integration of biosensing with ANNs. These research directions require considerable attention for improving the scope of ANNs for medical diagnostic and treatment applications.
Collapse
Affiliation(s)
- Muhammad Azeem
- School of Science, Engineering & Environment, University of Salford, Manchester M5 4WT, UK;
| | - Shumaila Javaid
- Department of Control Science and Engineering, College of Electronics and Information Engineering, Tongji University, Shanghai 201804, China; (S.J.); (H.F.)
| | - Ruhul Amin Khalil
- Department of Electrical Engineering, University of Engineering and Technology, Peshawar 25120, Pakistan;
- Department of Electrical and Communication Engineering, United Arab Emirates University (UAEU), Al-Ain 15551, United Arab Emirates
| | - Hamza Fahim
- Department of Control Science and Engineering, College of Electronics and Information Engineering, Tongji University, Shanghai 201804, China; (S.J.); (H.F.)
| | - Turke Althobaiti
- Department of Computer Science, Faculty of Science, Northern Border University, Arar 73222, Saudi Arabia;
| | - Nasser Alsharif
- Department of Administrative and Financial Sciences, Ranyah University Collage, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia;
| | - Nasir Saeed
- Department of Electrical and Communication Engineering, United Arab Emirates University (UAEU), Al-Ain 15551, United Arab Emirates
| |
Collapse
|
11
|
Nguyen KP, Treacher AH, Montillo AA. Adversarially-Regularized Mixed Effects Deep Learning (ARMED) Models Improve Interpretability, Performance, and Generalization on Clustered (non-iid) Data. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2023; 45:8081-8093. [PMID: 37018678 PMCID: PMC10644386 DOI: 10.1109/tpami.2023.3234291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Natural science datasets frequently violate assumptions of independence. Samples may be clustered (e.g., by study site, subject, or experimental batch), leading to spurious associations, poor model fitting, and confounded analyses. While largely unaddressed in deep learning, this problem has been handled in the statistics community through mixed effects models, which separate cluster-invariant fixed effects from cluster-specific random effects. We propose a general-purpose framework for Adversarially-Regularized Mixed Effects Deep learning (ARMED) models through non-intrusive additions to existing neural networks: 1) an adversarial classifier constraining the original model to learn only cluster-invariant features, 2) a random effects subnetwork capturing cluster-specific features, and 3) an approach to apply random effects to clusters unseen during training. We apply ARMED to dense, convolutional, and autoencoder neural networks on 4 datasets including simulated nonlinear data, dementia prognosis and diagnosis, and live-cell image analysis. Compared to prior techniques, ARMED models better distinguish confounded from true associations in simulations and learn more biologically plausible features in clinical applications. They can also quantify inter-cluster variance and visualize cluster effects in data. Finally, ARMED matches or improves performance on data from clusters seen during training (5-28% relative improvement) and generalization to unseen clusters (2-9% relative improvement) versus conventional models.
Collapse
|
12
|
Illakiya T, Karthik R. Automatic Detection of Alzheimer's Disease using Deep Learning Models and Neuro-Imaging: Current Trends and Future Perspectives. Neuroinformatics 2023; 21:339-364. [PMID: 36884142 DOI: 10.1007/s12021-023-09625-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/16/2023] [Indexed: 03/09/2023]
Abstract
Deep learning algorithms have a huge influence on tackling research issues in the field of medical image processing. It acts as a vital aid for the radiologists in producing accurate results toward effective disease diagnosis. The objective of this research is to highlight the importance of deep learning models in the detection of Alzheimer's Disease (AD). The main objective of this research is to analyze different deep learning methods used for detecting AD. This study examines 103 research articles published in various research databases. These articles have been selected based on specific criteria to find the most relevant findings in the field of AD detection. The review was carried out based on deep learning techniques such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Transfer Learning (TL). To propose accurate methods for the detection, segmentation, and severity grading of AD, the radiological features need to be examined in greater depth. This review attempts to analyze different deep learning methods applied for AD detection using neuroimaging modalities like Positron Emission Tomography (PET), Magnetic Resonance Imaging (MRI), etc. The focus of this review is restricted to deep learning works based on radiological imaging data for AD detection. There are a few works that have utilized other biomarkers to understand the effect of AD. Also, articles published in English were alone considered for analysis. This work concludes by highlighting the key research issues towards effective AD detection. Though several methods have yielded promising results in AD detection, the progression from Mild Cognitive Impairment (MCI) to AD need to be analyzed in greater depth using DL models.
Collapse
Affiliation(s)
- T Illakiya
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - R Karthik
- Centre for Cyber Physical Systems, School of Electronics Engineering, Vellore Institute of Technology, Chennai, India.
| |
Collapse
|
13
|
Raza N, Naseer A, Tamoor M, Zafar K. Alzheimer Disease Classification through Transfer Learning Approach. Diagnostics (Basel) 2023; 13:diagnostics13040801. [PMID: 36832292 PMCID: PMC9955379 DOI: 10.3390/diagnostics13040801] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 01/13/2023] [Accepted: 01/18/2023] [Indexed: 02/25/2023] Open
Abstract
Alzheimer's disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer's disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, we discuss the segmentation and classification of the Magnetic resonance imaging (MRI) of Alzheimer's disease, through the concept of transfer learning and customizing of the convolutional neural network (CNN) by specifically using images that are segmented by the Gray Matter (GM) of the brain. Instead of training and computing the proposed model accuracy from the start, we used a pre-trained deep learning model as our base model, and, after that, transfer learning was applied. The accuracy of the proposed model was tested over a different number of epochs, 10, 25, and 50. The overall accuracy of the proposed model was 97.84%.
Collapse
Affiliation(s)
- Noman Raza
- Department of Computer Science, National University of Computer and Emerging Sciences, Lahore 54770, Pakistan
| | - Asma Naseer
- Department of Computer Science, National University of Computer and Emerging Sciences, Lahore 54770, Pakistan
| | - Maria Tamoor
- Department of Computer Science, Forman Christian College, Lahore 54600, Pakistan
| | - Kashif Zafar
- Department of Computer Science, National University of Computer and Emerging Sciences, Lahore 54770, Pakistan
- Correspondence:
| |
Collapse
|
14
|
Deep learning-based hemorrhage detection for diabetic retinopathy screening. Sci Rep 2023; 13:1479. [PMID: 36707608 PMCID: PMC9883230 DOI: 10.1038/s41598-023-28680-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Accepted: 01/23/2023] [Indexed: 01/29/2023] Open
Abstract
Diabetic retinopathy is a retinal compilation that causes visual impairment. Hemorrhage is one of the pathological symptoms of diabetic retinopathy that emerges during disease development. Therefore, hemorrhage detection reveals the presence of diabetic retinopathy in the early phase. Diagnosing the disease in its initial stage is crucial to adopt proper treatment so the repercussions can be prevented. The automatic deep learning-based hemorrhage detection method is proposed that can be used as the second interpreter for ophthalmologists to reduce the time and complexity of conventional screening methods. The quality of the images was enhanced, and the prospective hemorrhage locations were estimated in the preprocessing stage. Modified gamma correction adaptively illuminates fundus images by using gradient information to address the nonuniform brightness levels of images. The algorithm estimated the locations of potential candidates by using a Gaussian match filter, entropy thresholding, and mathematical morphology. The required objects were segmented using the regional diversity at estimated locations. The novel hemorrhage network is propounded for hemorrhage classification and compared with the renowned deep models. Two datasets benchmarked the model's performance using sensitivity, specificity, precision, and accuracy metrics. Despite being the shallowest network, the proposed network marked competitive results than LeNet-5, AlexNet, ResNet50, and VGG-16. The hemorrhage network was assessed using training time and classification accuracy through synthetic experimentation. Results showed promising accuracy in the classification stage while significantly reducing training time. The research concluded that increasing deep network layers does not guarantee good results but rather increases training time. The suitable architecture of a deep model and its appropriate parameters are critical for obtaining excellent outcomes.
Collapse
|
15
|
Devika K, Mahapatra D, Subramanian R, Ramana Murthy Oruganti V. Dense Attentive GAN-based One-Class Model for Detection of Autism and ADHD. JOURNAL OF KING SAUD UNIVERSITY - COMPUTER AND INFORMATION SCIENCES 2022. [DOI: 10.1016/j.jksuci.2022.11.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
16
|
Ban Y, Zhang X, Lao H. Diagnosis of Alzheimer's Disease using Structure Highlighting Key Slice Stacking and Transfer Learning. Med Phys 2022; 49:5855-5869. [PMID: 35894542 DOI: 10.1002/mp.15888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Revised: 06/16/2022] [Accepted: 07/23/2022] [Indexed: 11/08/2022] Open
Abstract
BACKGROUND In recent years, two-dimensional convolutional neural network (2D CNN) have been widely used in the diagnosis of Alzheimer's disease (AD) based on structural magnetic resonance imaging (sMRI). However, due to the lack of targeted processing of the key slices of sMRI images, the classification performance of the CNN model needs to be improved. PURPOSE Therefore, in this paper, we propose a key slice processing technique called the structural highlighting key slice stacking (SHKSS) technique, and we apply it to a 2D transfer learning model for AD classification. METHODS Specifically, first, 3D MR images were preprocessed. Second, the 2D axial middle-layer image was extracted from the MR image as a key slice. Then, the image was normalized by intensity and mapped to the RGB space, and histogram specification was performed on the obtained RGB image to generate the final three-channel image. The final three-channel image was input into a pre-trained CNN model for AD classification. Finally, classification and generalization experiments were conducted to verify the validity of the proposed method. RESULTS The experimental results on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset show that our SHKSS method can effectively highlight the structural information in MRI slices. Compared with existing key slice processing techniques, our SHKSS method has an average accuracy improvement of at least 26% on the same test dataset, and it has better performance and generalization ability. CONCLUSIONS Our SHKSS method not only converts single-channel images into three-channel images to match the input requirements of the 2D transfer learning model but also highlights the structural information of MRI slices to improve the accuracy of AD diagnosis. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Yanjiao Ban
- School of Computer, Electronics and Information, Guangxi University, Nanning, Guangxi, 530004, PR China
| | - Xuejun Zhang
- School of Computer, Electronics and Information, Guangxi University, Nanning, Guangxi, 530004, PR China.,School of Artificial Intelligence, Guangxi Minzu University, Guangxi, 530006, PR China.,Guangxi Key Laboratory of Multimedia Communications and Network Technology, Nanning, Guangxi, 530004, PR China
| | - Huan Lao
- School of Artificial Intelligence, Guangxi Minzu University, Guangxi, 530006, PR China
| |
Collapse
|
17
|
Heng W, Solomon S, Gao W. Flexible Electronics and Devices as Human-Machine Interfaces for Medical Robotics. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2022; 34:e2107902. [PMID: 34897836 PMCID: PMC9035141 DOI: 10.1002/adma.202107902] [Citation(s) in RCA: 123] [Impact Index Per Article: 61.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/02/2021] [Revised: 12/08/2021] [Indexed: 05/02/2023]
Abstract
Medical robots are invaluable players in non-pharmaceutical treatment of disabilities. Particularly, using prosthetic and rehabilitation devices with human-machine interfaces can greatly improve the quality of life for impaired patients. In recent years, flexible electronic interfaces and soft robotics have attracted tremendous attention in this field due to their high biocompatibility, functionality, conformability, and low-cost. Flexible human-machine interfaces on soft robotics will make a promising alternative to conventional rigid devices, which can potentially revolutionize the paradigm and future direction of medical robotics in terms of rehabilitation feedback and user experience. In this review, the fundamental components of the materials, structures, and mechanisms in flexible human-machine interfaces are summarized by recent and renowned applications in five primary areas: physical and chemical sensing, physiological recording, information processing and communication, soft robotic actuation, and feedback stimulation. This review further concludes by discussing the outlook and current challenges of these technologies as a human-machine interface in medical robotics.
Collapse
Affiliation(s)
- Wenzheng Heng
- Andrew and Peggy Cherng Department of Medical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| | - Samuel Solomon
- Andrew and Peggy Cherng Department of Medical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| | - Wei Gao
- Andrew and Peggy Cherng Department of Medical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| |
Collapse
|
18
|
Li R, Wang X, Lawler K, Garg S, Bai Q, Alty J. Applications of Artificial Intelligence to aid detection of dementia: a scoping review on current capabilities and future directions. J Biomed Inform 2022; 127:104030. [DOI: 10.1016/j.jbi.2022.104030] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 01/21/2022] [Accepted: 02/12/2022] [Indexed: 12/17/2022]
|
19
|
Ebrahimi A, Luo S, Chiong R. Deep sequence modelling for Alzheimer's disease detection using MRI. Comput Biol Med 2021; 134:104537. [PMID: 34118752 DOI: 10.1016/j.compbiomed.2021.104537] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 05/27/2021] [Accepted: 05/27/2021] [Indexed: 12/21/2022]
Abstract
BACKGROUND Alzheimer's disease (AD) is one of the deadliest diseases in developed countries. Treatments following early AD detection can significantly delay institutionalisation and extend patients' independence. There has been a growing focus on early AD detection using artificial intelligence. Convolutional neural networks (CNNs) have proven revolutionary for image-based applications and have been applied to brain scans. In recent years, studies have utilised two-dimensional (2D) CNNs on magnetic resonance imaging (MRI) scans for AD detection. To apply a 2D CNN on three-dimensional (3D) MRI volumes, each MRI scan is split into 2D image slices. A CNN is trained over the image slices by calculating a loss function between each subject's label and each image slice's predicted output. Although 2D CNNs can discover spatial dependencies in an image slice, they cannot understand the temporal dependencies among 2D image slices in a 3D MRI volume. This study aims to resolve this issue by modelling the sequence of MRI features produced by a CNN with deep sequence-based networks for AD detection. METHOD The CNN utilised in this paper was ResNet-18 pre-trained on an ImageNet dataset. The employed sequence-based models were the temporal convolutional network (TCN) and different types of recurrent neural networks. Several deep sequence-based models and configurations were implemented and compared for AD detection. RESULTS Our proposed TCN model achieved the best classification performance with 91.78% accuracy, 91.56% sensitivity and 92% specificity. CONCLUSION Our results show that applying sequence-based models can improve the classification accuracy of 2D and 3D CNNs for AD detection by up to 10%.
Collapse
Affiliation(s)
- Amir Ebrahimi
- School of Electrical Engineering and Computing, The University of Newcastle, NSW 2308, Australia
| | - Suhuai Luo
- School of Electrical Engineering and Computing, The University of Newcastle, NSW 2308, Australia
| | - Raymond Chiong
- School of Electrical Engineering and Computing, The University of Newcastle, NSW 2308, Australia.
| |
Collapse
|