1
|
Xin J, Khishe M, Zeebaree DQ, Abualigah L, Ghazal TM. Adaptive habitat biogeography-based optimizer for optimizing deep CNN hyperparameters in image classification. Heliyon 2024; 10:e28147. [PMID: 38689992 PMCID: PMC11059399 DOI: 10.1016/j.heliyon.2024.e28147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 03/12/2024] [Accepted: 03/12/2024] [Indexed: 05/02/2024] Open
Abstract
Deep Convolutional Neural Networks (DCNNs) have shown remarkable success in image classification tasks, but optimizing their hyperparameters can be challenging due to their complex structure. This paper develops the Adaptive Habitat Biogeography-Based Optimizer (AHBBO) for tuning the hyperparameters of DCNNs in image classification tasks. In complicated optimization problems, the BBO suffers from premature convergence and insufficient exploration. In this regard, an adaptable habitat is presented as a solution to these problems; it would permit variable habitat sizes and regulated mutation. Better optimization performance and a greater chance of finding high-quality solutions across a wide range of problem domains are the results of this modification's increased exploration and population diversity. AHBBO is tested on 53 benchmark optimization functions and demonstrates its effectiveness in improving initial stochastic solutions and converging faster to the optimum. Furthermore, DCNN-AHBBO is compared to 23 well-known image classifiers on nine challenging image classification problems and shows superior performance in reducing the error rate by up to 5.14%. Our proposed algorithm outperforms 13 benchmark classifiers in 87 out of 95 evaluations, providing a high-performance and reliable solution for optimizing DNNs in image classification tasks. This research contributes to the field of deep learning by proposing a new optimization algorithm that can improve the efficiency of deep neural networks in image classification.
Collapse
Affiliation(s)
- Jiayun Xin
- School of Mechanical, Electrical and Information Engineering, Shandong University, Weihai, 264209, Shandong, China
| | - Mohammad Khishe
- Department of Electrical Engineering, Imam Khomeini Marine Science University, Nowshahr, Iran
- Center for Artificial Intelligence Applications, Yuan Ze University, Taiwan
| | - Diyar Qader Zeebaree
- Information Technology Department, Technical College of Duhok, Duhok Polytechnic University, Duhok, Iraq
| | - Laith Abualigah
- Hourani Center for Applied Scientific Research, Al-Ahliyya Amman University, Amman, 19328, Jordan
- Computer Science Department, Al al-Bayt University, Mafraq, 25113, Jordan
- Artificial Intelligence and Sensing Technologies (AIST) Research Center, University of Tabuk, Tabuk, 71491, Saudi Arabia
- MEU Research Unit, Middle East University, Amman, 11831, Jordan
- Department of Electrical and Computer Engineering, Lebanese American University, Byblos, 13-5053, Lebanon
- School of Engineering and Technology, Sunway University Malaysia, Petaling Jaya, 27500, Malaysia
| | - Taher M. Ghazal
- Centre for Cyber Physical Systems, Computer Science Department, Khalifa University, United Arab Emirates
- Center for Cyber Security, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia (UKM), 43600, Bangi, Selangor, Malaysia
- Applied Science Research Center, Applied Science Private University, Amman, 11937, Jordan
| |
Collapse
|
2
|
Lee J, Lee J. Discovering individual fingerprints in resting-state functional connectivity using deep neural networks. Hum Brain Mapp 2024; 45:e26561. [PMID: 38096866 PMCID: PMC10789221 DOI: 10.1002/hbm.26561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Revised: 11/13/2023] [Accepted: 11/28/2023] [Indexed: 01/16/2024] Open
Abstract
Non-negligible idiosyncrasy due to interindividual differences is an ongoing issue in resting-state functional MRI (rfMRI) analysis. We show that a deep neural network (DNN) can be employed for individual identification by learning important features from the time-varying functional connectivity (FC) of rfMRI in the Human Connectome Project. We employed the trained DNN to identify individuals from an independent dataset acquired at our institution. The results revealed that the DNN could successfully identify 300 individuals with an error rate of 2.9% using 15 s time-window and 870 individuals with an error rate of 6.7%. A trained DNN with nonlinear hidden layers led to the proposal of the "fingerprint of FC" (fpFC) as representative edges of individual FC. The fpFCs for individuals exhibited commonly important and individual-specific edges across time-window lengths (from 5 min to 15 s). Furthermore, the utility of our model for another group of subjects was validated, supporting the feasibility of our technique in the context of transfer learning. In conclusion, our study offers an insight into the discovery of the intrinsic mode of the human brain using whole-brain resting-state FC and DNNs.
Collapse
Affiliation(s)
- Juhyeon Lee
- Department of Brain and Cognitive EngineeringKorea UniversitySeoulRepublic of Korea
| | - Jong‐Hwan Lee
- Department of Brain and Cognitive EngineeringKorea UniversitySeoulRepublic of Korea
- Interdisciplinary Program in Precision Public HealthKorea UniversitySeoulSouth Korea
- McGovern Institute for Brain Research, Massachusetts Institute of TechnologyBostonMassachusettsUSA
| |
Collapse
|