1
|
Soundarya B, Poongodi C. A novel hybrid feature fusion approach using handcrafted features with transfer learning model for enhanced skin cancer classification. Comput Biol Med 2025; 190:110104. [PMID: 40168807 DOI: 10.1016/j.compbiomed.2025.110104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2024] [Revised: 03/20/2025] [Accepted: 03/26/2025] [Indexed: 04/03/2025]
Abstract
Skin cancer is a deadly disease and has the highest rising rates globally. It arises from aberrant skin cells, which are often caused by prolonged exposure to ultraviolet rays from sunlight or artificial tanning devices. Dermatologists rely on visual inspection and need to identify suspicious lesions. Prompt and accurate diagnosis is pivotal for effective treatment and enhancing the chances of recovery. Recently, skin cancer prediction has been made utilising machine and deep learning algorithms for early detection. This methodology presents a novel hybrid feature extraction and is fused with a deep learning model for dermoscopic image analysis. Skin lesion images from sources like ISIC were pre-processed. Features were extracted using the Grey-Level Co-Occurrence Matrix (GLCM), Redundant Discrete Wavelet Transform (RDWT) and a various pre-trained model. After evaluating all the combinations, the proposed feature fusion model performed well rather than all other models. This proposed feature fusion model includes GLCM, RDWT, and DenseNet121 features, which were estimated with the various classifiers, among which an impressive accuracy of 93.46 % was obtained with the XGBoost classifier and 94.25 % with the ensemble classifier. This study underscores the efficacy of integrating diverse feature extraction techniques to increase the reliability and effectiveness of skin cancer diagnosis.
Collapse
Affiliation(s)
- B Soundarya
- Bannari Amman Institute of Technology Sathyamangalam, India.
| | - C Poongodi
- Bannari Amman Institute of Technology Sathyamangalam, India.
| |
Collapse
|
2
|
Wang X, Bi Q, Deng C, Wang Y, Miao Y, Kong R, Chen J, Li C, Liu X, Gong X, Zhang Y, Bi G. Multiparametric MRI-based radiomics combined with 3D deep transfer learning to predict cervical stromal invasion in patients with endometrial carcinoma. Abdom Radiol (NY) 2025; 50:1414-1425. [PMID: 39276192 DOI: 10.1007/s00261-024-04577-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Revised: 09/06/2024] [Accepted: 09/09/2024] [Indexed: 09/16/2024]
Abstract
OBJECTIVE To develop and compare various preoperative cervical stromal invasion (CSI) prediction models, including radiomics, three-dimensional (3D) deep transfer learning (DTL), and integrated models, using single-sequence and multiparametric MRI. METHODS Data from 466 early-stage endometrial carcinoma (EC) patients from three centers were collected. Radiomics models were constructed based on T2-weighted imaging (T2WI), diffusion-weighted imaging (DWI), apparent diffusion coefficient (ADC) mapping, contrast-enhanced T1-weighted imaging (CE-T1WI), and four combined sequences as well as 3D DTL models. Two integrated models were created using ensemble and stacking algorithms based on optimal radiomics and DTL models. Model performance and clinical benefits were assessed using area under the curve (AUC), decision curve analysis (DCA), net reclassification index (NRI), integrated discrimination index (IDI), and the Delong test for model comparisons. RESULTS Multiparametric MRI models were superior to single-sequence models for radiomics or DTL models. Ensemble and stacking integrated models displayed excellent performance. The stacking model had the highest average AUC (0.908) and accuracy (0.883) in external validation groups 1 and 2 (AUC = 0.965 and 0.851, respectively) and emerged as the best predictive model for CSI. All models significantly outperformed the radiologist (P < 0.05). In terms of net benefits, all models demonstrated favorable outcomes in DCA, NRI, and IDI, with the stacking model yielding the highest net benefit. CONCLUSION Multiparametric MRI-based radiomics combined with 3D DTL can be used to noninvasively predict CSI in EC patients with greater diagnostic accuracy than the radiologist. Stacking integrated models showed significant potential utility in predicting CSI. Which helps to provide new treatment strategy for clinicians to treat early-stage EC patients.
Collapse
Affiliation(s)
- Xianhong Wang
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Qiu Bi
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Cheng Deng
- Department of Radiology, the Second Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Yaoxin Wang
- Department of Radiology, Shenzhen Traditional Chinese Medicine Hospital, the Fourth Clinical Medical College of Guangzhou University of Chinese Medicine, Shenzhen, China
| | - Yunbo Miao
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of Geriatrie Medicine, the First People's Hospital of Yunnan Province, Kunming, China
| | - Ruize Kong
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of Vascular Surgery, the First People's Hospital of Yunnan Province, Kunming, China
| | - Jie Chen
- Department of Radiology, the Third Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Chenrong Li
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Xiulan Liu
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Xiarong Gong
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Ya Zhang
- Department of Radiology, the Third Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Guoli Bi
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China.
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China.
| |
Collapse
|
3
|
Lazaros K, Adam S, Krokidis MG, Exarchos T, Vlamos P, Vrahatis AG. Non-Invasive Biomarkers in the Era of Big Data and Machine Learning. SENSORS (BASEL, SWITZERLAND) 2025; 25:1396. [PMID: 40096210 PMCID: PMC11902325 DOI: 10.3390/s25051396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/20/2025] [Revised: 02/09/2025] [Accepted: 02/20/2025] [Indexed: 03/19/2025]
Abstract
Invasive diagnostic techniques, while offering critical insights into disease pathophysiology, are often limited by high costs, procedural risks, and patient discomfort. Non-invasive biomarkers represent a transformative alternative, providing diagnostic precision through accessible biological samples or physiological data, including blood, saliva, breath, and wearable health metrics. They encompass molecular and imaging approaches, revealing genetic, epigenetic, and metabolic alterations associated with disease states. Furthermore, advances in breathomics and gut microbiome profiling further expand their diagnostic scope. Even with their strengths in terms of safety, cost-effectiveness, and accessibility, non-invasive biomarkers face challenges in achieving monitoring sensitivity and specificity comparable to traditional clinical approaches. Computational advancements, particularly in artificial intelligence and machine learning, are addressing these limitations by uncovering complex patterns in multi-modal datasets, enhancing diagnostic accuracy and facilitating personalized medicine. The present review integrates recent innovations, examines their clinical applications, highlights their limitations and provides a concise overview of the evolving role of non-invasive biomarkers in precision diagnostics, positioning them as a compelling choice for large-scale healthcare applications.
Collapse
Affiliation(s)
| | | | - Marios G. Krokidis
- Bioinformatics and Human Electrophysiology Laboratory, Department of Informatics, Ionian University, 49100 Corfu, Greece
| | | | | | | |
Collapse
|
4
|
Chiu TM, Li YC, Chi IC, Tseng MH. AI-Driven Enhancement of Skin Cancer Diagnosis: A Two-Stage Voting Ensemble Approach Using Dermoscopic Data. Cancers (Basel) 2025; 17:137. [PMID: 39796764 PMCID: PMC11720667 DOI: 10.3390/cancers17010137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2024] [Revised: 12/30/2024] [Accepted: 01/01/2025] [Indexed: 01/13/2025] Open
Abstract
BACKGROUND Skin cancer is the most common cancer worldwide, with melanoma being the deadliest type, though it accounts for less than 5% of cases. Traditional skin cancer detection methods are effective but are often costly and time-consuming. Recent advances in artificial intelligence have improved skin cancer diagnosis by helping dermatologists identify suspicious lesions. METHODS The study used datasets from two ethnic groups, sourced from the ISIC platform and CSMU Hospital, to develop an AI diagnostic model. Eight pre-trained models, including convolutional neural networks and vision transformers, were fine-tuned. The three best-performing models were combined into an ensemble model, which underwent multiple random experiments to ensure stability. To improve diagnostic accuracy and reduce false negatives, a two-stage classification strategy was employed: a three-class model for initial classification, followed by a binary model for secondary prediction of benign cases. RESULTS In the ISIC dataset, the false negative rate for malignant lesions was significantly reduced, and the number of malignant cases misclassified as benign dropped from 124 to 45. In the CSMUH dataset, false negatives for malignant cases were completely eliminated, reducing the number of misclassified malignant cases to zero, resulting in a notable improvement in diagnostic precision and a reduction in the false negative rate. CONCLUSIONS Through the proposed method, the study demonstrated clear success in both datasets. First, a three-class AI model can assist doctors in distinguishing between melanoma patients who require urgent treatment, non-melanoma skin cancer patients who can be treated later, and benign cases that do not require intervention. Subsequently, a two-stage classification strategy effectively reduces false negatives in malignant lesions. These findings highlight the potential of AI technology in skin cancer diagnosis, particularly in resource-limited medical settings, where it could become a valuable clinical tool to improve diagnostic accuracy, reduce skin cancer mortality, and reduce healthcare costs.
Collapse
Affiliation(s)
- Tsu-Man Chiu
- School of Medicine, Chung Shan Medical University, Taichung 402, Taiwan;
- Department of Dermatology, Chung Shan Medical University Hospital, Taichung 402, Taiwan;
| | - Yun-Chang Li
- Department of Dermatology, Chung Shan Medical University Hospital, Taichung 402, Taiwan;
| | - I-Chun Chi
- Department of Biomedical Sciences and Engineering, National Central University, Taoyuan 320, Taiwan;
| | - Ming-Hseng Tseng
- Department of Biomedical Sciences and Engineering, National Central University, Taoyuan 320, Taiwan;
- Information Technology Office, Chung Shan Medical University Hospital, Taichung 402, Taiwan
| |
Collapse
|
5
|
Aswathy R, Chalos VA, Suganya K, Sumathi S. Advancing miRNA cancer research through artificial intelligence: from biomarker discovery to therapeutic targeting. Med Oncol 2024; 42:30. [PMID: 39688780 DOI: 10.1007/s12032-024-02579-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2024] [Accepted: 12/03/2024] [Indexed: 12/18/2024]
Abstract
MicroRNAs (miRNAs), a class of small non-coding RNAs, play a vital role in regulating gene expression at the post-transcriptional level. Their discovery has profoundly impacted therapeutic strategies, particularly in cancer treatment, where RNA therapeutics, including miRNA-based targeted therapies, have gained prominence. Advances in RNA sequencing technologies have facilitated a comprehensive exploration of miRNAs-from fundamental research to their diagnostic and prognostic potential in various diseases, notably cancers. However, the manual handling and interpretation of vast RNA datasets pose significant challenges. The advent of artificial intelligence (AI) has revolutionized biological research by efficiently extracting insights from complex data. Machine learning algorithms, particularly deep learning techniques are effective for identifying critical miRNAs across different cancers and developing prognostic models. Moreover, the integration of AI has led to the creation of comprehensive miRNA databases for identifying mRNA and gene targets, thus facilitating deeper understanding and application in cancer research. This review comprehensively examines current developments in the application of machine learning techniques in miRNA research across diverse cancers. We discuss their roles in identifying biomarkers, elucidating miRNA targets, establishing disease associations, predicting prognostic outcomes, and exploring broader AI applications in cancer research. This review aims to guide researchers in leveraging AI techniques effectively within the miRNA field, thereby accelerating advancements in cancer diagnostics and therapeutics.
Collapse
Affiliation(s)
- Raghu Aswathy
- Department of Biochemistry, Biotechnology and Bioinformatics, Avinashilingam Institute for Home Science and Higher Education for Women, Coimbatore, Tamil Nadu, 641043, India
| | - Varghese Angel Chalos
- Department of Biochemistry, Biotechnology and Bioinformatics, Avinashilingam Institute for Home Science and Higher Education for Women, Coimbatore, Tamil Nadu, 641043, India
| | - Kanagaraj Suganya
- Department of Biochemistry, Biotechnology and Bioinformatics, Avinashilingam Institute for Home Science and Higher Education for Women, Coimbatore, Tamil Nadu, 641043, India
| | - Sundaravadivelu Sumathi
- Department of Biochemistry, Biotechnology and Bioinformatics, Avinashilingam Institute for Home Science and Higher Education for Women, Coimbatore, Tamil Nadu, 641043, India.
| |
Collapse
|
6
|
Wang Z, Wang C, Peng L, Lin K, Xue Y, Chen X, Bao L, Liu C, Zhang J, Xie Y. Radiomic and deep learning analysis of dermoscopic images for skin lesion pattern decoding. Sci Rep 2024; 14:19781. [PMID: 39187551 PMCID: PMC11347612 DOI: 10.1038/s41598-024-70231-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2024] [Accepted: 08/14/2024] [Indexed: 08/28/2024] Open
Abstract
This study aims to explore the efficacy of a hybrid deep learning and radiomics approach, supplemented with patient metadata, in the noninvasive dermoscopic imaging-based diagnosis of skin lesions. We analyzed dermoscopic images from the International Skin Imaging Collaboration (ISIC) dataset, spanning 2016-2020, encompassing a variety of skin lesions. Our approach integrates deep learning with a comprehensive radiomics analysis, utilizing a vast array of quantitative image features to precisely quantify skin lesion patterns. The dataset includes cases of three, four, and eight different skin lesion types. Our methodology was benchmarked against seven classification methods from the ISIC 2020 challenge and prior research using a binary decision framework. The proposed hybrid model demonstrated superior performance in distinguishing benign from malignant lesions, achieving area under the receiver operating characteristic curve (AUROC) scores of 99%, 95%, and 96%, and multiclass decoding AUROCs of 98.5%, 94.9%, and 96.4%, with sensitivities of 97.6%, 93.9%, and 96.0% and specificities of 98.4%, 96.7%, and 96.9% in the internal ISIC 2018 challenge, as well as in the external Jinan and Longhua datasets, respectively. Our findings suggest that the integration of radiomics and deep learning, utilizing dermoscopic images, effectively captures the heterogeneity and pattern expression of skin lesions.
Collapse
Affiliation(s)
- Zheng Wang
- School of Computer Science, Hunan First Normal University, Changsha, 410205, China
| | - Chong Wang
- Department of Dermatology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, 518020, Guangdong, China
| | - Li Peng
- School of Computer Science, Hunan First Normal University, Changsha, 410205, China
| | - Kaibin Lin
- School of Computer Science, Hunan First Normal University, Changsha, 410205, China
| | - Yang Xue
- School of Computer Science, Hunan First Normal University, Changsha, 410205, China
| | - Xiao Chen
- Department of Dermatology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, 518020, Guangdong, China
| | - Linlin Bao
- Department of Dermatology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, 518020, Guangdong, China
| | - Chao Liu
- Department of Dermatology, Longhua People's Hospital Affiliated to Southern Medical University, Shenzhen, 518109, Guangdong, China
| | - Jianglin Zhang
- Department of Dermatology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, 518020, Guangdong, China.
| | - Yang Xie
- Department of Dermatology, The Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, 510630, Guangdong, China.
| |
Collapse
|
7
|
Lyakhova UA, Lyakhov PA. Systematic review of approaches to detection and classification of skin cancer using artificial intelligence: Development and prospects. Comput Biol Med 2024; 178:108742. [PMID: 38875908 DOI: 10.1016/j.compbiomed.2024.108742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 06/03/2024] [Accepted: 06/08/2024] [Indexed: 06/16/2024]
Abstract
In recent years, there has been a significant improvement in the accuracy of the classification of pigmented skin lesions using artificial intelligence algorithms. Intelligent analysis and classification systems are significantly superior to visual diagnostic methods used by dermatologists and oncologists. However, the application of such systems in clinical practice is severely limited due to a lack of generalizability and risks of potential misclassification. Successful implementation of artificial intelligence-based tools into clinicopathological practice requires a comprehensive study of the effectiveness and performance of existing models, as well as further promising areas for potential research development. The purpose of this systematic review is to investigate and evaluate the accuracy of artificial intelligence technologies for detecting malignant forms of pigmented skin lesions. For the study, 10,589 scientific research and review articles were selected from electronic scientific publishers, of which 171 articles were included in the presented systematic review. All selected scientific articles are distributed according to the proposed neural network algorithms from machine learning to multimodal intelligent architectures and are described in the corresponding sections of the manuscript. This research aims to explore automated skin cancer recognition systems, from simple machine learning algorithms to multimodal ensemble systems based on advanced encoder-decoder models, visual transformers (ViT), and generative and spiking neural networks. In addition, as a result of the analysis, future directions of research, prospects, and potential for further development of automated neural network systems for classifying pigmented skin lesions are discussed.
Collapse
Affiliation(s)
- U A Lyakhova
- Department of Mathematical Modeling, North-Caucasus Federal University, 355017, Stavropol, Russia.
| | - P A Lyakhov
- Department of Mathematical Modeling, North-Caucasus Federal University, 355017, Stavropol, Russia; North-Caucasus Center for Mathematical Research, North-Caucasus Federal University, 355017, Stavropol, Russia.
| |
Collapse
|
8
|
Jiang H, Hu R, Wang YJ, Xie X. Predicting depression in patients with heart failure based on a stacking model. World J Clin Cases 2024; 12:4661-4672. [PMID: 39070824 PMCID: PMC11235518 DOI: 10.12998/wjcc.v12.i21.4661] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/27/2024] [Revised: 05/27/2024] [Accepted: 06/17/2024] [Indexed: 06/30/2024] Open
Abstract
BACKGROUND There is a lack of literature discussing the utilization of the stacking ensemble algorithm for predicting depression in patients with heart failure (HF). AIM To create a stacking model for predicting depression in patients with HF. METHODS This study analyzed data on 1084 HF patients from the National Health and Nutrition Examination Survey database spanning from 2005 to 2018. Through univariate analysis and the use of an artificial neural network algorithm, predictors significantly linked to depression were identified. These predictors were utilized to create a stacking model employing tree-based learners. The performances of both the individual models and the stacking model were assessed by using the test dataset. Furthermore, the SHapley additive exPlanations (SHAP) model was applied to interpret the stacking model. RESULTS The models included five predictors. Among these models, the stacking model demonstrated the highest performance, achieving an area under the curve of 0.77 (95%CI: 0.71-0.84), a sensitivity of 0.71, and a specificity of 0.68. The calibration curve supported the reliability of the models, and decision curve analysis confirmed their clinical value. The SHAP plot demonstrated that age had the most significant impact on the stacking model's output. CONCLUSION The stacking model demonstrated strong predictive performance. Clinicians can utilize this model to identify high-risk depression patients with HF, thus enabling early provision of psychological interventions.
Collapse
Affiliation(s)
- Hui Jiang
- Department of Ultrasound, The Second Affiliated Hospital of Anhui Medical University, Hefei 230601, Anhui Province, China
| | - Rui Hu
- Department of Ultrasound, The Second Affiliated Hospital of Anhui Medical University, Hefei 230601, Anhui Province, China
| | - Yu-Jie Wang
- Department of Obstetrics and Gynecology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, Anhui Province, China
| | - Xiang Xie
- Department of Ultrasound Diagnosis, The Second Affiliated Hospital of Anhui Medical University, Hefei 230601, Anhui Province, China
| |
Collapse
|
9
|
Devadhas DNP, Isaac Sugirtharaj HP, Fernandez MH, Periyasamy D. Effective prediction of human skin cancer using stacking based ensemble deep learning algorithm. NETWORK (BRISTOL, ENGLAND) 2024:1-37. [PMID: 38804548 DOI: 10.1080/0954898x.2024.2346608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Accepted: 04/19/2024] [Indexed: 05/29/2024]
Abstract
Automated diagnosis of cancer from skin lesion data has been the focus of numerous research. Despite that it can be challenging to interpret these images because of features like colour illumination changes, variation in the sizes and forms of the lesions. To tackle these problems, the proposed model develops an ensemble of deep learning techniques for skin cancer diagnosis. Initially, skin imaging data are collected and preprocessed using resizing and anisotropic diffusion to enhance the quality of the image. Preprocessed images are fed into the Fuzzy-C-Means clustering technique to segment the region of diseases. Stacking-based ensemble deep learning approach is used for classification and the LSTM acts as a meta-classifier. Deep Neural Network (DNN) and Convolutional Neural Network (CNN) are used as input for LSTM. This segmented images are utilized to be input into the CNN, and the local binary pattern (LBP) technique is employed to extract DNN features from the segments of the image. The output from these two classifiers will be fed into the LSTM Meta classifier. This LSTM classifies the input data and predicts the skin cancer disease. The proposed approach had a greater accuracy of 97%. Hence, the developed model accurately predicts skin cancer disease.
Collapse
Affiliation(s)
- David Neels Ponkumar Devadhas
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr.Sagunthala R & D Institute of Science and Technology, Chennai, India
| | | | - Mary Harin Fernandez
- Department of Computer Science and Engineering, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai, Tamil Nadu, India
| | - Duraipandy Periyasamy
- Department of Electrical and Electronics Engineering, J. B. Institute of Engineering & Technology, Telangana, Hyderabad, India
| |
Collapse
|
10
|
Kuo DP, Chen YC, Li YT, Cheng SJ, Hsieh KLC, Kuo PC, Ou CY, Chen CY. Estimating the volume of penumbra in rodents using DTI and stack-based ensemble machine learning framework. Eur Radiol Exp 2024; 8:59. [PMID: 38744784 PMCID: PMC11093947 DOI: 10.1186/s41747-024-00455-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Accepted: 03/05/2024] [Indexed: 05/16/2024] Open
Abstract
BACKGROUND This study investigates the potential of diffusion tensor imaging (DTI) in identifying penumbral volume (PV) compared to the standard gadolinium-required perfusion-diffusion mismatch (PDM), utilizing a stack-based ensemble machine learning (ML) approach with enhanced explainability. METHODS Sixteen male rats were subjected to middle cerebral artery occlusion. The penumbra was identified using PDM at 30 and 90 min after occlusion. We used 11 DTI-derived metrics and 14 distance-based features to train five voxel-wise ML models. The model predictions were integrated using stack-based ensemble techniques. ML-estimated and PDM-defined PVs were compared to evaluate model performance through volume similarity assessment, the Pearson correlation analysis, and Bland-Altman analysis. Feature importance was determined for explainability. RESULTS In the test rats, the ML-estimated median PV was 106.4 mL (interquartile range 44.6-157.3 mL), whereas the PDM-defined median PV was 102.0 mL (52.1-144.9 mL). These PVs had a volume similarity of 0.88 (0.79-0.96), a Pearson correlation coefficient of 0.93 (p < 0.001), and a Bland-Altman bias of 2.5 mL (2.4% of the mean PDM-defined PV), with 95% limits of agreement ranging from -44.9 to 49.9 mL. Among the features used for PV prediction, the mean diffusivity was the most important feature. CONCLUSIONS Our study confirmed that PV can be estimated using DTI metrics with a stack-based ensemble ML approach, yielding results comparable to the volume defined by the standard PDM. The model explainability enhanced its clinical relevance. Human studies are warranted to validate our findings. RELEVANCE STATEMENT The proposed DTI-based ML model can estimate PV without the need for contrast agent administration, offering a valuable option for patients with kidney dysfunction. It also can serve as an alternative if perfusion map interpretation fails in the clinical setting. KEY POINTS • Penumbral volume can be estimated by DTI combined with stack-based ensemble ML. • Mean diffusivity was the most important feature used for predicting penumbral volume. • The proposed approach can be beneficial for patients with kidney dysfunction.
Collapse
Affiliation(s)
- Duen-Pang Kuo
- Department of Medical Imaging, Taipei Medical University Hospital, No.250, Wu Hsing Street, Taipei, Taiwan
- Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan
- Department of Radiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Yung-Chieh Chen
- Department of Medical Imaging, Taipei Medical University Hospital, No.250, Wu Hsing Street, Taipei, Taiwan.
- Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan.
- Department of Radiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan.
| | - Yi-Tien Li
- Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan
- Research Center for Neuroscience, Taipei Medical University, Taipei, Taiwan
- Ph.D. Program in Medical Neuroscience, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
| | - Sho-Jen Cheng
- Department of Medical Imaging, Taipei Medical University Hospital, No.250, Wu Hsing Street, Taipei, Taiwan
- Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan
| | - Kevin Li-Chun Hsieh
- Department of Medical Imaging, Taipei Medical University Hospital, No.250, Wu Hsing Street, Taipei, Taiwan
- Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan
- Department of Radiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Po-Chih Kuo
- Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan
| | - Chen-Yin Ou
- Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan
| | - Cheng-Yu Chen
- Department of Medical Imaging, Taipei Medical University Hospital, No.250, Wu Hsing Street, Taipei, Taiwan
- Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan
- Research Center for Artificial Intelligence in Medicine, Taipei Medical University, Taipei, Taiwan
- Department of Radiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
- Department of Radiology, National Defense Medical Center, Taipei, Taiwan
| |
Collapse
|
11
|
Hartmann T, Passauer J, Hartmann J, Schmidberger L, Kneilling M, Volc S. Basic principles of artificial intelligence in dermatology explained using melanoma. J Dtsch Dermatol Ges 2024; 22:339-347. [PMID: 38361141 DOI: 10.1111/ddg.15322] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Accepted: 11/04/2023] [Indexed: 02/17/2024]
Abstract
The use of artificial intelligence (AI) continues to establish itself in the most diverse areas of medicine at an increasingly fast pace. Nevertheless, many healthcare professionals lack the basic technical understanding of how this technology works, which severely limits its application in clinical settings and research. Thus, we would like to discuss the functioning and classification of AI using melanoma as an example in this review to build an understanding of the technology behind AI. For this purpose, elaborate illustrations are used that quickly reveal the technology involved. Previous reviews tend to focus on the potential applications of AI, thereby missing the opportunity to develop a deeper understanding of the subject matter that is so important for clinical application. Malignant melanoma has become a significant burden for healthcare systems. If discovered early, a better prognosis can be expected, which is why skin cancer screening has become increasingly popular and is supported by health insurance. The number of experts remains finite, reducing their availability and leading to longer waiting times. Therefore, innovative ideas need to be implemented to provide the necessary care. Thus, machine learning offers the ability to recognize melanomas from images at a level comparable to experienced dermatologists under optimized conditions.
Collapse
Affiliation(s)
- Tim Hartmann
- Department of Dermatology, University hospital Tübingen, Tübingen, Germany
| | - Johannes Passauer
- Department of Dermatology, University hospital Tübingen, Tübingen, Germany
| | | | - Laura Schmidberger
- Department of Dermatology, University hospital Tübingen, Tübingen, Germany
| | - Manfred Kneilling
- Department of Dermatology, University hospital Tübingen, Tübingen, Germany
- Werner Siemens Imaging Center, Department of Preclinical Imaging and Radiopharmacy, Eberhard Karls University, Tübingen, Germany
- Cluster of Excellence iFIT (EXC 2180) "Image-Guided and Functionally Instructed Tumor Therapies", Eberhard Karls University, Tübingen, Germany
| | - Sebastian Volc
- Department of Dermatology, University hospital Tübingen, Tübingen, Germany
| |
Collapse
|
12
|
Hartmann T, Passauer J, Hartmann J, Schmidberger L, Kneilling M, Volc S. Grundprinzipien der künstlichen Intelligenz in der Dermatologie erklärt am Beispiel des Melanoms. J Dtsch Dermatol Ges 2024; 22:339-349. [PMID: 38450927 DOI: 10.1111/ddg.15322_g] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Accepted: 11/04/2023] [Indexed: 03/08/2024]
Abstract
ZusammenfassungDer Einsatz von künstlicher Intelligenz (KI) setzt sich in den verschiedensten Bereichen der Medizin immer schneller durch. Dennoch fehlt vielen medizinischen Kollegen das technische Grundverständnis für die Funktionsweise dieser Technologie, was ihre Anwendung in Klinik und Forschung stark einschränkt. Daher möchten wir in dieser Übersichtsarbeit die Funktionsweise und Klassifizierung der KI am Beispiel des Melanoms erörtern, um ein Verständnis für die Technologie hinter der KI zu schaffen. Dazu werden ausführliche Illustrationen verwendet, die die Technologie schnell erklären. Bisherige Übersichten konzentrieren sich eher auf die potenziellen Anwendungen der KI und verpassen die Gelegenheit, ein tieferes Verständnis für die Materie herauszuarbeiten, das für die klinische Anwendung so wichtig ist. Das maligne Melanom ist zu einer erheblichen Belastung für die Gesundheitssysteme geworden. Bei frühzeitiger Entdeckung ist eine bessere Prognose zu erwarten, weshalb das Hautkrebs‐Screening immer populärer und von den Krankenkassen unterstützt wird. Die Zahl der Fachärzte ist jedoch begrenzt, was ihre Verfügbarkeit einschränkt und zu längeren Wartezeiten führt. Daher müssen innovative Ideen umgesetzt werden, um die notwendige Versorgung zu gewährleisten. Das maschinelle Lernen bietet die Möglichkeit, Melanome auf Bildern zu erkennen, und zwar auf einem Niveau, das mit dem von erfahrenen Dermatologen – unter optimierten Bedingungen – vergleichbar ist.
Collapse
Affiliation(s)
- Tim Hartmann
- Hautklinik, Universitätsklinik, Eberhard Karls Universität, Tübingen
| | - Johannes Passauer
- Hautklinik, Universitätsklinik, Eberhard Karls Universität, Tübingen
| | | | | | - Manfred Kneilling
- Hautklinik, Universitätsklinik, Eberhard Karls Universität, Tübingen
- Werner Siemens Imaging Center, Department of Preclinical Imaging and Radiopharmacy, Eberhard Karls University, Tübingen
- Cluster of Excellence iFIT (EXC 2180) "Image-Guided and Functionally Instructed Tumor Therapies", Eberhard Karls Universität, Tübingen
| | - Sebastian Volc
- Hautklinik, Universitätsklinik, Eberhard Karls Universität, Tübingen
| |
Collapse
|
13
|
Dimas G, Cholopoulou E, Iakovidis DK. E pluribus unum interpretable convolutional neural networks. Sci Rep 2023; 13:11421. [PMID: 37452133 PMCID: PMC10349135 DOI: 10.1038/s41598-023-38459-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 07/08/2023] [Indexed: 07/18/2023] Open
Abstract
The adoption of convolutional neural network (CNN) models in high-stake domains is hindered by their inability to meet society's demand for transparency in decision-making. So far, a growing number of methodologies have emerged for developing CNN models that are interpretable by design. However, such models are not capable of providing interpretations in accordance with human perception, while maintaining competent performance. In this paper, we tackle these challenges with a novel, general framework for instantiating inherently interpretable CNN models, named E pluribus unum interpretable CNN (EPU-CNN). An EPU-CNN model consists of CNN sub-networks, each of which receives a different representation of an input image expressing a perceptual feature, such as color or texture. The output of an EPU-CNN model consists of the classification prediction and its interpretation, in terms of relative contributions of perceptual features in different regions of the input image. EPU-CNN models have been extensively evaluated on various publicly available datasets, as well as a contributed benchmark dataset. Medical datasets are used to demonstrate the applicability of EPU-CNN for risk-sensitive decisions in medicine. The experimental results indicate that EPU-CNN models can achieve a comparable or better classification performance than other CNN architectures while providing humanly perceivable interpretations.
Collapse
Affiliation(s)
- George Dimas
- Department of Computer Science and Biomedical Informatics, School of Science, University of Thessaly, Lamia, Greece
| | - Eirini Cholopoulou
- Department of Computer Science and Biomedical Informatics, School of Science, University of Thessaly, Lamia, Greece
| | - Dimitris K Iakovidis
- Department of Computer Science and Biomedical Informatics, School of Science, University of Thessaly, Lamia, Greece.
| |
Collapse
|
14
|
Li T, Zhang Q, Peng Y, Guan X, Li L, Mu J, Wang X, Yin X, Wang Q. Contributions of various driving factors to air pollution events: Interpretability analysis from Machine learning perspective. ENVIRONMENT INTERNATIONAL 2023; 173:107861. [PMID: 36898175 DOI: 10.1016/j.envint.2023.107861] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Revised: 02/09/2023] [Accepted: 03/01/2023] [Indexed: 06/18/2023]
Abstract
The air quality in China has been improved substantially, however fine particulate matter (PM2.5) still remain at a high level in many areas. PM2.5 pollution is a complex process that is attributed to gaseous precursors, chemical, and meteorological factors. Quantifying the contribution of each variable to air pollution can facilitate the formulation of effective policies to precisely eliminate air pollution. In this study, we first used decision plot to map out the decision process of the Random Forest (RF) model for a single hourly data set and constructed a framework for analyzing the causes of air pollution using multiple interpretable methods. Permutation importance was used to qualitatively analyze the effect of each variable on PM2.5 concentrations. The sensitivity of secondary inorganic aerosols (SIA): SO42-, NO3- and NH4+ to PM2.5 was verified by Partial dependence plot (PDP). Shapley Additive Explanation (Shapley) was used to quantify the contribution of drivers behind the ten air pollution events. The RF model can accurately predict PM2.5 concentrations, with determination coefficient (R2) of 0.94, root mean square error (RMSE) and mean absolute error (MAE) of 9.4 μg/m3 and 5.7 μg/m3, respectively. This study revealed that the order of sensitivity of SIA to PM2.5 was NH4+>NO3->SO42-. Fossil fuel and biomass combustion may be contributing factors to air pollution events in Zibo in 2021 autumn-winter. NH4+ contributed 19.9-65.4 μg/m3 among ten air pollution events (APs). K, NO3-, EC and OC were the other main drivers, contributing 8.7 ± 2.7 μg/m3, 6.8 ± 7.5 μg/m3, 3.6 ± 5.8 μg/m3 and 2.5 ± 2.0 μg/m3, respectively. Lower temperature and higher humidity were vital factors that promoted the formation of NO3-. Our study may provide a methodological framework for precise air pollution management.
Collapse
Affiliation(s)
- Tianshuai Li
- Big Data Research Center for Ecology and Environment, Environment Research Institute, Shandong University, Qingdao 266003, PR China
| | - Qingzhu Zhang
- Big Data Research Center for Ecology and Environment, Environment Research Institute, Shandong University, Qingdao 266003, PR China
| | - Yanbo Peng
- Big Data Research Center for Ecology and Environment, Environment Research Institute, Shandong University, Qingdao 266003, PR China; Shandong Academy for Environmental Planning, Jinan 250101, PR China.
| | - Xu Guan
- Shandong Academy for Environmental Planning, Jinan 250101, PR China
| | - Lei Li
- Big Data Research Center for Ecology and Environment, Environment Research Institute, Shandong University, Qingdao 266003, PR China
| | - Jiangshan Mu
- Big Data Research Center for Ecology and Environment, Environment Research Institute, Shandong University, Qingdao 266003, PR China
| | - Xinfeng Wang
- Big Data Research Center for Ecology and Environment, Environment Research Institute, Shandong University, Qingdao 266003, PR China
| | - Xianwei Yin
- Zibo Ecological Environment Monitoring Center of Shandong Province, Zibo 255040, PR China
| | - Qiao Wang
- Big Data Research Center for Ecology and Environment, Environment Research Institute, Shandong University, Qingdao 266003, PR China
| |
Collapse
|
15
|
Baig AR, Abbas Q, Almakki R, Ibrahim MEA, AlSuwaidan L, Ahmed AES. Light-Dermo: A Lightweight Pretrained Convolution Neural Network for the Diagnosis of Multiclass Skin Lesions. Diagnostics (Basel) 2023; 13:385. [PMID: 36766490 PMCID: PMC9914027 DOI: 10.3390/diagnostics13030385] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 01/16/2023] [Accepted: 01/18/2023] [Indexed: 01/22/2023] Open
Abstract
Skin cancer develops due to the unusual growth of skin cells. Early detection is critical for the recognition of multiclass pigmented skin lesions (PSLs). At an early stage, the manual work by ophthalmologists takes time to recognize the PSLs. Therefore, several "computer-aided diagnosis (CAD)" systems are developed by using image processing, machine learning (ML), and deep learning (DL) techniques. Deep-CNN models outperformed traditional ML approaches in extracting complex features from PSLs. In this study, a special transfer learning (TL)-based CNN model is suggested for the diagnosis of seven classes of PSLs. A novel approach (Light-Dermo) is developed that is based on a lightweight CNN model and applies the channelwise attention (CA) mechanism with a focus on computational efficiency. The ShuffleNet architecture is chosen as the backbone, and squeeze-and-excitation (SE) blocks are incorporated as the technique to enhance the original ShuffleNet architecture. Initially, an accessible dataset with 14,000 images of PSLs from seven classes is used to validate the Light-Dermo model. To increase the size of the dataset and control its imbalance, we have applied data augmentation techniques to seven classes of PSLs. By applying this technique, we collected 28,000 images from the HAM10000, ISIS-2019, and ISIC-2020 datasets. The outcomes of the experiments show that the suggested approach outperforms compared techniques in many cases. The most accurately trained model has an accuracy of 99.14%, a specificity of 98.20%, a sensitivity of 97.45%, and an F1-score of 98.1%, with fewer parameters compared to state-of-the-art DL models. The experimental results show that Light-Dermo assists the dermatologist in the better diagnosis of PSLs. The Light-Dermo code is available to the public on GitHub so that researchers can use it and improve it.
Collapse
Affiliation(s)
- Abdul Rauf Baig
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| | | | | | | | | | | |
Collapse
|
16
|
Distinguish the Value of the Benign Nevus and Melanomas Using Machine Learning: A Meta-Analysis and Systematic Review. Mediators Inflamm 2022; 2022:1734327. [PMID: 36274972 PMCID: PMC9586788 DOI: 10.1155/2022/1734327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Revised: 09/22/2022] [Accepted: 10/01/2022] [Indexed: 11/26/2022] Open
Abstract
Background Melanomas, the most common human malignancy, are primarily diagnosed visually, beginning with an initial clinical screening and followed potentially by dermoscopic analysis, a biopsy, and histopathological examination. We aimed to systematically review the performance and quality of machine learning-based methods in distinguishing melanoma and benign nevus in the relevant literature. Method Four databases (Web of Science, PubMed, Embase, and the Cochrane library) were searched to retrieve the relevant studies published until March 26, 2022. The Predictive model Deviation Risk Assessment tool (PROBAST) was used to assess the deviation risk of opposing law. Result This systematic review included thirty researches with 114007 subjects and 71 machine learning models. The convolutional neural network was the main machine learning method. The pooled sensitivity was 85% (95% CI 82–87%), the specificity was 86% (82–88%), and the C-index was 0.87 (0.84–0.90). Conclusion The findings of our study showed that ML algorithms had high sensitivity and specificity for distinguishing between melanoma and benign nevi. This suggests that state-of-the-art ML-based algorithms for distinguishing melanoma from benign nevi may be ready for clinical use. However, a large proportion of the earlier published studies had methodological flaws, such as lack of external validation and lack of clinician comparisons. The results of these studies should be interpreted with caution.
Collapse
|
17
|
An Efficient Deep Learning-Based Skin Cancer Classifier for an Imbalanced Dataset. Diagnostics (Basel) 2022; 12:diagnostics12092115. [PMID: 36140516 PMCID: PMC9497837 DOI: 10.3390/diagnostics12092115] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 08/24/2022] [Accepted: 08/29/2022] [Indexed: 12/12/2022] Open
Abstract
Efficient skin cancer detection using images is a challenging task in the healthcare domain. In today’s medical practices, skin cancer detection is a time-consuming procedure that may lead to a patient’s death in later stages. The diagnosis of skin cancer at an earlier stage is crucial for the success rate of complete cure. The efficient detection of skin cancer is a challenging task. Therefore, the numbers of skilful dermatologists around the globe are not enough to deal with today’s healthcare. The huge difference between data from various healthcare sector classes leads to data imbalance problems. Due to data imbalance issues, deep learning models are often trained on one class more than others. This study proposes a novel deep learning-based skin cancer detector using an imbalanced dataset. Data augmentation was used to balance various skin cancer classes to overcome the data imbalance. The Skin Cancer MNIST: HAM10000 dataset was employed, which consists of seven classes of skin lesions. Deep learning models are widely used in disease diagnosis through images. Deep learning-based models (AlexNet, InceptionV3, and RegNetY-320) were employed to classify skin cancer. The proposed framework was also tuned with various combinations of hyperparameters. The results show that RegNetY-320 outperformed InceptionV3 and AlexNet in terms of the accuracy, F1-score, and receiver operating characteristic (ROC) curve both on the imbalanced and balanced datasets. The performance of the proposed framework was better than that of conventional methods. The accuracy, F1-score, and ROC curve value obtained with the proposed framework were 91%, 88.1%, and 0.95, which were significantly better than those of the state-of-the-art method, which achieved 85%, 69.3%, and 0.90, respectively. Our proposed framework may assist in disease identification, which could save lives, reduce unnecessary biopsies, and reduce costs for patients, dermatologists, and healthcare professionals.
Collapse
|
18
|
Chang CC, Li YZ, Wu HC, Tseng MH. Melanoma Detection Using XGB Classifier Combined with Feature Extraction and K-Means SMOTE Techniques. Diagnostics (Basel) 2022; 12:1747. [PMID: 35885650 PMCID: PMC9320570 DOI: 10.3390/diagnostics12071747] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 07/14/2022] [Accepted: 07/18/2022] [Indexed: 12/02/2022] Open
Abstract
Melanoma, a very severe form of skin cancer, spreads quickly and has a high mortality rate if not treated early. Recently, machine learning, deep learning, and other related technologies have been successfully applied to computer-aided diagnostic tasks of skin lesions. However, some issues in terms of image feature extraction and imbalanced data need to be addressed. Based on a method for manually annotating image features by dermatologists, we developed a melanoma detection model with four improvement strategies, including applying the transfer learning technique to automatically extract image features, adding gender and age metadata, using an oversampling technique for imbalanced data, and comparing machine learning algorithms. According to the experimental results, the improved strategies proposed in this study have statistically significant performance improvement effects. In particular, our proposed ensemble model can outperform previous related models.
Collapse
Affiliation(s)
- Chih-Chi Chang
- Department of Medical Informatics, Chung Shan Medical University, Taichung 402, Taiwan; (C.-C.C.); (Y.-Z.L.)
| | - Yu-Zhen Li
- Department of Medical Informatics, Chung Shan Medical University, Taichung 402, Taiwan; (C.-C.C.); (Y.-Z.L.)
| | - Hui-Ching Wu
- Department of Medical Sociology and Social Work, Chung Shan Medical University, Taichung 402, Taiwan
| | - Ming-Hseng Tseng
- Department of Medical Informatics, Chung Shan Medical University, Taichung 402, Taiwan; (C.-C.C.); (Y.-Z.L.)
- Information Technology Office, Chung Shan Medical University Hospital, Taichung 402, Taiwan
| |
Collapse
|