1
|
Tay J, Yen YH, Rivera K, Chou EH, Wang CH, Chou FY, Sun JT, Han ST, Tsai TP, Chen YC, Bhakta T, Tsai CL, Lu TC, Huei-Ming Ma M. Development and External Validation of Clinical Features-based Machine Learning Models for Predicting COVID-19 in the Emergency Department. West J Emerg Med 2024; 25:67-78. [PMID: 38205987 PMCID: PMC10777189 DOI: 10.5811/westjem.60243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 09/29/2023] [Accepted: 10/02/2023] [Indexed: 01/12/2024] Open
Abstract
Introduction Timely diagnosis of patients affected by an emerging infectious disease plays a crucial role in treating patients and avoiding disease spread. In prior research, we developed an approach by using machine learning (ML) algorithms to predict serious acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection based on clinical features of patients visiting an emergency department (ED) during the early coronavirus 2019 (COVID-19) pandemic. In this study, we aimed to externally validate this approach within a distinct ED population. Methods To create our training/validation cohort (model development) we collected data retrospectively from suspected COVID-19 patients at a US ED from February 23-May 12, 2020. Another dataset was collected as an external validation (testing) cohort from an ED in another country from May 12-June 15, 2021. Clinical features including patient demographics and triage information were used to train and test the models. The primary outcome was the confirmed diagnosis of COVID-19, defined as a positive reverse transcription polymerase chain reaction test result for SARS-CoV-2. We employed three different ML algorithms, including gradient boosting, random forest, and extra trees classifiers, to construct the predictive model. The predictive performances were evaluated with the area under the receiver operating characteristic curve (AUC) in the testing cohort. Results In total, 580 and 946 ED patients were included in the training and testing cohorts, respectively. Of them, 98 (16.9%) and 180 (19.0%) were diagnosed with COVID-19. All the constructed ML models showed acceptable discrimination, as indicated by the AUC. Among them, random forest (0.785, 95% confidence interval [CI] 0.747-0.822) performed better than gradient boosting (0.774, 95% CI 0.739-0.811) and extra trees classifier (0.72, 95% CI 0.677-0.762). There was no significant difference between the constructed models. Conclusion Our study validates the use of ML for predicting COVID-19 in the ED and demonstrates its potential for predicting emerging infectious diseases based on models built by clinical features with temporal and spatial heterogeneity. This approach holds promise for scenarios where effective diagnostic tools for an emerging infectious disease may be lacking in the future.
Collapse
Affiliation(s)
- Joyce Tay
- National Taiwan University Hospital, Department of Emergency Medicine, Taipei, Taiwan
| | - Yi-Hsuan Yen
- Baylor Scott and White All Saints Medical Center, Department of Emergency Medicine, Fort Worth, Texas
| | - Kevin Rivera
- Texas Christian University, School of Medicine, Fort Worth, Texas
| | - Eric H Chou
- Baylor Scott and White All Saints Medical Center, Department of Emergency Medicine, Fort Worth, Texas
- Baylor University Medical Center, Department of Emergency Medicine, Dallas, Texas
| | - Chih-Hung Wang
- National Taiwan University Hospital, Department of Emergency Medicine, Taipei, Taiwan
- National Taiwan University, College of Medicine, Department of Emergency Medicine, Taipei, Taiwan
| | - Fan-Ya Chou
- National Taiwan University Hospital, Department of Emergency Medicine, Taipei, Taiwan
- National Taiwan University, College of Medicine, Department of Emergency Medicine, Taipei, Taiwan
| | - Jen-Tang Sun
- Far Eastern Memorial Hospital, Department of Emergency Medicine, New Taipei City, Taiwan
| | - Shih-Tsung Han
- Chang Gung Memorial Hospital at Linkou, Department of Emergency Medicine, Taoyuan, Taiwan
| | - Tzu-Ping Tsai
- Taipei Veterans General Hospital, Department of Emergency Medicine, Taipei, Taiwan
| | - Yen-Chia Chen
- Taipei Veterans General Hospital, Department of Emergency Medicine, Taipei, Taiwan
| | - Toral Bhakta
- Baylor Scott and White All Saints Medical Center, Department of Emergency Medicine, Fort Worth, Texas
| | - Chu-Lin Tsai
- National Taiwan University Hospital, Department of Emergency Medicine, Taipei, Taiwan
- National Taiwan University, College of Medicine, Department of Emergency Medicine, Taipei, Taiwan
| | - Tsung-Chien Lu
- National Taiwan University Hospital, Department of Emergency Medicine, Taipei, Taiwan
- National Taiwan University, College of Medicine, Department of Emergency Medicine, Taipei, Taiwan
| | - Matthew Huei-Ming Ma
- National Taiwan University Hospital, Department of Emergency Medicine, Taipei, Taiwan
- National Taiwan University, College of Medicine, Department of Emergency Medicine, Taipei, Taiwan
- National Taiwan University Hospital Yunlin Branch, Department of Emergency Medicine, Yunlin County, Taiwan
| |
Collapse
|
2
|
Mavaie P, Holder L, Skinner MK. Hybrid deep learning approach to improve classification of low-volume high-dimensional data. BMC Bioinformatics 2023; 24:419. [PMID: 37936066 PMCID: PMC10631218 DOI: 10.1186/s12859-023-05557-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 11/01/2023] [Indexed: 11/09/2023] Open
Abstract
BACKGROUND The performance of machine learning classification methods relies heavily on the choice of features. In many domains, feature generation can be labor-intensive and require domain knowledge, and feature selection methods do not scale well in high-dimensional datasets. Deep learning has shown success in feature generation but requires large datasets to achieve high classification accuracy. Biology domains typically exhibit these challenges with numerous handcrafted features (high-dimensional) and small amounts of training data (low volume). METHOD A hybrid learning approach is proposed that first trains a deep network on the training data, extracts features from the deep network, and then uses these features to re-express the data for input to a non-deep learning method, which is trained to perform the final classification. RESULTS The approach is systematically evaluated to determine the best layer of the deep learning network from which to extract features and the threshold on training data volume that prefers this approach. Results from several domains show that this hybrid approach outperforms standalone deep and non-deep learning methods, especially on low-volume, high-dimensional datasets. The diverse collection of datasets further supports the robustness of the approach across different domains. CONCLUSIONS The hybrid approach combines the strengths of deep and non-deep learning paradigms to achieve high performance on high-dimensional, low volume learning tasks that are typical in biology domains.
Collapse
Affiliation(s)
- Pegah Mavaie
- School of Electrical Engineering and Computer Science, Washington State University, Pullman, WA, 99164, USA
| | - Lawrence Holder
- School of Electrical Engineering and Computer Science, Washington State University, Pullman, WA, 99164, USA
| | - Michael K Skinner
- School of Biological Sciences, Center for Reproductive Biology, Washington State University, Pullman, WA, 99164-4236, USA.
| |
Collapse
|
3
|
Miyazaki A, Ikejima K, Nishio M, Yabuta M, Matsuo H, Onoue K, Matsunaga T, Nishioka E, Kono A, Yamada D, Oba K, Ishikura R, Murakami T. Computer-aided diagnosis of chest X-ray for COVID-19 diagnosis in external validation study by radiologists with and without deep learning system. Sci Rep 2023; 13:17533. [PMID: 37845348 PMCID: PMC10579343 DOI: 10.1038/s41598-023-44818-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 10/12/2023] [Indexed: 10/18/2023] Open
Abstract
To evaluate the diagnostic performance of our deep learning (DL) model of COVID-19 and investigate whether the diagnostic performance of radiologists was improved by referring to our model. Our datasets contained chest X-rays (CXRs) for the following three categories: normal (NORMAL), non-COVID-19 pneumonia (PNEUMONIA), and COVID-19 pneumonia (COVID). We used two public datasets and private dataset collected from eight hospitals for the development and external validation of our DL model (26,393 CXRs). Eight radiologists performed two reading sessions: one session was performed with reference to CXRs only, and the other was performed with reference to both CXRs and the results of the DL model. The evaluation metrics for the reading session were accuracy, sensitivity, specificity, and area under the curve (AUC). The accuracy of our DL model was 0.733, and that of the eight radiologists without DL was 0.696 ± 0.031. There was a significant difference in AUC between the radiologists with and without DL for COVID versus NORMAL or PNEUMONIA (p = 0.0038). Our DL model alone showed better diagnostic performance than that of most radiologists. In addition, our model significantly improved the diagnostic performance of radiologists for COVID versus NORMAL or PNEUMONIA.
Collapse
Affiliation(s)
- Aki Miyazaki
- Department of Radiology, Kobe University Graduate School of Medicine, 7-5-2 Kusunoki-Cho, Chuo-Ku, Kobe, 650-0017, Japan
| | - Kengo Ikejima
- Department of Radiology, St. Luke's International Hospital, 9-1 Akashi-Cho, Chuo-Ku, Tokyo, 104-8560, Japan
| | - Mizuho Nishio
- Department of Radiology, Kobe University Graduate School of Medicine, 7-5-2 Kusunoki-Cho, Chuo-Ku, Kobe, 650-0017, Japan.
| | - Minoru Yabuta
- Department of Radiology, St. Luke's International Hospital, 9-1 Akashi-Cho, Chuo-Ku, Tokyo, 104-8560, Japan
| | - Hidetoshi Matsuo
- Department of Radiology, Kobe University Graduate School of Medicine, 7-5-2 Kusunoki-Cho, Chuo-Ku, Kobe, 650-0017, Japan
| | - Koji Onoue
- Department of Radiology, Kobe City Medical Center General Hospital, 2-1-1 Minatojimaminamimachi, Chuo-Ku, Kobe, 650-0047, Japan
- Department of Diagnostic Imaging and Interventional Radiology, Kyoto Katsura Hospital, 17 Yamada-Hirao, Nishikyo-Ku, Kyoto, 615-8256, Japan
| | - Takaaki Matsunaga
- Department of Radiology, Kobe University Graduate School of Medicine, 7-5-2 Kusunoki-Cho, Chuo-Ku, Kobe, 650-0017, Japan
| | - Eiko Nishioka
- Department of Radiology, Kobe University Graduate School of Medicine, 7-5-2 Kusunoki-Cho, Chuo-Ku, Kobe, 650-0017, Japan
| | - Atsushi Kono
- Department of Radiology, Kobe University Graduate School of Medicine, 7-5-2 Kusunoki-Cho, Chuo-Ku, Kobe, 650-0017, Japan
| | - Daisuke Yamada
- Department of Radiology, St. Luke's International Hospital, 9-1 Akashi-Cho, Chuo-Ku, Tokyo, 104-8560, Japan
| | - Ken Oba
- Department of Radiology, St. Luke's International Hospital, 9-1 Akashi-Cho, Chuo-Ku, Tokyo, 104-8560, Japan
| | - Reiichi Ishikura
- Department of Radiology, Kobe City Medical Center General Hospital, 2-1-1 Minatojimaminamimachi, Chuo-Ku, Kobe, 650-0047, Japan
| | - Takamichi Murakami
- Department of Radiology, Kobe University Graduate School of Medicine, 7-5-2 Kusunoki-Cho, Chuo-Ku, Kobe, 650-0017, Japan
| |
Collapse
|
4
|
Das S, Ayus I, Gupta D. A comprehensive review of COVID-19 detection with machine learning and deep learning techniques. HEALTH AND TECHNOLOGY 2023; 13:1-14. [PMID: 37363343 PMCID: PMC10244837 DOI: 10.1007/s12553-023-00757-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 05/14/2023] [Indexed: 06/28/2023]
Abstract
Purpose The first transmission of coronavirus to humans started in Wuhan city of China, took the shape of a pandemic called Corona Virus Disease 2019 (COVID-19), and posed a principal threat to the entire world. The researchers are trying to inculcate artificial intelligence (Machine learning or deep learning models) for the efficient detection of COVID-19. This research explores all the existing machine learning (ML) or deep learning (DL) models, used for COVID-19 detection which may help the researcher to explore in different directions. The main purpose of this review article is to present a compact overview of the application of artificial intelligence to the research experts, helping them to explore the future scopes of improvement. Methods The researchers have used various machine learning, deep learning, and a combination of machine and deep learning models for extracting significant features and classifying various health conditions in COVID-19 patients. For this purpose, the researchers have utilized different image modalities such as CT-Scan, X-Ray, etc. This study has collected over 200 research papers from various repositories like Google Scholar, PubMed, Web of Science, etc. These research papers were passed through various levels of scrutiny and finally, 50 research articles were selected. Results In those listed articles, the ML / DL models showed an accuracy of 99% and above while performing the classification of COVID-19. This study has also presented various clinical applications of various research. This study specifies the importance of various machine and deep learning models in the field of medical diagnosis and research. Conclusion In conclusion, it is evident that ML/DL models have made significant progress in recent years, but there are still limitations that need to be addressed. Overfitting is one such limitation that can lead to incorrect predictions and overburdening of the models. The research community must continue to work towards finding ways to overcome these limitations and make machine and deep learning models even more effective and efficient. Through this ongoing research and development, we can expect even greater advances in the future.
Collapse
Affiliation(s)
- Sreeparna Das
- Department of Computer Science and Engineering, National Institute of Technology Arunachal Pradesh, Jote, Arunachal Pradesh 791113 India
| | - Ishan Ayus
- Department of Computer Science and Engineering, ITER, Siksha ‘O’ Anusandhan Deemed to be University, Bhubaneswar, Odisha 751030 India
| | - Deepak Gupta
- Department of Computer Science and Engineering, Motilal Nehru National Institute of Technology Allahabad, Prayagraj, UP 211004 India
| |
Collapse
|
5
|
Annamalai B, Saravanan P, Varadharajan I. ABOA-CNN: auction-based optimization algorithm with convolutional neural network for pulmonary disease prediction. Neural Comput Appl 2023; 35:7463-7474. [PMID: 36788792 PMCID: PMC9910772 DOI: 10.1007/s00521-022-08033-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 11/04/2022] [Indexed: 02/12/2023]
Abstract
Nowadays, deep learning plays a vital role behind many of the emerging technologies. Few applications of deep learning include speech recognition, virtual assistant, healthcare, entertainment, and so on. In healthcare applications, deep learning can be used to predict diseases effectively. It is a type of computer model that learns in conducting classification tasks directly from text, sound, or images. It also provides better accuracy and sometimes outdoes human performance. We presented a novel approach that makes use of the deep learning method in our proposed work. The prediction of pulmonary disease can be performed with the aid of convolutional neural network (CNN) incorporated with auction-based optimization algorithm (ABOA) and DSC process. The traditional CNN ignores the dominant features from the X-ray images while performing the feature extraction process. This can be effectively circumvented by the adoption of ABOA, and the DSC is used to classify the pulmonary disease types such as fibrosis, pneumonia, cardiomegaly, and normal from the X-ray images. We have taken two datasets, namely the NIH Chest X-ray dataset and ChestX-ray8. The performances of the proposed approach are compared with deep learning-based state-of-art works such as BPD, DL, CSS-DL, and Grad-CAM. From the performance analyses, it is confirmed that the proposed approach effectively extracts the features from the X-ray images, and thus, the prediction of pulmonary diseases is more accurate than the state-of-art approaches.
Collapse
Affiliation(s)
- Balaji Annamalai
- School of Computing Science and Engineering (SCSE), VIT Bhopal University, Bhopal, MP India
| | - Prabakeran Saravanan
- Department of Networking and Communications, School of Computing, SRM Institute of Science & Technology (SRMIST), Kattankulathur, Tamil Nadu India
| | - Indumathi Varadharajan
- Department of Computational Intelligence School of Computing, SRM Institute of Science and Technology (SRMIST), Kattankulathur, Tamil Nadu India
| |
Collapse
|
6
|
Ensemble Dilated Convolutional Neural Network and Its Application in Rotating Machinery Fault Diagnosis. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:6316140. [PMID: 36188683 PMCID: PMC9519275 DOI: 10.1155/2022/6316140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 08/19/2022] [Accepted: 08/23/2022] [Indexed: 11/25/2022]
Abstract
Fault diagnosis of rotating machinery is an attractive yet challenging task. This paper presents a novel intelligent fault diagnosis scheme for rotating machinery based on ensemble dilated convolutional neural networks. The novel fault diagnosis framework employs a model training strategy based on early stopping optimization to ensemble several one-dimensional dilated convolutional neural networks (1D-DCNNs). By varying the dilation rate of the 1D-DCNN, different receptive fields can be obtained to extract different vibration signal features. The early stopping strategy is used as a model update threshold to prevent overfitting and save computational resources. Ensemble learning uses a weighted mechanism to combine the outputs of multiple 1D-DCNN subclassifiers with different dilation rates to obtain the final fault diagnosis. The proposed method outperforms existing state-of-the-art classical machine learning and deep learning methods in simulation studies and diagnostic experiments, demonstrating that it can thoroughly mine fault features in vibration signals. The classification results further show that the EDCNN model can effectively and accurately identify multiple faults and outperform existing fault detection techniques.
Collapse
|
7
|
Shiri I, Mostafaei S, Haddadi Avval A, Salimi Y, Sanaat A, Akhavanallaf A, Arabi H, Rahmim A, Zaidi H. High-dimensional multinomial multiclass severity scoring of COVID-19 pneumonia using CT radiomics features and machine learning algorithms. Sci Rep 2022; 12:14817. [PMID: 36050434 PMCID: PMC9437017 DOI: 10.1038/s41598-022-18994-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 08/23/2022] [Indexed: 12/11/2022] Open
Abstract
We aimed to construct a prediction model based on computed tomography (CT) radiomics features to classify COVID-19 patients into severe-, moderate-, mild-, and non-pneumonic. A total of 1110 patients were studied from a publicly available dataset with 4-class severity scoring performed by a radiologist (based on CT images and clinical features). The entire lungs were segmented and followed by resizing, bin discretization and radiomic features extraction. We utilized two feature selection algorithms, namely bagging random forest (BRF) and multivariate adaptive regression splines (MARS), each coupled to a classifier, namely multinomial logistic regression (MLR), to construct multiclass classification models. The dataset was divided into 50% (555 samples), 20% (223 samples), and 30% (332 samples) for training, validation, and untouched test datasets, respectively. Subsequently, nested cross-validation was performed on train/validation to select the features and tune the models. All predictive power indices were reported based on the testing set. The performance of multi-class models was assessed using precision, recall, F1-score, and accuracy based on the 4 × 4 confusion matrices. In addition, the areas under the receiver operating characteristic curves (AUCs) for multi-class classifications were calculated and compared for both models. Using BRF, 23 radiomic features were selected, 11 from first-order, 9 from GLCM, 1 GLRLM, 1 from GLDM, and 1 from shape. Ten features were selected using the MARS algorithm, namely 3 from first-order, 1 from GLDM, 1 from GLRLM, 1 from GLSZM, 1 from shape, and 3 from GLCM features. The mean absolute deviation, skewness, and variance from first-order and flatness from shape, and cluster prominence from GLCM features and Gray Level Non Uniformity Normalize from GLRLM were selected by both BRF and MARS algorithms. All selected features by BRF or MARS were significantly associated with four-class outcomes as assessed within MLR (All p values < 0.05). BRF + MLR and MARS + MLR resulted in pseudo-R2 prediction performances of 0.305 and 0.253, respectively. Meanwhile, there was a significant difference between the feature selection models when using a likelihood ratio test (p value = 0.046). Based on confusion matrices for BRF + MLR and MARS + MLR algorithms, the precision was 0.856 and 0.728, the recall was 0.852 and 0.722, whereas the accuracy was 0.921 and 0.861, respectively. AUCs (95% CI) for multi-class classification were 0.846 (0.805-0.887) and 0.807 (0.752-0.861) for BRF + MLR and MARS + MLR algorithms, respectively. Our models based on the utilization of radiomic features, coupled with machine learning were able to accurately classify patients according to the severity of pneumonia, thus highlighting the potential of this emerging paradigm in the prognostication and management of COVID-19 patients.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Shayan Mostafaei
- Division of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | | | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Amirhossein Sanaat
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Azadeh Akhavanallaf
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Arman Rahmim
- Departments of Radiology and Physics, University of British Columbia, Vancouver, BC, Canada
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland.
- Geneva University Neurocenter, Geneva University, Geneva, Switzerland.
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands.
- Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
8
|
Jiang H, Cui T, Yang K. Design of Sponsored Search Auction Mechanism for Federated Learning Advertising Platform. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5787491. [PMID: 35432522 PMCID: PMC9010167 DOI: 10.1155/2022/5787491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 01/28/2022] [Accepted: 02/14/2022] [Indexed: 11/17/2022]
Abstract
Federated learning has demonstrated strong capabilities in terms of addressing concerns related to data islands and privacy protection. However, in real application scenarios, participants in federated learning have difficulty matching. For example, two companies distributed in different regions do not know that the other party also needs federated learning in the case of information asymmetry. Therefore, it is difficult to build alliances. To enable suppliers and consumers to find one or more federated learning objects that are relatively satisfactory in a short time, this paper considers the idea of establishing a federated learning advertising platform, where data transactions need to consider privacy protection. A sponsored search auction mechanism design method is introduced to solve the problem of ranking the presentation order of participant advertisements. Due to the potential malicious bidding problem, which occurs when using the classic sponsored search auction mechanism under the federated learning scenario, this paper proposes a novel federated sponsored search auction mechanism based on the Myerson theorem, improving upon the ranking index used in the classic sponsored search auction mechanism. A large number of experimental results on a simulation data set show that our proposed method can fairly select and rank the data providers participating in the bidding. Compared with other benchmark mechanisms, the malicious bidding rate is significantly decreased. In the long run, the proposed mechanism can encourage more data providers to participate in the federated learning platform, thus continuously promoting the establishment of a federated learning ecosystem.
Collapse
Affiliation(s)
- Hong Jiang
- School of Management, Shenzhen Polytechnic, Shenzhen 518055, China
| | - Tianxu Cui
- School of Information, Beijing Wuzi University, Beijing 101149, China
| | - Kaiwen Yang
- School of Information, Beijing Wuzi University, Beijing 101149, China
| |
Collapse
|
9
|
Aslan MF, Sabanci K, Durdu A, Unlersen MF. COVID-19 diagnosis using state-of-the-art CNN architecture features and Bayesian Optimization. Comput Biol Med 2022; 142:105244. [PMID: 35077936 PMCID: PMC8770389 DOI: 10.1016/j.compbiomed.2022.105244] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 01/17/2022] [Accepted: 01/17/2022] [Indexed: 12/16/2022]
Abstract
The coronavirus outbreak 2019, called COVID-19, which originated in Wuhan, negatively affected the lives of millions of people and many people died from this infection. To prevent the spread of the disease, which is still in effect, various restriction decisions have been taken all over the world. In addition, the number of COVID-19 tests has been increased to quarantine infected people. However, due to the problems encountered in the supply of RT-PCR tests and the ease of obtaining Computed Tomography and X-ray images, imaging-based methods have become very popular in the diagnosis of COVID-19. Therefore, studies using these images to classify COVID-19 have increased. This paper presents a classification method for computed tomography chest images in the COVID-19 Radiography Database using features extracted by popular Convolutional Neural Networks (CNN) models (AlexNet, ResNet18, ResNet50, Inceptionv3, Densenet201, Inceptionresnetv2, MobileNetv2, GoogleNet). The determination of hyperparameters of Machine Learning (ML) algorithms by Bayesian optimization, and ANN-based image segmentation are the two main contributions in this study. First of all, lung segmentation is performed automatically from the raw image with Artificial Neural Networks (ANNs). To ensure data diversity, data augmentation is applied to the COVID-19 classes, which are fewer than the other two classes. Then these images are applied as input to five different CNN models. The features extracted from each CNN model are given as input to four different ML algorithms, namely Support Vector Machine (SVM), k-Nearest Neighbors (k-NN), Naive Bayes (NB), and Decision Tree (DT) for classification. To achieve the most successful classification accuracy, the hyperparameters of each ML algorithm are determined using Bayesian optimization. With the classification made using these hyperparameters, the highest success is obtained as 96.29% with the DenseNet201 model and SVM algorithm. The Sensitivity, Precision, Specificity, MCC, and F1-Score metric values for this structure are 0.9642, 0.9642, 0.9812, 0.9641 and 0.9453, respectively. These results showed that ML methods with the most optimum hyperparameters can produce successful results.
Collapse
Affiliation(s)
- Muhammet Fatih Aslan
- Electrical and Electronics Engineering, Karamanoglu Mehmetbey University, Karaman, Turkey
| | - Kadir Sabanci
- Electrical and Electronics Engineering, Karamanoglu Mehmetbey University, Karaman, Turkey.
| | - Akif Durdu
- Electrical and Electronics Engineering, Konya Technical University, Konya, Turkey
| | | |
Collapse
|
10
|
Nasiri H, Alavi SA. A Novel Framework Based on Deep Learning and ANOVA Feature Selection Method for Diagnosis of COVID-19 Cases from Chest X-Ray Images. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:4694567. [PMID: 35013680 PMCID: PMC8742147 DOI: 10.1155/2022/4694567] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Accepted: 12/20/2021] [Indexed: 12/12/2022]
Abstract
Background and Objective. The new coronavirus disease (known as COVID-19) was first identified in Wuhan and quickly spread worldwide, wreaking havoc on the economy and people's everyday lives. As the number of COVID-19 cases is rapidly increasing, a reliable detection technique is needed to identify affected individuals and care for them in the early stages of COVID-19 and reduce the virus's transmission. The most accessible method for COVID-19 identification is Reverse Transcriptase-Polymerase Chain Reaction (RT-PCR); however, it is time-consuming and has false-negative results. These limitations encouraged us to propose a novel framework based on deep learning that can aid radiologists in diagnosing COVID-19 cases from chest X-ray images. Methods. In this paper, a pretrained network, DenseNet169, was employed to extract features from X-ray images. Features were chosen by a feature selection method, i.e., analysis of variance (ANOVA), to reduce computations and time complexity while overcoming the curse of dimensionality to improve accuracy. Finally, selected features were classified by the eXtreme Gradient Boosting (XGBoost). The ChestX-ray8 dataset was employed to train and evaluate the proposed method. Results and Conclusion. The proposed method reached 98.72% accuracy for two-class classification (COVID-19, No-findings) and 92% accuracy for multiclass classification (COVID-19, No-findings, and Pneumonia). The proposed method's precision, recall, and specificity rates on two-class classification were 99.21%, 93.33%, and 100%, respectively. Also, the proposed method achieved 94.07% precision, 88.46% recall, and 100% specificity for multiclass classification. The experimental results show that the proposed framework outperforms other methods and can be helpful for radiologists in the diagnosis of COVID-19 cases.
Collapse
Affiliation(s)
- Hamid Nasiri
- Department of Computer Engineering, Amirkabir University of Technology, Tehran, Iran
| | - Seyed Ali Alavi
- Electrical and Computer Engineering Department, Semnan University, Semnan, Iran
| |
Collapse
|