1
|
Pati A, Panigrahi A, Parhi M, Giri J, Qin H, Mallik S, Pattanayak SR, Agrawal UK. Performance assessment of hybrid machine learning approaches for breast cancer and recurrence prediction. PLoS One 2024; 19:e0304768. [PMID: 39088457 PMCID: PMC11293701 DOI: 10.1371/journal.pone.0304768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Accepted: 05/19/2024] [Indexed: 08/03/2024] Open
Abstract
Breast cancer is a major health concern for women everywhere and a major killer of women. Malignant tumors may be distinguished from benign ones, allowing for early diagnosis of this disease. Therefore, doctors need an accurate method of diagnosing tumors as either malignant or benign. Even if therapy begins immediately after diagnosis, some cancer cells may persist in the body, increasing the risk of a recurrence. Metastasis and recurrence are the leading causes of death from breast cancer. Therefore, detecting a return of breast cancer early has become a pressing medical issue. Evaluating and contrasting various Machine Learning (ML) techniques for breast cancer and recurrence prediction is crucial to choosing the best successful method. Inaccurate forecasts are common when using datasets with a large number of attributes. This study addresses the need for effective feature selection and optimization methods by introducing Recursive Feature Elimination (RFE) and Grey Wolf Optimizer (GWO), in response to the limitations observed in existing approaches. In this research, the performance evaluation of methods is enhanced by employing the RFE and GWO, considering the Wisconsin Diagnostic Breast Cancer (WDBC) and Wisconsin Prognostic Breast Cancer (WPBC) datasets taken from the UCI-ML repository. Various preprocessing techniques are applied to raw data, including imputation, scaling, and others. In the second step, relevant feature correlations are used with RFE to narrow down candidate discriminative features. The GWO chooses the best possible combination of attributes for the most accurate result in the next step. We use seven ML classifiers in both datasets to make a binary decision. On the WDBC and WPBC datasets, several experiments have shown accuracies of 98.25% and 93.27%, precisions of 98.13% and 95.56%, sensitivities of 99.06% and 96.63%, specificities of 96.92% and 73.33%, F1-scores of 98.59% and 96.09% and AUCs of 0.982 and 0.936, respectively. The hybrid approach's superior feature selection improved the accuracy of breast cancer performance indicators and recurrence classification.
Collapse
Affiliation(s)
- Abhilash Pati
- Department of Computer Science and Engineering, Siksha ‘O’ Anusandhan (Deemed to be University), Bhubaneswar, Odisha, India
| | - Amrutanshu Panigrahi
- Department of Computer Science and Engineering, Siksha ‘O’ Anusandhan (Deemed to be University), Bhubaneswar, Odisha, India
| | - Manoranjan Parhi
- Centre for Data Science, Siksha ‘O’ Anusandhan (Deemed to be University), Bhubaneswar, Odisha, India
| | - Jayant Giri
- Department of Mechanical Engineering, Yeshwantrao Chavan College of Engineering, Nagpur, India
- Department of VLSI Microelectronics, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences (SIMATS), Saveetha University, Chennai, Tamil Nadu, India
| | - Hong Qin
- Department of Computer Science and Engineering, University of Tennessee at Chattanooga, Chattanooga, Tamil Nadu, United States of America
| | - Saurav Mallik
- Department of Environmental Health, Harvard T H Chan School of Public Health, Boston, Massachusetts, United States of America
| | - Sambit Ranjan Pattanayak
- Department of Computer Science and Engineering, Siksha ‘O’ Anusandhan (Deemed to be University), Bhubaneswar, Odisha, India
| | - Umang Kumar Agrawal
- School of Computer Engineering, KIIT (Deemed to be University), Bhubaneswar, Odisha, India
| |
Collapse
|
2
|
Azeroual S, Ben-Bouazza FE, Naqi A, Sebihi R. Predicting disease recurrence in breast cancer patients using machine learning models with clinical and radiomic characteristics: a retrospective study. J Egypt Natl Canc Inst 2024; 36:20. [PMID: 38853190 DOI: 10.1186/s43046-024-00222-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 04/06/2024] [Indexed: 06/11/2024] Open
Abstract
BACKGROUND The goal is to use three different machine learning models to predict the recurrence of breast cancer across a very heterogeneous sample of patients with varying disease kinds and stages. METHODS A heterogeneous group of patients with varying cancer kinds and stages, including both triple-negative breast cancer (TNBC) and non-triple-negative breast cancer (non-TNBC), was examined. Three distinct models were created using the following five machine learning techniques: Adaptive Boosting (AdaBoost), Random Under-sampling Boosting (RUSBoost), Extreme Gradient Boosting (XGBoost), support vector machines (SVM), and Logistic Regression. The clinical model used both clinical and pathology data in conjunction with the machine learning algorithms. The machine learning algorithms were combined with dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) imaging characteristics in the radiomic model, and the merged model combined the two types of data. Each technique was evaluated using several criteria, including the receiver operating characteristic (ROC) curve, precision, recall, and F1 score. RESULTS The results suggest that the integration of clinical and radiomic data improves the predictive accuracy in identifying instances of breast cancer recurrence. The XGBoost algorithm is widely recognized as the most effective algorithm in terms of performance. CONCLUSION The findings presented in this study offer significant contributions to the field of breast cancer research, particularly in relation to the prediction of cancer recurrence. These insights hold great potential for informing future investigations and clinical interventions that seek to enhance the accuracy and effectiveness of recurrence prediction in breast cancer patients.
Collapse
Affiliation(s)
- Saadia Azeroual
- LPHE-Modeling and Simulations, Faculty of Science, Mohammed V University in Rabat, Rabat, Morocco.
| | - Fatima-Ezzahraa Ben-Bouazza
- Faculty of Sciences and Technology, Hassan First University, Settat, Morocco
- LaMSN (La Maison Des Sciences Num´Eriques), Saint-Denis, France
| | - Amine Naqi
- Mohammed VI University of Sciences and Health, Casablanca, Morocco
| | - Rajaa Sebihi
- LPHE-Modeling and Simulations, Faculty of Science, Mohammed V University in Rabat, Rabat, Morocco
| |
Collapse
|
3
|
Nicolis O, De Los Angeles D, Taramasco C. A contemporary review of breast cancer risk factors and the role of artificial intelligence. Front Oncol 2024; 14:1356014. [PMID: 38699635 PMCID: PMC11063273 DOI: 10.3389/fonc.2024.1356014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 03/25/2024] [Indexed: 05/05/2024] Open
Abstract
Background Breast cancer continues to be a significant global health issue, necessitating advancements in prevention and early detection strategies. This review aims to assess and synthesize research conducted from 2020 to the present, focusing on breast cancer risk factors, including genetic, lifestyle, and environmental aspects, as well as the innovative role of artificial intelligence (AI) in prediction and diagnostics. Methods A comprehensive literature search, covering studies from 2020 to the present, was conducted to evaluate the diversity of breast cancer risk factors and the latest advances in Artificial Intelligence (AI) in this field. The review prioritized high-quality peer-reviewed research articles and meta-analyses. Results Our analysis reveals a complex interplay of genetic, lifestyle, and environmental risk factors for breast cancer, with significant variability across different populations. Furthermore, AI has emerged as a promising tool in enhancing the accuracy of breast cancer risk prediction and the personalization of prevention strategies. Conclusion The review highlights the necessity for personalized breast cancer prevention and detection approaches that account for individual risk factor profiles. It underscores the potential of AI to revolutionize these strategies, offering clear recommendations for future research directions and clinical practice improvements.
Collapse
Affiliation(s)
- Orietta Nicolis
- Engineering Faculty, Universidad Andres Bello, Viña del Mar, Chile
- Centro para la Prevención y Control del Cáncer (CECAN), Santiago, Chile
| | - Denisse De Los Angeles
- Engineering Faculty, Universidad Andres Bello, Viña del Mar, Chile
- Centro para la Prevención y Control del Cáncer (CECAN), Santiago, Chile
| | - Carla Taramasco
- Engineering Faculty, Universidad Andres Bello, Viña del Mar, Chile
- Centro para la Prevención y Control del Cáncer (CECAN), Santiago, Chile
| |
Collapse
|
4
|
Khanna M, Singh LK, Shrivastava K, Singh R. An enhanced and efficient approach for feature selection for chronic human disease prediction: A breast cancer study. Heliyon 2024; 10:e26799. [PMID: 38463826 PMCID: PMC10920178 DOI: 10.1016/j.heliyon.2024.e26799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2023] [Revised: 01/15/2024] [Accepted: 02/20/2024] [Indexed: 03/12/2024] Open
Abstract
Computer-aided diagnosis (CAD) systems play a vital role in modern research by effectively minimizing both time and costs. These systems support healthcare professionals like radiologists in their decision-making process by efficiently detecting abnormalities as well as offering accurate and dependable information. These systems heavily depend on the efficient selection of features to accurately categorize high-dimensional biological data. These features can subsequently assist in the diagnosis of related medical conditions. The task of identifying patterns in biomedical data can be quite challenging due to the presence of numerous irrelevant or redundant features. Therefore, it is crucial to propose and then utilize a feature selection (FS) process in order to eliminate these features. The primary goal of FS approaches is to improve the accuracy of classification by eliminating features that are irrelevant or less informative. The FS phase plays a critical role in attaining optimal results in machine learning (ML)-driven CAD systems. The effectiveness of ML models can be significantly enhanced by incorporating efficient features during the training phase. This empirical study presents a methodology for the classification of biomedical data using the FS technique. The proposed approach incorporates three soft computing-based optimization algorithms, namely Teaching Learning-Based Optimization (TLBO), Elephant Herding Optimization (EHO), and a proposed hybrid algorithm of these two. These algorithms were previously employed; however, their effectiveness in addressing FS issues in predicting human diseases has not been investigated. The following evaluation focuses on the categorization of benign and malignant tumours using the publicly available Wisconsin Diagnostic Breast Cancer (WDBC) benchmark dataset. The five-fold cross-validation technique is employed to mitigate the risk of over-fitting. The evaluation of the proposed approach's proficiency is determined based on several metrics, including sensitivity, specificity, precision, accuracy, area under the receiver-operating characteristic curve (AUC), and F1-score. The best value of accuracy computed through the suggested approach is 97.96%. The proposed clinical decision support system demonstrates a highly favourable classification performance outcome, making it a valuable tool for medical practitioners to utilize as a secondary opinion and reducing the overburden of expert medical practitioners.
Collapse
Affiliation(s)
- Munish Khanna
- School of Computing Science and Engineering, Galgotias University, Greater Noida, Gautam Buddh Nagar, India
| | - Law Kumar Singh
- Department of Computer Engineering and Applications, GLA University, Mathura, India
| | - Kapil Shrivastava
- Department of Computer Engineering and Applications, GLA University, Mathura, India
| | - Rekha Singh
- Department of Physics, Uttar Pradesh Rajarshi Tandon Open University, Prayagraj, Uttar Pradesh, India
| |
Collapse
|
5
|
Ansari RM, Harris MF, Hosseinzadeh H, Zwar N. Application of Artificial Intelligence in Assessing the Self-Management Practices of Patients with Type 2 Diabetes. Healthcare (Basel) 2023; 11:healthcare11060903. [PMID: 36981560 PMCID: PMC10048183 DOI: 10.3390/healthcare11060903] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2023] [Revised: 03/16/2023] [Accepted: 03/17/2023] [Indexed: 03/30/2023] Open
Abstract
The use of Artificial intelligence in healthcare has evolved substantially in recent years. In medical diagnosis, Artificial intelligence algorithms are used to forecast or diagnose a variety of life-threatening illnesses, including breast cancer, diabetes, heart disease, etc. The main objective of this study is to assess self-management practices among patients with type 2 diabetes in rural areas of Pakistan using Artificial intelligence and machine learning algorithms. Of particular note is the assessment of the factors associated with poor self-management activities, such as non-adhering to medications, poor eating habits, lack of physical activities, and poor glycemic control (HbA1c %). The sample of 200 participants was purposefully recruited from the medical clinics in rural areas of Pakistan. The artificial neural network algorithm and logistic regression classification algorithms were used to assess diabetes self-management activities. The diabetes dataset was split 80:20 between training and testing; 80% (160) instances were used for training purposes and 20% (40) instances were used for testing purposes, while the algorithms' overall performance was measured using a confusion matrix. The current study found that self-management efforts and glycemic control were poor among diabetes patients in rural areas of Pakistan. The logistic regression model performance was evaluated based on the confusion matrix. The accuracy of the training set was 98%, while the test set's accuracy was 97.5%; each set had a recall rate of 79% and 75%, respectively. The output of the confusion matrix showed that only 11 out of 200 patients were correctly assessed/classified as meeting diabetes self-management targets based on the values of HbA1c < 7%. We added a wide range of neurons (32 to 128) in the hidden layers to train the artificial neural network models. The results showed that the model with three hidden layers and Adam's optimisation function achieved 98% accuracy on the validation set. This study has assessed the factors associated with poor self-management activities among patients with type 2 diabetes in rural areas of Pakistan. The use of a wide range of neurons in the hidden layers to train the artificial neural network models improved outcomes, confirming the model's effectiveness and efficiency in assessing diabetes self-management activities from the required data attributes.
Collapse
Affiliation(s)
- Rashid M Ansari
- School of Public Health and Community Medicine, Faculty of Medicine, University of New South Wales, Sydney, NSW 2052, Australia
| | - Mark F Harris
- Centre for Primary Health Care and Equity, University of New South Wales, Sydney, NSW 2052, Australia
| | - Hassan Hosseinzadeh
- School of Health and Society, Faculty of Science, Medicine and Health, University of Wollongong, Sydney, NSW 2522, Australia
| | - Nicholas Zwar
- Faculty of Health Sciences and Medicine, Queensland University, Brisbane, QLD 4072, Australia
| |
Collapse
|
6
|
Natural Language Processing Applications for Computer-Aided Diagnosis in Oncology. Diagnostics (Basel) 2023; 13:diagnostics13020286. [PMID: 36673096 PMCID: PMC9857980 DOI: 10.3390/diagnostics13020286] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2022] [Revised: 12/24/2022] [Accepted: 01/05/2023] [Indexed: 01/15/2023] Open
Abstract
In the era of big data, text-based medical data, such as electronic health records (EHR) and electronic medical records (EMR), are growing rapidly. EHR and EMR are collected from patients to record their basic information, lab tests, vital signs, clinical notes, and reports. EHR and EMR contain the helpful information to assist oncologists in computer-aided diagnosis and decision making. However, it is time consuming for doctors to extract the valuable information they need and analyze the information from the EHR and EMR data. Recently, more and more research works have applied natural language processing (NLP) techniques, i.e., rule-based, machine learning-based, and deep learning-based techniques, on the EHR and EMR data for computer-aided diagnosis in oncology. The objective of this review is to narratively review the recent progress in the area of NLP applications for computer-aided diagnosis in oncology. Moreover, we intend to reduce the research gap between artificial intelligence (AI) experts and clinical specialists to design better NLP applications. We originally identified 295 articles from the three electronic databases: PubMed, Google Scholar, and ACL Anthology; then, we removed the duplicated papers and manually screened the irrelevant papers based on the content of the abstract; finally, we included a total of 23 articles after the screening process of the literature review. Furthermore, we provided an in-depth analysis and categorized these studies into seven cancer types: breast cancer, lung cancer, liver cancer, prostate cancer, pancreatic cancer, colorectal cancer, and brain tumors. Additionally, we identified the current limitations of NLP applications on supporting the clinical practices and we suggest some promising future research directions in this paper.
Collapse
|
7
|
Mazo C, Aura C, Rahman A, Gallagher WM, Mooney C. Application of Artificial Intelligence Techniques to Predict Risk of Recurrence of Breast Cancer: A Systematic Review. J Pers Med 2022; 12:1496. [PMID: 36143281 PMCID: PMC9500690 DOI: 10.3390/jpm12091496] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Revised: 09/05/2022] [Accepted: 09/09/2022] [Indexed: 12/31/2022] Open
Abstract
Breast cancer is the most common disease among women, with over 2.1 million new diagnoses each year worldwide. About 30% of patients initially presenting with early stage disease have a recurrence of cancer within 10 years. Predicting who will have a recurrence and who will not remains challenging, with consequent implications for associated treatment. Artificial intelligence strategies that can predict the risk of recurrence of breast cancer could help breast cancer clinicians avoid ineffective overtreatment. Despite its significance, most breast cancer recurrence datasets are insufficiently large, not publicly available, or imbalanced, making these studies more difficult. This systematic review investigates the role of artificial intelligence in the prediction of breast cancer recurrence. We summarise common techniques, features, training and testing methodologies, metrics, and discuss current challenges relating to implementation in clinical practice. We systematically reviewed works published between 1 January 2011 and 1 November 2021 using the methodology of Kitchenham and Charter. We leveraged Springer, Google Scholar, PubMed, and IEEE search engines. This review found three areas that require further work. First, there is no agreement on artificial intelligence methodologies, feature predictors, or assessment metrics. Second, issues such as sampling strategies, missing data, and class imbalance problems are rarely addressed or discussed. Third, representative datasets for breast cancer recurrence are scarce, which hinders model validation and deployment. We conclude that predicting breast cancer recurrence remains an open problem despite the use of artificial intelligence.
Collapse
Affiliation(s)
- Claudia Mazo
- UCD School of Computer Science, University College Dublin, D04 V1W8 Dublin, Ireland
| | - Claudia Aura
- UCD School of Biomolecular and Biomedical Science, UCD Conway Institute, University College Dublin, D04 V1W8 Dublin, Ireland
| | - Arman Rahman
- UCD School of Biomolecular and Biomedical Science, UCD Conway Institute, University College Dublin, D04 V1W8 Dublin, Ireland
| | - William M. Gallagher
- UCD School of Biomolecular and Biomedical Science, UCD Conway Institute, University College Dublin, D04 V1W8 Dublin, Ireland
| | - Catherine Mooney
- UCD School of Computer Science, University College Dublin, D04 V1W8 Dublin, Ireland
| |
Collapse
|
8
|
Mikhailova V, Anbarjafari G. Comparative analysis of classification algorithms on the breast cancer recurrence using machine learning. Med Biol Eng Comput 2022; 60:2589-2600. [DOI: 10.1007/s11517-022-02623-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Accepted: 06/15/2022] [Indexed: 10/17/2022]
|
9
|
Predicting Breast Cancer Based on Optimized Deep Learning Approach. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:1820777. [PMID: 35345799 PMCID: PMC8957426 DOI: 10.1155/2022/1820777] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Accepted: 01/13/2022] [Indexed: 01/23/2023]
Abstract
Breast cancer is a dangerous disease with a high morbidity and mortality rate. One of the most important aspects in breast cancer treatment is getting an accurate diagnosis. Machine-learning (ML) and deep learning techniques can help doctors in making diagnosis decisions. This paper proposed the optimized deep recurrent neural network (RNN) model based on RNN and the Keras–Tuner optimization technique for breast cancer diagnosis. The optimized deep RNN consists of the input layer, five hidden layers, five dropout layers, and the output layer. In each hidden layer, we optimized the number of neurons and rate values of the dropout layer. Three feature-selection methods have been used to select the most important features from the database. Five regular ML models, namely decision tree (DT), support vector machine (SVM), random forest (RF), naive Bayes (NB), and K-nearest neighbor algorithm (KNN) were compared with the optimized deep RNN. The regular ML models and the optimized deep RNN have been applied the selected features. The results showed that the optimized deep RNN with the selected features by univariate has achieved the highest performance for CV and the testing results compared to the other models.
Collapse
|
10
|
Yang PT, Wu WS, Wu CC, Shih YN, Hsieh CH, Hsu JL. Breast cancer recurrence prediction with ensemble methods and cost-sensitive learning. Open Med (Wars) 2021; 16:754-768. [PMID: 34027105 PMCID: PMC8122465 DOI: 10.1515/med-2021-0282] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 03/11/2021] [Accepted: 04/03/2021] [Indexed: 11/15/2022] Open
Abstract
Breast cancer is one of the most common cancers in women all over the world. Due to the improvement of medical treatments, most of the breast cancer patients would be in remission. However, the patients have to face the next challenge, the recurrence of breast cancer which may cause more severe effects, and even death. The prediction of breast cancer recurrence is crucial for reducing mortality. This paper proposes a prediction model for the recurrence of breast cancer based on clinical nominal and numeric features. In this study, our data consist of 1,061 patients from Breast Cancer Registry from Shin Kong Wu Ho-Su Memorial Hospital between 2011 and 2016, in which 37 records are denoted as breast cancer recurrence. Each record has 85 features. Our approach consists of three stages. First, we perform data preprocessing and feature selection techniques to consolidate the dataset. Among all features, six features are identified for further processing in the following stages. Next, we apply resampling techniques to resolve the issue of class imbalance. Finally, we construct two classifiers, AdaBoost and cost-sensitive learning, to predict the risk of recurrence and carry out the performance evaluation in three-fold cross-validation. By applying the AdaBoost method, we achieve accuracy of 0.973 and sensitivity of 0.675. By combining the AdaBoost and cost-sensitive method of our model, we achieve a reasonable accuracy of 0.468 and substantially high sensitivity of 0.947 which guarantee almost no false dismissal. Our model can be used as a supporting tool in the setting and evaluation of the follow-up visit for early intervention and more advanced treatments to lower cancer mortality.
Collapse
Affiliation(s)
- Pei-Tse Yang
- Department of Computer Science and Information Engineering, Fu Jen Catholic University, New Taipei City, Taiwan, Republic of China
| | - Wen-Shuo Wu
- Department of Computer Science and Information Engineering, Fu Jen Catholic University, New Taipei City, Taiwan, Republic of China
| | - Chia-Chun Wu
- Department of Computer Science and Information Engineering, Fu Jen Catholic University, New Taipei City, Taiwan, Republic of China
| | - Yi-Nuo Shih
- Department of Occupational Therapy, Fu Jen Catholic University, New Taipei City, Taiwan, Republic of China
| | - Chung-Ho Hsieh
- Department of General Surgery, Shin Kong Wu Ho-Su Memorial Hospital, Taipei, Taiwan, Republic of China
| | - Jia-Lien Hsu
- Department of Computer Science and Information Engineering, Fu Jen Catholic University, New Taipei City, Taiwan, Republic of China
| |
Collapse
|