1
|
Joyce DW, Kormilitzin A, Smith KA, Cipriani A. Explainable artificial intelligence for mental health through transparency and interpretability for understandability. NPJ Digit Med 2023; 6:6. [PMID: 36653524 PMCID: PMC9849399 DOI: 10.1038/s41746-023-00751-9] [Citation(s) in RCA: 30] [Impact Index Per Article: 30.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2022] [Accepted: 01/10/2023] [Indexed: 01/19/2023] Open
Abstract
The literature on artificial intelligence (AI) or machine learning (ML) in mental health and psychiatry lacks consensus on what "explainability" means. In the more general XAI (eXplainable AI) literature, there has been some convergence on explainability meaning model-agnostic techniques that augment a complex model (with internal mechanics intractable for human understanding) with a simpler model argued to deliver results that humans can comprehend. Given the differing usage and intended meaning of the term "explainability" in AI and ML, we propose instead to approximate model/algorithm explainability by understandability defined as a function of transparency and interpretability. These concepts are easier to articulate, to "ground" in our understanding of how algorithms and models operate and are used more consistently in the literature. We describe the TIFU (Transparency and Interpretability For Understandability) framework and examine how this applies to the landscape of AI/ML in mental health research. We argue that the need for understandablity is heightened in psychiatry because data describing the syndromes, outcomes, disorders and signs/symptoms possess probabilistic relationships to each other-as do the tentative aetiologies and multifactorial social- and psychological-determinants of disorders. If we develop and deploy AI/ML models, ensuring human understandability of the inputs, processes and outputs of these models is essential to develop trustworthy systems fit for deployment.
Collapse
Affiliation(s)
- Dan W Joyce
- University of Oxford, Department of Psychiatry, Warneford Hospital, Oxford, OX3 7JX, UK.
- Institute of Population Health, Department of Primary Care and Mental Health, University of Liverpool, Liverpool, L69 3GF, UK.
| | - Andrey Kormilitzin
- University of Oxford, Department of Psychiatry, Warneford Hospital, Oxford, OX3 7JX, UK
| | - Katharine A Smith
- University of Oxford, Department of Psychiatry, Warneford Hospital, Oxford, OX3 7JX, UK
- Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Warneford Hospital, Oxford, OX3 7JX, UK
- Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, OX3 7JX, UK
| | - Andrea Cipriani
- University of Oxford, Department of Psychiatry, Warneford Hospital, Oxford, OX3 7JX, UK
- Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Warneford Hospital, Oxford, OX3 7JX, UK
- Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, OX3 7JX, UK
| |
Collapse
|
2
|
Tan X, Wang J, Tang J, Tian X, Jin L, Li M, Zhang Z, He D. A Nomogram for Predicting Cancer-Specific Survival in Children With Wilms Tumor: A Study Based on SEER Database and External Validation in China. Front Public Health 2022; 10:829840. [PMID: 35462822 PMCID: PMC9021525 DOI: 10.3389/fpubh.2022.829840] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2021] [Accepted: 02/28/2022] [Indexed: 11/29/2022] Open
Abstract
Background Wilms tumor (WT) is the most common tumor in children. We aim to construct a nomogram to predict the cancer-specific survival (CSS) of WT in children and externally validate in China. Methods We downloaded the clinicopathological data of children with WT from 2004 to 2018 in the SEER database. At the same time, we used the clinicopathological data collected previously for all children with WT between 2013 and 2018 at Children's Hospital of Chongqing Medical University (Chongqing, China). We analyzed the difference in survival between the patients in the SEER database and our hospital. Cox regression analysis was used to screen for significant risk factors. Based on these factors, a nomogram was constructed to predict the CSS of children with WT. Calibration curve, concordance index (C-index), the area under the receiver operating curve (AUC) and decision curve analysis (DCA) was used to evaluate the accuracy and reliability of the model. Results We included 1,045 children with WT in the SEER database. At the same time, we collected 112 children with WT in our hospital. The Kaplan-Meier curve suggested that children in China with WT had a higher mortality rate than those in the United States. Cox regression analysis revealed that age, lymph node density (LND), and tumor stage were significant prognostic factors for the patients in the SEER database. However, the patients in our hospital only confirmed that the tumor stage and the number of positive regional lymph nodes were significant factors. The prediction model established by the SEER database had been validated internally and externally to prove that it had good accuracy and reliability. Conclusion We have constructed a survival prognosis prediction model for children with WT, which has been validated internally and externally to prove accuracy and reliability.
Collapse
Affiliation(s)
- Xiaojun Tan
- Department of Urology, Children's Hospital of Chongqing Medical University, Chongqing, China
- Department of Urology, Nanchong Central Hospital, The Second Clinical Medical College, North Sichuan Medical University, Nanchong, China
- Chongqing Key Laboratory of Children Urogenital Development and Tissue Engineering, Chongqing, China
- Chongqing Key Laboratory of Pediatrics, Chongqing, China
- Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China
- National Clinical Research Center for Child Health and Disorders, Chongqing, China
- China International Science and Technology Cooperation Base of Child Development and Critical Disorders, Chongqing, China
| | - Jinkui Wang
- Department of Urology, Children's Hospital of Chongqing Medical University, Chongqing, China
- Chongqing Key Laboratory of Children Urogenital Development and Tissue Engineering, Chongqing, China
- Chongqing Key Laboratory of Pediatrics, Chongqing, China
- Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China
- National Clinical Research Center for Child Health and Disorders, Chongqing, China
- China International Science and Technology Cooperation Base of Child Development and Critical Disorders, Chongqing, China
| | - Jie Tang
- Department of Epidemiology, Public Health School, Shenyang Medical College, Shenyang, China
| | - Xiaomao Tian
- Department of Urology, Children's Hospital of Chongqing Medical University, Chongqing, China
- Chongqing Key Laboratory of Children Urogenital Development and Tissue Engineering, Chongqing, China
- Chongqing Key Laboratory of Pediatrics, Chongqing, China
- Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China
- National Clinical Research Center for Child Health and Disorders, Chongqing, China
- China International Science and Technology Cooperation Base of Child Development and Critical Disorders, Chongqing, China
| | - Liming Jin
- Department of Urology, Children's Hospital of Chongqing Medical University, Chongqing, China
- Chongqing Key Laboratory of Children Urogenital Development and Tissue Engineering, Chongqing, China
- Chongqing Key Laboratory of Pediatrics, Chongqing, China
- Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China
- National Clinical Research Center for Child Health and Disorders, Chongqing, China
- China International Science and Technology Cooperation Base of Child Development and Critical Disorders, Chongqing, China
| | - Mujie Li
- Department of Urology, Children's Hospital of Chongqing Medical University, Chongqing, China
- Chongqing Key Laboratory of Children Urogenital Development and Tissue Engineering, Chongqing, China
- Chongqing Key Laboratory of Pediatrics, Chongqing, China
- Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China
- National Clinical Research Center for Child Health and Disorders, Chongqing, China
- China International Science and Technology Cooperation Base of Child Development and Critical Disorders, Chongqing, China
| | - Zhaoxia Zhang
- Department of Urology, Children's Hospital of Chongqing Medical University, Chongqing, China
- Chongqing Key Laboratory of Children Urogenital Development and Tissue Engineering, Chongqing, China
- Chongqing Key Laboratory of Pediatrics, Chongqing, China
- Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China
- National Clinical Research Center for Child Health and Disorders, Chongqing, China
- China International Science and Technology Cooperation Base of Child Development and Critical Disorders, Chongqing, China
| | - Dawei He
- Department of Urology, Children's Hospital of Chongqing Medical University, Chongqing, China
- Chongqing Key Laboratory of Children Urogenital Development and Tissue Engineering, Chongqing, China
- Chongqing Key Laboratory of Pediatrics, Chongqing, China
- Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing, China
- National Clinical Research Center for Child Health and Disorders, Chongqing, China
- China International Science and Technology Cooperation Base of Child Development and Critical Disorders, Chongqing, China
- *Correspondence: Dawei He
| |
Collapse
|
3
|
Tang J, Wang J, Pan X, Liu X, Zhao B. A Web-Based Prediction Model for Cancer-Specific Survival of Middle-Aged Patients With Non-metastatic Renal Cell Carcinoma: A Population-Based Study. Front Public Health 2022; 10:822808. [PMID: 35284377 PMCID: PMC8907592 DOI: 10.3389/fpubh.2022.822808] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Accepted: 01/17/2022] [Indexed: 11/13/2022] Open
Abstract
Background Renal cell carcinoma (RCC) is one of the most common cancers in middle-aged patients. We aimed to establish a new nomogram for predicting cancer-specific survival (CSS) in middle-aged patients with non-metastatic renal cell carcinoma (nmRCC). Methods The clinicopathological information of all patients from 2010 to 2018 was downloaded from the SEER database. These patients were randomly assigned to the training set (70%) and validation set (30%). Univariate and multivariate COX regression analyses were used to identify independent risk factors for CSS in middle-aged patients with nmRCC in the training set. Based on these independent risk factors, a new nomogram was constructed to predict 1-, 3-, and 5-year CSS in middle-aged patients with nmRCC. Then, we used the consistency index (C-index), calibration curve, and area under receiver operating curve (AUC) to validate the accuracy and discrimination of the model. Decision curve analysis (DCA) was used to validate the clinical application value of the model. Results A total of 27,073 patients were included in the study. These patients were randomly divided into a training set (N = 18,990) and a validation set (N = 8,083). In the training set, univariate and multivariate Cox regression analysis indicated that age, sex, histological tumor grade, T stage, tumor size, and surgical method are independent risk factors for CSS of patients. A new nomogram was constructed to predict patients' 1-, 3-, and 5-year CSS. The C-index of the training set and validation set were 0.818 (95% CI: 0.802-0.834) and 0.802 (95% CI: 0.777-0.827), respectively. The 1 -, 3 -, and 5-year AUC for the training and validation set ranged from 77.7 to 80.0. The calibration curves of the training set and the validation set indicated that the predicted value is highly consistent with the actual observation value, indicating that the model has good accuracy. DCA also suggested that the model has potential clinical application value. Conclusion We found that independent risk factors for CSS in middle-aged patients with nmRCC were age, sex, histological tumor grade, T stage, tumor size, and surgery. We have constructed a new nomogram to predict the CSS of middle-aged patients with nmRCC. This model has good accuracy and reliability and can assist doctors and patients in clinical decision making.
Collapse
Affiliation(s)
- Jie Tang
- Department of Biostatistics and Epidemiology, School of Public Health, Shenyang Medical College, Shenyang, China
| | - Jinkui Wang
- Department of Urology, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing Key Laboratory of Pediatrics, China International Science and Technology Cooperation Base of Child Development and Critical Disorders, National Clinical Research Center for Child Health and Disorders (Chongqing), Children's Hospital of Chongqing Medical University, Chongqing, China
| | - Xiudan Pan
- Department of Biostatistics and Epidemiology, School of Public Health, Shenyang Medical College, Shenyang, China
| | - Xiaozhu Liu
- Department of Cardiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Binyi Zhao
- Department of Cardiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
- *Correspondence: Binyi Zhao
| |
Collapse
|