1
|
Nakano FK, Åkesson A, de Boer J, Dedja K, D'hondt R, Haredasht FN, Björk J, Courbebaisse M, Couzi L, Ebert N, Eriksen BO, Dalton RN, Derain-Dubourg L, Gaillard F, Garrouste C, Grubb A, Jacquemont L, Hansson M, Kamar N, Legendre C, Littmann K, Mariat C, Melsom T, Rostaing L, Rule AD, Schaeffner E, Sundin PO, Bökenkamp A, Berg U, Åsling-Monemi K, Selistre L, Larsson A, Nyman U, Lanot A, Pottel H, Delanaye P, Vens C. Comparison between the EKFC-equation and machine learning models to predict Glomerular Filtration Rate. Sci Rep 2024; 14:26383. [PMID: 39487227 PMCID: PMC11530427 DOI: 10.1038/s41598-024-77618-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2024] [Accepted: 10/23/2024] [Indexed: 11/04/2024] Open
Abstract
In clinical practice, the glomerular filtration rate (GFR), a measurement of kidney functioning, is normally calculated using equations, such as the European Kidney Function Consortium (EKFC) equation. Despite being the most general equation, EKFC, just like previously proposed approaches, can still struggle to achieve satisfactory performance, limiting its clinical applicability. As a possible solution, recently machine learning (ML) has been investigated to improve GFR prediction, nonetheless the literature still lacks a general and multi-center study. Using a dataset with 19,629 patients from 13 cohorts, we investigate if ML can improve GFR prediction in comparison to EKFC. More specifically, we compare diverse ML methods, which were allowed to use age, sex, serum creatinine, cystatin C, height, weight and BMI as features, in internal and external cohorts against EKFC. The results show that the most performing ML method, random forest (RF), and EKFC are very competitive where RF and EKFC achieved respectively P10 and P30 values of 0.45 (95% CI 0.44;0.46) and 0.89 (95% CI 0.88;0.90), whereas EKFC yielded 0.44 (95% CI 0.43; 0.44) and 0.89 (95% CI 0.88; 0.90), considering the entire cohort. Small differences were, however, observed in patients younger than 12 years where RF slightly outperformed EKFC.
Collapse
Affiliation(s)
- Felipe Kenji Nakano
- Department of Public Health and Primary Care, KU Leuven Campus Kulak Kortrijk, Kortrijk, Belgium.
- Itec, Imec Research Group at KU Leuven, Kortrijk, Belgium.
| | - Anna Åkesson
- Division of Occupational and Environmental Medicine, Lund University, Lund, Sweden
- Clinical Studies Sweden, Forum South, Skåne University Hospital, Lund, Sweden
| | - Jasper de Boer
- Department of Public Health and Primary Care, KU Leuven Campus Kulak Kortrijk, Kortrijk, Belgium
- Itec, Imec Research Group at KU Leuven, Kortrijk, Belgium
| | - Klest Dedja
- Department of Public Health and Primary Care, KU Leuven Campus Kulak Kortrijk, Kortrijk, Belgium
- Itec, Imec Research Group at KU Leuven, Kortrijk, Belgium
| | - Robbe D'hondt
- Department of Public Health and Primary Care, KU Leuven Campus Kulak Kortrijk, Kortrijk, Belgium
- Itec, Imec Research Group at KU Leuven, Kortrijk, Belgium
| | - Fateme Nateghi Haredasht
- Department of Public Health and Primary Care, KU Leuven Campus Kulak Kortrijk, Kortrijk, Belgium
- Itec, Imec Research Group at KU Leuven, Kortrijk, Belgium
| | - Jonas Björk
- Division of Occupational and Environmental Medicine, Lund University, Lund, Sweden
- Clinical Studies Sweden, Forum South, Skåne University Hospital, Lund, Sweden
| | - Marie Courbebaisse
- Physiology Department, Georges Pompidou European Hospital, Assistance Publique Hôpitaux de Paris, INSERM U1151-CNRS UMR8253, Paris Descartes University, Paris, France
| | - Lionel Couzi
- CNRS-UMR 5164 Immuno ConcEpT, CHU de Bordeaux, Nephrologie-Transplantation-Dialyse, Université de Bordeaux, Bordeaux, France
| | - Natalie Ebert
- Institute of Public Health, Charité Universitätsmedizin Berlin, Berlin, Germany
| | - Björn O Eriksen
- Metabolic and Renal Research Group, UiT the Arctic University of Norway, Tromsö, Norway
| | - R Neil Dalton
- The Wellchild Laboratory, Evelina London Children's Hospital, London, UK
| | - Laurence Derain-Dubourg
- Néphrologie, Dialyse, Hypertension et Exploration Fonctionnelle Rénale, Hôpital Edouard Herriot, Hospices Civils de Lyon, France
| | - Francois Gaillard
- Renal Transplantation Department, Assistance Publique-Hôpitaux de Paris (AP-HP), Paris, France
| | - Cyril Garrouste
- Department of Nephrology, Clermont-Ferrand University Hospital, Clermont-Ferrand, France
| | - Anders Grubb
- Department of Clinical Chemistry, Skåne University Hospital, Lund University, Lund, Sweden
| | - Lola Jacquemont
- Renal Transplantation Department, CHU Nantes, Nantes University, Nantes, France
| | - Magnus Hansson
- Function Area Clinical Chemistry, Karolinska University Laboratory, Karolinska Institute, Karolinska University Hospital Huddinge and Department of Laboratory Medicine, Stockholm, Sweden
| | - Nassim Kamar
- Department of Nephrology, Dialysis and Organ Transplantation, CHU Rangueil, INSERM U1043, IFR-BMT, University Paul Sabatier, Toulouse, France
| | | | - Karin Littmann
- Institute om Medicine Huddinge (Med H), Karolinska Institute, Solna, Sweden
| | - Christophe Mariat
- Service de Néphrologie, Dialyse et Transplantation Rénale, Hôpital Nord, CHU de Saint-Etienne, Saint-Priest-en-Jarez, France
| | - Toralf Melsom
- Metabolic and Renal Research Group, UiT the Arctic University of Norway, Tromsö, Norway
| | - Lionel Rostaing
- Service de Néphrologie, Hémodialyse, Aphérèses et Transplantation Rénale, Hôpital Michallon, CHU Grenoble-Alpes, Tronche, France
| | - Andrew D Rule
- Division of Nephrology and Hypertension, Mayo Clinic, Rochester, MN, USA
| | - Elke Schaeffner
- Institute of Public Health, Charité Universitätsmedizin Berlin, Berlin, Germany
| | - Per-Ola Sundin
- Karla Healthcare Centre, Faculty of Medicine and Health, Örebro University, 70182, Örebro, SE, Sweden
| | - Arend Bökenkamp
- Department of Paediatric Nephrology, Emma Children's Hospital, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Ulla Berg
- Department of Clinical Science, Intervention and Technology, Division of Pediatrics, Karolinska Institutet, Karolinska University Hospital Huddinge, Stockholm, Sweden
| | - Kajsa Åsling-Monemi
- Department of Clinical Science, Intervention and Technology, Division of Pediatrics, Karolinska Institutet, Karolinska University Hospital Huddinge, Stockholm, Sweden
| | - Luciano Selistre
- Mestrado Em Ciências da Saúde-Universidade Caxias do Sul Foundation CAPES, Caxias Do Sul, Brazil
| | - Anders Larsson
- Department of Medical Sciences, Clinical Chemistry, Uppsala University, Uppsala, Sweden
| | - Ulf Nyman
- Department of Translational Medicine, Division of Medical Radiology, Lund University, Malmö, Sweden
| | - Antoine Lanot
- Normandie Université, Unicaen, CHU de Caen Normandie, Néphrologie, Caen, France
- Normandie Université, Unicaen, UFR de Médecine, 2 Rue Des Rochambelles, Caen, France
- ANTICIPE U1086 INSERM-UCN, Centre François Baclesse, Caen, France
| | - Hans Pottel
- Department of Public Health and Primary Care, KU Leuven Campus Kulak Kortrijk, Kortrijk, Belgium
| | - Pierre Delanaye
- Department of Nephrology-Dialysis-Transplantation, University of Liège (ULg CHU), CHU Sart Tilman, Liège, Belgium
- Department of Nephrology-Dialysis-Apheresis, Hopital Universitaire Caremeau, Nimes, France
| | - Celine Vens
- Department of Public Health and Primary Care, KU Leuven Campus Kulak Kortrijk, Kortrijk, Belgium
- Itec, Imec Research Group at KU Leuven, Kortrijk, Belgium
| |
Collapse
|
2
|
Abbasian Ardakani A, Airom O, Khorshidi H, Bureau NJ, Salvi M, Molinari F, Acharya UR. Interpretation of Artificial Intelligence Models in Healthcare: A Pictorial Guide for Clinicians. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2024. [PMID: 39032010 DOI: 10.1002/jum.16524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2024] [Revised: 06/19/2024] [Accepted: 07/01/2024] [Indexed: 07/22/2024]
Abstract
Artificial intelligence (AI) models can play a more effective role in managing patients with the explosion of digital health records available in the healthcare industry. Machine-learning (ML) and deep-learning (DL) techniques are two methods used to develop predictive models that serve to improve the clinical processes in the healthcare industry. These models are also implemented in medical imaging machines to empower them with an intelligent decision system to aid physicians in their decisions and increase the efficiency of their routine clinical practices. The physicians who are going to work with these machines need to have an insight into what happens in the background of the implemented models and how they work. More importantly, they need to be able to interpret their predictions, assess their performance, and compare them to find the one with the best performance and fewer errors. This review aims to provide an accessible overview of key evaluation metrics for physicians without AI expertise. In this review, we developed four real-world diagnostic AI models (two ML and two DL models) for breast cancer diagnosis using ultrasound images. Then, 23 of the most commonly used evaluation metrics were reviewed uncomplicatedly for physicians. Finally, all metrics were calculated and used practically to interpret and evaluate the outputs of the models. Accessible explanations and practical applications empower physicians to effectively interpret, evaluate, and optimize AI models to ensure safety and efficacy when integrated into clinical practice.
Collapse
Affiliation(s)
- Ali Abbasian Ardakani
- Department of Radiology Technology, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Omid Airom
- Department of Mathematics, University of Padova, Padova, Italy
| | - Hamid Khorshidi
- Department of Information Engineering, University of Padova, Padova, Italy
| | - Nathalie J Bureau
- Department of Radiology, Centre Hospitalier de l'Université de Montréal, Montreal, Quebec, Canada
| | - Massimo Salvi
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Filippo Molinari
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Queensland, Australia
- Centre for Health Research, University of Southern Queensland, Springfield, Queensland, Australia
| |
Collapse
|
3
|
Delanaye P, Pottel H, Cavalier E, Flamant M, Stehlé T, Mariat C. Diagnostic standard: assessing glomerular filtration rate. Nephrol Dial Transplant 2024; 39:1088-1096. [PMID: 37950562 DOI: 10.1093/ndt/gfad241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Indexed: 11/12/2023] Open
Abstract
Creatinine-based estimated glomerular filtration rate (eGFR) is imprecise at individual level, due to non-GFR-related serum creatinine determinants, including atypical muscle mass. Cystatin C has the advantage of being independent of muscle mass, a feature that led to the development of race- and sex-free equations. Yet, cystatin C-based equations do not perform better than creatinine-based equations for estimating GFR unless both variables are included together. The new race-free Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) equation had slight opposite biases between Black and non-Black subjects in the USA, but has poorer performance than that the previous version in European populations. The European Kidney Function Consortium (EKFC) equation developed in 2021 can be used in both children and adults, is more accurate in young and old adults, and is applicable to non-white European populations, by rescaling the Q factor, i.e. population median creatinine, in a potentially universal way. A sex- and race-free cystatin C-based EKFC, with the same mathematical design, has also be defined. New developments in the field of GFR estimation would be standardization of cystatin C assays, development of creatinine-based eGFR equations that incorporate muscle mass data, implementation of new endogenous biomarkers and the use of artificial intelligence. Standardization of different GFR measurement methods would also be a future challenge, as well as new technologies for measuring GFR. Future research is also needed into discrepancies between cystatin C and creatinine, which is associated with high risk of adverse events: we need to standardize the definition of discrepancy and understand its determinants.
Collapse
Affiliation(s)
- Pierre Delanaye
- Department of Nephrology-Dialysis-Transplantation, University of Liège (ULiege), CHU Sart Tilman, Liège, Belgium
- Department of Nephrology-Dialysis-Apheresis, Hôpital Universitaire Carémeau, Nîmes, France
| | - Hans Pottel
- Department of Public Health and Primary Care, KU Leuven Campus Kulak Kortrijk, Kortrijk, Belgium
| | - Etienne Cavalier
- Department of Clinical Chemistry, University of Liège (ULiege), CHU Sart Tilman, Liège, Belgium
| | - Martin Flamant
- Assistance Publique-Hôpitaux de Paris, Bichat Hospital, and Université Paris Cité, UMR 1149, Paris, France
| | - Thomas Stehlé
- Assistance Publique-Hôpitaux de Paris, Hôpitaux Universitaires Henri Mondor, Service de Néphrologie et Transplantation, Fédération Hospitalo-Universitaire « Innovative therapy for immune disorders », Créteil, France
| | - Christophe Mariat
- Service de Néphrologie, Dialyse et Transplantation Rénale, Hôpital Nord, CHU de Saint-Etienne, France
| |
Collapse
|
4
|
Wang Y, Shi Y, Xiao T, Bi X, Huo Q, Wang S, Xiong J, Zhao J. A Klotho-Based Machine Learning Model for Prediction of both Kidney and Cardiovascular Outcomes in Chronic Kidney Disease. KIDNEY DISEASES (BASEL, SWITZERLAND) 2024; 10:200-212. [PMID: 38835404 PMCID: PMC11149992 DOI: 10.1159/000538510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Accepted: 03/18/2024] [Indexed: 06/06/2024]
Abstract
Introduction This study aimed to develop and validate machine learning (ML) models based on serum Klotho for predicting end-stage kidney disease (ESKD) and cardiovascular disease (CVD) in patients with chronic kidney disease (CKD). Methods Five different ML models were trained to predict the risk of ESKD and CVD at three different time points (3, 5, and 8 years) using a cohort of 400 non-dialysis CKD patients. The dataset was divided into a training set (70%) and an internal validation set (30%). These models were informed by data comprising 47 clinical features, including serum Klotho. The best-performing model was selected and used to identify risk factors for each outcome. Model performance was assessed using various metrics. Results The findings showed that the least absolute shrinkage and selection operator regression model had the highest accuracy (C-index = 0.71) in predicting ESKD. The features mainly included in this model were estimated glomerular filtration rate, 24-h urinary microalbumin, serum albumin, phosphate, parathyroid hormone, and serum Klotho, which achieved the highest area under the curve (AUC) of 0.930 (95% CI: 0.897-0.962). In addition, for the CVD risk prediction, the random survival forest model with the highest accuracy (C-index = 0.66) was selected and achieved the highest AUC of 0.782 (95% CI: 0.633-0.930). The features mainly included in this model were age, history of primary hypertension, calcium, tumor necrosis factor-alpha, and serum Klotho. Conclusion We successfully developed and validated Klotho-based ML risk prediction models for CVD and ESKD in CKD patients with good performance, indicating their high clinical utility.
Collapse
Affiliation(s)
- Yating Wang
- Department of Nephrology, The Key Laboratory for the Prevention and Treatment of Chronic Kidney Disease of Chongqing, Kidney Center of PLA, Xinqiao Hospital, Army Medical University (Third Military Medical University), Chongqing, PR China
| | - Yu Shi
- Department of Nephrology, The Key Laboratory for the Prevention and Treatment of Chronic Kidney Disease of Chongqing, Kidney Center of PLA, Xinqiao Hospital, Army Medical University (Third Military Medical University), Chongqing, PR China
| | - Tangli Xiao
- Department of Nephrology, The Key Laboratory for the Prevention and Treatment of Chronic Kidney Disease of Chongqing, Kidney Center of PLA, Xinqiao Hospital, Army Medical University (Third Military Medical University), Chongqing, PR China
| | - Xianjin Bi
- Department of Nephrology, The Key Laboratory for the Prevention and Treatment of Chronic Kidney Disease of Chongqing, Kidney Center of PLA, Xinqiao Hospital, Army Medical University (Third Military Medical University), Chongqing, PR China
| | - Qingyu Huo
- Department of Nephrology, The Key Laboratory for the Prevention and Treatment of Chronic Kidney Disease of Chongqing, Kidney Center of PLA, Xinqiao Hospital, Army Medical University (Third Military Medical University), Chongqing, PR China
| | - Shaobo Wang
- Department of Nephrology, The Key Laboratory for the Prevention and Treatment of Chronic Kidney Disease of Chongqing, Kidney Center of PLA, Xinqiao Hospital, Army Medical University (Third Military Medical University), Chongqing, PR China
| | - Jiachuan Xiong
- Department of Nephrology, The Key Laboratory for the Prevention and Treatment of Chronic Kidney Disease of Chongqing, Kidney Center of PLA, Xinqiao Hospital, Army Medical University (Third Military Medical University), Chongqing, PR China
| | - Jinghong Zhao
- Department of Nephrology, The Key Laboratory for the Prevention and Treatment of Chronic Kidney Disease of Chongqing, Kidney Center of PLA, Xinqiao Hospital, Army Medical University (Third Military Medical University), Chongqing, PR China
| |
Collapse
|
5
|
Alshanberi AM, Mousa AH, Hashim SA, Almutairi RS, Alrehali S, Hamisu AM, Shaikhomer M, Ansari SA. Knowledge and Perception of Artificial Intelligence among Faculty Members and Students at Batterjee Medical College. JOURNAL OF PHARMACY AND BIOALLIED SCIENCES 2024; 16:S1815-S1820. [PMID: 38882896 PMCID: PMC11174240 DOI: 10.4103/jpbs.jpbs_1162_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 01/21/2024] [Accepted: 02/01/2024] [Indexed: 06/18/2024] Open
Abstract
Background Mounting research suggests that artificial intelligence (AI) is one of the innovations that aid in the patient's diagnosis and treatment, but unfortunately limited research has been conducted in this regard in the Kingdom of Saudi Arabia (KSA). Hence, this study aimed to assess the level of knowledge and awareness of AI among faculty members and medicine students in one of the premier medical colleges in KSA. Methods A cross-sectional descriptive study was conducted at Batterjee Medical College (BMC), Jeddah (KSA), from November 2022 to April 2023. Result A total of 131 participants contributed to our study, of which three were excluded due to incomplete responses, thereby giving a response rate of 98%. Conclusion 85.4% of the respondents believe that AI has a positive impact on the healthcare system and physicians in general. Hence, there should be a mandatory course in medical schools that can prepare future doctors to diagnose patients more accurately, make predictions about patients' future health, and recommend better treatments.
Collapse
Affiliation(s)
- Asim M Alshanberi
- Department of Community Medicine and Pilgrims Health Care, Umm Al-Qura University, Makkah, Saudi Arabia
| | - Ahmed H Mousa
- Department of Neurosurgery, Graduate Medical Education, Mohammed Bin Rashid University (MBRU), Dubai Health, Dubai, United Arab Emirates
- Department of Neurosurgery, Rashid Hospital, Dubai Health, Dubai, United Arab Emirates
- General Medicine Practice Program, Batterjee Medical College, Jeddah, Saudi Arabia
| | - Sama A Hashim
- General Medicine Practice Program, Batterjee Medical College, Jeddah, Saudi Arabia
| | - Reem S Almutairi
- General Medicine Practice Program, Batterjee Medical College, Jeddah, Saudi Arabia
| | - Sara Alrehali
- General Medicine Practice Program, Batterjee Medical College, Jeddah, Saudi Arabia
| | - Aisha M Hamisu
- General Medicine Practice Program, Batterjee Medical College, Jeddah, Saudi Arabia
| | - Mohammed Shaikhomer
- Department of Internal Medicine, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Shakeel A Ansari
- Department of Biochemistry, General Medicine Practice Program, Batterjee Medical College, Jeddah, Saudi Arabia
| |
Collapse
|
6
|
Oh SW, Byun SS, Kim JK, Jeong CW, Kwak C, Hwang EC, Kang SH, Chung J, Kim YJ, Ha YS, Hong SH. Machine learning models for predicting the onset of chronic kidney disease after surgery in patients with renal cell carcinoma. BMC Med Inform Decis Mak 2024; 24:85. [PMID: 38519947 PMCID: PMC10960396 DOI: 10.1186/s12911-024-02473-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 03/03/2024] [Indexed: 03/25/2024] Open
Abstract
BACKGROUND Patients with renal cell carcinoma (RCC) have an elevated risk of chronic kidney disease (CKD) following nephrectomy. Therefore, continuous monitoring and subsequent interventions are necessary. It is recommended to evaluate renal function postoperatively. Therefore, a tool to predict CKD onset is essential for postoperative follow-up and management. METHODS We constructed a cohort using data from eight tertiary hospitals from the Korean Renal Cell Carcinoma (KORCC) database. A dataset of 4389 patients with RCC was constructed for analysis from the collected data. Nine machine learning (ML) models were used to classify the occurrence and nonoccurrence of CKD after surgery. The final model was selected based on the area under the receiver operating characteristic (AUROC), and the importance of the variables constituting the model was confirmed using the shapley additive explanation (SHAP) value and Kaplan-Meier survival analyses. RESULTS The gradient boost algorithm was the most effective among the various ML models tested. The gradient boost model demonstrated superior performance with an AUROC of 0.826. The SHAP value confirmed that preoperative eGFR, albumin level, and tumor size had a significant impact on the occurrence of CKD after surgery. CONCLUSIONS We developed a model to predict CKD onset after surgery in patients with RCC. This predictive model is a quantitative approach to evaluate post-surgical CKD risk in patients with RCC, facilitating improved prognosis through personalized postoperative care.
Collapse
Affiliation(s)
- Seol Whan Oh
- Department of Medical Informatics, College of Medicine, The Catholic University of Korea, 06591, Seoul, Korea
- Department of Biomedicine & Health Sciences, The Catholic University of Korea, 06591, Seoul, Korea
| | - Seok-Soo Byun
- Department of Urology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, 13620, Seongnam, Korea
| | - Jung Kwon Kim
- Department of Urology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, 13620, Seongnam, Korea
| | - Chang Wook Jeong
- Department of Urology, Seoul National University College of Medicine, Seoul National University Hospital, 03080, Seoul, Korea
| | - Cheol Kwak
- Department of Urology, Seoul National University College of Medicine, Seoul National University Hospital, 03080, Seoul, Korea
| | - Eu Chang Hwang
- Department of Urology, Chonnam National University Medical School, 61469, Gwangju, Korea
| | - Seok Ho Kang
- Department of Urology, Korea University School of Medicine, 02841, Seoul, Korea
| | - Jinsoo Chung
- Department of Urology, National Cancer Center, 10408, Goyang, Korea
| | - Yong-June Kim
- Department of Urology, Chungbuk National University College of Medicine, 28644, Cheongju, Korea
- Department of Urology, College of Medicine, Chungbuk National University, 28644, Cheongju, Korea
| | - Yun-Sok Ha
- Department of Urology, School of Medicine, Kyungpook National University Chilgok Hospital, Kyungpook National University, 41404, Daegu, Korea
| | - Sung-Hoo Hong
- Department of Urology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea.
| |
Collapse
|
7
|
Shi S, Gao L, Zhang J, Zhang B, Xiao J, Xu W, Tian Y, Ni L, Wu X. The automatic detection of diabetic kidney disease from retinal vascular parameters combined with clinical variables using artificial intelligence in type-2 diabetes patients. BMC Med Inform Decis Mak 2023; 23:241. [PMID: 37904184 PMCID: PMC10617171 DOI: 10.1186/s12911-023-02343-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Accepted: 10/16/2023] [Indexed: 11/01/2023] Open
Abstract
BACKGROUND Diabetic kidney disease (DKD) has become the largest cause of end-stage kidney disease. Early and accurate detection of DKD is beneficial for patients. The present detection depends on the measurement of albuminuria or the estimated glomerular filtration rate, which is invasive and not optimal; therefore, new detection tools are urgently needed. Meanwhile, a close relationship between diabetic retinopathy and DKD has been reported; thus, we aimed to develop a novel detection algorithm for DKD using artificial intelligence technology based on retinal vascular parameters combined with several easily available clinical parameters in patients with type-2 diabetes. METHODS A total of 515 consecutive patients with type-2 diabetes mellitus from Xiangyang Central Hospital were included. Patients were stratified by DKD diagnosis and split randomly into either the training set (70%, N = 360) or the testing set (30%, N = 155) (random seed = 1). Data from the training set were used to develop the machine learning algorithm (MLA), while those from the testing set were used to validate the MLA. Model performances were evaluated. RESULTS The MLA using the random forest classifier presented optimal performance compared with other classifiers. When validated, the accuracy, sensitivity, specificity, F1 score, and AUC for the optimal model were 84.5%(95% CI 83.3-85.7), 84.5%(82.3-86.7), 84.5%(82.7-86.3), 0.845(0.831-0.859), and 0.914(0.903-0.925), respectively. CONCLUSIONS A new machine learning algorithm for DKD diagnosis based on fundus images and 8 easily available clinical parameters was developed, which indicated that retinal vascular changes can assist in DKD screening and detection.
Collapse
Affiliation(s)
- Shaomin Shi
- Department of Nephrology, Zhongnan Hospital of Wuhan University, 169 Donghu Road, Wuhan, 430071, Hubei, China
- Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang, Hubei, 441000, China
| | - Ling Gao
- Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang, Hubei, 441000, China
| | - Juan Zhang
- Department of Nephrology, Zhongnan Hospital of Wuhan University, 169 Donghu Road, Wuhan, 430071, Hubei, China
| | - Baifang Zhang
- Department of Biochemistry, Wuhan University TaiKang Medical School (School of Basic Medical Sciences), Wuhan, 430071, Hubei, China
| | - Jing Xiao
- Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang, Hubei, 441000, China
| | - Wan Xu
- Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang, Hubei, 441000, China
| | - Yuan Tian
- Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang, Hubei, 441000, China.
| | - Lihua Ni
- Department of Nephrology, Zhongnan Hospital of Wuhan University, 169 Donghu Road, Wuhan, 430071, Hubei, China.
| | - Xiaoyan Wu
- Department of Nephrology, Zhongnan Hospital of Wuhan University, 169 Donghu Road, Wuhan, 430071, Hubei, China.
- Department of General Practice, Zhongnan Hospital of Wuhan University, 169 Donghu Road, Wuhan, 430071, Hubei, China.
| |
Collapse
|
8
|
Kotsis F, Bächle H, Altenbuchinger M, Dönitz J, Njipouombe Nsangou YA, Meiselbach H, Kosch R, Salloch S, Bratan T, Zacharias HU, Schultheiss UT. Expectation of clinical decision support systems: a survey study among nephrologist end-users. BMC Med Inform Decis Mak 2023; 23:239. [PMID: 37884906 PMCID: PMC10605935 DOI: 10.1186/s12911-023-02317-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 09/29/2023] [Indexed: 10/28/2023] Open
Abstract
BACKGROUND Chronic kidney disease (CKD), a major public health problem with differing disease etiologies, leads to complications, comorbidities, polypharmacy, and mortality. Monitoring disease progression and personalized treatment efforts are crucial for long-term patient outcomes. Physicians need to integrate different data levels, e.g., clinical parameters, biomarkers, and drug information, with medical knowledge. Clinical decision support systems (CDSS) can tackle these issues and improve patient management. Knowledge about the awareness and implementation of CDSS in Germany within the field of nephrology is scarce. PURPOSE Nephrologists' attitude towards any CDSS and potential CDSS features of interest, like adverse event prediction algorithms, is important for a successful implementation. This survey investigates nephrologists' experiences with and expectations towards a useful CDSS for daily medical routine in the outpatient setting. METHODS The 38-item questionnaire survey was conducted either by telephone or as a do-it-yourself online interview amongst nephrologists across all of Germany. Answers were collected and analysed using the Electronic Data Capture System REDCap, as well as Stata SE 15.1, and Excel. The survey consisted of four modules: experiences with CDSS (M1), expectations towards a helpful CDSS (M2), evaluation of adverse event prediction algorithms (M3), and ethical aspects of CDSS (M4). Descriptive statistical analyses of all questions were conducted. RESULTS The study population comprised 54 physicians, with a response rate of about 80-100% per question. Most participants were aged between 51-60 years (45.1%), 64% were male, and most participants had been working in nephrology out-patient clinics for a median of 10.5 years. Overall, CDSS use was poor (81.2%), often due to lack of knowledge about existing CDSS. Most participants (79%) believed CDSS to be helpful in the management of CKD patients with a high willingness to try out a CDSS. Of all adverse event prediction algorithms, prediction of CKD progression (97.8%) and in-silico simulations of disease progression when changing, e. g., lifestyle or medication (97.7%) were rated most important. The spectrum of answers on ethical aspects of CDSS was diverse. CONCLUSION This survey provides insights into experience with and expectations of out-patient nephrologists on CDSS. Despite the current lack of knowledge on CDSS, the willingness to integrate CDSS into daily patient care, and the need for adverse event prediction algorithms was high.
Collapse
Affiliation(s)
- Fruzsina Kotsis
- Institute of Genetic Epidemiology, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany
- Department of Medicine IV - Nephrology and Primary Care, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany
| | - Helena Bächle
- Institute of Genetic Epidemiology, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany
| | - Michael Altenbuchinger
- Department of Medical Bioinformatics, University Medical Center Göttingen, Göttingen, Germany
| | - Jürgen Dönitz
- Department of Medical Bioinformatics, University Medical Center Göttingen, Göttingen, Germany
- Institute of Computational Biology, Helmholtz Zentrum München, Munich, Germany
| | | | - Heike Meiselbach
- Department of Nephrology and Hypertension, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Robin Kosch
- Department of Medical Bioinformatics, University Medical Center Göttingen, Göttingen, Germany
| | - Sabine Salloch
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School, Hanover, Germany
| | - Tanja Bratan
- Competence Center Emerging Technologies, Fraunhofer Institute for Systems and Innovation Research ISI, Karlsruhe, Germany
| | - Helena U Zacharias
- Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, Hanover, Germany
| | - Ulla T Schultheiss
- Institute of Genetic Epidemiology, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany.
- Department of Medicine IV - Nephrology and Primary Care, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany.
| |
Collapse
|
9
|
Layton AT. "Hi, how can i help you?": embracing artificial intelligence in kidney research. Am J Physiol Renal Physiol 2023; 325:F395-F406. [PMID: 37589052 DOI: 10.1152/ajprenal.00177.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Revised: 08/08/2023] [Accepted: 08/09/2023] [Indexed: 08/18/2023] Open
Abstract
In recent years, biology and precision medicine have benefited from major advancements in generating large-scale molecular and biomedical datasets and in analyzing those data using advanced machine learning algorithms. Machine learning applications in kidney physiology and pathophysiology include segmenting kidney structures from imaging data and predicting conditions like acute kidney injury or chronic kidney disease using electronic health records. Despite the potential of machine learning to revolutionize nephrology by providing innovative diagnostic and therapeutic tools, its adoption in kidney research has been slower than in other organ systems. Several factors contribute to this underutilization. The complexity of the kidney as an organ, with intricate physiology and specialized cell populations, makes it challenging to extrapolate bulk omics data to specific processes. In addition, kidney diseases often present with overlapping manifestations and morphological changes, making diagnosis and treatment complex. Moreover, kidney diseases receive less funding compared with other pathologies, leading to lower awareness and limited public-private partnerships. To promote the use of machine learning in kidney research, this review provides an introduction to machine learning and reviews its notable applications in renal research, such as morphological analysis, omics data examination, and disease diagnosis and prognosis. Challenges and limitations associated with data-driven predictive techniques are also discussed. The goal of this review is to raise awareness and encourage the kidney research community to embrace machine learning as a powerful tool that can drive advancements in understanding kidney diseases and improving patient care.
Collapse
Affiliation(s)
- Anita T Layton
- Department of Applied Mathematics, University of Waterloo, Waterloo, Ontario, Canada
- Department of Biology, University of Waterloo, Waterloo, Ontario, Canada
- Cheriton School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada
- School of Pharmacology, University of Waterloo, Waterloo, Ontario, Canada
| |
Collapse
|
10
|
Yan X, Li X, Lu Y, Ma D, Mou S, Cheng Z, Ding Y, Yan B, Zhang X, Hu G. Establishment and Evaluation of Artificial Intelligence-Based Prediction Models for Chronic Kidney Disease under the Background of Big Data. EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE : ECAM 2022; 2022:6561721. [PMID: 35845598 PMCID: PMC9286960 DOI: 10.1155/2022/6561721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Revised: 06/22/2022] [Accepted: 06/23/2022] [Indexed: 11/19/2022]
Abstract
Objective To establish a prediction model for the risk evaluation of chronic kidney disease (CKD) to guide the management and prevention of CKD. Methods A total of 1263 patients with CKD and 1948 patients without CKD admitted to the Tongde Hospital of the Zhejiang Province from January 1, 2008, to December 31, 2018, were retrospectively analyzed. Spearman's correlation was used to analyze the relationship between CKD and laboratory parameters. XGBoost, random forest, Naive Bayes, support vector machine, and multivariate logistic regression algorithms were employed to establish prediction models for the risk evaluation of CKD. The accuracy, precision, recall, F1 score, and area under the receiver operating curve (AUC) of each model were compared. The new bidirectional encoder representations from transformers with light gradient boosting machine (MD-BERT-LGBM) model was used to process the unstructured data and transform it into researchable unstructured vectors, and the AUC was compared before and after processing. Results Differences in laboratory parameters between CKD and non-CKD patients were observed. The neutrophil ratio and white blood cell count were significantly associated with the occurrence of CKD. The XGBoost model demonstrated the best prediction effect (accuracy = 0.9088, precision = 0.9175, recall = 0.8244, F1 score = 0.8868, AUC = 0.8244), followed by the random forest model (accuracy = 0.9020, precision = 0.9318, recall = 0.7905, F1 score = 0.581, AUC = 0.9519). Comparatively, the predictions of the Naive Bayes and support vector machine models were inferior to those of the logistic regression model. The AUC of all models was improved to some extent after processing using the new MD-BERT-LGBM model. Conclusion The new MD-BERT-LGBM model with the inclusion of unstructured data has contributed to the higher accuracy, sensitivity, and specificity of the prediction models. Clinical features such as age, gender, urinary white blood cells, urinary red blood cells, thrombin time, serum creatinine, and total cholesterol were associated with CKD incidence.
Collapse
Affiliation(s)
- Xiaoqian Yan
- Department of Nephropathy, Tongde Hospital of Zhejiang Province, Hangzhou, Zhejiang 310012, China
| | - Ximin Li
- Department of Nephropathy, Tongde Hospital of Zhejiang Province, Hangzhou, Zhejiang 310012, China
| | - Ying Lu
- Department of Nephropathy, Tongde Hospital of Zhejiang Province, Hangzhou, Zhejiang 310012, China
| | - Dongfang Ma
- School of Micro-Nanoelectronics, Zhejiang University, Hangzhou, Zhejiang 310058, China
| | - Shenghong Mou
- School of Micro-Nanoelectronics, Zhejiang University, Hangzhou, Zhejiang 310058, China
| | - Zhiyuan Cheng
- School of Micro-Nanoelectronics, Zhejiang University, Hangzhou, Zhejiang 310058, China
| | - Yuan Ding
- Network Information Center, Tongde Hospital of Zhejiang Province, Hangzhou, Zhejiang 310012, China
| | - Bin Yan
- Network Information Center, Tongde Hospital of Zhejiang Province, Hangzhou, Zhejiang 310012, China
| | - Xianzhen Zhang
- Department of Nephropathy, Tongde Hospital of Zhejiang Province, Hangzhou, Zhejiang 310012, China
| | - Gang Hu
- Department of Nephropathy, Tongde Hospital of Zhejiang Province, Hangzhou, Zhejiang 310012, China
| |
Collapse
|