1
|
Teshale AB, Htun HL, Vered M, Owen AJ, Freak-Poli R. A Systematic Review of Artificial Intelligence Models for Time-to-Event Outcome Applied in Cardiovascular Disease Risk Prediction. J Med Syst 2024; 48:68. [PMID: 39028429 PMCID: PMC11271333 DOI: 10.1007/s10916-024-02087-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2024] [Accepted: 07/09/2024] [Indexed: 07/20/2024]
Abstract
Artificial intelligence (AI) based predictive models for early detection of cardiovascular disease (CVD) risk are increasingly being utilised. However, AI based risk prediction models that account for right-censored data have been overlooked. This systematic review (PROSPERO protocol CRD42023492655) includes 33 studies that utilised machine learning (ML) and deep learning (DL) models for survival outcome in CVD prediction. We provided details on the employed ML and DL models, eXplainable AI (XAI) techniques, and type of included variables, with a focus on social determinants of health (SDoH) and gender-stratification. Approximately half of the studies were published in 2023 with the majority from the United States. Random Survival Forest (RSF), Survival Gradient Boosting models, and Penalised Cox models were the most frequently employed ML models. DeepSurv was the most frequently employed DL model. DL models were better at predicting CVD outcomes than ML models. Permutation-based feature importance and Shapley values were the most utilised XAI methods for explaining AI models. Moreover, only one in five studies performed gender-stratification analysis and very few incorporate the wide range of SDoH factors in their prediction model. In conclusion, the evidence indicates that RSF and DeepSurv models are currently the optimal models for predicting CVD outcomes. This study also highlights the better predictive ability of DL survival models, compared to ML models. Future research should ensure the appropriate interpretation of AI models, accounting for SDoH, and gender stratification, as gender plays a significant role in CVD occurrence.
Collapse
Affiliation(s)
- Achamyeleh Birhanu Teshale
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
- Department of Epidemiology and Biostatistics, Institute of Public Health, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia
| | - Htet Lin Htun
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
| | - Mor Vered
- Department of Data Science and AI, Faculty of Information Technology, Monash University, Clayton, VIC, Australia
| | - Alice J Owen
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
| | - Rosanne Freak-Poli
- School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia.
- Stroke and Ageing Research, Department of Medicine, School of Clinical Sciences at Monash Health, Monash University, Melbourne, VIC, Australia.
| |
Collapse
|
2
|
Collins GS, Moons KGM, Dhiman P, Riley RD, Beam AL, Van Calster B, Ghassemi M, Liu X, Reitsma JB, van Smeden M, Boulesteix AL, Camaradou JC, Celi LA, Denaxas S, Denniston AK, Glocker B, Golub RM, Harvey H, Heinze G, Hoffman MM, Kengne AP, Lam E, Lee N, Loder EW, Maier-Hein L, Mateen BA, McCradden MD, Oakden-Rayner L, Ordish J, Parnell R, Rose S, Singh K, Wynants L, Logullo P. TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ 2024; 385:e078378. [PMID: 38626948 PMCID: PMC11019967 DOI: 10.1136/bmj-2023-078378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/17/2024] [Indexed: 04/19/2024]
Affiliation(s)
- Gary S Collins
- Centre for Statistics in Medicine, UK EQUATOR Centre, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK
| | - Karel G M Moons
- Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands
| | - Paula Dhiman
- Centre for Statistics in Medicine, UK EQUATOR Centre, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK
| | - Richard D Riley
- Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
- National Institute for Health and Care Research (NIHR) Birmingham Biomedical Research Centre, Birmingham, UK
| | - Andrew L Beam
- Department of Epidemiology, Harvard T H Chan School of Public Health, Boston, MA, USA
| | - Ben Van Calster
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
- Department of Biomedical Data Science, Leiden University Medical Centre, Leiden, Netherlands
| | - Marzyeh Ghassemi
- Department of Electrical Engineering and Computer Science, Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Xiaoxuan Liu
- Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Johannes B Reitsma
- Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands
| | - Maarten van Smeden
- Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands
| | - Anne-Laure Boulesteix
- Institute for Medical Information Processing, Biometry and Epidemiology, Faculty of Medicine, Ludwig-Maximilians-University of Munich and Munich Centre of Machine Learning, Germany
| | - Jennifer Catherine Camaradou
- Patient representative, Health Data Research UK patient and public involvement and engagement group
- Patient representative, University of East Anglia, Faculty of Health Sciences, Norwich Research Park, Norwich, UK
| | - Leo Anthony Celi
- Beth Israel Deaconess Medical Center, Boston, MA, USA
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Biostatistics, Harvard T H Chan School of Public Health, Boston, MA, USA
| | - Spiros Denaxas
- Institute of Health Informatics, University College London, London, UK
- British Heart Foundation Data Science Centre, London, UK
| | - Alastair K Denniston
- National Institute for Health and Care Research (NIHR) Birmingham Biomedical Research Centre, Birmingham, UK
- Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
| | - Ben Glocker
- Department of Computing, Imperial College London, London, UK
| | - Robert M Golub
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | | | - Georg Heinze
- Section for Clinical Biometrics, Centre for Medical Data Science, Medical University of Vienna, Vienna, Austria
| | - Michael M Hoffman
- Princess Margaret Cancer Centre, University Health Network, Toronto, ON, Canada
- Department of Medical Biophysics, University of Toronto, Toronto, ON, Canada
- Department of Computer Science, University of Toronto, Toronto, ON, Canada
- Vector Institute for Artificial Intelligence, Toronto, ON, Canada
| | | | - Emily Lam
- Patient representative, Health Data Research UK patient and public involvement and engagement group
| | - Naomi Lee
- National Institute for Health and Care Excellence, London, UK
| | - Elizabeth W Loder
- The BMJ, London, UK
- Department of Neurology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Lena Maier-Hein
- Department of Intelligent Medical Systems, German Cancer Research Centre, Heidelberg, Germany
| | - Bilal A Mateen
- Institute of Health Informatics, University College London, London, UK
- Wellcome Trust, London, UK
- Alan Turing Institute, London, UK
| | - Melissa D McCradden
- Department of Bioethics, Hospital for Sick Children Toronto, ON, Canada
- Genetics and Genome Biology, SickKids Research Institute, Toronto, ON, Canada
| | - Lauren Oakden-Rayner
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, SA, Australia
| | - Johan Ordish
- Medicines and Healthcare products Regulatory Agency, London, UK
| | - Richard Parnell
- Patient representative, Health Data Research UK patient and public involvement and engagement group
| | - Sherri Rose
- Department of Health Policy and Center for Health Policy, Stanford University, Stanford, CA, USA
| | - Karandeep Singh
- Department of Epidemiology, CAPHRI Care and Public Health Research Institute, Maastricht University, Maastricht, Netherlands
| | - Laure Wynants
- Department of Epidemiology, CAPHRI Care and Public Health Research Institute, Maastricht University, Maastricht, Netherlands
| | - Patricia Logullo
- Centre for Statistics in Medicine, UK EQUATOR Centre, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK
| |
Collapse
|
3
|
Mani K, Kleinbart E, Schlumprecht A, Golding R, Akioyamen N, Song H, De La Garza Ramos R, Eleswarapu A, Yang R, Geller D, Hoang B, Fourman MS. Association of Socioeconomic Status With Worse Overall Survival in Patients With Bone and Joint Cancer. J Am Acad Orthop Surg 2024; 32:e346-e355. [PMID: 38354415 DOI: 10.5435/jaaos-d-23-00718] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Accepted: 12/25/2023] [Indexed: 02/16/2024] Open
Abstract
BACKGROUND The effect of socioeconomic status (SES) on the outcomes of patients with metastatic cancer to bone has not been adequately studied. We analyzed the association between the Yost Index, a composite geocoded SES score, and overall survival among patients who underwent nonprimary surgical resection for bone metastases. METHODS This population-based study used data from the National Cancer Institute's Surveillance, Epidemiology, and End Results database (2010 to 2018). We categorized bone and joint sites using International Classification of Disease-O-3 recodes. The Yost Index was geocoded using a factor analysis and categorized into quintiles using census tract-level American Community Service 5-year estimates and seven measures: median household income, median house value, median rent, percent below 150% of the poverty line, education index, percent working class, and percent unemployed. Multivariate Cox regression models were used to calculate adjusted hazard ratios of overall survival and 95% confidence intervals. RESULTS A total of 138,158 patients were included. Patients with the lowest SES had 34% higher risk of mortality compared with those with the highest SES (adjusted hazard ratio of 1.34, 95% confidence interval: 1.32 to 1.37, P < 0.001). Among patients who underwent nonprimary surgery of the distant bone tumor (n = 11,984), the age-adjusted mortality rate was 31.3% higher in the lowest SES patients compared with the highest SES patients (9.9 versus 6.8 per 100,000, P < 0.001). Patients in the lowest SES group showed more racial heterogeneity (63.0% White, 33.5% Black, 3.1% AAPI) compared with the highest SES group (83.9% White, 4.0% Black, 11.8% AAPI, P < 0.001). Higher SES patients are more likely to be married (77.5% versus 59.0%, P < 0.0001) and to live in metropolitan areas (99.6% versus 73.6%, P < 0.0001) compared with lower SES patients. DISCUSSION Our results may have implications for developing interventions to improve access and quality of care for patients from lower SES backgrounds, ultimately reducing disparities in orthopaedic surgery.
Collapse
Affiliation(s)
- Kyle Mani
- From the Albert Einstein College of Medicine (Mani, Kleinbart, Golding, and Song), the Department of Neurological Surgery, Montefiore Einstein (Schlumprecht, and De La Garza Ramos), and the Department of Orthopaedic Surgery, Montefiore Einstein, Bronx, NY (Akioyamen, Eleswarapu, Yang, Geller, Hoang, and Fourman)
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
4
|
Adams MCB, Nelson AM, Narouze S. Daring discourse: artificial intelligence in pain medicine, opportunities and challenges. Reg Anesth Pain Med 2023; 48:439-442. [PMID: 37169486 PMCID: PMC10525018 DOI: 10.1136/rapm-2023-104526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2023] [Accepted: 04/28/2023] [Indexed: 05/13/2023]
Abstract
Artificial intelligence (AI) tools are currently expanding their influence within healthcare. For pain clinics, unfettered introduction of AI may cause concern in both patients and healthcare teams. Much of the concern stems from the lack of community standards and understanding of how the tools and algorithms function. Data literacy and understanding can be challenging even for experienced healthcare providers as these topics are not incorporated into standard clinical education pathways. Another reasonable concern involves the potential for encoding bias in healthcare screening and treatment using faulty algorithms. And yet, the massive volume of data generated by healthcare encounters is increasingly challenging for healthcare teams to navigate and will require an intervention to make the medical record manageable in the future. AI approaches that lighten the workload and support clinical decision-making may provide a solution to the ever-increasing menial tasks involved in clinical care. The potential for pain providers to have higher-quality connections with their patients and manage multiple complex data sources might balance the understandable concerns around data quality and decision-making that accompany introduction of AI. As a specialty, pain medicine will need to establish thoughtful and intentionally integrated AI tools to help clinicians navigate the changing landscape of patient care.
Collapse
Affiliation(s)
- Meredith C B Adams
- Departments of Anesthesiology, Biomedical Informatics, Physiology & Pharmacology, and Public Health Sciences, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA
| | - Ariana M Nelson
- Department of Anesthesiology and Perioperative Care, University of California Irvine, Irvine, California, USA
| | | |
Collapse
|