1
|
Rosselló-Jiménez D, Docampo S, Collado Y, Cuadra-Llopart L, Riba F, Llonch-Masriera M. Geriatrics and artificial intelligence in Spain (Ger-IA project): talking to ChatGPT, a nationwide survey. Eur Geriatr Med 2024; 15:1129-1136. [PMID: 38615289 DOI: 10.1007/s41999-024-00970-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2023] [Accepted: 03/04/2024] [Indexed: 04/15/2024]
Abstract
PURPOSE The purposes of the study was to describe the degree of agreement between geriatricians with the answers given by an AI tool (ChatGPT) in response to questions related to different areas in geriatrics, to study the differences between specialists and residents in geriatrics in terms of the degree of agreement with ChatGPT, and to analyse the mean scores obtained by areas of knowledge/domains. METHODS An observational study was conducted involving 126 doctors from 41 geriatric medicine departments in Spain. Ten questions about geriatric medicine were posed to ChatGPT, and doctors evaluated the AI's answers using a Likert scale. Sociodemographic variables were included. Questions were categorized into five knowledge domains, and means and standard deviations were calculated for each. RESULTS 130 doctors answered the questionnaire. 126 doctors (69.8% women, mean age 41.4 [9.8]) were included in the final analysis. The mean score obtained by ChatGPT was 3.1/5 [0.67]. Specialists rated ChatGPT lower than residents (3.0/5 vs. 3.3/5 points, respectively, P < 0.05). By domains, ChatGPT scored better (M: 3.96; SD: 0.71) in general/theoretical questions rather than in complex decisions/end-of-life situations (M: 2.50; SD: 0.76) and answers related to diagnosis/performing of complementary tests obtained the lowest ones (M: 2.48; SD: 0.77). CONCLUSION Scores presented big variability depending on the area of knowledge. Questions related to theoretical aspects of challenges/future in geriatrics obtained better scores. When it comes to complex decision-making, appropriateness of the therapeutic efforts or decisions about diagnostic tests, professionals indicated a poorer performance. AI is likely to be incorporated into some areas of medicine, but it would still present important limitations, mainly in complex medical decision-making.
Collapse
Affiliation(s)
- Daniel Rosselló-Jiménez
- Geriatric Medicine Department, Hospital Universitari de Terrassa, Consorci Sanitari de Terrassa, Carr. Torrebonica, s/n, Terrassa, 08227, Barcelona, Spain.
| | - S Docampo
- Geriatric Medicine Department, Hospital Santa Creu, Tortosa, Tortosa, Tarragona, Spain
| | - Y Collado
- Geriatric Medicine Department, Hospital Universitari de Terrassa, Consorci Sanitari de Terrassa, Carr. Torrebonica, s/n, Terrassa, 08227, Barcelona, Spain
| | - L Cuadra-Llopart
- Geriatric Medicine Department, Hospital Universitari de Terrassa, Consorci Sanitari de Terrassa, Carr. Torrebonica, s/n, Terrassa, 08227, Barcelona, Spain
- Faculty of Medicine and Health Sciences, Universitat Internacional de Catalunya (UIC), Barcelona, Spain
- ACTIUM Functional Anatomy Group, Universitat Internacional de Catalunya (UIC), Barcelona, Spain
| | - F Riba
- Geriatric Medicine Department, Hospital Santa Creu, Tortosa, Tortosa, Tarragona, Spain
| | - M Llonch-Masriera
- Geriatric Medicine Department, Hospital Universitari de Terrassa, Consorci Sanitari de Terrassa, Carr. Torrebonica, s/n, Terrassa, 08227, Barcelona, Spain
- Faculty of Medicine and Health Sciences, Universitat Internacional de Catalunya (UIC), Barcelona, Spain
| |
Collapse
|
2
|
Li Z, Liu X, Tang Z, Jin N, Zhang P, Eadon MT, Song Q, Chen YV, Su J. TrajVis: a visual clinical decision support system to translate artificial intelligence trajectory models in the precision management of chronic kidney disease. J Am Med Inform Assoc 2024:ocae158. [PMID: 38916922 DOI: 10.1093/jamia/ocae158] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 05/31/2024] [Accepted: 06/10/2024] [Indexed: 06/26/2024] Open
Abstract
OBJECTIVE Our objective is to develop and validate TrajVis, an interactive tool that assists clinicians in using artificial intelligence (AI) models to leverage patients' longitudinal electronic medical records (EMRs) for personalized precision management of chronic disease progression. MATERIALS AND METHODS We first perform requirement analysis with clinicians and data scientists to determine the visual analytics tasks of the TrajVis system as well as its design and functionalities. A graph AI model for chronic kidney disease (CKD) trajectory inference named DisEase PrOgression Trajectory (DEPOT) is used for system development and demonstration. TrajVis is implemented as a full-stack web application with synthetic EMR data derived from the Atrium Health Wake Forest Baptist Translational Data Warehouse and the Indiana Network for Patient Care research database. A case study with a nephrologist and a user experience survey of clinicians and data scientists are conducted to evaluate the TrajVis system. RESULTS The TrajVis clinical information system is composed of 4 panels: the Patient View for demographic and clinical information, the Trajectory View to visualize the DEPOT-derived CKD trajectories in latent space, the Clinical Indicator View to elucidate longitudinal patterns of clinical features and interpret DEPOT predictions, and the Analysis View to demonstrate personal CKD progression trajectories. System evaluations suggest that TrajVis supports clinicians in summarizing clinical data, identifying individualized risk predictors, and visualizing patient disease progression trajectories, overcoming the barriers of AI implementation in healthcare. DISCUSSION The TrajVis system provides a novel visualization solution which is complimentary to other risk estimators such as the Kidney Failure Risk Equations. CONCLUSION TrajVis bridges the gap between the fast-growing AI/ML modeling and the clinical use of such models for personalized and precision management of chronic diseases.
Collapse
Affiliation(s)
- Zuotian Li
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN 46202, United States
- Department of Computer Graphics Technology, Purdue University, West Lafayette, IN 47907, United States
| | - Xiang Liu
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN 46202, United States
| | - Ziyang Tang
- Department of Computer and Information Technology, Purdue University, West Lafayette, IN 47907, United States
| | - Nanxin Jin
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN 46202, United States
- Department of Computer and Information Technology, Purdue University, West Lafayette, IN 47907, United States
| | - Pengyue Zhang
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN 46202, United States
| | - Michael T Eadon
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN 46202, United States
| | - Qianqian Song
- Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL 32610, United States
| | - Yingjie V Chen
- Department of Computer Graphics Technology, Purdue University, West Lafayette, IN 47907, United States
| | - Jing Su
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN 46202, United States
- Gerontology and Geriatric Medicine, Wake Forest School of Medicine, Winston-Salem, NC 27101, United States
| |
Collapse
|
3
|
Kuziemsky CE, Chrimes D, Minshall S, Mannerow M, Lau F. AI Quality Standards in Health Care: Rapid Umbrella Review. J Med Internet Res 2024; 26:e54705. [PMID: 38776538 PMCID: PMC11153979 DOI: 10.2196/54705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2023] [Revised: 04/03/2024] [Accepted: 04/04/2024] [Indexed: 05/25/2024] Open
Abstract
BACKGROUND In recent years, there has been an upwelling of artificial intelligence (AI) studies in the health care literature. During this period, there has been an increasing number of proposed standards to evaluate the quality of health care AI studies. OBJECTIVE This rapid umbrella review examines the use of AI quality standards in a sample of health care AI systematic review articles published over a 36-month period. METHODS We used a modified version of the Joanna Briggs Institute umbrella review method. Our rapid approach was informed by the practical guide by Tricco and colleagues for conducting rapid reviews. Our search was focused on the MEDLINE database supplemented with Google Scholar. The inclusion criteria were English-language systematic reviews regardless of review type, with mention of AI and health in the abstract, published during a 36-month period. For the synthesis, we summarized the AI quality standards used and issues noted in these reviews drawing on a set of published health care AI standards, harmonized the terms used, and offered guidance to improve the quality of future health care AI studies. RESULTS We selected 33 review articles published between 2020 and 2022 in our synthesis. The reviews covered a wide range of objectives, topics, settings, designs, and results. Over 60 AI approaches across different domains were identified with varying levels of detail spanning different AI life cycle stages, making comparisons difficult. Health care AI quality standards were applied in only 39% (13/33) of the reviews and in 14% (25/178) of the original studies from the reviews examined, mostly to appraise their methodological or reporting quality. Only a handful mentioned the transparency, explainability, trustworthiness, ethics, and privacy aspects. A total of 23 AI quality standard-related issues were identified in the reviews. There was a recognized need to standardize the planning, conduct, and reporting of health care AI studies and address their broader societal, ethical, and regulatory implications. CONCLUSIONS Despite the growing number of AI standards to assess the quality of health care AI studies, they are seldom applied in practice. With increasing desire to adopt AI in different health topics, domains, and settings, practitioners and researchers must stay abreast of and adapt to the evolving landscape of health care AI quality standards and apply these standards to improve the quality of their AI studies.
Collapse
Affiliation(s)
| | - Dillon Chrimes
- School of Health Information Science, University of Victoria, Victoria, BC, Canada
| | - Simon Minshall
- School of Health Information Science, University of Victoria, Victoria, BC, Canada
| | | | - Francis Lau
- School of Health Information Science, University of Victoria, Victoria, BC, Canada
| |
Collapse
|
4
|
Kolasa K, Admassu B, Hołownia-Voloskova M, Kędzior KJ, Poirrier JE, Perni S. Systematic reviews of machine learning in healthcare: a literature review. Expert Rev Pharmacoecon Outcomes Res 2024; 24:63-115. [PMID: 37955147 DOI: 10.1080/14737167.2023.2279107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 10/31/2023] [Indexed: 11/14/2023]
Abstract
INTRODUCTION The increasing availability of data and computing power has made machine learning (ML) a viable approach to faster, more efficient healthcare delivery. METHODS A systematic literature review (SLR) of published SLRs evaluating ML applications in healthcare settings published between1 January 2010 and 27 March 2023 was conducted. RESULTS In total 220 SLRs covering 10,462 ML algorithms were reviewed. The main application of AI in medicine related to the clinical prediction and disease prognosis in oncology and neurology with the use of imaging data. Accuracy, specificity, and sensitivity were provided in 56%, 28%, and 25% SLRs respectively. Internal and external validation was reported in 53% and less than 1% of the cases respectively. The most common modeling approach was neural networks (2,454 ML algorithms), followed by support vector machine and random forest/decision trees (1,578 and 1,522 ML algorithms, respectively). EXPERT OPINION The review indicated considerable reporting gaps in terms of the ML's performance, both internal and external validation. Greater accessibility to healthcare data for developers can ensure the faster adoption of ML algorithms into clinical practice.
Collapse
Affiliation(s)
- Katarzyna Kolasa
- Division of Health Economics and Healthcare Management, Kozminski University, Warsaw, Poland
| | - Bisrat Admassu
- Division of Health Economics and Healthcare Management, Kozminski University, Warsaw, Poland
| | | | | | | | | |
Collapse
|
5
|
Das A, Dhillon P. Application of machine learning in measurement of ageing and geriatric diseases: a systematic review. BMC Geriatr 2023; 23:841. [PMID: 38087195 PMCID: PMC10717316 DOI: 10.1186/s12877-023-04477-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Accepted: 11/10/2023] [Indexed: 12/18/2023] Open
Abstract
BACKGROUND As the ageing population continues to grow in many countries, the prevalence of geriatric diseases is on the rise. In response, healthcare providers are exploring novel methods to enhance the quality of life for the elderly. Over the last decade, there has been a remarkable surge in the use of machine learning in geriatric diseases and care. Machine learning has emerged as a promising tool for the diagnosis, treatment, and management of these conditions. Hence, our study aims to find out the present state of research in geriatrics and the application of machine learning methods in this area. METHODS This systematic review followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and focused on healthy ageing in individuals aged 45 and above, with a specific emphasis on the diseases that commonly occur during this process. The study mainly focused on three areas, that are machine learning, the geriatric population, and diseases. Peer-reviewed articles were searched in the PubMed and Scopus databases with inclusion criteria of population above 45 years, must have used machine learning methods, and availability of full text. To assess the quality of the studies, Joanna Briggs Institute's (JBI) critical appraisal tool was used. RESULTS A total of 70 papers were selected from the 120 identified papers after going through title screening, abstract screening, and reference search. Limited research is available on predicting biological or brain age using deep learning and different supervised machine learning methods. Neurodegenerative disorders were found to be the most researched disease, in which Alzheimer's disease was focused the most. Among non-communicable diseases, diabetes mellitus, hypertension, cancer, kidney diseases, and cardiovascular diseases were included, and other rare diseases like oral health-related diseases and bone diseases were also explored in some papers. In terms of the application of machine learning, risk prediction was the most common approach. Half of the studies have used supervised machine learning algorithms, among which logistic regression, random forest, XG Boost were frequently used methods. These machine learning methods were applied to a variety of datasets including population-based surveys, hospital records, and digitally traced data. CONCLUSION The review identified a wide range of studies that employed machine learning algorithms to analyse various diseases and datasets. While the application of machine learning in geriatrics and care has been well-explored, there is still room for future development, particularly in validating models across diverse populations and utilizing personalized digital datasets for customized patient-centric care in older populations. Further, we suggest a scope of Machine Learning in generating comparable ageing indices such as successful ageing index.
Collapse
Affiliation(s)
- Ayushi Das
- International Institute for Population Sciences, Deonar, Mumbai, 400088, India
| | - Preeti Dhillon
- Department of Survey Research and Data Analytics, International Institute for Population Sciences, Deonar, Mumbai, 400088, India.
| |
Collapse
|
6
|
Shiwani T, Relton S, Evans R, Kale A, Heaven A, Clegg A, Todd O. New Horizons in artificial intelligence in the healthcare of older people. Age Ageing 2023; 52:afad219. [PMID: 38124256 PMCID: PMC10733173 DOI: 10.1093/ageing/afad219] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Indexed: 12/23/2023] Open
Abstract
Artificial intelligence (AI) in healthcare describes algorithm-based computational techniques which manage and analyse large datasets to make inferences and predictions. There are many potential applications of AI in the care of older people, from clinical decision support systems that can support identification of delirium from clinical records to wearable devices that can predict the risk of a fall. We held four meetings of older people, clinicians and AI researchers. Three priority areas were identified for AI application in the care of older people. These included: monitoring and early diagnosis of disease, stratified care and care coordination between healthcare providers. However, the meetings also highlighted concerns that AI may exacerbate health inequity for older people through bias within AI models, lack of external validation amongst older people, infringements on privacy and autonomy, insufficient transparency of AI models and lack of safeguarding for errors. Creating effective interventions for older people requires a person-centred approach to account for the needs of older people, as well as sufficient clinical and technological governance to meet standards of generalisability, transparency and effectiveness. Education of clinicians and patients is also needed to ensure appropriate use of AI technologies, with investment in technological infrastructure required to ensure equity of access.
Collapse
Affiliation(s)
- Taha Shiwani
- Academic Unit for Ageing & Stroke Research, Bradford Institute for Health Research, Bradford Teaching Hospitals NHS Foundation Trust, Duckworth Lane, Bradford, West Yorkshire BD9 6RJ, UK
| | - Samuel Relton
- Leeds Institute of Health Sciences, University of Leeds, Leeds, UK
| | - Ruth Evans
- Leeds Institute of Health Sciences, University of Leeds, Leeds, UK
| | - Aditya Kale
- Academic Unit of Ophthalmology, Institute of Inflammation & Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
| | - Anne Heaven
- Academic Unit for Ageing & Stroke Research, Bradford Institute for Health Research, Bradford Teaching Hospitals NHS Foundation Trust, Duckworth Lane, Bradford, West Yorkshire BD9 6RJ, UK
| | - Andrew Clegg
- Academic Unit for Ageing & Stroke Research, Bradford Institute for Health Research, Bradford Teaching Hospitals NHS Foundation Trust, Duckworth Lane, Bradford, West Yorkshire BD9 6RJ, UK
| | - Oliver Todd
- Academic Unit for Ageing & Stroke Research, Bradford Institute for Health Research, Bradford Teaching Hospitals NHS Foundation Trust, Duckworth Lane, Bradford, West Yorkshire BD9 6RJ, UK
| |
Collapse
|
7
|
Olender RT, Roy S, Nishtala PS. Application of machine learning approaches in predicting clinical outcomes in older adults - a systematic review and meta-analysis. BMC Geriatr 2023; 23:561. [PMID: 37710210 PMCID: PMC10503191 DOI: 10.1186/s12877-023-04246-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Accepted: 08/19/2023] [Indexed: 09/16/2023] Open
Abstract
BACKGROUND Machine learning-based prediction models have the potential to have a considerable positive impact on geriatric care. DESIGN Systematic review and meta-analyses. PARTICIPANTS Older adults (≥ 65 years) in any setting. INTERVENTION Machine learning models for predicting clinical outcomes in older adults were evaluated. A random-effects meta-analysis was conducted in two grouped cohorts, where the predictive models were compared based on their performance in predicting mortality i) under and including 6 months ii) over 6 months. OUTCOME MEASURES Studies were grouped into two groups by the clinical outcome, and the models were compared based on the area under the receiver operating characteristic curve metric. RESULTS Thirty-seven studies that satisfied the systematic review criteria were appraised, and eight studies predicting a mortality outcome were included in the meta-analyses. We could only pool studies by mortality as there were inconsistent definitions and sparse data to pool studies for other clinical outcomes. The area under the receiver operating characteristic curve from the meta-analysis yielded a summary estimate of 0.80 (95% CI: 0.76 - 0.84) for mortality within 6 months and 0.81 (95% CI: 0.76 - 0.86) for mortality over 6 months, signifying good discriminatory power. CONCLUSION The meta-analysis indicates that machine learning models display good discriminatory power in predicting mortality. However, more large-scale validation studies are necessary. As electronic healthcare databases grow larger and more comprehensive, the available computational power increases and machine learning models become more sophisticated; there should be an effort to integrate these models into a larger research setting to predict various clinical outcomes.
Collapse
Affiliation(s)
- Robert T Olender
- Department of Life Sciences, University of Bath, Bath, BA2 7AY, UK.
| | - Sandipan Roy
- Department of Mathematical Sciences, University of Bath, Bath, BA2 7AY, UK
| | - Prasad S Nishtala
- Department of Life Sciences & Centre for Therapeutic Innovation, University of Bath, Bath, BA2 7AY, UK
| |
Collapse
|
8
|
Pavon JM, Previll L, Woo M, Henao R, Solomon M, Rogers U, Olson A, Fischer J, Leo C, Fillenbaum G, Hoenig H, Casarett D. Machine learning functional impairment classification with electronic health record data. J Am Geriatr Soc 2023; 71:2822-2833. [PMID: 37195174 PMCID: PMC10524844 DOI: 10.1111/jgs.18383] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 03/16/2023] [Accepted: 03/19/2023] [Indexed: 05/18/2023]
Abstract
BACKGROUND Poor functional status is a key marker of morbidity, yet is not routinely captured in clinical encounters. We developed and evaluated the accuracy of a machine learning algorithm that leveraged electronic health record (EHR) data to provide a scalable process for identification of functional impairment. METHODS We identified a cohort of patients with an electronically captured screening measure of functional status (Older Americans Resources and Services ADL/IADL) between 2018 and 2020 (N = 6484). Patients were classified using unsupervised learning K means and t-distributed Stochastic Neighbor Embedding into normal function (NF), mild to moderate functional impairment (MFI), and severe functional impairment (SFI) states. Using 11 EHR clinical variable domains (832 variable input features), we trained an Extreme Gradient Boosting supervised machine learning algorithm to distinguish functional status states, and measured prediction accuracies. Data were randomly split into training (80%) and test (20%) sets. The SHapley Additive Explanations (SHAP) feature importance analysis was used to list the EHR features in rank order of their contribution to the outcome. RESULTS Median age was 75.3 years, 62% female, 60% White. Patients were classified as 53% NF (n = 3453), 30% MFI (n = 1947), and 17% SFI (n = 1084). Summary of model performance for identifying functional status state (NF, MFI, SFI) was AUROC (area under the receiving operating characteristic curve) 0.92, 0.89, and 0.87, respectively. Age, falls, hospitalization, home health use, labs (e.g., albumin), comorbidities (e.g., dementia, heart failure, chronic kidney disease, chronic pain), and social determinants of health (e.g., alcohol use) were highly ranked features in predicting functional status states. CONCLUSION A machine learning algorithm run on EHR clinical data has potential utility for differentiating functional status in the clinical setting. Through further validation and refinement, such algorithms can complement traditional screening methods and result in a population-based strategy for identifying patients with poor functional status who need additional health resources.
Collapse
Affiliation(s)
- Juliessa M Pavon
- Department of Medicine/Division of Geriatrics, Duke University, Durham, North Carolina, USA
- Geriatric Research Education Clinical Center, Durham Veteran Affairs Health Care System, Durham, North Carolina, USA
- Claude D. Pepper Center, Duke University, Durham, North Carolina, USA
- Center for the Study of Aging and Human Development, Duke University, Durham, North Carolina, USA
| | - Laura Previll
- Department of Medicine/Division of Geriatrics, Duke University, Durham, North Carolina, USA
- Geriatric Research Education Clinical Center, Durham Veteran Affairs Health Care System, Durham, North Carolina, USA
- Center for the Study of Aging and Human Development, Duke University, Durham, North Carolina, USA
| | - Myung Woo
- AI Health, Duke University, Durham, North Carolina, USA
- Department of Medicine/Division of General Internal Medicine/Hospital Medicine, Duke University, Durham, North Carolina, USA
| | - Ricardo Henao
- AI Health, Duke University, Durham, North Carolina, USA
| | - Mary Solomon
- AI Health, Duke University, Durham, North Carolina, USA
| | - Ursula Rogers
- AI Health, Duke University, Durham, North Carolina, USA
| | - Andrew Olson
- AI Health, Duke University, Durham, North Carolina, USA
| | - Jonathan Fischer
- Department of Community and Family Medicine, Duke University, Durham, North Carolina, USA
| | - Christopher Leo
- Department of Medicine/Division of Geriatrics, Duke University, Durham, North Carolina, USA
- Department of Medicine/Division of General Internal Medicine/Hospital Medicine, Duke University, Durham, North Carolina, USA
| | - Gerda Fillenbaum
- Claude D. Pepper Center, Duke University, Durham, North Carolina, USA
- Center for the Study of Aging and Human Development, Duke University, Durham, North Carolina, USA
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, North Carolina, USA
| | - Helen Hoenig
- Department of Medicine/Division of Geriatrics, Duke University, Durham, North Carolina, USA
- Geriatric Research Education Clinical Center, Durham Veteran Affairs Health Care System, Durham, North Carolina, USA
- Claude D. Pepper Center, Duke University, Durham, North Carolina, USA
- Center for the Study of Aging and Human Development, Duke University, Durham, North Carolina, USA
- Physical Medicine & Rehabilitation Service, Durham Veteran Affairs Health Care System, Durham, North Carolina, USA
| | - David Casarett
- Department of Medicine/Division of General Internal Medicine/Palliative Care, Duke University, Durham, North Carolina, USA
| |
Collapse
|
9
|
Reis FJJ, Bittencourt JV, Calestini L, de Sá Ferreira A, Meziat-Filho N, Nogueira LC. Exploratory analysis of 5 supervised machine learning models for predicting the efficacy of the endogenous pain inhibitory pathway in patients with musculoskeletal pain. Musculoskelet Sci Pract 2023; 66:102788. [PMID: 37315499 DOI: 10.1016/j.msksp.2023.102788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 05/09/2023] [Accepted: 06/05/2023] [Indexed: 06/16/2023]
Abstract
OBJECTIVES The identification of factors that influence the efficacy of endogenous pain inhibitory pathways remains challenging due to different protocols and populations. We explored five machine learning (ML) models to estimate the Conditioned Pain Modulation (CPM) efficacy. DESIGN Exploratory, cross-sectional design. SETTING AND PARTICIPANTS This study was conducted in an outpatient setting and included 311 patients with musculoskeletal pain. METHODS Data collection included sociodemographic, lifestyle, and clinical characteristics. CPM efficacy was calculated by comparing the pressure pain thresholds before and after patients submerged their non-dominant hand in a bucket of cold water (cold-pressure test) (1-4 °C). We developed five ML models: decision tree, random forest, gradient-boosted trees, logistic regression, and support vector machine. MAIN OUTCOME MEASURES Model performance were assessed using receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, precision, recall, F1-score, and the Matthews Correlation Coefficient (MCC). To interpret and explain the predictions, we used SHapley Additive explanation values and Local Interpretable Model-Agnostic Explanations. RESULTS The XGBoost model presented the highest performance with an accuracy of 0.81 (95% CI = 0.73 to 0.89), F1 score of 0.80 (95% CI = 0.74 to 0.87), AUC of 0.81 (95% CI: 0.74 to 0.88), MCC of 0.61, and Kappa of 0.61. The model was influenced by duration of pain, fatigue, physical activity, and the number of painful areas. CONCLUSIONS XGBoost showed potential in predicting the CPM efficacy in patients with musculoskeletal pain on our dataset. Further research is needed to ensure the external validity and clinical utility of this model.
Collapse
Affiliation(s)
- Felipe J J Reis
- Physical Therapy Department, Instituto Federal do Rio de Janeiro (IFRJ), Rio de Janeiro, Brazil; Postgraduate Program in Clinical Medicine, Universidade Federal do Rio de Janeiro (UFRJ), Rio de Janeiro, Brazil; . Pain in Motion Research Group, Department of Physiotherapy, Human Physiology and Anatomy, Faculty of Physical Education & Physiotherapy, Vrije Universiteit Brussel, Brussels, Belgium.
| | - Juliana Valentim Bittencourt
- Postgraduate Program in Rehabilitation Sciences, Centro Universitário Augusto Motta (UNISUAM), Rio de Janeiro, Brazil
| | | | - Arthur de Sá Ferreira
- Postgraduate Program in Rehabilitation Sciences, Centro Universitário Augusto Motta (UNISUAM), Rio de Janeiro, Brazil
| | - Ney Meziat-Filho
- Postgraduate Program in Rehabilitation Sciences, Centro Universitário Augusto Motta (UNISUAM), Rio de Janeiro, Brazil
| | - Leandro C Nogueira
- Physical Therapy Department, Instituto Federal do Rio de Janeiro (IFRJ), Rio de Janeiro, Brazil; Postgraduate Program in Rehabilitation Sciences, Centro Universitário Augusto Motta (UNISUAM), Rio de Janeiro, Brazil
| |
Collapse
|
10
|
Shi HY, Yeh SCJ, Chou HC, Wang WC. Long-term care insurance purchase decisions of registered nurses: Deep learning versus logistic regression models. Health Policy 2023; 129:104709. [PMID: 36725380 DOI: 10.1016/j.healthpol.2023.104709] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2022] [Revised: 10/03/2022] [Accepted: 01/16/2023] [Indexed: 01/19/2023]
Abstract
OBJECTIVE The purpose of this study was to use a deep learning model and a traditional statistical regression model to predict the long-term care insurance decisions of registered nurses. METHODS We Prospectively surveyed 1,373 registered nurses with a minimum of 2 years of full-time working experience at a large medical center in Taiwan: 615 who already owned long-term care insurance (LTCI), 332 who had no intention to purchase LTCI (group 1), and 426 who intended to purchase LTCI (group 2). RESULTS After inverse probability of treatment weighting (IPTW), no statistically significant differences were identified in the study characteristics of the two groups. All the performance indices for the deep neural network (DNN) model were significantly higher than those of the multiple logistic regression (MLR) model (P<0.001). The strongest predictor of an individual's long-term care insurance decision was their risk propensity score, followed by their caregiving responsibilities, whether they live with older adult relatives, their experiences of catastrophic illness, and their openness to experience. CONCLUSIONS The DNN model is useful for predicting long-term care insurance decisions. Its prediction accuracy can be increased through training with temporal data collected from registered nurses. Future research can explore designs for two-level or multilevel models that explain the contextual effects of the risk factors on long-term care insurance decisions.
Collapse
Affiliation(s)
- Hon-Yi Shi
- Institute of Health Care Management and Department of Business Management, National Sun Yat-sen University, No.70 Lian Hai Road, Kaohsiung 80424, Taiwan; Department of Healthcare Administration and Medical Informatics, Kaohsiung Medical University, Kaohsiung, Taiwan; Graduate Institute of Technological and Vocational Education, National Pingtung University of Science and Technology, Pingtung, Taiwan; Department of Medical Research, Kaohsiung Medical University Hospital, Kaohsiung, Taiwan; Department of Medical Research, China Medical University Hospital, China Medical University, Taichung, Taiwan
| | - Shu-Chuan Jennifer Yeh
- Institute of Health Care Management and Department of Business Management, National Sun Yat-sen University, No.70 Lian Hai Road, Kaohsiung 80424, Taiwan; Department of Healthcare Administration and Medical Informatics, Kaohsiung Medical University, Kaohsiung, Taiwan.
| | - Hsueh-Chih Chou
- Institute of Health Care Management and Department of Business Management, National Sun Yat-sen University, No.70 Lian Hai Road, Kaohsiung 80424, Taiwan; Department of Nursing, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan
| | - Wen Chun Wang
- Institute of Health Care Management and Department of Business Management, National Sun Yat-sen University, No.70 Lian Hai Road, Kaohsiung 80424, Taiwan
| |
Collapse
|
11
|
Bunney G, Tran S, Han S, Gu C, Wang H, Luo Y, Dresden S. Using Machine Learning to Predict Hospital Disposition With Geriatric Emergency Department Innovation Intervention. Ann Emerg Med 2023; 81:353-363. [PMID: 36253298 DOI: 10.1016/j.annemergmed.2022.07.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Revised: 06/27/2022] [Accepted: 07/19/2022] [Indexed: 11/18/2022]
Abstract
STUDY OBJECTIVE The Geriatric Emergency Department Innovations (GEDI) program is a nurse-based geriatric assessment and care coordination program that reduces preventable admissions for older adults. Unfortunately, only 5% of older adults receive GEDI care because of resource limitations. The objective of this study was to predict the likelihood of hospitalization accurately and consistently with and without GEDI care using machine learning models to better target patients for the GEDI program. METHODS We performed a cross-sectional observational study of emergency department (ED) patients between 2010 and 2018. Using propensity-score matching, GEDI patients were matched to other older adult patients. Multiple models, including random forest, were used to predict hospital admission. Multiple second-layer models, including random forest, were then used to predict whether GEDI assessment would change predicted hospital admission. Final model performance was reported as the area under the curve using receiver operating characteristic models. RESULTS We included 128,050 patients aged over 65 years. The random forest ED disposition model had an area under the curve of 0.774 (95% confidence interval [CI] 0.741 to 0.806). In the random forest GEDI change-in-disposition model, 24,876 (97.3%) ED visits were predicted to have no change in disposition with GEDI assessment, and 695 (2.7%) ED visits were predicted to have a change in disposition with GEDI assessment. CONCLUSION Our machine learning models could predict who will likely be discharged with GEDI assessment with good accuracy and thus select a cohort appropriate for GEDI care. In addition, future implementation through integration into the electronic health record may assist in selecting patients to be prioritized for GEDI care.
Collapse
Affiliation(s)
- Gabrielle Bunney
- Department of Emergency Medicine, Northwestern University, Chicago, IL.
| | - Steven Tran
- Feinberg School of Medicine, Northwestern University, Chicago, IL
| | - Sae Han
- Feinberg School of Medicine, Northwestern University, Chicago, IL
| | - Carol Gu
- Applied Health Sciences, University of Illinois, Chicago, IL
| | - Hanyin Wang
- Feinberg School of Medicine, Northwestern University, Chicago, IL
| | - Yuan Luo
- Department of Preventative Medicine, Northwestern University, Chicago, IL
| | - Scott Dresden
- Department of Emergency Medicine, Northwestern University, Chicago, IL
| |
Collapse
|
12
|
Viswanath M, Clinch D, Ceresoli M, Dhesi J, D’Oria M, De Simone B, Podda M, Di Saverio S, Coccolini F, Sartelli M, Catena F, Moore E, Rangar D, Biffl WL, Damaskos D. Perceptions and practices surrounding the perioperative management of frail emergency surgery patients: a WSES-endorsed cross-sectional qualitative survey. World J Emerg Surg 2023; 18:7. [PMID: 36653865 PMCID: PMC9850554 DOI: 10.1186/s13017-022-00471-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Accepted: 12/25/2022] [Indexed: 01/19/2023] Open
Abstract
BACKGROUND Frailty is associated with poor post-operative outcomes in emergency surgical patients. Shared multidisciplinary models have been developed to provide a holistic, reactive model of care to improve outcomes for older people living with frailty. We aimed to describe current perioperative practices, and surgeons' awareness and perception of perioperative frailty management, and barriers to its implementation. METHODS A qualitative cross-sectional survey was sent via the World Society of Emergency Surgery e-letter to their members. Responses were analysed using descriptive statistics and reported by themes: risk scoring systems, frailty awareness and assessment and barriers to implementation. RESULT Of 168/1000 respondents, 38% were aware of the terms "Perioperative medicine for older people undergoing surgery" (POPS) and Comprehensive Geriatric Assessment (CGA). 66.6% of respondents assessed perioperative risk, with 45.2% using the American Society of Anaesthesiologists Physical Status Classification System (ASA-PS). 77.8% of respondents mostly agreed or agreed with the statement that they routinely conducted medical comorbidity management, and pain and falls risk assessment during emergency surgical admissions. Although 98.2% of respondents agreed that frailty was important, only 2.4% performed CGA and 1.2% used a specific frailty screening tool. Clinical frailty score was the most commonly used tool by those who did. Screening was usually conducted by surgical trainees. Key barriers included a lack of knowledge about frailty assessment, a lack of clarity on who should be responsible for frailty screening, and a lack of trained staff. CONCLUSIONS Our study highlights the ubiquitous lack of awareness regarding frailty assessment and the POPS model of care. More training and clear guidelines on frailty scoring, alongside support by multidisciplinary teams, may reduce the burden on surgical trainees, potentially improving rates of appropriate frailty assessment and management of the frailty syndrome in emergency surgical patients.
Collapse
Affiliation(s)
| | - Darja Clinch
- grid.418716.d0000 0001 0709 1919Registrar in General Surgery, Royal Infirmary of Edinburgh, Edinburgh, UK
| | - Marco Ceresoli
- grid.7563.70000 0001 2174 1754General and Emergency Surgery, School of Medicine and Surgery, Milano-Bicocca University, Monza, Italy
| | - Jugdeep Dhesi
- grid.420545.20000 0004 0489 3985Department of Ageing and Health, Guy’s and St Thomas NHS Foundation Trust, London, UK
| | - Mario D’Oria
- grid.460062.60000000459364044Division of Vascular and Endovascular Surgery, Cardiovascular Departments, University Hospital of Trieste, ASUGI, Trieste, Italy
| | - Belinda De Simone
- Unit of Digestive and Bariatric Surgery, Clinique Saint Louis, Poissy, Île-de-France France
| | - Mauro Podda
- grid.7763.50000 0004 1755 3242Emergency Surgery Unit, Department of Surgical Science, University of Cagliari, Cagliari, Italy
| | - Salomone Di Saverio
- Hospital of San Benedetto del Tronto, AV5 ASUR Marche, San Benedetto del Tronto, Italy
| | - Federico Coccolini
- grid.144189.10000 0004 1756 8209Emergency and Trauma Surgery Department, Pisa University Hospital, Pisa, Italy
| | | | - Fausto Catena
- grid.414682.d0000 0004 1758 8744General and Emergency Surgery Dept, Bufalini Hospital, Cesena, Italy
| | - Ernest Moore
- grid.239638.50000 0001 0369 638XDenver Health System-Denver Health Medical Center, Denver, USA
| | - Deepa Rangar
- grid.418716.d0000 0001 0709 1919Medicine of the Elderly, Royal Infirmary of Edinburgh, Edinburgh, UK
| | - Walter L. Biffl
- grid.415402.60000 0004 0449 3295Scripps Memorial Hospital La Jolla, La Jolla, CA USA
| | - Dimitrios Damaskos
- grid.418716.d0000 0001 0709 1919Department of General Surgery, Royal Infirmary of Edinburgh, Edinburgh, UK
| |
Collapse
|
13
|
Sinha K, Uddin Z, Kawsar H, Islam S, Deen M, Howlader M. Analyzing chronic disease biomarkers using electrochemical sensors and artificial neural networks. Trends Analyt Chem 2023. [DOI: 10.1016/j.trac.2022.116861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
14
|
Al Meslamani AZ. Applications of AI in pharmacy practice: a look at hospital and community settings. J Med Econ 2023; 26:1081-1084. [PMID: 37594444 DOI: 10.1080/13696998.2023.2249758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 08/11/2023] [Accepted: 08/15/2023] [Indexed: 08/19/2023]
Affiliation(s)
- Ahmad Z Al Meslamani
- College of Pharmacy, Al Ain University, Abu Dhabi, United Arab Emirates
- AAU Health and Biomedical Research Center, Al Ain University, Abu Dhabi, United Arab Emirates
| |
Collapse
|
15
|
Al-Ani MA, Bai C, Hashky A, Parker AM, Vilaro JR, Aranda JM, Shickel B, Rashidi P, Bihorac A, Ahmed MM, Mardini MT. Artificial intelligence guidance of advanced heart failure therapies: A systematic scoping review. Front Cardiovasc Med 2023; 10:1127716. [PMID: 36910520 PMCID: PMC9999024 DOI: 10.3389/fcvm.2023.1127716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Accepted: 02/07/2023] [Indexed: 03/14/2023] Open
Abstract
Introduction Artificial intelligence can recognize complex patterns in large datasets. It is a promising technology to advance heart failure practice, as many decisions rely on expert opinions in the absence of high-quality data-driven evidence. Methods We searched Embase, Web of Science, and PubMed databases for articles containing "artificial intelligence," "machine learning," or "deep learning" and any of the phrases "heart transplantation," "ventricular assist device," or "cardiogenic shock" from inception until August 2022. We only included original research addressing post heart transplantation (HTx) or mechanical circulatory support (MCS) clinical care. Review and data extraction were performed in accordance with PRISMA-Scr guidelines. Results Of 584 unique publications detected, 31 met the inclusion criteria. The majority focused on outcome prediction post HTx (n = 13) and post durable MCS (n = 7), as well as post HTx and MCS management (n = 7, n = 3, respectively). One study addressed temporary mechanical circulatory support. Most studies advocated for rapid integration of AI into clinical practice, acknowledging potential improvements in management guidance and reliability of outcomes prediction. There was a notable paucity of external data validation and integration of multiple data modalities. Conclusion Our review showed mounting innovation in AI application in management of MCS and HTx, with the largest evidence showing improved mortality outcome prediction.
Collapse
Affiliation(s)
- Mohammad A Al-Ani
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Chen Bai
- Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, FL, United States
| | - Amal Hashky
- Department of Computer and Information Science and Engineering, University of Florida, Gainesville, FL, United States
| | - Alex M Parker
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Juan R Vilaro
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Juan M Aranda
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Benjamin Shickel
- Department of Medicine, University of Florida, Gainesville, FL, United States.,Intelligent Critical Care Center (IC3), University of Florida, Gainesville, FL, United States
| | - Parisa Rashidi
- Intelligent Critical Care Center (IC3), University of Florida, Gainesville, FL, United States.,Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
| | - Azra Bihorac
- Department of Medicine, University of Florida, Gainesville, FL, United States.,Intelligent Critical Care Center (IC3), University of Florida, Gainesville, FL, United States
| | - Mustafa M Ahmed
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Mamoun T Mardini
- Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, FL, United States
| |
Collapse
|
16
|
Silva Rocha ED, de Morais Melo FL, de Mello MEF, Figueiroa B, Sampaio V, Endo PT. On usage of artificial intelligence for predicting mortality during and post-pregnancy: a systematic review of literature. BMC Med Inform Decis Mak 2022; 22:334. [PMID: 36536413 PMCID: PMC9764498 DOI: 10.1186/s12911-022-02082-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2022] [Accepted: 12/13/2022] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND Care during pregnancy, childbirth and puerperium are fundamental to avoid pathologies for the mother and her baby. However, health issues can occur during this period, causing misfortunes, such as the death of the fetus or neonate. Predictive models of fetal and infant deaths are important technological tools that can help to reduce mortality indexes. The main goal of this work is to present a systematic review of literature focused on computational models to predict mortality, covering stillbirth, perinatal, neonatal, and infant deaths, highlighting their methodology and the description of the proposed computational models. METHODS We conducted a systematic review of literature, limiting the search to the last 10 years of publications considering the five main scientific databases as source. RESULTS From 671 works, 18 of them were selected as primary studies for further analysis. We found that most of works are focused on prediction of neonatal deaths, using machine learning models (more specifically Random Forest). The top five most common features used to train models are birth weight, gestational age, sex of the child, Apgar score and mother's age. Having predictive models for preventing mortality during and post-pregnancy not only improve the mother's quality of life, as well as it can be a powerful and low-cost tool to decrease mortality ratios. CONCLUSION Based on the results of this SRL, we can state that scientific efforts have been done in this area, but there are many open research opportunities to be developed by the community.
Collapse
Affiliation(s)
- Elisson da Silva Rocha
- grid.26141.300000 0000 9011 5442Programa de Pós-Graduação em Engenharia da Computação, Universidade de Pernambuco, Recife, Brazil
| | - Flavio Leandro de Morais Melo
- grid.26141.300000 0000 9011 5442Programa de Pós-Graduação em Engenharia da Computação, Universidade de Pernambuco, Recife, Brazil
| | | | - Barbara Figueiroa
- Programa Mãe Coruja Pernambucana, Secretaria de Saúde do Estado de Pernambuco, Recife, Brazil
| | | | - Patricia Takako Endo
- grid.26141.300000 0000 9011 5442Programa de Pós-Graduação em Engenharia da Computação, Universidade de Pernambuco, Recife, Brazil
| |
Collapse
|
17
|
Can the Electronic Health Record Predict Risk of Falls in Hospitalized Patients by Using Artificial Intelligence? A Meta-analysis. COMPUTERS, INFORMATICS, NURSING : CIN 2022:00024665-990000000-00056. [PMID: 36731013 DOI: 10.1097/cin.0000000000000952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Because of an aging population worldwide, the increasing prevalence of falls and their consequent injuries are becoming a safety, health, and social-care issue among elderly people. We conducted a meta-analysis to investigate the benchmark of prediction power when using the EHR with artificial intelligence to predict risk of falls in hospitalized patients. The CHARMS guideline was used in this meta-analysis. We searched PubMed, Cochrane, and EMBASE. The pooled sensitivity and specificity were calculated, and the summary receiver operating curve was formed to investigate the predictive power of artificial intelligence models. The PROBAST table was used to assess the quality of the selected studies. A total of 132 846 patients were included in this meta-analysis. The pooled area under the curve of the collected research was estimated to be 0.78. The pooled sensitivity was 0.63 (95% confidence interval, 0.52-0.72), whereas the pooled specificity was 0.82 (95% confidence interval, 0.73-0.88). The quality of our selected studies was high, with most of them being evaluated with low risk of bias and low concern for applicability. Our study demonstrates that using the EHR with artificial intelligence to predict the risk of falls among hospitalized patients is feasible. Future clinical applications are anticipated.
Collapse
|
18
|
Choudhury A. Factors influencing clinicians' willingness to use an AI-based clinical decision support system. Front Digit Health 2022; 4:920662. [PMID: 36339516 PMCID: PMC9628998 DOI: 10.3389/fdgth.2022.920662] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Accepted: 08/01/2022] [Indexed: 11/07/2022] Open
Abstract
Background Given the opportunities created by artificial intelligence (AI) based decision support systems in healthcare, the vital question is whether clinicians are willing to use this technology as an integral part of clinical workflow. Purpose This study leverages validated questions to formulate an online survey and consequently explore cognitive human factors influencing clinicians' intention to use an AI-based Blood Utilization Calculator (BUC), an AI system embedded in the electronic health record that delivers data-driven personalized recommendations for the number of packed red blood cells to transfuse for a given patient. Method A purposeful sampling strategy was used to exclusively include BUC users who are clinicians in a university hospital in Wisconsin. We recruited 119 BUC users who completed the entire survey. We leveraged structural equation modeling to capture the direct and indirect effects of “AI Perception” and “Expectancy” on clinicians' Intention to use the technology when mediated by “Perceived Risk”. Results The findings indicate a significant negative relationship concerning the direct impact of AI's perception on BUC Risk (ß = −0.23, p < 0.001). Similarly, Expectancy had a significant negative effect on Risk (ß = −0.49, p < 0.001). We also noted a significant negative impact of Risk on the Intent to use BUC (ß = −0.34, p < 0.001). Regarding the indirect effect of Expectancy on the Intent to Use BUC, the findings show a significant positive impact mediated by Risk (ß = 0.17, p = 0.004). The study noted a significant positive and indirect effect of AI Perception on the Intent to Use BUC when mediated by risk (ß = 0.08, p = 0.027). Overall, this study demonstrated the influences of expectancy, perceived risk, and perception of AI on clinicians' intent to use BUC (an AI system). AI developers need to emphasize the benefits of AI technology, ensure ease of use (effort expectancy), clarify the system's potential (performance expectancy), and minimize the risk perceptions by improving the overall design. Conclusion Identifying the factors that determine clinicians' intent to use AI-based decision support systems can help improve technology adoption and use in the healthcare domain. Enhanced and safe adoption of AI can uplift the overall care process and help standardize clinical decisions and procedures. An improved AI adoption in healthcare will help clinicians share their everyday clinical workload and make critical decisions.
Collapse
|
19
|
Choudhury A. Toward an Ecologically Valid Conceptual Framework for the Use of Artificial Intelligence in Clinical Settings: Need for Systems Thinking, Accountability, Decision-making, Trust, and Patient Safety Considerations in Safeguarding the Technology and Clinicians. JMIR Hum Factors 2022; 9:e35421. [PMID: 35727615 PMCID: PMC9257623 DOI: 10.2196/35421] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Revised: 03/26/2022] [Accepted: 05/20/2022] [Indexed: 01/29/2023] Open
Abstract
The health care management and the medical practitioner literature lack a descriptive conceptual framework for understanding the dynamic and complex interactions between clinicians and artificial intelligence (AI) systems. As most of the existing literature has been investigating AI's performance and effectiveness from a statistical (analytical) standpoint, there is a lack of studies ensuring AI's ecological validity. In this study, we derived a framework that focuses explicitly on the interaction between AI and clinicians. The proposed framework builds upon well-established human factors models such as the technology acceptance model and expectancy theory. The framework can be used to perform quantitative and qualitative analyses (mixed methods) to capture how clinician-AI interactions may vary based on human factors such as expectancy, workload, trust, cognitive variables related to absorptive capacity and bounded rationality, and concerns for patient safety. If leveraged, the proposed framework can help to identify factors influencing clinicians' intention to use AI and, consequently, improve AI acceptance and address the lack of AI accountability while safeguarding the patients, clinicians, and AI technology. Overall, this paper discusses the concepts, propositions, and assumptions of the multidisciplinary decision-making literature, constituting a sociocognitive approach that extends the theories of distributed cognition and, thus, will account for the ecological validity of AI.
Collapse
Affiliation(s)
- Avishek Choudhury
- Industrial and Management Systems Engineering, Benjamin M Statler College of Engineering and Mineral Resources, West Virginia University, Morgantown, WV, United States
| |
Collapse
|
20
|
Artificial Intelligence in NICU and PICU: A Need for Ecological Validity, Accountability, and Human Factors. Healthcare (Basel) 2022; 10:healthcare10050952. [PMID: 35628089 PMCID: PMC9140402 DOI: 10.3390/healthcare10050952] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 05/17/2022] [Accepted: 05/19/2022] [Indexed: 02/04/2023] Open
Abstract
Pediatric patients, particularly in neonatal and pediatric intensive care units (NICUs and PICUs), are typically at an increased risk of fatal decompensation. That being said, any delay in treatment or minor errors in medication dosage can overcomplicate patient health. Under such an environment, clinicians are expected to quickly and effectively comprehend large volumes of medical information to diagnose and develop a treatment plan for any baby. The integration of Artificial Intelligence (AI) into the clinical workflow can be a potential solution to safeguard pediatric patients and augment the quality of care. However, before making AI an integral part of pediatric care, it is essential to evaluate the technology from a human factors perspective, ensuring its readiness (technology readiness level) and ecological validity. Addressing AI accountability is also critical to safeguarding clinicians and improving AI acceptance in the clinical workflow. This article summarizes the application of AI in NICU/PICU and consecutively identifies the existing flaws in AI (from clinicians’ standpoint), and proposes related recommendations, which, if addressed, can improve AIs’ readiness for a real clinical environment.
Collapse
|
21
|
Goździkiewicz N, Zwolińska D, Polak-Jonkisz D. The Use of Artificial Intelligence Algorithms in the Diagnosis of Urinary Tract Infections-A Literature Review. J Clin Med 2022; 11:jcm11102734. [PMID: 35628861 PMCID: PMC9146683 DOI: 10.3390/jcm11102734] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 05/04/2022] [Accepted: 05/09/2022] [Indexed: 02/05/2023] Open
Abstract
Urinary tract infections (UTIs) are among the most common infections occurring across all age groups. UTIs are a well-known cause of acute morbidity and chronic medical conditions. The current diagnostic methods of UTIs remain sub-optimal. The development of better diagnostic tools for UTIs is essential for improving treatment and reducing morbidity. Artificial intelligence (AI) is defined as the science of computers where they have the ability to perform tasks commonly associated with intelligent beings. The objective of this study was to analyze current views regarding attempts to apply artificial intelligence techniques in everyday practice, as well as find promising methods to diagnose urinary tract infections in the most efficient ways. We included six research works comparing various AI models to predict UTI. The literature examined here confirms the relevance of AI models in UTI diagnosis, while it has not yet been established which model is preferable for infection prediction in adult patients. AI models achieve a high performance in retrospective studies, but further studies are required.
Collapse
Affiliation(s)
- Natalia Goździkiewicz
- Department of Pediatric Nephrology, University Hospital in Wroclaw, 50-556 Wrocław, Poland
- Correspondence: ; Tel.: +48-717-364-400
| | - Danuta Zwolińska
- Department of Pediatric Nephrology, Wroclaw Medical Univeristy, 50-556 Wrocław, Poland; (D.Z.); (D.P.-J.)
| | - Dorota Polak-Jonkisz
- Department of Pediatric Nephrology, Wroclaw Medical Univeristy, 50-556 Wrocław, Poland; (D.Z.); (D.P.-J.)
| |
Collapse
|
22
|
Identification and Prediction of Chronic Diseases Using Machine Learning Approach. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:2826127. [PMID: 35251563 PMCID: PMC8896926 DOI: 10.1155/2022/2826127] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 02/01/2022] [Accepted: 02/07/2022] [Indexed: 01/01/2023]
Abstract
Nowadays, humans face various diseases due to the current environmental condition and their living habits. The identification and prediction of such diseases at their earlier stages are much important, so as to prevent the extremity of it. It is difficult for doctors to manually identify the diseases accurately most of the time. The goal of this paper is to identify and predict the patients with more common chronic illnesses. This could be achieved by using a cutting-edge machine learning technique to ensure that this categorization reliably identifies persons with chronic diseases. The prediction of diseases is also a challenging task. Hence, data mining plays a critical role in disease prediction. The proposed system offers a broad disease prognosis based on patient's symptoms by using the machine learning algorithms such as convolutional neural network (CNN) for automatic feature extraction and disease prediction and K-nearest neighbor (KNN) for distance calculation to find the exact match in the data set and the final disease prediction outcome. A collection of disease symptoms has been performed for the preparation of the data set along with the person's living habits, and details related to doctor consultations are taken into account in this general disease prediction. Finally, a comparative study of the proposed system with various algorithms such as Naïve Bayes, decision tree, and logistic regression has been demonstrated in this paper.
Collapse
|
23
|
Adegboro CO, Choudhury A, Asan O, Kelly MM. Artificial Intelligence to Improve Health Outcomes in the NICU and PICU: A Systematic Review. Hosp Pediatr 2022; 12:93-110. [PMID: 34890453 DOI: 10.1542/hpeds.2021-006094] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
CONTEXT Artificial intelligence (AI) technologies are increasingly used in pediatrics and have the potential to help inpatient physicians provide high-quality care for critically ill children. OBJECTIVE We aimed to describe the use of AI to improve any health outcome(s) in neonatal and pediatric intensive care. DATA SOURCE PubMed, IEEE Xplore, Cochrane, and Web of Science databases. STUDY SELECTION We used peer-reviewed studies published between June 1, 2010, and May 31, 2020, in which researchers described (1) AI, (2) pediatrics, and (3) intensive care. Studies were included if researchers assessed AI use to improve at least 1 health outcome (eg, mortality). DATA EXTRACTION Data extraction was conducted independently by 2 researchers. Articles were categorized by direct or indirect impact of AI, defined by the European Institute of Innovation and Technology Health joint report. RESULTS Of the 287 publications screened, 32 met inclusion criteria. Approximately 22% (n = 7) of studies revealed a direct impact and improvement in health outcomes after AI implementation. Majority were in prototype testing, and few were deployed into an ICU setting. Among the remaining 78% (n = 25) AI models outperformed standard clinical modalities and may have indirectly influenced patient outcomes. Quantitative assessment of health outcomes using statistical measures, such as area under the receiver operating curve (56%; n = 18) and specificity (38%; n = 12), revealed marked heterogeneity in metrics and standardization. CONCLUSIONS Few studies have revealed that AI has directly improved health outcomes for pediatric critical care patients. Further prospective, experimental studies are needed to assess AI's impact by using established implementation frameworks, standardized metrics, and validated outcome measures.
Collapse
Affiliation(s)
- Claudette O Adegboro
- Department of Pediatrics, School of Medicine and Public Health, University of Wisconsin, Madison, Wisconsin
| | - Avishek Choudhury
- Division of Engineering Management, School of Systems and Enterprise, Stevens Institute of Technology, Hoboken, New Jersey
| | - Onur Asan
- Division of Engineering Management, School of Systems and Enterprise, Stevens Institute of Technology, Hoboken, New Jersey
| | - Michelle M Kelly
- Department of Pediatrics, School of Medicine and Public Health, University of Wisconsin, Madison, Wisconsin
| |
Collapse
|
24
|
Ma B, Zhang F, Ma B. Self-Attention-Guided Recurrent Neural Network and Motion Perception for Intelligent Prediction of Chronic Diseases. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:6382619. [PMID: 34745506 PMCID: PMC8566041 DOI: 10.1155/2021/6382619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/28/2021] [Revised: 09/14/2021] [Accepted: 09/16/2021] [Indexed: 11/18/2022]
Abstract
Parkinson's disease is a common chronic disease that affects a large number of people. In the real world, however, Parkinson's disease can result in a loss of physical performance, which is classified as a movement disorder by clinicians. Parkinson's disease is currently diagnosed primarily through clinical symptoms, which are highly dependent on clinician experience. As a result, there is a need for effective early detection methods. Traditional machine learning algorithms filter out many inherently relevant features in the process of dimensionality reduction and feature classification, lowering the classification model's performance. To solve this problem and ensure high correlation between features while reducing dimensionality to achieve the goal of improving classification performance, this paper proposes a recurrent neural network classification model based on self attention and motion perception. Using a combination of self-attention mechanism and recurrent neural network, as well as wearable inertial sensors, the model classifies and trains the five brain area features extracted from MRI and DTI images (cerebral gray matter, white matter, cerebrospinal fluid density, and so on). Clinical and exercise data can be combined to produce characteristic parameters that can be used to describe movement sluggishness. The experimental results show that the model proposed in this paper improves the recognition performance of Parkinson's disease, which is better than the compared methods by 2.45% to 12.07%.
Collapse
Affiliation(s)
- Baojuan Ma
- Physical Education Department, Shijiazhuang Information Engineering Vocational College, Shijiazhuang 05000, Hebei, China
| | - Fengyan Zhang
- Physical Education Department, Shijiazhuang Information Engineering Vocational College, Shijiazhuang 05000, Hebei, China
| | - Baoling Ma
- Physical Education and Health College, Hebei Normal University of Science and Technology, Qinhuangdao 066004, Hebei, China
| |
Collapse
|
25
|
Javadi-Pashaki N, Ghazanfari MJ, Karkhah S. Machine Learning for Geriatric Clinical Care: Opportunities and Challenges. Ann Geriatr Med Res 2021; 25:137-138. [PMID: 34120436 PMCID: PMC8272992 DOI: 10.4235/agmr.21.0054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Accepted: 06/05/2021] [Indexed: 12/01/2022] Open
Affiliation(s)
- Nazila Javadi-Pashaki
- Social Determinants of Health Research Center (SDHRC), Guilan University of Medical Sciences, Rasht, Iran.,Department of Nursing, Cardiovascular Diseases Research Center, School of Nursing and Midwifery, Guilan University of Medical Sciences, Rasht, Iran
| | - Mohammad Javad Ghazanfari
- Department of Medical-Surgical Nursing, School of Nursing and Midwifery, Kashan University of Medical Sciences, Kashan, Iran
| | - Samad Karkhah
- Department of Medical-Surgical Nursing, School of Nursing and Midwifery, Guilan University of Medical Sciences, Rasht, Iran
| |
Collapse
|
26
|
Asan O, Choudhury A. Research Trends in Artificial Intelligence Applications in Human Factors Health Care: Mapping Review. JMIR Hum Factors 2021; 8:e28236. [PMID: 34142968 PMCID: PMC8277302 DOI: 10.2196/28236] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 04/14/2021] [Accepted: 05/03/2021] [Indexed: 01/17/2023] Open
Abstract
BACKGROUND Despite advancements in artificial intelligence (AI) to develop prediction and classification models, little research has been devoted to real-world translations with a user-centered design approach. AI development studies in the health care context have often ignored two critical factors of ecological validity and human cognition, creating challenges at the interface with clinicians and the clinical environment. OBJECTIVE The aim of this literature review was to investigate the contributions made by major human factors communities in health care AI applications. This review also discusses emerging research gaps, and provides future research directions to facilitate a safer and user-centered integration of AI into the clinical workflow. METHODS We performed an extensive mapping review to capture all relevant articles published within the last 10 years in the major human factors journals and conference proceedings listed in the "Human Factors and Ergonomics" category of the Scopus Master List. In each published volume, we searched for studies reporting qualitative or quantitative findings in the context of AI in health care. Studies are discussed based on the key principles such as evaluating workload, usability, trust in technology, perception, and user-centered design. RESULTS Forty-eight articles were included in the final review. Most of the studies emphasized user perception, the usability of AI-based devices or technologies, cognitive workload, and user's trust in AI. The review revealed a nascent but growing body of literature focusing on augmenting health care AI; however, little effort has been made to ensure ecological validity with user-centered design approaches. Moreover, few studies (n=5 against clinical/baseline standards, n=5 against clinicians) compared their AI models against a standard measure. CONCLUSIONS Human factors researchers should actively be part of efforts in AI design and implementation, as well as dynamic assessments of AI systems' effects on interaction, workflow, and patient outcomes. An AI system is part of a greater sociotechnical system. Investigators with human factors and ergonomics expertise are essential when defining the dynamic interaction of AI within each element, process, and result of the work system.
Collapse
Affiliation(s)
- Onur Asan
- School of Systems and Enterprises, Stevens Institute of Technology, Hoboken, NJ, United States
| | - Avishek Choudhury
- School of Systems and Enterprises, Stevens Institute of Technology, Hoboken, NJ, United States
| |
Collapse
|
27
|
Pickens S, Daniel M, Jones EC, Jefferson F. Development of a Conceptual Framework for Severe Self-Neglect (SN) by Modifying the CREST Model for Self-Neglect. Front Med (Lausanne) 2021; 8:654627. [PMID: 34079809 PMCID: PMC8165169 DOI: 10.3389/fmed.2021.654627] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Accepted: 03/02/2021] [Indexed: 11/26/2022] Open
Abstract
Self-neglect is an inability or refusal to meet one's own basic needs as accepted by societal norms and is the most common report received by state agencies charged with investigating abuse, neglect and exploitation of vulnerable adults. Self-neglect is often seen in addition to one or multiple conditions of frailty, mild to severe dementia, poor sleep and depression. While awareness of elder self-neglect as a public health condition and intervention has significantly risen in the past decade as evidenced by the increasing amount of literature available, research on self-neglect still lacks comprehensiveness and clarity since its inception to the medical literature in the late 1960s. With the burgeoning of the older adult population, commonness of self-neglect will most likely increase as the current incidence rate represents only the "tip of the iceberg" theory given that most cases are unreported. The COVID-19 pandemic has exacerbated the incidence of self-neglect in aged populations and the need for the use of intervention tools for aging adults and geriatric patients living alone, many of which may include in-home artificial intelligence systems. Despite this, little research has been conducted on aspects of self-neglect other than definition and identification. Substantial further study of this disorder's etiology, educating society on early detection, and conceivably preventing this syndrome altogether or at least halting progression and abating its severity is needed. The purpose of this research is to provide a definition of severe self-neglect, identify key concepts related to self-neglect, comprehensively describe this syndrome, present a conceptual framework and analyze the model for its usefulness, generalizability, parsimony, and testability.
Collapse
Affiliation(s)
- Sabrina Pickens
- Department of Research, University of Texas Health Science Center at Houston, Jane and Robert Cizik School of Nursing, Houston, TX, United States
| | - Mary Daniel
- Department of Research, University of Texas Health Science Center at Houston, Jane and Robert Cizik School of Nursing, Houston, TX, United States
| | - Erick C. Jones
- College of Engineering, Industrial, Manufacturing and Systems Engineering Department, University of Texas Arlington, Arlington, TX, United States
| | - Felicia Jefferson
- Biology Academic Department, Fort Valley State University, Fort Valley, GA, United States
| |
Collapse
|
28
|
Secinaro S, Calandra D, Secinaro A, Muthurangu V, Biancone P. The role of artificial intelligence in healthcare: a structured literature review. BMC Med Inform Decis Mak 2021; 21:125. [PMID: 33836752 PMCID: PMC8035061 DOI: 10.1186/s12911-021-01488-9] [Citation(s) in RCA: 121] [Impact Index Per Article: 40.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Accepted: 04/01/2021] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND/INTRODUCTION Artificial intelligence (AI) in the healthcare sector is receiving attention from researchers and health professionals. Few previous studies have investigated this topic from a multi-disciplinary perspective, including accounting, business and management, decision sciences and health professions. METHODS The structured literature review with its reliable and replicable research protocol allowed the researchers to extract 288 peer-reviewed papers from Scopus. The authors used qualitative and quantitative variables to analyse authors, journals, keywords, and collaboration networks among researchers. Additionally, the paper benefited from the Bibliometrix R software package. RESULTS The investigation showed that the literature in this field is emerging. It focuses on health services management, predictive medicine, patient data and diagnostics, and clinical decision-making. The United States, China, and the United Kingdom contributed the highest number of studies. Keyword analysis revealed that AI can support physicians in making a diagnosis, predicting the spread of diseases and customising treatment paths. CONCLUSIONS The literature reveals several AI applications for health services and a stream of research that has not fully been covered. For instance, AI projects require skills and data quality awareness for data-intensive analysis and knowledge-based management. Insights can help researchers and health professionals understand and address future research on AI in the healthcare field.
Collapse
Affiliation(s)
| | - Davide Calandra
- Department of Management, University of Turin, Turin, Italy.
| | | | - Vivek Muthurangu
- Institute of Child Health, University College London, London, UK
| | - Paolo Biancone
- Department of Management, University of Turin, Turin, Italy
| |
Collapse
|