1
|
Ko RE, Kim Z, Jeon B, Ji M, Chung CR, Suh GY, Chung MJ, Cho BH. Deep Learning-Based Early Warning Score for Predicting Clinical Deterioration in General Ward Cancer Patients. Cancers (Basel) 2023; 15:5145. [PMID: 37958319 PMCID: PMC10647448 DOI: 10.3390/cancers15215145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Revised: 10/24/2023] [Accepted: 10/24/2023] [Indexed: 11/15/2023] Open
Abstract
BACKGROUND Cancer patients who are admitted to hospitals are at high risk of short-term deterioration due to treatment-related or cancer-specific complications. A rapid response system (RRS) is initiated when patients who are deteriorating or at risk of deteriorating are identified. This study was conducted to develop a deep learning-based early warning score (EWS) for cancer patients (Can-EWS) using delta values in vital signs. METHODS A retrospective cohort study was conducted on all oncology patients who were admitted to the general ward between 2016 and 2020. The data were divided into a training set (January 2016-December 2019) and a held-out test set (January 2020-December 2020). The primary outcome was clinical deterioration, defined as the composite of in-hospital cardiac arrest (IHCA) and unexpected intensive care unit (ICU) transfer. RESULTS During the study period, 19,739 cancer patients were admitted to the general wards and eligible for this study. Clinical deterioration occurred in 894 cases. IHCA and unexpected ICU transfer prevalence was 1.77 per 1000 admissions and 43.45 per 1000 admissions, respectively. We developed two models: Can-EWS V1, which used input vectors of the original five input variables, and Can-EWS V2, which used input vectors of 10 variables (including an additional five delta variables). The cross-validation performance of the clinical deterioration for Can-EWS V2 (AUROC, 0.946; 95% confidence interval [CI], 0.943-0.948) was higher than that for MEWS of 5 (AUROC, 0.589; 95% CI, 0.587-0.560; p < 0.001) and Can-EWS V1 (AUROC, 0.927; 95% CI, 0.924-0.931). As a virtual prognostic study, additional validation was performed on held-out test data. The AUROC and 95% CI were 0.588 (95% CI, 0.588-0.589), 0.890 (95% CI, 0.888-0.891), and 0.898 (95% CI, 0.897-0.899), for MEWS of 5, Can-EWS V1, and the deployed model Can-EWS V2, respectively. Can-EWS V2 outperformed other approaches for specificities, positive predictive values, negative predictive values, and the number of false alarms per day at the same sensitivity level on the held-out test data. CONCLUSIONS We have developed and validated a deep learning-based EWS for cancer patients using the original values and differences between consecutive measurements of basic vital signs. The Can-EWS has acceptable discriminatory power and sensitivity, with extremely decreased false alarms compared with MEWS.
Collapse
Affiliation(s)
- Ryoung-Eun Ko
- Department of Critical Care Medicine, Samsung Medical Center, School of Medicine, Sungkyunkwan University, 81 Irwon-ro, Gangnam-gu, Seoul 06351, Republic of Korea; (R.-E.K.); (C.R.C.); (G.Y.S.)
| | - Zero Kim
- Medical AI Research Center, Samsung Medical Center, Seoul 06351, Republic of Korea; (Z.K.); (B.J.); (M.J.); (M.J.C.)
- Department of Data Convergence and Future Medicine, School of Medicine, Sungkyunkwan University, Seoul 06351, Republic of Korea
| | - Bomi Jeon
- Medical AI Research Center, Samsung Medical Center, Seoul 06351, Republic of Korea; (Z.K.); (B.J.); (M.J.); (M.J.C.)
| | - Migyeong Ji
- Medical AI Research Center, Samsung Medical Center, Seoul 06351, Republic of Korea; (Z.K.); (B.J.); (M.J.); (M.J.C.)
| | - Chi Ryang Chung
- Department of Critical Care Medicine, Samsung Medical Center, School of Medicine, Sungkyunkwan University, 81 Irwon-ro, Gangnam-gu, Seoul 06351, Republic of Korea; (R.-E.K.); (C.R.C.); (G.Y.S.)
- Department of Medicine, Samsung Medical Center, Sungkyunkwan University, Seoul 06351, Republic of Korea
| | - Gee Young Suh
- Department of Critical Care Medicine, Samsung Medical Center, School of Medicine, Sungkyunkwan University, 81 Irwon-ro, Gangnam-gu, Seoul 06351, Republic of Korea; (R.-E.K.); (C.R.C.); (G.Y.S.)
- Devision of Pulmonary and Critical Care Medicine, Department of Medicine, Samsung Medical Center, Sungkyunkwan University, Seoul 06351, Republic of Korea
| | - Myung Jin Chung
- Medical AI Research Center, Samsung Medical Center, Seoul 06351, Republic of Korea; (Z.K.); (B.J.); (M.J.); (M.J.C.)
- Department of Data Convergence and Future Medicine, School of Medicine, Sungkyunkwan University, Seoul 06351, Republic of Korea
| | - Baek Hwan Cho
- Department of Biomedical Informatics, School of Medicine, CHA University, Seongnam 13497, Republic of Korea
- Institute of Biomedical Informatics, School of Medicine, CHA University, Seongnam 13497, Republic of Korea
| |
Collapse
|
2
|
Williams G, Pirret A, Credland N, Odell M, Raftery C, Smith D, Winterbottom F, Massey D. A practical approach to establishing a critical care outreach service: An expert panel research design. Aust Crit Care 2023; 36:151-158. [PMID: 35341667 DOI: 10.1016/j.aucc.2022.01.008] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2021] [Revised: 12/18/2021] [Accepted: 01/18/2022] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND For over two decades, nurse-led critical care outreach services have improved the recognition, response, and management of deteriorating patients in general hospital wards, yet variation in terms, design, implementation, and evaluation of such services continue. For those establishing a critical care outreach service, these factors make the literature difficult to interpret and translate to the real-world setting. AIM The aim of this study was to provide a practical approach to establishing a critical care outreach service in the hospital setting. METHOD An international expert panel of clinicians, managers, and academics with experience in implementing, developing, operationalising, educating, and evaluating critical care outreach services collaborated to synthesise evidence, experience, and clinical judgment to develop a practical approach for those establishing a critical care outreach service. A rapid review of the literature identified publications relevant to the study. A modified Delphi technique was used to achieve expert panel consensus particularly in areas where insufficient published literature or ambiguities existed. FINDINGS There were 502 publications sourced from the rapid review, of which 104 were relevant and reviewed. Using the modified Delphi technique, the expert panel identified five key components needed to establish a critical care outreach service: (i) approaches to service delivery, (ii) education and training, (iii) organisational engagement, (iv) clinical governance, and (v) monitoring and evaluation. CONCLUSION An expert panel research design successfully synthesised evidence, experience, and clinical judgement to provide a practical approach for those establishing a critical care outreach service. This method of research will likely be valuable in other areas of practice where terms are used interchangeably, and the literature is diverse and lacking a single approach to practice.
Collapse
Affiliation(s)
- Ged Williams
- School of Nursing & Midwifery, Griffith University, Australia; South Metropolitan Health Service, Perth, Australia.
| | - Alison Pirret
- Critical Care Complex, Middlemore Hospital, Auckland, New Zealand; Massey University, Auckland, New Zealand
| | - Nicki Credland
- Reader in Critical Care Education, University of Hull, United Kingdom; Chair British Association of Critical Care Nurses (BACCN), United Kingdom
| | - Mandy Odell
- Critical Care, Royal Berkshire Hospital, NHS FT, Reading, United Kingdom
| | - Chris Raftery
- School of Nursing, Queensland University of Technology, Australia; Gold Coast Health, Queensland, Australia
| | - Duncan Smith
- City, University of London, Northampton Square, London, UK; Honorary Charge Nurse - Patient Emergency Response & Resuscitation Team, University College London Hospitals NHS Foundation Trust, London, United Kingdom
| | | | - Debbie Massey
- Southern Cross University, Australia; Intensive Care Unit John Flynn Hospital, Tugun, Australia
| |
Collapse
|
3
|
Lee J, Ban WH, Kim SW, Kim EY, Han MR, Kim SC. Utilization of a rapid response team and associated outcomes in patients with malignancy. Acute Crit Care 2020; 35:16-23. [PMID: 32131577 PMCID: PMC7056961 DOI: 10.4266/acc.2019.00675] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2019] [Accepted: 02/19/2020] [Indexed: 12/03/2022] Open
Abstract
Background: Recent advances in diagnosis and treatment have improved long-term outcomes in cancer patients. As a result, the requirement for a rapid response team (RRT) for cancer patients is also increasing. This study aimed to analyze utilization of an RRT and the associations between related factors and mortality in a population of cancer patients. Methods: This retrospective cohort study included hospitalized patients at a single academic medical center in Seoul, Korea, who required RRT activation during a 6-year period from June 2013 to December 2018. Results: Overall, 164 of the 457 patients who met the above criteria were cancer patients, and they had a significantly higher Charlson comorbidity score than the non-cancer patients (5.0 vs. 7.0, P<0.001). A significantly larger proportion of cancer patients required intensive care unit transfer (51.8% vs. 41.0%, P=0.032). Cancer patients also had significantly higher in-hospital mortality compared with other patients (39.6% vs. 10.9%, P<0.001). Furthermore, presence of cancer was independently associated with in-hospital mortality (adjusted odds ratio [OR], 2.09; 95% confidence interval [CI], 1.11 to 3.93). Among cancer patients, higher Acute Physiology and Chronic Health Evaluation (APACHE) II at the time of RRT activation was significantly associated with in-hospital mortality regardless of malignancy (adjusted OR, 1.08; 95% CI, 1.01 to 1.15). Conclusions: Cancer patients requiring RRT activation have significantly higher rates of inhospital mortality than patients not using RRT. Higher severity score at the time of RRT activation in patients with malignancy was significantly associated with in-hospital mortality.
Collapse
Affiliation(s)
- Jongmin Lee
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Woo Ho Ban
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Eunpyeong St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Sei Won Kim
- Division of Trauma and Surgical Critical Care, Department of Surgery, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Eun Young Kim
- Division of Trauma and Surgical Critical Care, Department of Surgery, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Mi Ra Han
- St. Mary's Advanced Life Support Team, Department of Nursing, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Seok Chan Kim
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| |
Collapse
|
4
|
Williams M, Cardona-Morrell M, Stevens P, Bey J, Smith Glasgow M. Timing of palliative care team referrals for inpatients receiving rapid response services: A retrospective pilot study in a US hospital. Int J Nurs Stud 2017; 75:147-153. [DOI: 10.1016/j.ijnurstu.2017.07.017] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2017] [Revised: 07/28/2017] [Accepted: 07/29/2017] [Indexed: 01/13/2023]
|
5
|
Azoulay E, Schellongowski P, Darmon M, Bauer PR, Benoit D, Depuydt P, Divatia JV, Lemiale V, van Vliet M, Meert AP, Mokart D, Pastores SM, Perner A, Pène F, Pickkers P, Puxty KA, Vincent F, Salluh J, Soubani AO, Antonelli M, Staudinger T, von Bergwelt-Baildon M, Soares M. The Intensive Care Medicine research agenda on critically ill oncology and hematology patients. Intensive Care Med 2017; 43:1366-1382. [PMID: 28725926 DOI: 10.1007/s00134-017-4884-z] [Citation(s) in RCA: 114] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2017] [Accepted: 07/08/2017] [Indexed: 12/13/2022]
Abstract
Over the coming years, accelerating progress against cancer will be associated with an increased number of patients who require life-sustaining therapies for infectious or toxic chemotherapy-related events. Major changes include increased number of cancer patients admitted to the ICU with full-code status or for time-limited trials, increased survival and quality of life in ICU survivors, changing prognostic factors, early ICU admission for optimal monitoring, and use of noninvasive diagnostic and therapeutic strategies. In this review, experts in the management of critically ill cancer patients highlight recent changes in the use and the results of intensive care in patients with malignancies. They seek to put forward a standard of care for the management of these patients and highlight important updates that are required to care for them. The research agenda they suggest includes important studies to be conducted in the next few years to increase our understanding of organ dysfunction in this population and to improve our ability to appropriately use life-saving therapies or select new therapeutic approaches that are likely to improve outcomes. This review aims to provide more guidance for the daily management of patients with cancer, in whom outcomes are constantly improving, as is our global ability to fight against what is becoming the leading cause of mortality in industrialized and non-industrialized countries.
Collapse
Affiliation(s)
- Elie Azoulay
- ECSTRA Team, and Clinical Epidemiology, UMR 1153 (Center of Epidemiology and Biostatistics, Sorbonne Paris Cité, CRESS), INSERM, Paris Diderot Sorbonne University, Paris, France.
- Medical Intensive Care Unit, Hôpital Saint-Louis, Paris, France.
| | | | - Michael Darmon
- Saint-Etienne University Hospital, Saint-Etienne, France
| | | | | | | | | | | | | | | | | | | | | | | | - Peter Pickkers
- Radboud University Medical Center, Nijmegen, The Netherlands
| | | | | | - Jorge Salluh
- Instituto de Ensino e Perquisa da Santa Casa de Belo Horizonte, Rio de Janeiro, Brazil
| | | | | | | | | | - Marcio Soares
- Instituto Nacional de Câncer (INCA), Rio de Janeiro, Brazil
| |
Collapse
|