1
|
La Via L, Sangiorgio G, Stefani S, Marino A, Nunnari G, Cocuzza S, La Mantia I, Cacopardo B, Stracquadanio S, Spampinato S, Lavalle S, Maniaci A. The Global Burden of Sepsis and Septic Shock. EPIDEMIOLOGIA 2024; 5:456-478. [PMID: 39189251 PMCID: PMC11348270 DOI: 10.3390/epidemiologia5030032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 07/07/2024] [Accepted: 07/18/2024] [Indexed: 08/28/2024] Open
Abstract
A dysregulated host response to infection causes organ dysfunction in sepsis and septic shock, two potentially fatal diseases. They continue to be major worldwide health burdens with high rates of morbidity and mortality despite advancements in medical care. The goal of this thorough review was to present a thorough summary of the current body of knowledge about the prevalence of sepsis and septic shock worldwide. Using widely used computerized databases, a comprehensive search of the literature was carried out, and relevant studies were chosen in accordance with predetermined inclusion and exclusion criteria. A narrative technique was used to synthesize the data that were retrieved. The review's conclusions show how widely different locations and nations differ in terms of sepsis and septic shock's incidence, prevalence, and fatality rates. Compared to high-income countries (HICs), low- and middle-income countries (LMICs) are disproportionately burdened more heavily. We talk about risk factors, comorbidities, and difficulties in clinical management and diagnosis in a range of healthcare settings. The review highlights the need for more research, enhanced awareness, and context-specific interventions in order to successfully address the global burden of sepsis and septic shock.
Collapse
Affiliation(s)
- Luigi La Via
- Department of Anaesthesia and Intensive Care, University Hospital Policlinico “G. Rodolico-San Marco”, 24046 Catania, Italy
| | - Giuseppe Sangiorgio
- Department of Biomedical and Biotechnological Sciences, University of Catania, Via Santa Sofia 97, 95123 Catania, Italy; (G.S.); (S.S.); (S.S.)
| | - Stefania Stefani
- Department of Biomedical and Biotechnological Sciences, University of Catania, Via Santa Sofia 97, 95123 Catania, Italy; (G.S.); (S.S.); (S.S.)
| | - Andrea Marino
- Unit of Infectious Diseases, Department of Clinical and Experimental Medicine, ARNAS Garibaldi Hospital, University of Catania, 95123 Catania, Italy; (A.M.); (G.N.); (B.C.); (S.S.)
| | - Giuseppe Nunnari
- Unit of Infectious Diseases, Department of Clinical and Experimental Medicine, ARNAS Garibaldi Hospital, University of Catania, 95123 Catania, Italy; (A.M.); (G.N.); (B.C.); (S.S.)
| | - Salvatore Cocuzza
- Department of Medical, Surgical Sciences and Advanced Technologies “GF Ingrassia” ENT Section, University of Catania, 95123 Catania, Italy; (S.C.); (I.L.M.)
| | - Ignazio La Mantia
- Department of Medical, Surgical Sciences and Advanced Technologies “GF Ingrassia” ENT Section, University of Catania, 95123 Catania, Italy; (S.C.); (I.L.M.)
| | - Bruno Cacopardo
- Unit of Infectious Diseases, Department of Clinical and Experimental Medicine, ARNAS Garibaldi Hospital, University of Catania, 95123 Catania, Italy; (A.M.); (G.N.); (B.C.); (S.S.)
| | - Stefano Stracquadanio
- Department of Biomedical and Biotechnological Sciences, University of Catania, Via Santa Sofia 97, 95123 Catania, Italy; (G.S.); (S.S.); (S.S.)
| | - Serena Spampinato
- Unit of Infectious Diseases, Department of Clinical and Experimental Medicine, ARNAS Garibaldi Hospital, University of Catania, 95123 Catania, Italy; (A.M.); (G.N.); (B.C.); (S.S.)
| | - Salvatore Lavalle
- Department of Medicine and Surgery, University of Enna “Kore”, 94100 Enna, Italy; (S.L.); (A.M.)
| | - Antonino Maniaci
- Department of Medicine and Surgery, University of Enna “Kore”, 94100 Enna, Italy; (S.L.); (A.M.)
| |
Collapse
|
2
|
Rhee C, Strich JR, Chiotos K, Classen DC, Cosgrove SE, Greeno R, Heil EL, Kadri SS, Kalil AC, Gilbert DN, Masur H, Septimus EJ, Sweeney DA, Terry A, Winslow DL, Yealy DM, Klompas M. Improving Sepsis Outcomes in the Era of Pay-for-Performance and Electronic Quality Measures: A Joint IDSA/ACEP/PIDS/SHEA/SHM/SIDP Position Paper. Clin Infect Dis 2024; 78:505-513. [PMID: 37831591 DOI: 10.1093/cid/ciad447] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Indexed: 10/15/2023] Open
Abstract
The Centers for Medicare & Medicaid Services (CMS) introduced the Severe Sepsis/Septic Shock Management Bundle (SEP-1) as a pay-for-reporting measure in 2015 and is now planning to make it a pay-for-performance measure by incorporating it into the Hospital Value-Based Purchasing Program. This joint IDSA/ACEP/PIDS/SHEA/SHM/SIPD position paper highlights concerns with this change. Multiple studies indicate that SEP-1 implementation was associated with increased broad-spectrum antibiotic use, lactate measurements, and aggressive fluid resuscitation for patients with suspected sepsis but not with decreased mortality rates. Increased focus on SEP-1 risks further diverting attention and resources from more effective measures and comprehensive sepsis care. We recommend retiring SEP-1 rather than using it in a payment model and shifting instead to new sepsis metrics that focus on patient outcomes. CMS is developing a community-onset sepsis 30-day mortality electronic clinical quality measure (eCQM) that is an important step in this direction. The eCQM preliminarily identifies sepsis using systemic inflammatory response syndrome (SIRS) criteria, antibiotic administrations or diagnosis codes for infection or sepsis, and clinical indicators of acute organ dysfunction. We support the eCQM but recommend removing SIRS criteria and diagnosis codes to streamline implementation, decrease variability between hospitals, maintain vigilance for patients with sepsis but without SIRS, and avoid promoting antibiotic use in uninfected patients with SIRS. We further advocate for CMS to harmonize the eCQM with the Centers for Disease Control and Prevention's (CDC) Adult Sepsis Event surveillance metric to promote unity in federal measures, decrease reporting burden for hospitals, and facilitate shared prevention initiatives. These steps will result in a more robust measure that will encourage hospitals to pay more attention to the full breadth of sepsis care, stimulate new innovations in diagnosis and treatment, and ultimately bring us closer to our shared goal of improving outcomes for patients.
Collapse
Affiliation(s)
- Chanu Rhee
- Department of Population Medicine, Harvard Medical School/Harvard Pilgrim Health Care Institute, Boston, Massachusetts, USA
- Division of Infectious Diseases, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Jeffrey R Strich
- Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA
| | - Kathleen Chiotos
- Department of Anesthesiology and Critical Care Medicine, Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
| | - David C Classen
- Division of Epidemiology, Department of Medicine, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Sara E Cosgrove
- Division of Infectious Diseases, Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Ron Greeno
- Society of Hospital Medicine, Philadelphia, Pennsylvania, USA
| | - Emily L Heil
- Department of Practice, Sciences, and Health Outcomes Research, University of Maryland School of Pharmacy, Baltimore, Maryland, USA
| | - Sameer S Kadri
- Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA
| | - Andre C Kalil
- Division of Infectious Diseases, Department of Internal Medicine, University of Nebraska School of Medicine, Omaha, Nebraska, USA
| | - David N Gilbert
- Division of Infectious Diseases, Department of Medicine, Oregon Health and Science University, Portland, Oregon, USA
| | - Henry Masur
- Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA
| | - Edward J Septimus
- Department of Population Medicine, Harvard Medical School/Harvard Pilgrim Health Care Institute, Boston, Massachusetts, USA
- Department of Internal Medicine, Texas A&M College of Medicine, Houston, Texas, USA
| | - Daniel A Sweeney
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, University of California San Diego School of Medicine, San Diego, California, USA
| | - Aisha Terry
- Department of Emergency Medicine, George Washington University School of Medicine, Washington D.C., USA
| | - Dean L Winslow
- Division of Infectious Diseases, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Donald M Yealy
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| | - Michael Klompas
- Department of Population Medicine, Harvard Medical School/Harvard Pilgrim Health Care Institute, Boston, Massachusetts, USA
- Division of Infectious Diseases, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
| |
Collapse
|
3
|
Su L, Liu S, Long Y, Chen C, Chen K, Chen M, Chen Y, Cheng Y, Cui Y, Ding Q, Ding R, Duan M, Gao T, Gu X, He H, He J, Hu B, Hu C, Huang R, Huang X, Jiang H, Jiang J, Lan Y, Li J, Li L, Li L, Li W, Li Y, Lin J, Luo X, Lyu F, Mao Z, Miao H, Shang X, Shang X, Shang Y, Shen Y, Shi Y, Sun Q, Sun W, Tang Z, Wang B, Wang H, Wang H, Wang L, Wang L, Wang S, Wang Z, Wang Z, Wei D, Wu J, Wu Q, Xing X, Yang J, Yang X, Yu J, Yu W, Yu Y, Yuan H, Zhai Q, Zhang H, Zhang L, Zhang M, Zhang Z, Zhao C, Zheng R, Zhong L, Zhou F, Zhu W. Chinese experts' consensus on the application of intensive care big data. Front Med (Lausanne) 2024; 10:1174429. [PMID: 38264049 PMCID: PMC10804886 DOI: 10.3389/fmed.2023.1174429] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2023] [Accepted: 11/09/2023] [Indexed: 01/25/2024] Open
Abstract
The development of intensive care medicine is inseparable from the diversified monitoring data. Intensive care medicine has been closely integrated with data since its birth. Critical care research requires an integrative approach that embraces the complexity of critical illness and the computational technology and algorithms that can make it possible. Considering the need of standardization of application of big data in intensive care, Intensive Care Medicine Branch of China Health Information and Health Care Big Data Society, Standard Committee has convened expert group, secretary group and the external audit expert group to formulate Chinese Experts' Consensus on the Application of Intensive Care Big Data (2022). This consensus makes 29 recommendations on the following five parts: Concept of intensive care big data, Important scientific issues, Standards and principles of database, Methodology in solving big data problems, Clinical application and safety consideration of intensive care big data. The consensus group believes this consensus is the starting step of application big data in the field of intensive care. More explorations and big data based retrospective research should be carried out in order to enhance safety and reliability of big data based models of critical care field.
Collapse
Affiliation(s)
- Longxiang Su
- Department of Critical Care Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, China
| | - Shengjun Liu
- Department of Critical Care Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, China
| | - Yun Long
- Department of Critical Care Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, China
| | - Chaodong Chen
- Department of Surgical Intensive Critical Unit, Beijing Chao-yang Hospital, Capital Medical University, Beijing, China
| | - Kai Chen
- Department of Critical Care Medicine, Fujian Provincial Key Laboratory of Critical Care Medicine, Shengli Clinical Medical College of Fujian Medical University, Fujian Provincial Hospital, Fujian Provincial Center for Critical Care Medicine, Fuzhou, Fujian, China
| | - Ming Chen
- Department of Critical Care Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, Jiangsu, China
| | - Yaolong Chen
- Evidence-based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
| | - Yisong Cheng
- Department of Critical Care Medicine, West China Hospital of Sichuan University, Chengdu, China
| | - Yating Cui
- Department of Critical Care Medicine, The First Medical Center, Chinese PLA General Hospital, Beijing, China
| | - Qi Ding
- Department of Surgical Intensive Critical Unit, Beijing Chao-yang Hospital, Capital Medical University, Beijing, China
| | - Renyu Ding
- Department of Intensive Care Unit, The First Hospital of China Medical University, Shenyang, Liaoning, China
| | - Meili Duan
- Department of Critical Care Medicine, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Tao Gao
- Department of Critical Care Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, Jiangsu, China
| | - Xiaohua Gu
- Department of Critical Care Medicine, Northern Jiangsu People’s Hospital; Clinical Medical College, Yangzhou University, Yangzhou, China
| | - Hongli He
- Intensive Care Unit, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, School of Medicine of University of Electronic Science and Technology, Chengdu, China
| | - Jiawei He
- Department of Critical Care Medicine, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Bo Hu
- Department of Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan, Hubei, China
| | - Chang Hu
- Department of Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan, Hubei, China
| | - Rui Huang
- Department of Critical Care Medicine, The Second Affiliated Hospital of Harbin Medical University, Harbin, Heilongjiang, China
| | - Xiaobo Huang
- Intensive Care Unit, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, School of Medicine of University of Electronic Science and Technology, Chengdu, China
| | - Huizhen Jiang
- Department of Information Center, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, China
| | - Jing Jiang
- Department of Critical Care Medicine, Chongqing General Hospital, Chongqing, China
| | - Yunping Lan
- Intensive Care Unit, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, School of Medicine of University of Electronic Science and Technology, Chengdu, China
| | - Jun Li
- Department of Critical Care Medicine, Fujian Provincial Key Laboratory of Critical Care Medicine, Shengli Clinical Medical College of Fujian Medical University, Fujian Provincial Hospital, Fujian Provincial Center for Critical Care Medicine, Fuzhou, Fujian, China
| | - Linfeng Li
- Medical Data Research Institute, Chongqing Medical University, Chongqing, China
| | - Lu Li
- Department of Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan, Hubei, China
| | - Wenxiong Li
- Department of Surgical Intensive Critical Unit, Beijing Chao-yang Hospital, Capital Medical University, Beijing, China
| | - Yongzai Li
- Information Network Center, QiLu Hospital, ShanDong University, Jinan, China
| | - Jin Lin
- Department of Critical Care Medicine, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Xufei Luo
- Evidence-based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
| | - Feng Lyu
- Department of Computer Science and Engineering, Central South University, Changsha, China
| | - Zhi Mao
- Department of Critical Care Medicine, The First Medical Center, Chinese PLA General Hospital, Beijing, China
| | - He Miao
- Department of Intensive Care Unit, The First Hospital of China Medical University, Shenyang, Liaoning, China
| | - Xiaopu Shang
- Department of Information Management, Beijing Jiaotong University, Beijing, China
| | - Xiuling Shang
- Department of Critical Care Medicine, Fujian Provincial Key Laboratory of Critical Care Medicine, Shengli Clinical Medical College of Fujian Medical University, Fujian Provincial Hospital, Fujian Provincial Center for Critical Care Medicine, Fuzhou, Fujian, China
| | - You Shang
- Department of Critical Care Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yuwen Shen
- Intensive Care Unit of Cardiovascular Surgery Department, Qilu Hospital of Shandong University, Jinan, China
| | - Yinghuan Shi
- National Institute of Healthcare Data Science, Nanjing University, Nanjing, China
| | - Qihang Sun
- British Chinese Society of Health Informatics, Beijing, China
| | - Weijun Sun
- Faculty of Automation, Guangdong University of Technology, Guangzhou, China
| | - Zhiyun Tang
- Department of Intensive Care Unit, Zhejiang Provincial People’s Hospital, Affiliated People’s Hospital, Emergency and Intensive Care Unit Center, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Bo Wang
- Department of Critical Care Medicine, West China Hospital of Sichuan University, Chengdu, China
| | - Haijun Wang
- Department of Intensive Care Unit, National Cancer Center/National Clinical Research Center, Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Hongliang Wang
- Department of Critical Care Medicine, The Second Affiliated Hospital of Harbin Medical University, Harbin, Heilongjiang, China
| | - Li Wang
- Department of Epidemiology and Biostatistics, Institute of Basic Medical Sciences Chinese Academy of Medical Sciences; School of Basic Medicine Peking Union Medical College, Beijing, China
| | - Luhao Wang
- Department of Critical Care Medicine, Sun Yat-Sen University First Affiliated Hospital, Guangzhou, China
| | - Sicong Wang
- Department of Critical Care Medicine, The Second Affiliated Hospital of Harbin Medical University, Harbin, Heilongjiang, China
| | - Zhanwen Wang
- Intensive Care Unit, XiangYa Hospital, Central South University, Changsha, China
- National Clinical Research Center for Geriatric Disorders, Xiang Ya Hospital, Central South University, Changsha, China
- Hunan Provincial Clinical Research Center for Critical Care Medicine, Xiang Ya Hospital, Central South University, Changsha, China
| | - Zhong Wang
- Department of Intensive Care Unit, The First Hospital of China Medical University, Shenyang, Liaoning, China
| | - Dong Wei
- National Institute of Healthcare Data Science, Nanjing University, Nanjing, China
| | - Jianfeng Wu
- Intensive Care Unit, XiangYa Hospital, Central South University, Changsha, China
| | - Qin Wu
- Department of Critical Care Medicine, West China Hospital of Sichuan University, Chengdu, China
| | - Xuezhong Xing
- Department of Epidemiology and Biostatistics, Institute of Basic Medical Sciences Chinese Academy of Medical Sciences; School of Basic Medicine Peking Union Medical College, Beijing, China
| | - Jin Yang
- Department of Critical Care Medicine, Chongqing General Hospital, Chongqing, China
| | - Xianghong Yang
- Department of Intensive Care Unit, National Cancer Center/National Clinical Research Center, Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Jiangquan Yu
- Department of Critical Care Medicine, Northern Jiangsu People’s Hospital; Clinical Medical College, Yangzhou University, Yangzhou, China
| | - Wenkui Yu
- Department of Critical Care Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, Jiangsu, China
| | - Yuan Yu
- Intensive Care Unit of Cardiovascular Surgery Department, Qilu Hospital of Shandong University, Jinan, China
| | - Hao Yuan
- Department of Critical Care Medicine, Sun Yat-Sen University First Affiliated Hospital, Guangzhou, China
| | - Qian Zhai
- National Institute of Healthcare Data Science, Nanjing University, Nanjing, China
| | - Hao Zhang
- Department of Intensive Care Unit, National Cancer Center/National Clinical Research Center, Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Lina Zhang
- Intensive Care Unit, XiangYa Hospital, Central South University, Changsha, China
- National Clinical Research Center for Geriatric Disorders, Xiang Ya Hospital, Central South University, Changsha, China
- Hunan Provincial Clinical Research Center for Critical Care Medicine, Xiang Ya Hospital, Central South University, Changsha, China
| | - Meng Zhang
- Department of Critical Care Medicine, Chongqing General Hospital, Chongqing, China
| | - Zhongheng Zhang
- Department of Emergency Medicine, Key Laboratory of Precision Medicine in Diagnosis and Monitoring Research of Zhejiang Province, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Chunguang Zhao
- Intensive Care Unit, XiangYa Hospital, Central South University, Changsha, China
- National Clinical Research Center for Geriatric Disorders, Xiang Ya Hospital, Central South University, Changsha, China
- Hunan Provincial Clinical Research Center for Critical Care Medicine, Xiang Ya Hospital, Central South University, Changsha, China
| | - Ruiqiang Zheng
- Department of Critical Care Medicine, Northern Jiangsu People’s Hospital; Clinical Medical College, Yangzhou University, Yangzhou, China
| | - Lei Zhong
- Department of Intensive Care Unit, National Cancer Center/National Clinical Research Center, Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Feihu Zhou
- Department of Critical Care Medicine, The First Medical Center, Chinese PLA General Hospital, Beijing, China
| | - Weiguo Zhu
- Department of General Medicine, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, China
| |
Collapse
|
4
|
Wan YKJ, Wright MC, McFarland MM, Dishman D, Nies MA, Rush A, Madaras-Kelly K, Jeppesen A, Del Fiol G. Information displays for automated surveillance algorithms of in-hospital patient deterioration: a scoping review. J Am Med Inform Assoc 2023; 31:256-273. [PMID: 37847664 PMCID: PMC10746326 DOI: 10.1093/jamia/ocad203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 09/12/2023] [Accepted: 10/02/2023] [Indexed: 10/19/2023] Open
Abstract
OBJECTIVE Surveillance algorithms that predict patient decompensation are increasingly integrated with clinical workflows to help identify patients at risk of in-hospital deterioration. This scoping review aimed to identify the design features of the information displays, the types of algorithm that drive the display, and the effect of these displays on process and patient outcomes. MATERIALS AND METHODS The scoping review followed Arksey and O'Malley's framework. Five databases were searched with dates between January 1, 2009 and January 26, 2022. Inclusion criteria were: participants-clinicians in inpatient settings; concepts-intervention as deterioration information displays that leveraged automated AI algorithms; comparison as usual care or alternative displays; outcomes as clinical, workflow process, and usability outcomes; and context as simulated or real-world in-hospital settings in any country. Screening, full-text review, and data extraction were reviewed independently by 2 researchers in each step. Display categories were identified inductively through consensus. RESULTS Of 14 575 articles, 64 were included in the review, describing 61 unique displays. Forty-one displays were designed for specific deteriorations (eg, sepsis), 24 provided simple alerts (ie, text-based prompts without relevant patient data), 48 leveraged well-accepted score-based algorithms, and 47 included nurses as the target users. Only 1 out of the 10 randomized controlled trials reported a significant effect on the primary outcome. CONCLUSIONS Despite significant advancements in surveillance algorithms, most information displays continue to leverage well-understood, well-accepted score-based algorithms. Users' trust, algorithmic transparency, and workflow integration are significant hurdles to adopting new algorithms into effective decision support tools.
Collapse
Affiliation(s)
- Yik-Ki Jacob Wan
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT 84108, United States
| | - Melanie C Wright
- College of Pharmacy, Idaho State University, Meridian, ID 83642, United States
| | - Mary M McFarland
- Eccles Health Sciences Library, University of Utah, Salt Lake City, UT 84112, United States
| | - Deniz Dishman
- Cizik School of Nursing Department of Research, University of Texas Health Science Center at Houston, Houston, TX 77030, United States
| | - Mary A Nies
- College of Health, Idaho State University, Pocatello, ID 83209, United States
| | - Adriana Rush
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT 84108, United States
| | - Karl Madaras-Kelly
- College of Pharmacy, Idaho State University, Meridian, ID 83642, United States
| | - Amanda Jeppesen
- College of Pharmacy, Idaho State University, Meridian, ID 83642, United States
| | - Guilherme Del Fiol
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT 84108, United States
| |
Collapse
|
5
|
Bucheeri MAGA, Elligsen M, Lam PW, Daneman N, MacFadden D. A sepsis treatment algorithm to improve early antibiotic de-escalation while maintaining adequacy of coverage (Early-IDEAS): A prospective observational study. PLoS One 2023; 18:e0295908. [PMID: 38117796 PMCID: PMC10732396 DOI: 10.1371/journal.pone.0295908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Accepted: 12/01/2023] [Indexed: 12/22/2023] Open
Abstract
BACKGROUND Empiric antibiotic treatment selection should provide adequate coverage for potential pathogens while minimizing unnecessary broad-spectrum antibiotic use. We sought to pilot a sepsis treatment algorithm to individualize antibiotic recommendations, and thereby improve early antibiotic de-escalation while maintaining adequacy of coverage (Early-IDEAS). METHODS In this observational study, the Early-IDEAS decision support algorithm was derived from previous Gram- negative and Gram-positive prediction rules and models along with local guidelines, and then applied to prospectively identified consecutive adults within 24 hours of suspected sepsis. The primary outcome was the proportion of patients for whom de-escalation of the primary antibiotic regimen was recommended by the algorithm. Secondary outcomes included: (1) proportion of patients for whom escalation was recommended; (2) number of recommended de-escalation steps along a pre-specified antibiotic cascade; and (3) adequacy of therapy in patients with culture-confirmed infection. RESULTS We screened 578 patients, of whom 107 eligible patients were included. The Early-IDEAS treatment recommendation was informed by Gram-negative models in 76 (71%) patients, Gram-positive rules in 64 (59.8%), and local guidelines in 27 (25.2%). Antibiotic de-escalation was recommended in almost half of all patients (n = 52, 48.6%), with a median of 2 steps down the a priori antibiotic treatment cascade. No treatment change was recommended in 45 patients (42.1%), and escalation was recommended in 10 (9.3%). Among the 17 patients with positive blood cultures, both the clinician prescribed regimen and the algorithm recommendation provided adequate coverage for the isolated pathogen in 12 patients (70.6%), (p = 1). Among the 25 patients with positive relevant, non-blood cultures, both the clinician prescribed regimen and the algorithm recommendation provided adequate coverage in 20 (80%), (p = 1). CONCLUSION An individualized decision support algorithm in early sepsis could lead to substantial antibiotic de-escalation without compromising adequate antibiotic coverage.
Collapse
Affiliation(s)
| | | | - Philip W. Lam
- Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
- Division of Infectious Diseases, University of Toronto, Toronto, Canada
| | - Nick Daneman
- Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
- Division of Infectious Diseases, University of Toronto, Toronto, Canada
| | - Derek MacFadden
- The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| |
Collapse
|
6
|
Keszthelyi D, Gaudet-Blavignac C, Bjelogrlic M, Lovis C. Patient Information Summarization in Clinical Settings: Scoping Review. JMIR Med Inform 2023; 11:e44639. [PMID: 38015588 DOI: 10.2196/44639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 03/15/2023] [Accepted: 07/25/2023] [Indexed: 11/29/2023] Open
Abstract
BACKGROUND Information overflow, a common problem in the present clinical environment, can be mitigated by summarizing clinical data. Although there are several solutions for clinical summarization, there is a lack of a complete overview of the research relevant to this field. OBJECTIVE This study aims to identify state-of-the-art solutions for clinical summarization, to analyze their capabilities, and to identify their properties. METHODS A scoping review of articles published between 2005 and 2022 was conducted. With a clinical focus, PubMed and Web of Science were queried to find an initial set of reports, later extended by articles found through a chain of citations. The included reports were analyzed to answer the questions of where, what, and how medical information is summarized; whether summarization conserves temporality, uncertainty, and medical pertinence; and how the propositions are evaluated and deployed. To answer how information is summarized, methods were compared through a new framework "collect-synthesize-communicate" referring to information gathering from data, its synthesis, and communication to the end user. RESULTS Overall, 128 articles were included, representing various medical fields. Exclusively structured data were used as input in 46.1% (59/128) of papers, text in 41.4% (53/128) of articles, and both in 10.2% (13/128) of papers. Using the proposed framework, 42.2% (54/128) of the records contributed to information collection, 27.3% (35/128) contributed to information synthesis, and 46.1% (59/128) presented solutions for summary communication. Numerous summarization approaches have been presented, including extractive (n=13) and abstractive summarization (n=19); topic modeling (n=5); summary specification (n=11); concept and relation extraction (n=30); visual design considerations (n=59); and complete pipelines (n=7) using information extraction, synthesis, and communication. Graphical displays (n=53), short texts (n=41), static reports (n=7), and problem-oriented views (n=7) were the most common types in terms of summary communication. Although temporality and uncertainty information were usually not conserved in most studies (74/128, 57.8% and 113/128, 88.3%, respectively), some studies presented solutions to treat this information. Overall, 115 (89.8%) articles showed results of an evaluation, and methods included evaluations with human participants (median 15, IQR 24 participants): measurements in experiments with human participants (n=31), real situations (n=8), and usability studies (n=28). Methods without human involvement included intrinsic evaluation (n=24), performance on a proxy (n=10), or domain-specific tasks (n=11). Overall, 11 (8.6%) reports described a system deployed in clinical settings. CONCLUSIONS The scientific literature contains many propositions for summarizing patient information but reports very few comparisons of these proposals. This work proposes to compare these algorithms through how they conserve essential aspects of clinical information and through the "collect-synthesize-communicate" framework. We found that current propositions usually address these 3 steps only partially. Moreover, they conserve and use temporality, uncertainty, and pertinent medical aspects to varying extents, and solutions are often preliminary.
Collapse
Affiliation(s)
- Daniel Keszthelyi
- Division of Medical Information Sciences, University Hospitals of Geneva, Geneva, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland
| | - Christophe Gaudet-Blavignac
- Division of Medical Information Sciences, University Hospitals of Geneva, Geneva, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland
| | - Mina Bjelogrlic
- Division of Medical Information Sciences, University Hospitals of Geneva, Geneva, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland
| | - Christian Lovis
- Division of Medical Information Sciences, University Hospitals of Geneva, Geneva, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland
| |
Collapse
|
7
|
King AJ, Tang L, Davis BS, Preum SM, Bukowski LA, Zimmerman J, Kahn JM. Machine learning-based prediction of low-value care for hospitalized patients. INTELLIGENCE-BASED MEDICINE 2023; 8:100115. [PMID: 38130744 PMCID: PMC10735238 DOI: 10.1016/j.ibmed.2023.100115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/23/2023]
Abstract
Objective Low-value care (i.e., costly health care treatments that provide little or no benefit) is an ongoing problem in United States hospitals. Traditional strategies for reducing low-value care are only moderately successful. Informed by behavioral science principles, we sought to use machine learning to inform a targeted prompting system that suggests preferred alternative treatments at the point of care but before clinicians have made a decision. Methods We used intravenous administration of albumin for fluid resuscitation in intensive care unit (ICU) patients as an exemplar of low-value care practice, identified using the electronic health record of a multi-hospital health system. We divided all ICU episodes into 4-h periods and defined a set of relevant clinical features at the period level. We then developed two machine learning models: a single-stage model that directly predicts if a patient will receive albumin in the next period; and a two-stage model that first predicts if any resuscitation fluid will be administered and then predicts albumin only among the patients with a high probability of fluid use. Results We examined 87,489 ICU episodes divided into approximately 1.5 million 4-h periods. The area under the receiver operating characteristic curve was 0.86 for both prediction models. The positive predictive value was 0.21 (95% confidence interval: 0.20, 0.23) for the single-stage model and 0.22 (0.20, 0.23) for the two-stage model. Applying either model in a targeted prompting system could prevent 10% of albumin administrations, with an attending physician receiving one prompt every 4.2 days of ICU service. Conclusion Prediction of low-value care is feasible and could enable a point-of-care, targeted prompting system that offers suggestions ahead of the moment of need before clinicians have already decided. A two-stage approach does not improve performance but does interject new levers for the calibration of such a system.
Collapse
Affiliation(s)
- Andrew J. King
- Department of Critical Care Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Lu Tang
- Department of Biostatistics, University of Pittsburgh School of Public Health, Pittsburgh, PA, USA
| | - Billie S. Davis
- Department of Critical Care Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Sarah M. Preum
- Department of Computer Science, Dartmouth College, Hanover, NH, USA
| | - Leigh A. Bukowski
- Department of Critical Care Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - John Zimmerman
- Human-Computer Interaction Institute, Carnegie Mellon University School of Computer Science, Pittsburgh, PA, USA
| | - Jeremy M. Kahn
- Department of Critical Care Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| |
Collapse
|
8
|
Abstract
Data science has the potential to greatly enhance efforts to translate evidence into practice in critical care. The intensive care unit is a data-rich environment enabling insight into both patient-level care patterns and clinician-level treatment patterns. By applying artificial intelligence to these novel data sources, implementation strategies can be tailored to individual patients, individual clinicians, and individual situations, revealing when evidence-based practices are missed and facilitating context-sensitive clinical decision support. To achieve these goals, technology developers should work closely with clinicians to create unbiased applications that are integrated into the clinical workflow.
Collapse
Affiliation(s)
- Andrew J King
- Department of Critical Care Medicine, University of Pittsburgh School of Medicine, 3500 Terrace Street, Suite 600, Pittsburgh, PA 15261, USA
| | - Jeremy M Kahn
- Department of Critical Care Medicine, University of Pittsburgh School of Medicine, 3500 Terrace Street, Suite 600, Pittsburgh, PA 15261, USA; Department of Health Policy and Management, University of Pittsburgh School of Public Health, 130 De Soto Street, Pittsburgh, PA 15261, USA.
| |
Collapse
|
9
|
Clermont G. The Learning Electronic Health Record. Crit Care Clin 2023; 39:689-700. [PMID: 37704334 DOI: 10.1016/j.ccc.2023.03.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/15/2023]
Abstract
Electronic medical records (EMRs) constitute the electronic version of all medical information included in a patient's paper chart. The electronic health record (EHR) technology has witnessed massive expansion in developed countries and to a lesser extent in underresourced countries during the last 2 decades. We will review factors leading to this expansion, how the emergence of EHRs is affecting several health-care stakeholders; some of the growing pains associated with EHRs with a particular emphasis on the delivery of care to the critically ill; and ongoing developments on the path to improve the quality of research, health-care delivery, and stakeholder satisfaction.
Collapse
Affiliation(s)
- Gilles Clermont
- VA Pittsburgh Medical Center, 1054 Aliquippa Street, Pittsburgh, PA 15104, USA; Critical Care Medicine, University of Pittsburgh, 200 Lothrop Street, Pittsburgh, PA 15061, USA.
| |
Collapse
|
10
|
Schootman M, Wiskow C, Loux T, Meyer L, Powell S, Gandhi A, Lacasse A. Evaluation of the effectiveness of an automated sepsis predictive tool on patient outcomes. J Crit Care 2022; 71:154061. [DOI: 10.1016/j.jcrc.2022.154061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 05/02/2022] [Accepted: 05/02/2022] [Indexed: 10/18/2022]
|
11
|
Zhang Z, Chen L, Xu P, Wang Q, Zhang J, Chen K, Clements CM, Celi LA, Herasevich V, Hong Y. Effectiveness of automated alerting system compared to usual care for the management of sepsis. NPJ Digit Med 2022; 5:101. [PMID: 35854120 PMCID: PMC9296632 DOI: 10.1038/s41746-022-00650-5] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Accepted: 07/04/2022] [Indexed: 01/18/2023] Open
Abstract
There is a large body of evidence showing that delayed initiation of sepsis bundle is associated with adverse clinical outcomes in patients with sepsis. However, it is controversial whether electronic automated alerts can help improve clinical outcomes of sepsis. Electronic databases are searched from inception to December 2021 for comparative effectiveness studies comparing automated alerts versus usual care for the management of sepsis. A total of 36 studies are eligible for analysis, including 6 randomized controlled trials and 30 non-randomized studies. There is significant heterogeneity in these studies concerning the study setting, design, and alerting methods. The Bayesian meta-analysis by using pooled effects of non-randomized studies as priors shows a beneficial effect of the alerting system (relative risk [RR]: 0.71; 95% credible interval: 0.62 to 0.81) in reducing mortality. The automated alerting system shows less beneficial effects in the intensive care unit (RR: 0.90; 95% CI: 0.73–1.11) than that in the emergency department (RR: 0.68; 95% CI: 0.51–0.90) and ward (RR: 0.71; 95% CI: 0.61–0.82). Furthermore, machine learning-based prediction methods can reduce mortality by a larger magnitude (RR: 0.56; 95% CI: 0.39–0.80) than rule-based methods (RR: 0.73; 95% CI: 0.63–0.85). The study shows a statistically significant beneficial effect of using the automated alerting system in the management of sepsis. Interestingly, machine learning monitoring systems coupled with better early interventions show promise, especially for patients outside of the intensive care unit.
Collapse
Affiliation(s)
- Zhongheng Zhang
- Department of Emergency Medicine, Key Laboratory of Precision Medicine in Diagnosis and Monitoring Research of Zhejiang Province, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China.
| | - Lin Chen
- Department of Critical Care Medicine, Affiliated Jinhua Hospital, Zhejiang University School of Medicine, Jinhua, People's Republic of China
| | - Ping Xu
- Emergency Department, Zigong Fourth People's Hospital, Zigong, Sichuan, China.,Institute of Medical Big Data, Zigong Academy of Artificial Intelligence and Big Data for Medical Science Artificial Intelligence, Zigong, Sichuan, China.,Key Laboratory of Sichuan Province, Zigong, China
| | - Qing Wang
- Department of Surgery, University of Virginia, Charlottesville, VA, USA
| | - Jianjun Zhang
- Emergency Department, Zigong Fourth People's Hospital, Zigong, Sichuan, China
| | - Kun Chen
- Department of Critical Care Medicine, Affiliated Jinhua Hospital, Zhejiang University School of Medicine, Jinhua, People's Republic of China
| | - Casey M Clements
- Department of Emergency Medicine, Mayo Clinic, Rochester, MN, USA
| | - Leo Anthony Celi
- Department of Biostatistics, Harvard T H Chan School of Public Health, Boston, USA.,Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, USA.,Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Boston, USA
| | - Vitaly Herasevich
- Department of Anesthesiology and Perioperative Medicine, Division of Critical Care Medicine, Mayo Clinic, Rochester, MN, USA
| | - Yucai Hong
- Department of Emergency Medicine, Key Laboratory of Precision Medicine in Diagnosis and Monitoring Research of Zhejiang Province, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China
| |
Collapse
|
12
|
Xie CX, Chen Q, Hincapié CA, Hofstetter L, Maher CG, Machado GC. Effectiveness of clinical dashboards as audit and feedback or clinical decision support tools on medication use and test ordering: a systematic review of randomized controlled trials. J Am Med Inform Assoc 2022; 29:1773-1785. [PMID: 35689652 PMCID: PMC9471705 DOI: 10.1093/jamia/ocac094] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Revised: 05/04/2022] [Accepted: 05/31/2022] [Indexed: 11/14/2022] Open
Abstract
BACKGROUND Clinical dashboards used as audit and feedback (A&F) or clinical decision support systems (CDSS) are increasingly adopted in healthcare. However, their effectiveness in changing the behavior of clinicians or patients is still unclear. This systematic review aims to investigate the effectiveness of clinical dashboards used as CDSS or A&F tools (as a standalone intervention or part of a multifaceted intervention) in primary care or hospital settings on medication prescription/adherence and test ordering. METHODS Seven major databases were searched for relevant studies, from inception to August 2021. Two authors independently extracted data, assessed the risk of bias using the Cochrane RoB II scale, and evaluated the certainty of evidence using GRADE. Data on trial characteristics and intervention effect sizes were extracted. A narrative synthesis was performed to summarize the findings of the included trials. RESULTS Eleven randomized trials were included. Eight trials evaluated clinical dashboards as standalone interventions and provided conflicting evidence on changes in antibiotic prescribing and no effects on statin prescribing compared to usual care. Dashboards increased medication adherence in patients with inflammatory arthritis but not in kidney transplant recipients. Three trials investigated dashboards as part of multicomponent interventions revealing decreased use of opioids for low back pain, increased proportion of patients receiving cardiovascular risk screening, and reduced antibiotic prescribing for upper respiratory tract infections. CONCLUSION There is limited evidence that dashboards integrated into electronic medical record systems and used as feedback or decision support tools may be associated with improvements in medication use and test ordering.
Collapse
Affiliation(s)
- Charis Xuan Xie
- Wolfson Institute of Population Health, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, UK
| | - Qiuzhe Chen
- Institute for Musculoskeletal Health, Sydney, NSW, Australia.,Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| | - Cesar A Hincapié
- Department of Chiropractic Medicine, Faculty of Medicine, University of Zurich and Balgrist University Hospital, Zurich, Switzerland.,Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Léonie Hofstetter
- Department of Chiropractic Medicine, Faculty of Medicine, University of Zurich and Balgrist University Hospital, Zurich, Switzerland
| | - Chris G Maher
- Institute for Musculoskeletal Health, Sydney, NSW, Australia.,Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| | - Gustavo C Machado
- Institute for Musculoskeletal Health, Sydney, NSW, Australia.,Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
13
|
Ronan CE, Crable EL, Drainoni ML, Walkey AJ. The impact of clinical decision support systems on provider behavior in the inpatient setting: A systematic review and meta-analysis. J Hosp Med 2022; 17:368-383. [PMID: 35514024 DOI: 10.1002/jhm.12825] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 03/08/2022] [Accepted: 03/22/2022] [Indexed: 12/19/2022]
Abstract
BACKGROUND Clinical decision support systems (CDSS) are used to improve processes of care. CDSS proliferation may have unintended consequences impacting effectiveness. OBJECTIVE To evaluate the effectiveness of CDSS in altering clinician behavior. DESIGN Electronic searches were performed in EMBASE, PubMed, and Cochrane Central Register of Control Trials for randomized controlled trials testing the impacted of CDSS on clinician behavior from 2000-2021. Extracted data included study design, CDSS attributed and outcomes, user characteristics, settings, and risk of bias. Eligible studies were analyzed qualitatively to describe CDSS types. Studies with sufficient outcome data were included in the meta-analysis. SETTING AND PARTICIPANTS Adult inpatients in the United States. INTERVENTION Clinical decision support system versus non-clinical decision support system. MAIN OUTCOME AND MEASURE A random-effects model measured the pooled risk difference (RD) and odds ratio of clinicians' adherence to CDSS; subgroup analyses tested differences in CDSS effectiveness over time and by CDSS type. RESULTS Qualitative synthesis included 22 studies. Eleven studies reported sufficient outcome data for inclusion in the meta-analysis. CDSS did not result in a statistically significant increase in clinician adoption of desired practicies (RD = 0.04 [95% confidence interval {CI} 0.00, 0.07]). CDSS from 2010-2015 (n = 5) did not increase clinician adoption of desired practice [RD -0.01, (95% CI -0.04, 0.02)].CDSS from 2016-2021 (n = 6) were associated with an increase in targeted practices [RD 0.07 (95% CI0.03, 0.12)], pInteraction = 0.004. EHR [RD 0.04 (95% CI 0.00, 0.08)] vs. non-EHR [RD 0.01 (95% CI -0.01, 0.04)] based CDSS interventions did not result in different adoption of desired practices (pInteraction = 0.27). The meta-analysis did not find an overall positive impact of CDSS on clinician behavior in the inpatient setting.
Collapse
Affiliation(s)
- Clare E Ronan
- Department of Medicine, Boston Medical Center, Boston, Massachusetts, USA
| | - Erika L Crable
- Department of Psychiatry, Child and Adolescent Services Research Center, University of California, San Diego, La Jolla, California, USA
- ACTRI UCSD Dissemination and Implementation Science Center, University of California San Diego, La Jolla, California, USA
| | - Mari-Lynn Drainoni
- Department of Medicine, Evans Center for Implementation and Improvement Sciences, Boston University School of Medicine, Boston, Massachusetts, USA
- Department of Medicine, Section of Infectious Diseases, Boston University School of Medicine, Boston, Massachusetts, USA
- Department of Health Law, Policy & Management, Boston University School of Public Health, Boston, Massachusetts, USA
| | - Allan J Walkey
- Department of Medicine, Evans Center for Implementation and Improvement Sciences, Boston University School of Medicine, Boston, Massachusetts, USA
- Department of Medicine, The Pulmonary Center, Boston University School of Medicine, Boston, Massachusetts, USA
| |
Collapse
|
14
|
Joshi M, Mecklai K, Rozenblum R, Samal L. Implementation approaches and barriers for rule-based and machine learning-based sepsis risk prediction tools: a qualitative study. JAMIA Open 2022; 5:ooac022. [PMID: 35474719 PMCID: PMC9030109 DOI: 10.1093/jamiaopen/ooac022] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Revised: 01/16/2022] [Accepted: 03/30/2022] [Indexed: 11/23/2022] Open
Abstract
Objective Many options are currently available for sepsis surveillance clinical decision support (CDS) from electronic medical record (EMR) vendors, third party, and homegrown models drawing on rule-based (RB) and machine learning (ML) algorithms. This study explores sepsis CDS implementation from the perspective of implementation leads by describing the motivations, tool choices, and implementation experiences of a diverse group of implementers. Materials and Methods Semi-structured interviews were conducted with and a questionnaire was administered to 21 hospital leaders overseeing CDS implementation at 15 US medical centers. Participants were recruited via convenience sampling. Responses were coded by 2 coders with consensus approach and inductively analyzed for themes. Results Use of sepsis CDS is motivated in part by quality metrics for sepsis patients. Choice of tool is driven by ease of integration, customization capability, and perceived predictive potential. Implementation processes for these CDS tools are complex, time-consuming, interdisciplinary undertakings resulting in heterogeneous choice of tools and workflow integration. To improve clinician acceptance, implementers addressed both optimization of the alerts as well as clinician understanding and buy in. More distrust and confusion was reported for ML models, as compared to RB models. Respondents described a variety of approaches to overcome implementation barriers; these approaches related to alert firing, content, integration, and buy-in. Discussion While there are shared socio-technical challenges of implementing CDS for both RB and ML models, attention to user education, support, expectation management, and dissemination of effective practices may improve feasibility and effectiveness of ML models in quality improvement efforts. Conclusion Further implementation science research is needed to determine real world efficacy of these tools. Clinician acceptance is a significant barrier to sepsis CDS implementation. Successful implementation of less clinically intuitive ML models may require additional attention to user confusion and distrust. Sepsis is a life-threatening illness. Improving sepsis care is a growing priority for many hospitals. Patients at risk of developing sepsis can be identified before they get very sick using tools that analyze data from computerized medical records systems. A variety of options are available from different sources. Some tools are programmed using established sepsis screening criteria used in clinical practice. Others rely on machine learning, where computer algorithms identify patterns in the available data without being pre-programmed by a human being. In this study, we interviewed 21 individuals at 15 US medical centers who oversaw hospital level implementations of these tools. Teams were motivated by wanting to improve quality of care for patients with sepsis. One major challenge was making the tools identify as many patients truly at risk for sepsis as possible while limiting false identification of patients not actually at risk. Many interviewees also described lack of trust in the tools from the nurses and doctors using the tools. There was more distrust and confusion reported by implementers of tools that relied on machine learning than tools that programmed human logic. Strategies emphasizing user education, user support, and expectation management were reported to be helpful.
Collapse
Affiliation(s)
- Mugdha Joshi
- Department of Medicine, Stanford University, Stanford, California, USA
| | | | - Ronen Rozenblum
- Harvard Medical School, Boston, Massachusetts, USA
- Division of General Internal Medicine and Primary Care, Brigham and Women’s Hospital, Boston, Massachusetts, USA
| | - Lipika Samal
- Harvard Medical School, Boston, Massachusetts, USA
- Division of General Internal Medicine and Primary Care, Brigham and Women’s Hospital, Boston, Massachusetts, USA
| |
Collapse
|
15
|
Silvestri JA, Kmiec TE, Bishop NS, Regli SH, Weissman GE. A qualitative study of clinician perspectives and desired characteristics of a clinical decision support system for early sepsis recognition (Preprint). JMIR Hum Factors 2022; 9:e36976. [PMID: 36269653 PMCID: PMC9636532 DOI: 10.2196/36976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Revised: 08/05/2022] [Accepted: 08/06/2022] [Indexed: 11/29/2022] Open
Abstract
Background Sepsis is a major burden for health care systems in the United States, with over 750,000 cases annually and a total cost of approximately US $20 billion. The hallmark of sepsis treatment is early and appropriate initiation of antibiotic therapy. Although sepsis clinical decision support (CDS) systems can provide clinicians with early predictions of suspected sepsis or imminent clinical decline, such systems have not reliably demonstrated improvements in clinical outcomes or care processes. Growing evidence suggests that the challenges of integrating sepsis CDS systems into clinical workflows, gaining the trust of clinicians, and making sepsis CDS systems clinically relevant at the bedside are all obstacles to successful deployment. However, there are significant knowledge gaps regarding the achievement of these implementation and deployment goals. Objective We aimed to identify perceptions of predictive information in sepsis CDS systems based on clinicians’ past experiences, explore clinicians’ perceptions of a hypothetical sepsis CDS system, and identify the characteristics of a CDS system that would be helpful in promoting timely recognition and management of suspected sepsis in a multidisciplinary, team-based clinical setting. Methods We conducted semistructured interviews with practicing bedside nurses, advanced practice providers, and physicians at a large academic medical center between September 2020 and March 2021. We used modified human factor methods (contextual interview and cognitive walkthrough performed over video calls because of the COVID-19 pandemic) and conducted a thematic analysis using an abductive approach for coding to identify important patterns and concepts in the interview transcripts. Results We interviewed 6 bedside nurses and 9 clinicians responsible for ordering antibiotics (advanced practice providers or physicians) who had a median of 4 (IQR 4-6.5) years of experience working in an inpatient setting. We then synthesized critical content from the thematic analysis of the data into four domains: clinician perceptions of prediction models and alerts; previous experiences of clinician encounters with predictive information and risk scores; desired characteristics of a CDS system build, including predictions, supporting information, and delivery methods for a potential alert; and the clinical relevance and potential utility of a CDS system. These 4 domains were strongly linked to clinicians’ perceptions of the likelihood of adoption and the impact on clinical workflows when diagnosing and managing patients with suspected sepsis. Ultimately, clinicians desired a trusted and actionable CDS system to improve sepsis care. Conclusions Building a trusted and actionable sepsis CDS alert is paramount to achieving acceptability and use among clinicians. These findings can inform the development, implementation, and deployment strategies for CDS systems that support the early detection and treatment of sepsis. This study also highlights several key opportunities when eliciting clinician input before the development and deployment of prediction models.
Collapse
Affiliation(s)
- Jasmine A Silvestri
- Palliative and Advanced Illness Research Center, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Tyler E Kmiec
- Palliative and Advanced Illness Research Center, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Nicholas S Bishop
- Palliative and Advanced Illness Research Center, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Susan H Regli
- University of Pennsylvania Health System, Philadelphia, PA, United States
| | - Gary E Weissman
- Palliative and Advanced Illness Research Center, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
- Division of Pulmonary, Allergy and Critical Care Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
- Leonard Davis Institute of Health Economics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
- Penn Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| |
Collapse
|
16
|
Kuo YY, Huang ST, Chiu HW. Applying artificial neural network for early detection of sepsis with intentionally preserved highly missing real-world data for simulating clinical situation. BMC Med Inform Decis Mak 2021; 21:290. [PMID: 34686163 PMCID: PMC8539833 DOI: 10.1186/s12911-021-01653-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2021] [Accepted: 10/12/2021] [Indexed: 12/12/2022] Open
Abstract
Purpose Some predictive systems using machine learning models have been developed to predict sepsis; however, they were mostly built with a low percent of missing values, which does not correspond with the actual clinical situation. In this study, we developed a machine learning model with a high rate of missing and erroneous data to enable prediction under missing, noisy, and erroneous inputs, as in the actual clinical situation. Materials and methods The proposed artificial neural network model was implemented using the MATLAB ANN toolbox, based on stochastic gradient descent. The dataset was collected over the past decade with approval from the appropriate institutional review boards, and the sepsis status was identified and labeled using Sepsis-3 clinical criteria. The imputation method was built by last observation carried forward and mean value, aimed to simulate clinical situation. Results The mean area under the receiver operating characteristic (ROC) curve (AUC) of classifying sepsis and nonsepsis patients was 0.82 and 0.786 at 0 h and 40 h prior to onset, respectively. The highest model performance was found for one-hourly data, demonstrating that our ANN model can perform adequately with limited hourly data provided. Conclusions Our model has the moderate ability to predict sepsis up to 40 h in advance under simulated clinical situation with real-world data.
Collapse
Affiliation(s)
- Yao-Yi Kuo
- School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Shu-Tien Huang
- Department of Emergency Medicine, Mackay Memorial Hospital, Taipei, Taiwan
| | - Hung-Wen Chiu
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan.
| |
Collapse
|
17
|
Arabi YM, Alsaawi A, Al Zahrani M, Al Khathaami AM, AlHazme RH, Al Mutrafy A, Al Qarni A, Al Shouabi A, Al Qasim E, Abdukahil SA, Al-Rabeah FK, Al Ghamdi H, Al Ghamdi E, Alansari M, Abuelgasim KA, Alatassi A, Alchin J, Al-Dorzi HM, Ghamdi AA, Al-Hameed F, Alharbi A, Hussein M, Jastaniah W, AlKatheri ME, AlMarhabi H, Mustafa HT, Jones J, Al-Qahtani S, Qahtani S, Qureshi AS, Salih SB, Alselaim N, Tashkandi N, Vishwakarma RK, AlWafi E, Alyami AH, Alyousef Z. Electronic early notification of sepsis in hospitalized ward patients: a study protocol for a stepped-wedge cluster randomized controlled trial. Trials 2021; 22:695. [PMID: 34635151 PMCID: PMC8503718 DOI: 10.1186/s13063-021-05562-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2021] [Accepted: 08/24/2021] [Indexed: 12/29/2022] Open
Abstract
Background To evaluate the effect of screening for sepsis using an electronic sepsis alert vs. no alert in hospitalized ward patients on 90-day in-hospital mortality. Methods The SCREEN trial is designed as a stepped-wedge cluster randomized controlled trial. Hospital wards (total of 45 wards, constituting clusters in this design) are randomized to have active alert vs. masked alert, 5 wards at a time, with each 5 wards constituting a sequence. The study consists of ten 2-month periods with a phased introduction of the intervention. In the first period, all wards have a masked alert for 2 months. Afterwards the intervention (alert system) is implemented in a new sequence every 2-month period until the intervention is implemented in all sequences. The intervention includes the implementation of an electronic alert system developed in the hospital electronic medical records based on the quick sequential organ failure assessment (qSOFA). The alert system sends notifications of “possible sepsis alert” to the bedside nurse, charge nurse, and primary medical team and requires an acknowledgment in the health information system from the bedside nurse and physician. The calculated sample size is 65,250. The primary endpoint is in-hospital mortality by 90 days. Discussion The trial started on October 1, 2019, and is expected to complete patient follow-up by the end of October 2021. Trial registration ClinicalTrials.gov NCT04078594. Registered on September 6, 2019 Supplementary Information The online version contains supplementary material available at 10.1186/s13063-021-05562-5.
Collapse
Affiliation(s)
- Yaseen M Arabi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Intensive Care Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia.
| | - Abdulmohsen Alsaawi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Mohammed Al Zahrani
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Jeddah, Saudi Arabia
| | - Ali M Al Khathaami
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Quality and Patient Safety Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Raed H AlHazme
- College of Public Health and Health Informatics, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Information Technology Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia.,College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, Florida, USA
| | - Abdullah Al Mutrafy
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, King Abdullah Specialized Children's Hospital, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Ali Al Qarni
- Department of Medicine, King Abdulaziz Hospital, Ministry of National Guard Health Affairs, Al Ahsa, Saudi Arabia.,King Abdullah International Medical Research Center, Al Ahsa, Saudi Arabia.,King Saud bin Abdulaziz University for Health Sciences, Al Ahsa, Saudi Arabia
| | - Ahmed Al Shouabi
- Imam Abdulrahman Al Faisal Hospital, Ministry of National Guard Health Affairs, Dammam, Saudi Arabia
| | - Eman Al Qasim
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, Research Office, King Abdullah International Medical Research Center, Intensive Care Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Sheryl Ann Abdukahil
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Intensive Care Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Fawaz K Al-Rabeah
- College of Public Health and Health Informatics, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Information Technology Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Huda Al Ghamdi
- College of Public Health and Health Informatics, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Information Technology Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Ebtisam Al Ghamdi
- College of Public Health and Health Informatics, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Information Technology Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Mariam Alansari
- Department of Internal Medicine, Imam Abdulrahman Al Faisal Hospital, Ministry of National Guard Health Affairs, Dammam, Saudi Arabia
| | - Khadega A Abuelgasim
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Oncology Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Abdulaleem Alatassi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Quality and Patient Safety Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - John Alchin
- King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Nursing Services Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Hasan M Al-Dorzi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Intensive Care Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Abdulaziz A Ghamdi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Quality and Patient Safety Department, King Abdulaziz Hospital Ministry of National Guard Health Affairs, Al Ahsa, Saudi Arabia
| | - Fahad Al-Hameed
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Intensive Care Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Jeddah, Saudi Arabia
| | - Ahmad Alharbi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Division of Infectious Diseases, Department of Medicine, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Mohamed Hussein
- King Saud Bin Abdulaziz University for Health Sciences, Bioinformatics and Bioinformatics Department, King Abdullah International Medical Research Center, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Wasil Jastaniah
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Princess Noorah Oncology Center, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Jeddah, Saudi Arabia
| | - Mufareh Edah AlKatheri
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Quality and Patient Safety Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Hassan AlMarhabi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, Quality and Patient Safety Department, Department of Medicine, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Jeddah, Saudi Arabia
| | - Hani T Mustafa
- Department of Medicine, King Abdulaziz Hospital, Ministry of National Guard Health Affairs, Al Ahsa, Saudi Arabia
| | - Joan Jones
- King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Nursing Services Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Saad Al-Qahtani
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Intensive Care Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Shaher Qahtani
- King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Quality and Patient Safety Department, Imam Abdulrahman Al Faisal Hospital, Ministry of National Guard Health Affairs, Dammam, Saudi Arabia
| | - Ahmad S Qureshi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Intensive Care Department, Prince Mohammed bin Abdulaziz Hospital, Ministry of National Guard Health Affairs, Madinah, Saudi Arabia
| | - Salih Bin Salih
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Department of Medicine, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Nahar Alselaim
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Department of Surgery, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Nabiha Tashkandi
- King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Nursing Services Department, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia.,Saudi Nursing Professional Council, Saudi Commission for Health Specialties, Riyadh, Saudi Arabia
| | - Ramesh Kumar Vishwakarma
- King Saud Bin Abdulaziz University for Health Sciences, Bioinformatics and Bioinformatics Department, King Abdullah International Medical Research Center, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Emad AlWafi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Department of Medicine, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Jeddah, Saudi Arabia
| | - Ali H Alyami
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Department of Surgery, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Jeddah, Saudi Arabia
| | - Zeyad Alyousef
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Department of Surgery, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | | |
Collapse
|
18
|
Wong A, Otles E, Donnelly JP, Krumm A, McCullough J, DeTroyer-Cooley O, Pestrue J, Phillips M, Konye J, Penoza C, Ghous M, Singh K. External Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized Patients. JAMA Intern Med 2021; 181:1065-1070. [PMID: 34152373 PMCID: PMC8218233 DOI: 10.1001/jamainternmed.2021.2626] [Citation(s) in RCA: 272] [Impact Index Per Article: 90.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
IMPORTANCE The Epic Sepsis Model (ESM), a proprietary sepsis prediction model, is implemented at hundreds of US hospitals. The ESM's ability to identify patients with sepsis has not been adequately evaluated despite widespread use. OBJECTIVE To externally validate the ESM in the prediction of sepsis and evaluate its potential clinical value compared with usual care. DESIGN, SETTING, AND PARTICIPANTS This retrospective cohort study was conducted among 27 697 patients aged 18 years or older admitted to Michigan Medicine, the academic health system of the University of Michigan, Ann Arbor, with 38 455 hospitalizations between December 6, 2018, and October 20, 2019. EXPOSURE The ESM score, calculated every 15 minutes. MAIN OUTCOMES AND MEASURES Sepsis, as defined by a composite of (1) the Centers for Disease Control and Prevention surveillance criteria and (2) International Statistical Classification of Diseases and Related Health Problems, Tenth Revision diagnostic codes accompanied by 2 systemic inflammatory response syndrome criteria and 1 organ dysfunction criterion within 6 hours of one another. Model discrimination was assessed using the area under the receiver operating characteristic curve at the hospitalization level and with prediction horizons of 4, 8, 12, and 24 hours. Model calibration was evaluated with calibration plots. The potential clinical benefit associated with the ESM was assessed by evaluating the added benefit of the ESM score compared with contemporary clinical practice (based on timely administration of antibiotics). Alert fatigue was evaluated by comparing the clinical value of different alerting strategies. RESULTS We identified 27 697 patients who had 38 455 hospitalizations (21 904 women [57%]; median age, 56 years [interquartile range, 35-69 years]) meeting inclusion criteria, of whom sepsis occurred in 2552 (7%). The ESM had a hospitalization-level area under the receiver operating characteristic curve of 0.63 (95% CI, 0.62-0.64). The ESM identified 183 of 2552 patients with sepsis (7%) who did not receive timely administration of antibiotics, highlighting the low sensitivity of the ESM in comparison with contemporary clinical practice. The ESM also did not identify 1709 patients with sepsis (67%) despite generating alerts for an ESM score of 6 or higher for 6971 of all 38 455 hospitalized patients (18%), thus creating a large burden of alert fatigue. CONCLUSIONS AND RELEVANCE This external validation cohort study suggests that the ESM has poor discrimination and calibration in predicting the onset of sepsis. The widespread adoption of the ESM despite its poor performance raises fundamental concerns about sepsis management on a national level.
Collapse
Affiliation(s)
- Andrew Wong
- Department of Internal Medicine, University of Michigan Medical School, Ann Arbor
| | - Erkin Otles
- Medical Scientist Training Program, University of Michigan Medical School, Ann Arbor.,Department of Industrial and Operations Engineering, University of Michigan College of Engineering, Ann Arbor
| | - John P Donnelly
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| | - Andrew Krumm
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| | | | | | | | - Marie Phillips
- Health Information Technology and Services, Michigan Medicine, Ann Arbor
| | - Judy Konye
- Nursing Informatics, Michigan Medicine, Ann Arbor
| | | | - Muhammad Ghous
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| | - Karandeep Singh
- Department of Internal Medicine, University of Michigan Medical School, Ann Arbor.,Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| |
Collapse
|
19
|
|
20
|
Scott HF, Colborn KL, Sevick CJ, Bajaj L, Deakyne Davies SJ, Fairclough D, Kissoon N, Kempe A. Development and Validation of a Model to Predict Pediatric Septic Shock Using Data Known 2 Hours After Hospital Arrival. Pediatr Crit Care Med 2021; 22:16-26. [PMID: 33060422 PMCID: PMC7790844 DOI: 10.1097/pcc.0000000000002589] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Objective: To use Electronic Health Record (EHR) data from the first two hours of care to derive and validate a model to predict hypotensive septic shock in children with infection. Design: Derivation-validation study using an existing registry Setting: Six emergency care sites within a regional pediatric healthcare system. Three datasets of unique visits were designated: Patients: Patients in whom clinicians were concerned about serious infection from 60 days-17 years were included; those with septic shock in the first two hours were excluded. There were 2318 included visits; 197 developed septic shock (8.5%). Interventions: Lasso with tenfold cross-validation was used for variable selection; logistic regression was then used to construct a model from those variables in the training set. Variables were derived from EHR data known in the first two hours, including vital signs, medical history, demographics, laboratory information. Test characteristics at two thresholds were evaluated: 1) optimizing sensitivity and specificity, 2) set to 90% sensitivity. Measurements and Main Results: Septic shock was defined as systolic hypotension and vasoactive use or ≥30 ml/kg isotonic crystalloid administration in the first 24 hours. A model was created using twenty predictors, with an area under the receiver operating curve in the training set of 0.85 (0.82-0.88); 0.83 [0.78-0.89] in the temporal test set; 0.83 [0.60-1.00] in the geographic test set. Sensitivity and specificity varied based on cutpoint; when sensitivity in the training set was set to 90% (83%, 94%), specificity was 62% (60%, 65%). Conclusions: This model predicted risk of septic shock in children with suspected infection 2 hours after arrival, a critical timepoint for emergent treatment and transfer decisions. Varied cutpoints could be used to customize sensitivity to clinical context.
Collapse
Affiliation(s)
- Halden F. Scott
- Department of Pediatrics, University of Colorado School of Medicine, Aurora, CO, United States
- Section of Pediatric Emergency Medicine, Children's Hospital Colorado, Aurora, CO, United States
| | - Kathryn L. Colborn
- Department of Surgery, University of Colorado School of Medicine, Aurora, CO, United States
| | - Carter J. Sevick
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado, Aurora, CO, United States and Children's Hospital Colorado, Aurora, CO, United States
| | - Lalit Bajaj
- Department of Pediatrics, University of Colorado School of Medicine, Aurora, CO, United States
- Section of Pediatric Emergency Medicine, Children's Hospital Colorado, Aurora, CO, United States
- Center for Clinical Effectiveness, Children’s Hospital Colorado, Aurora CO, United States
| | | | - Diane Fairclough
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado, Aurora, CO, United States and Children's Hospital Colorado, Aurora, CO, United States
- Department of Surgery, University of Colorado School of Medicine, Aurora, CO, United States
| | - Niranjan Kissoon
- British Columbia Children’s Hospital, Vancouver, BC, Canada
- University of British Columbia, Vancouver, BC, Canada
| | - Allison Kempe
- Department of Pediatrics, University of Colorado School of Medicine, Aurora, CO, United States
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado, Aurora, CO, United States and Children's Hospital Colorado, Aurora, CO, United States
| |
Collapse
|
21
|
Coronavirus Disease 2019 Calls for Predictive Analytics Monitoring-A New Kind of Illness Scoring System. Crit Care Explor 2020; 2:e0294. [PMID: 33364604 PMCID: PMC7752690 DOI: 10.1097/cce.0000000000000294] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
Coronavirus disease 2019 can lead to sudden and severe respiratory failure that mandates endotracheal intubation, a procedure much more safely performed under elective rather than emergency conditions. Early warning of rising risk of this event could benefit both patients and healthcare providers by reducing the high risk of emergency intubation. Current illness severity scoring systems, which usually update only when clinicians measure vital signs or laboratory values, are poorly suited for early detection of this kind of rapid clinical deterioration. We propose that continuous predictive analytics monitoring, a new approach to bedside management, is more useful. The principles of this new practice anchor in analysis of continuous bedside monitoring data, training models on diagnosis-specific paths of deterioration using clinician-identified events, and continuous display of trends in risks rather than alerts when arbitrary thresholds are exceeded.
Collapse
|
22
|
Early Prediction of Sepsis From Clinical Data Using Ratio and Power-Based Features. Crit Care Med 2020; 48:e1343-e1349. [DOI: 10.1097/ccm.0000000000004691] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
23
|
Semler MW, Bernard GR, Aaron SD, Angus DC, Biros MH, Brower RG, Calfee CS, Colantuoni EA, Ferguson ND, Gong MN, Hopkins RO, Hough CL, Iwashyna TJ, Levy BD, Martin TR, Matthay MA, Mizgerd JP, Moss M, Needham DM, Self WH, Seymour CW, Stapleton RD, Thompson BT, Wunderink RG, Aggarwal NR, Reineck LA. Identifying Clinical Research Priorities in Adult Pulmonary and Critical Care. NHLBI Working Group Report. Am J Respir Crit Care Med 2020; 202:511-523. [PMID: 32150460 PMCID: PMC7427373 DOI: 10.1164/rccm.201908-1595ws] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2019] [Accepted: 03/06/2020] [Indexed: 12/14/2022] Open
Abstract
Preventing, treating, and promoting recovery from critical illness due to pulmonary disease are foundational goals of the critical care community and the NHLBI. Decades of clinical research in acute respiratory distress syndrome, acute respiratory failure, pneumonia, and sepsis have yielded improvements in supportive care, which have translated into improved patient outcomes. Novel therapeutics have largely failed to translate from promising preclinical findings into improved patient outcomes in late-phase clinical trials. Recent advances in personalized medicine, "big data," causal inference using observational data, novel clinical trial designs, preclinical disease modeling, and understanding of recovery from acute illness promise to transform the methods of pulmonary and critical care clinical research. To assess the current state of, research priorities for, and future directions in adult pulmonary and critical care research, the NHLBI assembled a multidisciplinary working group of investigators. This working group identified recommendations for future research, including 1) focusing on understanding the clinical, physiological, and biological underpinnings of heterogeneity in syndromes, diseases, and treatment response with the goal of developing targeted, personalized interventions; 2) optimizing preclinical models by incorporating comorbidities, cointerventions, and organ support; 3) developing and applying novel clinical trial designs; and 4) advancing mechanistic understanding of injury and recovery to develop and test interventions targeted at achieving long-term improvements in the lives of patients and families. Specific areas of research are highlighted as especially promising for making advances in pneumonia, acute hypoxemic respiratory failure, and acute respiratory distress syndrome.
Collapse
Affiliation(s)
| | | | - Shawn D. Aaron
- Division of Respirology, University of Ottawa, Ottawa, Ontario, Canada
| | | | - Michelle H. Biros
- Department of Emergency Medicine, University of Minnesota, Minneapolis, Minnesota
| | - Roy G. Brower
- Division of Pulmonary and Critical Care Medicine and
| | - Carolyn S. Calfee
- Department of Medicine and
- Department of Anesthesia, University of California, San Francisco, San Francisco, California
| | | | - Niall D. Ferguson
- Interdepartmental Division of Critical Care Medicine
- Department of Medicine
- Department of Physiology, and
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Michelle N. Gong
- Department of Epidemiology
- Department of Population Health, and
- Department of Medicine, Montefiore Medical Center, Bronx, New York
| | - Ramona O. Hopkins
- Department of Psychology, Brigham Young University, Provo, Utah
- Pulmonary and Critical Care Division, Intermountain Medical Center, Murray, Utah
| | - Catherine L. Hough
- Division of Pulmonary, Critical Care, and Sleep Medicine, University of Washington, Seattle, Washington
| | - Theodore J. Iwashyna
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, Michigan
| | - Bruce D. Levy
- Pulmonary and Critical Care Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts
| | - Thomas R. Martin
- Division of Pulmonary, Critical Care, and Sleep Medicine, University of Washington, Seattle, Washington
| | - Michael A. Matthay
- Department of Medicine and
- Department of Anesthesia, University of California, San Francisco, San Francisco, California
| | - Joseph P. Mizgerd
- Pulmonary Center, Boston University School of Medicine, Boston, Massachusetts
| | - Marc Moss
- Division of Pulmonary Sciences & Critical Care, University of Colorado, Denver, Colorado
| | | | - Wesley H. Self
- Department of Emergency Medicine, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Christopher W. Seymour
- Department of Critical Care Medicine and
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Renee D. Stapleton
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, University of Vermont, Burlington, Vermont
| | - B. Taylor Thompson
- Division of Pulmonary and Critical Care Medicine, Harvard University, Boston, Massachusetts
| | - Richard G. Wunderink
- Division of Pulmonary and Critical Care, Northwestern University Feinberg School of Medicine, Chicago, Illinois; and
| | | | | |
Collapse
|
24
|
Kruse CS, Ehrbar N. Effects of Computerized Decision Support Systems on Practitioner Performance and Patient Outcomes: Systematic Review. JMIR Med Inform 2020; 8:e17283. [PMID: 32780714 PMCID: PMC7448176 DOI: 10.2196/17283] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2019] [Revised: 04/08/2020] [Accepted: 07/27/2020] [Indexed: 12/15/2022] Open
Abstract
Background Computerized decision support systems (CDSSs) are software programs that support the decision making of practitioners and other staff. Other reviews have analyzed the relationship between CDSSs, practitioner performance, and patient outcomes. These reviews reported positive practitioner performance in over half the articles analyzed, but very little information was found for patient outcomes. Objective The purpose of this review was to analyze the relationship between CDSSs, practitioner performance, and patient medical outcomes. PubMed, CINAHL, Embase, Web of Science, and Cochrane databases were queried. Methods Articles were chosen based on year published (last 10 years), high quality, peer-reviewed sources, and discussion of the relationship between the use of CDSS as an intervention and links to practitioner performance or patient outcomes. Reviewers used an Excel spreadsheet (Microsoft Corporation) to collect information on the relationship between CDSSs and practitioner performance or patient outcomes. Reviewers also collected observations of participants, intervention, comparison with control group, outcomes, and study design (PICOS) along with those showing implicit bias. Articles were analyzed by multiple reviewers following the Kruse protocol for systematic reviews. Data were organized into multiple tables for analysis and reporting. Results Themes were identified for both practitioner performance (n=38) and medical outcomes (n=36). A total of 66% (25/38) of articles had occurrences of positive practitioner performance, 13% (5/38) found no difference in practitioner performance, and 21% (8/38) did not report or discuss practitioner performance. Zero articles reported negative practitioner performance. A total of 61% (22/36) of articles had occurrences of positive patient medical outcomes, 8% (3/36) found no statistically significant difference in medical outcomes between intervention and control groups, and 31% (11/36) did not report or discuss medical outcomes. Zero articles found negative patient medical outcomes attributed to using CDSSs. Conclusions Results of this review are commensurate with previous reviews with similar objectives, but unlike these reviews we found a high level of reporting of positive effects on patient medical outcomes.
Collapse
Affiliation(s)
- Clemens Scott Kruse
- School of Health Administration, Texas State University, San Marcos, TX, United States
| | - Nolan Ehrbar
- School of Health Administration, Texas State University, San Marcos, TX, United States
| |
Collapse
|
25
|
Dewan M, Vidrine R, Zackoff M, Paff Z, Seger B, Pfeiffer S, Hagedorn P, Stalets EL. Design, Implementation, and Validation of a Pediatric ICU Sepsis Prediction Tool as Clinical Decision Support. Appl Clin Inform 2020; 11:218-225. [PMID: 32215893 DOI: 10.1055/s-0040-1705107] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023] Open
Abstract
BACKGROUND Sepsis is an uncontrolled inflammatory reaction caused by infection. Clinicians in the pediatric intensive care unit (PICU) developed a paper-based tool to identify patients at risk of sepsis. To improve the utilization of the tool, the PICU team integrated the paper-based tool as a real-time clinical decision support (CDS) intervention in the electronic health record (EHR). OBJECTIVE This study aimed to improve identification of PICU patients with sepsis through an automated EHR-based CDS intervention. METHODS A prospective cohort study of all patients admitted to the PICU from May 2017 to May 2019. A CDS intervention was implemented in May 2018. The CDS intervention screened patients for nonspecific sepsis criteria, temperature dysregulation and a blood culture within 6 hours. Following the screening, an interruptive alert prompted nursing staff to complete a perfusion screen to assess for clinical signs of sepsis. The primary alert performance outcomes included sensitivity, specificity, and positive and negative predictive value. The secondary clinical outcome was completion of sepsis management tasks. RESULTS During the 1-year post implementation period, there were 45.0 sepsis events per 1,000 patient days over 10,805 patient days. The sepsis alert identified 392 of the 436 sepsis episodes accurately with sensitivity of 92.5%, specificity of 95.6%, positive predictive value of 46.0%, and negative predictive value of 99.7%. Examining only patients with severe sepsis confirmed by chart review, test characteristics fell to a sensitivity of 73.3%, a specificity of 92.5%. Prior to the initiation of the alert, 18.6% (13/70) of severe sepsis patients received recommended sepsis interventions. Following the implementation, 34% (27/80) received these interventions in the time recommended, p = 0.04. CONCLUSION An EHR CDS intervention demonstrated strong performance characteristics and improved completion of recommended sepsis interventions.
Collapse
Affiliation(s)
- Maya Dewan
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.,Division of Critical Care Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States.,Division of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States
| | - Rhea Vidrine
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.,Division of Critical Care Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States
| | - Matthew Zackoff
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.,Division of Critical Care Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States
| | - Zachary Paff
- Division of Critical Care Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States
| | - Brandy Seger
- Division of Critical Care Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States
| | - Stephen Pfeiffer
- Division of Critical Care Medicine, Department of Pediatrics, Children's Mercy Hospital, Kansas City, Missouri, United States
| | - Philip Hagedorn
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.,Division of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States.,Division of Hospital Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States
| | - Erika L Stalets
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.,Division of Critical Care Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States
| |
Collapse
|
26
|
Waller RG, Wright MC, Segall N, Nesbitt P, Reese T, Borbolla D, Del Fiol G. Novel displays of patient information in critical care settings: a systematic review. J Am Med Inform Assoc 2020; 26:479-489. [PMID: 30865769 DOI: 10.1093/jamia/ocy193] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2018] [Revised: 09/28/2018] [Accepted: 01/02/2019] [Indexed: 12/14/2022] Open
Abstract
OBJECTIVE Clinician information overload is prevalent in critical care settings. Improved visualization of patient information may help clinicians cope with information overload, increase efficiency, and improve quality. We compared the effect of information display interventions with usual care on patient care outcomes. MATERIALS AND METHODS We conducted a systematic review including experimental and quasi-experimental studies of information display interventions conducted in critical care and anesthesiology settings. Citations from January 1990 to June 2018 were searched in PubMed and IEEE Xplore. Reviewers worked independently to screen articles, evaluate quality, and abstract primary outcomes and display features. RESULTS Of 6742 studies identified, 22 studies evaluating 17 information displays met the study inclusion criteria. Information display categories included comprehensive integrated displays (3 displays), multipatient dashboards (7 displays), physiologic and laboratory monitoring (5 displays), and expert systems (2 displays). Significant improvement on primary outcomes over usual care was reported in 12 studies for 9 unique displays. Improvement was found mostly with comprehensive integrated displays (4 of 6 studies) and multipatient dashboards (5 of 7 studies). Only 1 of 5 randomized controlled trials had a positive effect in the primary outcome. CONCLUSION We found weak evidence suggesting comprehensive integrated displays improve provider efficiency and process outcomes, and multipatient dashboards improve compliance with care protocols and patient outcomes. Randomized controlled trials of physiologic and laboratory monitoring displays did not show improvement in primary outcomes, despite positive results in simulated settings. Important research translation gaps from laboratory to actual critical care settings exist.
Collapse
Affiliation(s)
- Rosalie G Waller
- Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA
| | - Melanie C Wright
- Trinity Health and Saint Alphonsus Regional Medical Center, Boise, ID, USA
| | - Noa Segall
- Department of Anesthesiology, Duke University Medical Center, Durham, North Carolina, USA
| | - Paige Nesbitt
- Trinity Health and Saint Alphonsus Regional Medical Center, Boise, ID, USA
| | - Thomas Reese
- Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA
| | - Damian Borbolla
- Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA
| | - Guilherme Del Fiol
- Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA
| |
Collapse
|
27
|
Delawder JM, Hulton L. An Interdisciplinary Code Sepsis Team to Improve Sepsis-Bundle Compliance: A Quality Improvement Project. J Emerg Nurs 2020; 46:91-98. [DOI: 10.1016/j.jen.2019.07.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2019] [Revised: 07/02/2019] [Accepted: 07/03/2019] [Indexed: 01/30/2023]
|
28
|
Liu VX, Bates DW, Wiens J, Shah NH. The number needed to benefit: estimating the value of predictive analytics in healthcare. J Am Med Inform Assoc 2019; 26:1655-1659. [PMID: 31192367 PMCID: PMC6857505 DOI: 10.1093/jamia/ocz088] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Revised: 05/10/2019] [Accepted: 05/17/2019] [Indexed: 12/21/2022] Open
Abstract
Predictive analytics in health care has generated increasing enthusiasm recently, as reflected in a rapidly growing body of predictive models reported in literature and in real-time embedded models using electronic health record data. However, estimating the benefit of applying any single model to a specific clinical problem remains challenging today. Developing a shared framework for estimating model value is therefore critical to facilitate the effective, safe, and sustainable use of predictive tools into the future. We highlight key concepts within the prediction-action dyad that together are expected to impact model benefit. These include factors relevant to model prediction (including the number needed to screen) as well as those relevant to the subsequent action (number needed to treat). In the simplest terms, a number needed to benefit contextualizes the numbers needed to screen and treat, offering an opportunity to estimate the value of a clinical predictive model in action.
Collapse
Affiliation(s)
- Vincent X Liu
- Division of Research, Kaiser Permanente, Oakland, California, USA
| | - David W Bates
- Division of General Internal Medicine, Brigham and Women’s Hospital, and Harvard Medical School, Boston, Massachusetts, USA
| | - Jenna Wiens
- Division of Computer Science and Engineering, College of Engineering, University of Michigan, Ann Arbor, Michigan, USA
| | - Nigam H Shah
- Division of Biomedical Informatics Research, Stanford University, Stanford, California, USA
| |
Collapse
|
29
|
Yee CR, Narain NR, Akmaev VR, Vemulapalli V. A Data-Driven Approach to Predicting Septic Shock in the Intensive Care Unit. BIOMEDICAL INFORMATICS INSIGHTS 2019; 11:1178222619885147. [PMID: 31700248 PMCID: PMC6829643 DOI: 10.1177/1178222619885147] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/19/2019] [Accepted: 09/23/2019] [Indexed: 12/29/2022]
Abstract
Early diagnosis of sepsis and septic shock has been unambiguously linked to lower
mortality and better patient outcomes. Despite this, there is a strong unmet
need for a reliable clinical tool that can be used for large-scale automated
screening to identify high-risk patients. We addressed the following questions:
Can a novel algorithm to identify patients at high risk of septic shock 24 hours
before diagnosis be discovered using available clinical data? What are
performance characteristics of this predictive algorithm? Can current metrics
for evaluation of sepsis be improved using novel algorithm? Publicly available
data from the intensive care unit setting was used to build septic shock and
control patient cohorts. Using Bayesian networks, causal relationships between
diagnosis groups, procedure groups, laboratory results, and demographic data
were inferred. Predictive model for septic shock 24 hours prior to digital
diagnosis was built based on inferred causal networks. Sepsis risk scores were
augmented by de novo inferred model and performance was evaluated. A novel
predictive model to identify high-risk patients 24 hours ahead of time, with
area under curve of 0.81, negative predictive value of 0.87, and a positive
predictive value as high as 0.65 was built. The specificity of quick sequential
organ failure assessment, systemic inflammatory response syndrome, and modified
early warning score was improved when augmented with the novel model, whereas no
improvements were made to the sequential organ failure assessment score. We used
a data-driven, expert knowledge agnostic method to build a screening algorithm
for early detection of septic shock. The model demonstrates strong performance
in the data set used and provides a basis for expanding this work toward
building an algorithm that is used to screen patients based on electronic
medical record data in real time.
Collapse
|
30
|
The Effect of the Intelligent Sepsis Management System on Outcomes among Patients with Sepsis and Septic Shock Diagnosed According to the Sepsis-3 Definition in the Emergency Department. J Clin Med 2019; 8:jcm8111800. [PMID: 31717855 PMCID: PMC6912745 DOI: 10.3390/jcm8111800] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2019] [Revised: 10/23/2019] [Accepted: 10/24/2019] [Indexed: 12/29/2022] Open
Abstract
We developed a novel computer program, the Intelligent Sepsis Management System, based on Sepsis-3 definitions and 2016 Surviving Sepsis Campaign guidelines and performed a quasi-experimental pre-post study to assess its effect on compliance with the Surviving Sepsis Campaign guidelines and outcomes in patients with sepsis and septic shock. During the pre-period, patients were managed with usual care. During the post-period, patients were managed using the Intelligent Sepsis Management System upon arrival at the emergency department. A total of 631 patients were enrolled (pre-period, 316; post-period, 315). The overall compliance with the Surviving Sepsis Campaign guidelines’ bundle improved (pre-period 10.8% vs. post-period 54.6%; p < 0.001). The post-period showed significantly lower 30-day mortality than the pre-period (pre-period 37.3% vs. post-period 29.5%; p = 0.037), but was not a protective factor for 30-day mortality, with an adjusted hazard ratio (95% confidence interval) of 0.75 (0.55–1.04) (p = 0.151). The associated factors for 30-day mortality were age, sequential organ failure assessment score, overall compliance, and lactate levels. The 30-day mortality was significantly lower in the compliance group than in the non-compliance group (27.2% vs. 36.5%; p = 0.002). After implementation of the Intelligent Sepsis Management System, overall compliance with the Surviving Sepsis Campaign guidelines improved and was associated with reduced 30-day mortality. However, we could not verify the causal effect of this system on 30-day mortality.
Collapse
|
31
|
Woodworth A. What Is the Role of a Clinical Laboratorian in Care of a Septic Patient? J Appl Lab Med 2019; 3:737-739. [PMID: 31639744 DOI: 10.1373/jalm.2017.025841] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2018] [Accepted: 10/19/2018] [Indexed: 11/06/2022]
Affiliation(s)
- Alison Woodworth
- Pathology and Laboratory Medicine, Core Clinical Laboratory and Point of Care Testing, University of Kentucky Medical Center, Lexington, KY.
| |
Collapse
|
32
|
Delay Within the 3-Hour Surviving Sepsis Campaign Guideline on Mortality for Patients With Severe Sepsis and Septic Shock. Crit Care Med 2019; 46:500-505. [PMID: 29298189 DOI: 10.1097/ccm.0000000000002949] [Citation(s) in RCA: 109] [Impact Index Per Article: 21.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
OBJECTIVES To specify when delays of specific 3-hour bundle Surviving Sepsis Campaign guideline recommendations applied to severe sepsis or septic shock become harmful and impact mortality. DESIGN Retrospective cohort study. SETTING One health system composed of six hospitals and 45 clinics in a Midwest state from January 01, 2011, to July 31, 2015. PATIENTS All adult patients hospitalized with billing diagnosis of severe sepsis or septic shock. INTERVENTIONS Four 3-hour Surviving Sepsis Campaign guideline recommendations: 1) obtain blood culture before antibiotics, 2) obtain lactate level, 3) administer broad-spectrum antibiotics, and 4) administer 30 mL/kg of crystalloid fluid for hypotension (defined as "mean arterial pressure" < 65) or lactate (> 4). MEASUREMENTS AND MAIN RESULTS To determine the effect of t minutes of delay in carrying out each intervention, propensity score matching of "baseline" characteristics compensated for differences in health status. The average treatment effect in the treated computed as the average difference in outcomes between those treated after shorter versus longer delay. To estimate the uncertainty associated with the average treatment effect in the treated metric and to construct 95% CIs, bootstrap estimation with 1,000 replications was performed. From 5,072 patients with severe sepsis or septic shock, 1,412 (27.8%) had in-hospital mortality. The majority of patients had the four 3-hour bundle recommendations initiated within 3 hours. The statistically significant time in minutes after which a delay increased the risk of death for each recommendation was as follows: lactate, 20.0 minutes; blood culture, 50.0 minutes; crystalloids, 100.0 minutes; and antibiotic therapy, 125.0 minutes. CONCLUSIONS The guideline recommendations showed that shorter delays indicates better outcomes. There was no evidence that 3 hours is safe; even very short delays adversely impact outcomes. Findings demonstrated a new approach to incorporate time t when analyzing the impact on outcomes and provide new evidence for clinical practice and research.
Collapse
|
33
|
Bachmann KF, Vetter C, Wenzel L, Konrad C, Vogt AP. Implementation and Evaluation of a Web-Based Distribution System For Anesthesia Department Guidelines and Standard Operating Procedures: Qualitative Study and Content Analysis. J Med Internet Res 2019; 21:e14482. [PMID: 31418427 PMCID: PMC6714503 DOI: 10.2196/14482] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2019] [Revised: 06/28/2019] [Accepted: 06/29/2019] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Digitization is spreading exponentially in medical care, with improved availability of electronic devices. Guidelines and standard operating procedures (SOPs) form an important part of daily clinical routine, and adherence is associated with improved outcomes. OBJECTIVE This study aimed to evaluate a digital solution for the maintenance and distribution of SOPs and guidelines in 2 different anesthesiology departments in Switzerland. METHODS A content management system (CMS), WordPress, was set up in 2 tertiary-level hospitals within 1 year: the Department of Anesthesiology and Pain Medicine at the Kantonsspital Lucerne in Lucerne, Switzerland, as an open-access system, followed by a similar system for internal usage in the Department of Anaesthesiology and Pain Medicine of the Inselspital, Bern University Hospital, in Bern, Switzerland. We analyzed the requirements and implementation processes needed to successfully set up these systems, and we evaluated the systems' impact by analyzing content and usage. RESULTS The systems' generated exportable metadata, such as traffic and content. Analysis of the exported metadata showed that the Lucerne website had 269 pages managed by 44 users, with 88,124 visits per month (worldwide access possible), and the Bern website had 341 pages managed by 35 users, with 1765 visits per month (access only possible from within the institution). Creation of an open-access system resulted in third-party interest in the published guidelines and SOPs. The implementation process can be performed over the course of 1 year and setup and maintenance costs are low. CONCLUSIONS A CMS, such as WordPress, is a suitable solution for distributing and managing guidelines and SOPs. Content is easily accessible and is accessed frequently. Metadata from the system allow live monitoring of usage and suggest that the system be accepted and appreciated by the users. In the future, Web-based solutions could be an important tool to handle guidelines and SOPs, but further studies are needed to assess the effect of these systems.
Collapse
Affiliation(s)
- Kaspar F Bachmann
- Department of Anaesthesiology & Pain Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Christian Vetter
- Department of Anaesthesiology & Pain Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Lars Wenzel
- Department of Anaesthesiology & Pain Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Christoph Konrad
- Department of Anaesthesiology & Pain Medicine, Kantonsspital Lucerne, Lucerne, Switzerland
| | - Andreas P Vogt
- Department of Anaesthesiology & Pain Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| |
Collapse
|
34
|
|
35
|
Barton C, Chettipally U, Zhou Y, Jiang Z, Lynn-Palevsky A, Le S, Calvert J, Das R. Evaluation of a machine learning algorithm for up to 48-hour advance prediction of sepsis using six vital signs. Comput Biol Med 2019; 109:79-84. [PMID: 31035074 DOI: 10.1016/j.compbiomed.2019.04.027] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Revised: 04/01/2019] [Accepted: 04/21/2019] [Indexed: 12/21/2022]
Abstract
OBJECTIVE Sepsis remains a costly and prevalent syndrome in hospitals; however, machine learning systems can increase timely sepsis detection using electronic health records. This study validates a gradient boosted ensemble machine learning tool for sepsis detection and prediction, and compares its performance to existing methods. MATERIALS AND METHODS Retrospective data was drawn from databases at the University of California, San Francisco (UCSF) Medical Center and the Beth Israel Deaconess Medical Center (BIDMC). Adult patient encounters without sepsis on admission, and with at least one recording of each of six vital signs (SpO2, heart rate, respiratory rate, temperature, systolic and diastolic blood pressure) were included. We compared the performance of the machine learning algorithm (MLA) to that of commonly used scoring systems. Area under the receiver operating characteristic (AUROC) curve was our primary measure of accuracy. MLA performance was measured at sepsis onset, and at 24 and 48 h prior to sepsis onset. RESULTS The MLA achieved an AUROC of 0.88, 0.84, and 0.83 for sepsis onset and 24 and 48 h prior to onset, respectively. These values were superior to those of SIRS (0.66), MEWS (0.61), SOFA (0.72), and qSOFA (0.60) at time of onset. When trained on UCSF data and tested on BIDMC data, sepsis onset AUROC was 0.89. DISCUSSION AND CONCLUSION The MLA predicts sepsis up to 48 h in advance and identifies sepsis onset more accurately than commonly used tools, maintaining high performance for sepsis detection when trained and tested on separate datasets.
Collapse
Affiliation(s)
- Christopher Barton
- Department of Emergency Medicine, University of California San Francisco, San Francisco, CA, USA
| | - Uli Chettipally
- Department of Emergency Medicine, University of California San Francisco, San Francisco, CA, USA; Kaiser Permanente South San Francisco Medical Center, South San Francisco, CA, USA
| | - Yifan Zhou
- Dascena Inc., Oakland, CA, USA; Department of Statistics, University of California Berkeley, Berkeley, CA, USA
| | - Zirui Jiang
- Dascena Inc., Oakland, CA, USA; Department of Nuclear Engineering, University of California Berkeley, Berkeley, CA, USA
| | | | | | | | | |
Collapse
|
36
|
Ruppel H, Liu V. To catch a killer: electronic sepsis alert tools reaching a fever pitch? BMJ Qual Saf 2019; 28:693-696. [PMID: 31015377 DOI: 10.1136/bmjqs-2019-009463] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/08/2019] [Indexed: 12/26/2022]
Affiliation(s)
- Halley Ruppel
- Systems Research Initiative, Kaiser Permanente Division of Research, Oakland, California, USA
| | - Vincent Liu
- Systems Research Initiative, Kaiser Permanente Division of Research, Oakland, California, USA
| |
Collapse
|
37
|
Intensive Care Unit Telemedicine in the Era of Big Data, Artificial Intelligence, and Computer Clinical Decision Support Systems. Crit Care Clin 2019; 35:483-495. [PMID: 31076048 DOI: 10.1016/j.ccc.2019.02.005] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
This article examines the history of the telemedicine intensive care unit (tele-ICU), the current state of clinical decision support systems (CDSS) in the tele-ICU, applications of machine learning (ML) algorithms to critical care, and opportunities to integrate ML with tele-ICU CDSS. The enormous quantities of data generated by tele-ICU systems is a major driver in the development of the large, comprehensive, heterogeneous, and granular data sets necessary to develop generalizable ML CDSS algorithms, and deidentification of these data sets expands opportunities for ML CDSS research.
Collapse
|
38
|
Downing NL, Rolnick J, Poole SF, Hall E, Wessels AJ, Heidenreich P, Shieh L. Electronic health record-based clinical decision support alert for severe sepsis: a randomised evaluation. BMJ Qual Saf 2019; 28:762-768. [PMID: 30872387 PMCID: PMC6860967 DOI: 10.1136/bmjqs-2018-008765] [Citation(s) in RCA: 55] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2018] [Revised: 02/05/2019] [Accepted: 02/08/2019] [Indexed: 12/03/2022]
Abstract
Background Sepsis remains the top cause of morbidity and mortality of hospitalised patients despite concerted efforts. Clinical decision support for sepsis has shown mixed results reflecting heterogeneous populations, methodologies and interventions. Objectives To determine whether the addition of a real-time electronic health record (EHR)-based clinical decision support alert improves adherence to treatment guidelines and clinical outcomes in hospitalised patients with suspected severe sepsis. Design Patient-level randomisation, single blinded. Setting Medical and surgical inpatient units of an academic, tertiary care medical centre. Patients 1123 adults over the age of 18 admitted to inpatient wards (intensive care units (ICU) excluded) at an academic teaching hospital between November 2014 and March 2015. Interventions Patients were randomised to either usual care or the addition of an EHR-generated alert in response to a set of modified severe sepsis criteria that included vital signs, laboratory values and physician orders. Measurements and main results There was no significant difference between the intervention and control groups in primary outcome of the percentage of patients with new antibiotic orders at 3 hours after the alert (35% vs 37%, p=0.53). There was no difference in secondary outcomes of in-hospital mortality at 30 days, length of stay greater than 72 hours, rate of transfer to ICU within 48 hours of alert, or proportion of patients receiving at least 30 mL/kg of intravenous fluids. Conclusions An EHR-based severe sepsis alert did not result in a statistically significant improvement in several sepsis treatment performance measures.
Collapse
Affiliation(s)
- Norman Lance Downing
- Department of Medicine - Biomedical Informatics Research, Hospital Medicine, and Primary Care and Population Health, Stanford University, Stanford, California, USA .,Clinical Excellence Research Center, Stanford University, Stanford, California, USA
| | - Joshua Rolnick
- Division of General Internal Medicine, Department of Medicine and the National Clinician Scholars Program, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA.,Corporal Michael J. Crescenz VA Medical Center, Pennsylvania, PA, United States
| | - Sarah F Poole
- Biomedical Informatics Training Program, Stanford University, Stanford, California, USA
| | - Evan Hall
- Medicine, Hematology and Oncology, Stanford University, Stanford, California, USA
| | | | - Paul Heidenreich
- Department of Medicine, Cardiovascular Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Lisa Shieh
- Medicine, Stanford School of Medicine, Stanford, California, USA
| |
Collapse
|
39
|
Fargo EL, D'Amico F, Pickering A, Fowler K, Campbell R, Baumgartner M. Impact of Electronic Physician Order-Set on Antibiotic Ordering Time in Septic Patients in the Emergency Department. Appl Clin Inform 2018; 9:869-874. [PMID: 30517970 DOI: 10.1055/s-0038-1676040] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND Sepsis is a serious medical condition that can lead to organ dysfunction and death. Research shows that each hour delay in antibiotic administration increases mortality. The Surviving Sepsis Campaign Bundles created standards to assist in the timely treatment of patients with suspected sepsis to improve outcomes and reduce mortality. OBJECTIVE This article determines if the use of an electronic physician order-set decreases time to antibiotic ordering for patients with sepsis in the emergency department (ED). METHODS A retrospective chart review was performed on adult patients who presented to the ED of four community hospitals from May to July 2016. Patients with severe sepsis and/or septic shock were included. Primary outcome was the difference in time to antibiotic ordering in patients whose physicians utilized the order-set versus those whose physicians did not. Secondary outcomes included differences in time to antibiotic administration, time to lactate test, hospital length of stay, and posthospitalization disposition. The institution's Quality Improvement Committee approved the project. RESULTS Forty-five of 123 patients (36.6%) with sepsis had physicians who used the order-set. Order-set utilization reduced the mean time to ordering antibiotics by 20 minutes (99 minutes, 95% confidence interval [CI]: 69-128 vs. 119 minutes, 95% CI: 91-147), but this finding was not statistically significant. Mean time to antibiotic administration (145 minutes, 95% CI: 108-181 vs. 182 minutes, 95% CI: 125-239) and median time to lactate tests (12 minutes, 95% CI: 0-20 vs. 19 minutes, 95% CI: 8-34), although in the direction of the hypotheses, were not significantly different. CONCLUSION Utilization of the order-set was associated with a potentially clinically significant, but not statistically significant, reduced time to antibiotic ordering in patients with sepsis. Electronic order-sets are a promising tool to assist hospitals with meeting the Centers for Medicare and Medicaid Services core measure.
Collapse
Affiliation(s)
- Emily L Fargo
- UPMC St. Margaret, Pittsburgh, Pennsylvania, United States
| | - Frank D'Amico
- UPMC St. Margaret, Pittsburgh, Pennsylvania, United States
| | | | - Kathleen Fowler
- Department of Pharmacy, UPMC Work Partners, Pittsburgh, Pennsylvania, United States
| | | | | |
Collapse
|
40
|
Westphal GA, Pereira AB, Fachin SM, Sperotto G, Gonçalves M, Albino L, Bittencourt R, Franzini VDR, Koenig Á. An electronic warning system helps reduce the time to diagnosis of sepsis. Rev Bras Ter Intensiva 2018; 30:414-422. [PMID: 30570029 PMCID: PMC6334482 DOI: 10.5935/0103-507x.20180059] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2018] [Accepted: 05/30/2018] [Indexed: 12/20/2022] Open
Abstract
OBJECTIVE To describe the improvements of an early warning system for the identification of septic patients on the time to diagnosis, antibiotic delivery, and mortality. METHODS This was an observational cohort study that describes the successive improvements made over a period of 10 years using an early warning system to detect sepsis, including systematic active manual surveillance, electronic alerts via a telephonist, and alerts sent directly to the mobile devices of nurses. For all periods, after an alert was triggered, early treatment was instituted according to the institutional sepsis guidelines. RESULTS In total, 637 patients with sepsis were detected over the study period. The median triage-to-diagnosis time was reduced from 19:20 (9:10 - 38:15) hours to 12:40 (2:50 - 23:45) hours when the manual surveillance method was used (p = 0.14), to 2:10 (1:25 - 2:20) hours when the alert was sent automatically to the hospital telephone service (p = 0.014), and to 1:00 (0:30 - 1:10) hour when the alert was sent directly to the nurse's mobile phone (p = 0.016). The diagnosis-to-antibiotic time was reduced to 1:00 (0:55 - 1:30) hours when the alert was sent to the telephonist and to 0:45 (0:30 - 1:00) minutes when the alert was sent directly to the nurse's mobile phone (p = 0.02), with the maintenance of similar values over the following years. There was no difference in the time of treatment between survivors and non-survivors. CONCLUSION Electronic systems help reduce the triage-to-diagnosis time and diagnosis-to-antibiotic time in patients with sepsis.
Collapse
|
41
|
Ruminski CM, Clark MT, Lake DE, Kitzmiller RR, Keim-Malpass J, Robertson MP, Simons TR, Moorman JR, Calland JF. Impact of predictive analytics based on continuous cardiorespiratory monitoring in a surgical and trauma intensive care unit. J Clin Monit Comput 2018; 33:703-711. [PMID: 30121744 DOI: 10.1007/s10877-018-0194-4] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2018] [Accepted: 08/02/2018] [Indexed: 01/10/2023]
Abstract
Predictive analytics monitoring, the use of patient data to provide continuous risk estimation of deterioration, is a promising new application of big data analytical techniques to the care of individual patients. We tested the hypothesis that continuous display of novel electronic risk visualization of respiratory and cardiovascular events would impact intensive care unit (ICU) patient outcomes. In an adult tertiary care surgical trauma ICU, we displayed risk estimation visualizations on a large monitor, but in the medical ICU in the same institution we did not. The risk estimates were based solely on analysis of continuous cardiorespiratory monitoring. We examined 4275 individual patient records within a 7 month time period preceding and following data display. We determined cases of septic shock, emergency intubation, hemorrhage, and death to compare rates per patient care pre-and post-implementation. Following implementation, the incidence of septic shock fell by half (p < 0.01 in a multivariate model that included age and APACHE) in the surgical trauma ICU, where the data were continuously on display, but by only 10% (p = NS) in the control Medical ICU. There were no significant changes in the other outcomes. Display of a predictive analytics monitor based on continuous cardiorespiratory monitoring was followed by a reduction in the rate of septic shock, even when controlling for age and APACHE score.
Collapse
Affiliation(s)
- Caroline M Ruminski
- University of Virginia School of Medicine, P.O. Box 800158, Charlottesville, VA, 22908, USA
| | - Matthew T Clark
- Advanced Medical Predictive Devices, Diagnostics, Displays (AMP3D), Charlottesville, VA, USA
| | - Douglas E Lake
- University of Virginia School of Medicine, P.O. Box 800158, Charlottesville, VA, 22908, USA
| | | | | | | | | | - J Randall Moorman
- University of Virginia School of Medicine, P.O. Box 800158, Charlottesville, VA, 22908, USA.
| | - J Forrest Calland
- University of Virginia School of Medicine, P.O. Box 800158, Charlottesville, VA, 22908, USA
| |
Collapse
|
42
|
A Critical Care Clinician Survey Comparing Attitudes and Perceived Barriers to Low Tidal Volume Ventilation with Actual Practice. Ann Am Thorac Soc 2018; 14:1682-1689. [PMID: 28771042 DOI: 10.1513/annalsats.201612-973oc] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
RATIONALE Low-Vt ventilation lowers mortality in patients with acute respiratory distress syndrome (ARDS) but is underused. Little is known about clinician attitudes toward and perceived barriers to low-Vt ventilation use and their association with actual low-Vt ventilation use. OBJECTIVES The objectives of this study were to assess clinicians' attitudes toward and perceived barriers to low-Vt ventilation (Vt <6.5 ml/kg predicted body weight) in patients with ARDS, to identify differences in attitudes and perceived barriers among clinician types, and to compare attitudes toward and perceived barriers to actual low-Vt ventilation use in patients with ARDS. METHODS We conducted a survey of critical care physicians, nurses, and respiratory therapists at four non-ARDS Network hospitals in the Chicago region. We compared survey responses with performance in a cohort of 362 patients with ARDS. RESULTS Survey responses included clinician attitudes toward and perceived barriers to low-Vt ventilation use. We also measured low-Vt ventilation initiation by these clinicians in 347 patients with ARDS initiated after ARDS onset as well as correlation with clinician attitudes and perceived barriers. Of 674 clinicians surveyed, 467 (69.3%) responded. Clinicians had positive attitudes toward and perceived few process barriers to ARDS diagnosis or initiation of low-Vt ventilation. Physicians had more positive attitudes and perceived fewer barriers than nurses or respiratory therapists. However, use of low-Vt ventilation by all three clinician groups was low. For example, whereas physicians believed that 92.5% of their patients with ARDS warranted treatment with low-Vt ventilation, they initiated low-Vt ventilation for a median (interquartile range) of 7.4% (0 to 14.3%) of their eligible patients with ARDS. Clinician attitudes and perceived barriers were not correlated with low-Vt ventilation initiation. CONCLUSIONS Clinicians had positive attitudes toward low-Vt ventilation and perceived few barriers to using it, but attitudes and perceived process barriers were not correlated with actual low-Vt ventilation use, which was low. Implementation strategies should be focused on examining other issues, such as ARDS recognition and process solutions, to improve low-Vt ventilation use.
Collapse
|
43
|
Van de Velde S, Kunnamo I, Roshanov P, Kortteisto T, Aertgeerts B, Vandvik PO, Flottorp S. The GUIDES checklist: development of a tool to improve the successful use of guideline-based computerised clinical decision support. Implement Sci 2018; 13:86. [PMID: 29941007 PMCID: PMC6019508 DOI: 10.1186/s13012-018-0772-3] [Citation(s) in RCA: 66] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2018] [Accepted: 05/30/2018] [Indexed: 02/08/2023] Open
Abstract
Background Computerised decision support (CDS) based on trustworthy clinical guidelines is a key component of a learning healthcare system. Research shows that the effectiveness of CDS is mixed. Multifaceted context, system, recommendation and implementation factors may potentially affect the success of CDS interventions. This paper describes the development of a checklist that is intended to support professionals to implement CDS successfully. Methods We developed the checklist through an iterative process that involved a systematic review of evidence and frameworks, a synthesis of the success factors identified in the review, feedback from an international expert panel that evaluated the checklist in relation to a list of desirable framework attributes, consultations with patients and healthcare consumers and pilot testing of the checklist. Results We screened 5347 papers and selected 71 papers with relevant information on success factors for guideline-based CDS. From the selected papers, we developed a 16-factor checklist that is divided in four domains, i.e. the CDS context, content, system and implementation domains. The panel of experts evaluated the checklist positively as an instrument that could support people implementing guideline-based CDS across a wide range of settings globally. Patients and healthcare consumers identified guideline-based CDS as an important quality improvement intervention and perceived the GUIDES checklist as a suitable and useful strategy. Conclusions The GUIDES checklist can support professionals in considering the factors that affect the success of CDS interventions. It may facilitate a deeper and more accurate understanding of the factors shaping CDS effectiveness. Relying on a structured approach may prevent that important factors are missed. Electronic supplementary material The online version of this article (10.1186/s13012-018-0772-3) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Stijn Van de Velde
- Centre for Informed Health Choices, Division for Health Services, Norwegian Institute of Public Health, Oslo, Norway.
| | - Ilkka Kunnamo
- Duodecim, Scientific Society of Finnish Physicians, Helsinki, Finland
| | - Pavel Roshanov
- Department of Medicine, McMaster University, Hamilton, Canada
| | | | - Bert Aertgeerts
- Department of Public Health and Primary Care, KU Leuven, Leuven, Belgium
| | - Per Olav Vandvik
- MAGIC Non-Profit Research and Innovation Programme, Oslo, Norway.,Institute of Health and Society, University of Oslo, Oslo, Norway
| | - Signe Flottorp
- Centre for Informed Health Choices, Division for Health Services, Norwegian Institute of Public Health, Oslo, Norway.,Institute of Health and Society, University of Oslo, Oslo, Norway
| | | |
Collapse
|
44
|
Warttig S, Alderson P, Evans DJW, Lewis SR, Kourbeti IS, Smith AF. Automated monitoring compared to standard care for the early detection of sepsis in critically ill patients. Cochrane Database Syst Rev 2018; 6:CD012404. [PMID: 29938790 PMCID: PMC6353245 DOI: 10.1002/14651858.cd012404.pub2] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
BACKGROUND Sepsis is a life-threatening condition that is usually diagnosed when a patient has a suspected or documented infection, and meets two or more criteria for systemic inflammatory response syndrome (SIRS). The incidence of sepsis is higher among people admitted to critical care settings such as the intensive care unit (ICU) than among people in other settings. If left untreated sepsis can quickly worsen; severe sepsis has a mortality rate of 40% or higher, depending on definition. Recognition of sepsis can be challenging as it usually requires patient data to be combined from multiple unconnected sources, and interpreted correctly, which can be complex and time consuming to do. Electronic systems that are designed to connect information sources together, and automatically collate, analyse, and continuously monitor the information, as well as alerting healthcare staff when pre-determined diagnostic thresholds are met, may offer benefits by facilitating earlier recognition of sepsis and faster initiation of treatment, such as antimicrobial therapy, fluid resuscitation, inotropes, and vasopressors if appropriate. However, there is the possibility that electronic, automated systems do not offer benefits, or even cause harm. This might happen if the systems are unable to correctly detect sepsis (meaning that treatment is not started when it should be, or it is started when it shouldn't be), or healthcare staff may not respond to alerts quickly enough, or get 'alarm fatigue' especially if the alarms go off frequently or give too many false alarms. OBJECTIVES To evaluate whether automated systems for the early detection of sepsis can reduce the time to appropriate treatment (such as initiation of antibiotics, fluids, inotropes, and vasopressors) and improve clinical outcomes in critically ill patients in the ICU. SEARCH METHODS We searched CENTRAL; MEDLINE; Embase; CINAHL; ISI Web of science; and LILACS, clinicaltrials.gov, and the World Health Organization trials portal. We searched all databases from their date of inception to 18 September 2017, with no restriction on country or language of publication. SELECTION CRITERIA We included randomized controlled trials (RCTs) that compared automated sepsis-monitoring systems to standard care (such as paper-based systems) in participants of any age admitted to intensive or critical care units for critical illness. We defined an automated system as any process capable of screening patient records or data (one or more systems) automatically at intervals for markers or characteristics that are indicative of sepsis. We defined critical illness as including, but not limited to postsurgery, trauma, stroke, myocardial infarction, arrhythmia, burns, and hypovolaemic or haemorrhagic shock. We excluded non-randomized studies, quasi-randomized studies, and cross-over studies . We also excluded studies including people already diagnosed with sepsis. DATA COLLECTION AND ANALYSIS We used the standard methodological procedures expected by Cochrane. Our primary outcomes were: time to initiation of antimicrobial therapy; time to initiation of fluid resuscitation; and 30-day mortality. Secondary outcomes included: length of stay in ICU; failed detection of sepsis; and quality of life. We used GRADE to assess the quality of evidence for each outcome. MAIN RESULTS We included three RCTs in this review. It was unclear if the RCTs were three separate studies involving 1199 participants in total, or if they were reports from the same study involving fewer participants. We decided to treat the studies separately, as we were unable to make contact with the study authors to clarify.All three RCTs are of very low study quality because of issues with unclear randomization methods, allocation concealment and uncertainty of effect size. Some of the studies were reported as abstracts only and contained limited data, which prevented meaningful analysis and assessment of potential biases.The studies included participants who all received automated electronic monitoring during their hospital stay. Participants were randomized to an intervention group (automated alerts sent from the system) or to usual care (no automated alerts sent from the system).Evidence from all three studies reported 'Time to initiation of antimicrobial therapy'. We were unable to pool the data, but the largest study involving 680 participants reported median time to initiation of antimicrobial therapy in the intervention group of 5.6 hours (interquartile range (IQR) 2.3 to 19.7) in the intervention group (n = not stated) and 7.8 hours (IQR 2.5 to 33.1) in the control group (n = not stated).No studies reported 'Time to initiation of fluid resuscitation' or the adverse event 'Mortality at 30 days'. However very low-quality evidence was available where mortality was reported at other time points. One study involving 77 participants reported 14-day mortality of 20% in the intervention group and 21% in the control group (numerator and denominator not stated). One study involving 442 participants reported mortality at 28 days, or discharge was 14% in the intervention group and 10% in the control group (numerator and denominator not reported). Sample sizes were not reported adequately for these outcomes and so we could not estimate confidence intervals.Very low-quality evidence from one study involving 442 participants reported 'Length of stay in ICU'. Median length of stay was 3.0 days in the intervention group (IQR = 2.0 to 5.0), and 3.0 days (IQR 2.0 to 4.0 in the control).Very low-quality evidence from one study involving at least 442 participants reported the adverse effect 'Failed detection of sepsis'. Data were only reported for failed detection of sepsis in two participants and it wasn't clear which group(s) this outcome occurred in.No studies reported 'Quality of life'. AUTHORS' CONCLUSIONS It is unclear what effect automated systems for monitoring sepsis have on any of the outcomes included in this review. Very low-quality evidence is only available on automated alerts, which is only one component of automated monitoring systems. It is uncertain whether such systems can replace regular, careful review of the patient's condition by experienced healthcare staff.
Collapse
Affiliation(s)
- Sheryl Warttig
- National Institute for Health and Care ExcellenceLevel 1A, City TowerPiccadilly PlazaManchesterUKM1 4BD
| | - Phil Alderson
- National Institute for Health and Care ExcellenceLevel 1A, City TowerPiccadilly PlazaManchesterUKM1 4BD
| | | | - Sharon R Lewis
- Royal Lancaster InfirmaryLancaster Patient Safety Research UnitPointer Court 1, Ashton RoadLancasterUKLA1 4RP
| | - Irene S Kourbeti
- Furness General HospitalDepartment of Acute and Emergency MedicineBarrow‐in‐FurnessUK
| | - Andrew F Smith
- Royal Lancaster InfirmaryDepartment of AnaesthesiaAshton RoadLancasterLancashireUKLA1 4RP
| | | |
Collapse
|
45
|
Lapse in Antibiotics Leads to Sepsis. AORN J 2018; 107:655-656. [DOI: 10.1002/aorn.12100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
46
|
Sinha M, Jupe J, Mack H, Coleman TP, Lawrence SM, Fraley SI. Emerging Technologies for Molecular Diagnosis of Sepsis. Clin Microbiol Rev 2018; 31:e00089-17. [PMID: 29490932 PMCID: PMC5967692 DOI: 10.1128/cmr.00089-17] [Citation(s) in RCA: 187] [Impact Index Per Article: 31.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Abstract
Rapid and accurate profiling of infection-causing pathogens remains a significant challenge in modern health care. Despite advances in molecular diagnostic techniques, blood culture analysis remains the gold standard for diagnosing sepsis. However, this method is too slow and cumbersome to significantly influence the initial management of patients. The swift initiation of precise and targeted antibiotic therapies depends on the ability of a sepsis diagnostic test to capture clinically relevant organisms along with antimicrobial resistance within 1 to 3 h. The administration of appropriate, narrow-spectrum antibiotics demands that such a test be extremely sensitive with a high negative predictive value. In addition, it should utilize small sample volumes and detect polymicrobial infections and contaminants. All of this must be accomplished with a platform that is easily integrated into the clinical workflow. In this review, we outline the limitations of routine blood culture testing and discuss how emerging sepsis technologies are converging on the characteristics of the ideal sepsis diagnostic test. We include seven molecular technologies that have been validated on clinical blood specimens or mock samples using human blood. In addition, we discuss advances in machine learning technologies that use electronic medical record data to provide contextual evaluation support for clinical decision-making.
Collapse
Affiliation(s)
- Mridu Sinha
- Bioengineering Department, University of California, San Diego, San Diego, California, USA
| | - Julietta Jupe
- Donald Danforth Plant Science Center, Saint Louis, Missouri, USA
| | - Hannah Mack
- Bioengineering Department, University of California, San Diego, San Diego, California, USA
| | - Todd P Coleman
- Bioengineering Department, University of California, San Diego, San Diego, California, USA
- Center for Microbiome Innovation, University of California, San Diego, San Diego, California, USA
| | - Shelley M Lawrence
- Department of Pediatrics, Division of Neonatal-Perinatal Medicine, University of California, San Diego, San Diego, California, USA
- Rady Children's Hospital of San Diego, San Diego, California, USA
- Clinical Translational Research Institute, University of California, San Diego, San Diego, California, USA
- Center for Microbiome Innovation, University of California, San Diego, San Diego, California, USA
| | - Stephanie I Fraley
- Bioengineering Department, University of California, San Diego, San Diego, California, USA
- Clinical Translational Research Institute, University of California, San Diego, San Diego, California, USA
- Center for Microbiome Innovation, University of California, San Diego, San Diego, California, USA
| |
Collapse
|
47
|
Chanas T, Volles D, Sawyer R, Mallow-Corbett S. Analysis of a new best-practice advisory on time to initiation of antibiotics in surgical intensive care unit patients with septic shock. J Intensive Care Soc 2018; 20:34-39. [PMID: 30792760 DOI: 10.1177/1751143718767059] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022] Open
Abstract
Background Early administration of antibiotics in septic shock is associated with decreased mortality. Promptly identifying sepsis and eliciting a response are necessary to reduce time to antibiotic administration. Methods A best-practice advisory was introduced in the surgical intensive care unit to identify patients with septic shock and promote timely action. The best-practice advisory is triggered by blood culture orders and vasopressor administration within 24 h. The nurse or provider who triggers the alert may send an automatic notification to the intensive care unit resident, clinical pharmacist, and charge nurse, prompting bedside response and closer evaluation. Patients who met best-practice advisory criteria in the surgical intensive care unit from May 2016 through March 2017 were included. Outcomes included changes in antibiotics within 24 h, response to best-practice advisory, and time-to-antibiotics. Time-to-antibiotics was compared between a retrospective pre-intervention period and a six-month prospective post-intervention period defined by launch of the new best-practice advisory in September 2016. Data were analyzed by chi square, Mann-Whitney U, and Kruskal-Wallis. Results During the first six months of best-practice advisory implementation, 191 alerts were triggered by 97 unique patients. Alert notification was transmitted in 79 best-practice advisories (41%), with pharmacist bedside response in 53 (67%). New antibiotics were started within 24 h following 83 best-practice advisories (43%). There was a trend toward decreased time-to-antibiotics following implementation of the best-practice advisory (7.4 vs. 4.2 h, p = 0.057). Compared to the entire cohort, time-to-antibiotics was shorter when the team was notified and when a pharmacist responded to the bedside (4.2 vs. 1.6 vs. 1.2 hours). Conclusions A new best-practice advisory has been effective at eliciting a rapid response and reducing the time-to-antibiotics in surgical intensive care unit patients with septic shock. Team notification and pharmacist response are associated with decreased time-to-antibiotics.
Collapse
Affiliation(s)
- Tyler Chanas
- University of Virginia Medical Center, Charlottesville, VA, USA
| | - David Volles
- University of Virginia Medical Center, Charlottesville, VA, USA
| | - Rob Sawyer
- University of Virginia Medical Center, Charlottesville, VA, USA
| | | |
Collapse
|
48
|
Kruse CS, Beane A. Health Information Technology Continues to Show Positive Effect on Medical Outcomes: Systematic Review. J Med Internet Res 2018; 20:e41. [PMID: 29402759 PMCID: PMC5818676 DOI: 10.2196/jmir.8793] [Citation(s) in RCA: 76] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2017] [Revised: 09/17/2017] [Accepted: 10/04/2017] [Indexed: 01/08/2023] Open
Abstract
Background Health information technology (HIT) has been introduced into the health care industry since the 1960s when mainframes assisted with financial transactions, but questions remained about HIT’s contribution to medical outcomes. Several systematic reviews since the 1990s have focused on this relationship. This review updates the literature. Objective The purpose of this review was to analyze the current literature for the impact of HIT on medical outcomes. We hypothesized that there is a positive association between the adoption of HIT and medical outcomes. Methods We queried the Cumulative Index of Nursing and Allied Health Literature (CINAHL) and Medical Literature Analysis and Retrieval System Online (MEDLINE) by PubMed databases for peer-reviewed publications in the last 5 years that defined an HIT intervention and an effect on medical outcomes in terms of efficiency or effectiveness. We structured the review from the Primary Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA), and we conducted the review in accordance with the Assessment for Multiple Systematic Reviews (AMSTAR). Results We narrowed our search from 3636 papers to 37 for final analysis. At least one improved medical outcome as a result of HIT adoption was identified in 81% (25/37) of research studies that met inclusion criteria, thus strongly supporting our hypothesis. No statistical difference in outcomes was identified as a result of HIT in 19% of included studies. Twelve categories of HIT and three categories of outcomes occurred 38 and 65 times, respectively. Conclusions A strong majority of the literature shows positive effects of HIT on the effectiveness of medical outcomes, which positively supports efforts that prepare for stage 3 of meaningful use. This aligns with previous reviews in other time frames.
Collapse
Affiliation(s)
- Clemens Scott Kruse
- School of Health Administration, Texas State University, San Marcos, TX, United States
| | - Amanda Beane
- School of Health Administration, Texas State University, San Marcos, TX, United States
| |
Collapse
|
49
|
Shimabukuro DW, Barton CW, Feldman MD, Mataraso SJ, Das R. Effect of a machine learning-based severe sepsis prediction algorithm on patient survival and hospital length of stay: a randomised clinical trial. BMJ Open Respir Res 2017; 4:e000234. [PMID: 29435343 PMCID: PMC5687546 DOI: 10.1136/bmjresp-2017-000234] [Citation(s) in RCA: 186] [Impact Index Per Article: 26.6] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2017] [Revised: 10/18/2017] [Indexed: 02/06/2023] Open
Abstract
Introduction Several methods have been developed to electronically monitor patients for severe sepsis, but few provide predictive capabilities to enable early intervention; furthermore, no severe sepsis prediction systems have been previously validated in a randomised study. We tested the use of a machine learning-based severe sepsis prediction system for reductions in average length of stay and in-hospital mortality rate. Methods We conducted a randomised controlled clinical trial at two medical-surgical intensive care units at the University of California, San Francisco Medical Center, evaluating the primary outcome of average length of stay, and secondary outcome of in-hospital mortality rate from December 2016 to February 2017. Adult patients (18+) admitted to participating units were eligible for this factorial, open-label study. Enrolled patients were assigned to a trial arm by a random allocation sequence. In the control group, only the current severe sepsis detector was used; in the experimental group, the machine learning algorithm (MLA) was also used. On receiving an alert, the care team evaluated the patient and initiated the severe sepsis bundle, if appropriate. Although participants were randomly assigned to a trial arm, group assignments were automatically revealed for any patients who received MLA alerts. Results Outcomes from 75 patients in the control and 67 patients in the experimental group were analysed. Average length of stay decreased from 13.0 days in the control to 10.3 days in the experimental group (p=0.042). In-hospital mortality decreased by 12.4 percentage points when using the MLA (p=0.018), a relative reduction of 58.0%. No adverse events were reported during this trial. Conclusion The MLA was associated with improved patient outcomes. This is the first randomised controlled trial of a sepsis surveillance system to demonstrate statistically significant differences in length of stay and in-hospital mortality. Trial registration NCT03015454.
Collapse
Affiliation(s)
- David W Shimabukuro
- Division of Critical Care Medicine, Department of Anesthesia and Perioperative Care, University of California San Francisco, San Francisco, California, USA
| | - Christopher W Barton
- Department of Emergency Medicine, University of California San Francisco, San Francisco, California, USA
| | - Mitchell D Feldman
- Division of General Internal Medicine, Department of Medicine, University of California San Francisco, San Francisco, California, USA
| | - Samson J Mataraso
- Department of Bioengineering, University of California Berkeley, Berkeley, California, USA.,Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, California, USA
| | | |
Collapse
|
50
|
Hiensch R, Poeran J, Saunders-Hao P, Adams V, Powell CA, Glasser A, Mazumdar M, Patel G. Impact of an electronic sepsis initiative on antibiotic use and health care facility-onset Clostridium difficile infection rates. Am J Infect Control 2017; 45:1091-1100. [PMID: 28602274 DOI: 10.1016/j.ajic.2017.04.005] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2016] [Revised: 04/05/2017] [Accepted: 04/05/2017] [Indexed: 12/31/2022]
Abstract
BACKGROUND Although integrated, electronic sepsis screening and treatment protocols are thought to improve patient outcomes, less is known about their unintended consequences. We aimed to determine if the introduction of a sepsis initiative coincided with increases in broad-spectrum antibiotic use and health care facility-onset (HCFO) Clostridium difficile infection (CDI) rates. METHODS We used interrupted time series data from a large, tertiary, urban academic medical center including all adult inpatients on 4 medicine wards (June 2011-July 2014). The main exposure was implementation of the sepsis screening program; the main outcomes were the use of broad-spectrum antibiotics (including 3 that were part of an order set designed for the sepsis initiative) and HCFO CDI rates. Segmented regression analyses compared outcomes in 3 time segments: before (11 months), during (14 months), and after (12 months) implementation of a sepsis initiative. RESULTS Antibiotic use and HFCO CDI rates increased during the period of implementation and the period after implementation compared with baseline; these increases were highest in the period after implementation (level change, 50.4 days of therapy per 1,000 patient days for overall antibiotic use and 10.8 HCFO CDIs per 10,000 patient days; P < .05). Remarkably, the main drivers of overall antibiotic use were not those included in the sepsis order set. CONCLUSIONS The implementation of an electronic sepsis screening and treatment protocol coincided with increased broad-spectrum antibiotic use and HCFO CDIs. Because these protocols are increasingly used, further study of their unintended consequences is warranted.
Collapse
|