1
|
Bampa M, Miliou I, Jovanovic B, Papapetrou P. M-ClustEHR: A multimodal clustering approach for electronic health records. Artif Intell Med 2024; 154:102905. [PMID: 38908256 DOI: 10.1016/j.artmed.2024.102905] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 05/29/2024] [Accepted: 06/03/2024] [Indexed: 06/24/2024]
Abstract
Sepsis refers to a potentially life-threatening situation where the immune system of the human body has an extreme response to an infection. In the presence of underlying comorbidities, the situation can become even worse and result in death. Employing unsupervised machine learning techniques, such as clustering, can assist in providing a better understanding of patient phenotypes by unveiling subgroups characterized by distinct sepsis progression and treatment patterns. More concretely, this study introduces M-ClustEHR, a clustering approach that utilizes medical data of multiple modalities by employing a multimodal autoencoder for learning comprehensive sepsis patient representations. M-ClustEHR consistently outperforms traditional clustering approaches in terms of several internal clustering performance metrics, as well as cluster stability in identifying phenotypes in the sepsis cohort. The unveiled patterns, supported by existing medical literature and clinicians, highlight the importance of multimodal clustering for advancing personalized sepsis care.
Collapse
Affiliation(s)
- Maria Bampa
- Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden.
| | - Ioanna Miliou
- Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden
| | | | - Panagiotis Papapetrou
- Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden
| |
Collapse
|
2
|
Riedinger CJ, Barrington DA, Nagel CI, Khadraoui WK, Haight PJ, Tubbs C, Backes FJ, Cohn DE, O'Malley DM, Copeland LJ, Chambers LM. RETRACTED: Cost-effectiveness of chemotherapy and dostarlimab for advanced or recurrent endometrial cancer. Gynecol Oncol 2024; 183:78-84. [PMID: 38554477 DOI: 10.1016/j.ygyno.2024.03.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Revised: 03/10/2024] [Accepted: 03/21/2024] [Indexed: 04/01/2024]
Abstract
This article has been retracted: please see Elsevier Policy on Article Withdrawal (https://www.elsevier.com/about/policies/article-withdrawal). This article has been retracted at the request of the Authors. The authors have independently identified an error in the formula that was utilized to calculate the Quality Adjusted Life Years which invalidates the data and the conclusion of the paper. The authors have contacted the journal requesting to retract the article. Apologies are offered to the readers of the journal for any confusion or inconvenience that may have resulted from the publication of this article.
Collapse
Affiliation(s)
- Courtney J Riedinger
- Department of Obstetrics and Gynecologic, Division of Gynecologic Oncology, The Ohio State University Comprehensive Cancer Center/James Cancer Hospital, USA.
| | - David A Barrington
- Gynecologic Oncology Section, Women's Services and The Ochsner Cancer Institute, Ochsner Health, New Orleans, LA, USA
| | - Christa I Nagel
- Department of Obstetrics and Gynecologic, Division of Gynecologic Oncology, The Ohio State University Comprehensive Cancer Center/James Cancer Hospital, USA
| | - Wafa K Khadraoui
- Department of Obstetrics and Gynecologic, Division of Gynecologic Oncology, The Ohio State University Comprehensive Cancer Center/James Cancer Hospital, USA
| | - Paulina J Haight
- Department of Obstetrics and Gynecologic, Division of Gynecologic Oncology, The Ohio State University Comprehensive Cancer Center/James Cancer Hospital, USA
| | - Crystal Tubbs
- Department of Pharmacy, The Ohio State University Wexner Medical Center, USA
| | - Floor J Backes
- Department of Obstetrics and Gynecologic, Division of Gynecologic Oncology, The Ohio State University Comprehensive Cancer Center/James Cancer Hospital, USA
| | - David E Cohn
- Department of Obstetrics and Gynecologic, Division of Gynecologic Oncology, The Ohio State University Comprehensive Cancer Center/James Cancer Hospital, USA
| | - David M O'Malley
- Department of Obstetrics and Gynecologic, Division of Gynecologic Oncology, The Ohio State University Comprehensive Cancer Center/James Cancer Hospital, USA
| | - Larry J Copeland
- Department of Obstetrics and Gynecologic, Division of Gynecologic Oncology, The Ohio State University Comprehensive Cancer Center/James Cancer Hospital, USA
| | - Laura M Chambers
- Department of Obstetrics and Gynecologic, Division of Gynecologic Oncology, The Ohio State University Comprehensive Cancer Center/James Cancer Hospital, USA
| |
Collapse
|
3
|
Loots FJ, van der Meulen MP, Smits M, Hopstaken RM, de Bont EG, van Bussel BC, Latten GH, Oosterheert JJ, van Zanten AR, Verheij TJ, Frederix GW. Potential impact of a new sepsis prediction model for the primary care setting: early health economic evaluation using an observational cohort. BMJ Open 2024; 14:e071598. [PMID: 38233050 PMCID: PMC10806707 DOI: 10.1136/bmjopen-2023-071598] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 12/21/2023] [Indexed: 01/19/2024] Open
Abstract
OBJECTIVES To estimate the potential referral rate and cost impact at different cut-off points of a recently developed sepsis prediction model for general practitioners (GPs). DESIGN Prospective observational study with decision tree modelling. SETTING Four out-of-hours GP services in the Netherlands. PARTICIPANTS 357 acutely ill adult patients assessed during home visits. PRIMARY AND SECONDARY OUTCOME MEASURES The primary outcome is the cost per patient from a healthcare perspective in four scenarios based on different cut-off points for referral of the sepsis prediction model. Second, the number of hospital referrals for the different scenarios is estimated. The potential impact of referral of patients with sepsis on mortality and hospital admission was estimated by an expert panel. Using these study data, a decision tree with a time horizon of 1 month was built to estimate the referral rate and cost impact in case the model would be implemented. RESULTS Referral rates at a low cut-off (score 2 or 3 on a scale from 0 to 6) of the prediction model were higher than observed for patients with sepsis (99% and 91%, respectively, compared with 88% observed). However, referral was also substantially higher for patients who did not need hospital assessment. As a consequence, cost-savings due to referral of patients with sepsis were offset by increased costs due to unnecessary referral for all cut-offs of the prediction model. CONCLUSIONS Guidance for referral of adult patients with suspected sepsis in the primary care setting using any cut-off point of the sepsis prediction model is not likely to save costs. The model should only be incorporated in sepsis guidelines for GPs if improvement of care can be demonstrated in an implementation study. TRIAL REGISTRATION NUMBER Dutch Trial Register (NTR 7026).
Collapse
Affiliation(s)
- Feike J Loots
- Julius Center for Health Sciences and Primary Care, UMC Utrecht, Utrecht, The Netherlands
| | | | - Marleen Smits
- Radboud Institute for Health Sciences, Scientific Center for Quality of Healthcare (IQ healthcare), Radboud University Medical Center, Nijmegen, The Netherlands
| | - Rogier M Hopstaken
- Star-shl diagnostic centres, Etten-Leur, The Netherlands
- General Practice Hapert and Hoogeloon, Hapert, the Netherlands
| | - Eefje Gpm de Bont
- Department of Family Medicine, Maastricht University, Care and Public Health Research Institute (CAPHRI, Maastricht, The Netherlands
| | - Bas Ct van Bussel
- Department of Intensive Care, Maastricht University Medical Centre+, Maastricht, The Netherlands
| | - Gideon Hp Latten
- Department of Family Medicine, Maastricht University, Care and Public Health Research Institute (CAPHRI, Maastricht, The Netherlands
- Emergency Department, Zuyderland Medical Centre Heerlen, Heerlen, The Netherlands
| | - Jan Jelrik Oosterheert
- Department of internal medicine and infectious diseases, UMC Utrecht, Utrecht, The Netherlands
| | - Arthur Rh van Zanten
- Department of Intensive Care, Gelderse Vallei Hospital, Ede, The Netherlands
- Division of Human Nutrition and Health, Wageningen University & Research, Wageningen, The Netherlands
| | - Theo Jm Verheij
- Julius Center for Health Sciences and Primary Care, UMC Utrecht, Utrecht, The Netherlands
| | - Geert Wj Frederix
- Julius Center for Health Sciences and Primary Care, UMC Utrecht, Utrecht, The Netherlands
| |
Collapse
|
4
|
Wan YKJ, Wright MC, McFarland MM, Dishman D, Nies MA, Rush A, Madaras-Kelly K, Jeppesen A, Del Fiol G. Information displays for automated surveillance algorithms of in-hospital patient deterioration: a scoping review. J Am Med Inform Assoc 2023; 31:256-273. [PMID: 37847664 PMCID: PMC10746326 DOI: 10.1093/jamia/ocad203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 09/12/2023] [Accepted: 10/02/2023] [Indexed: 10/19/2023] Open
Abstract
OBJECTIVE Surveillance algorithms that predict patient decompensation are increasingly integrated with clinical workflows to help identify patients at risk of in-hospital deterioration. This scoping review aimed to identify the design features of the information displays, the types of algorithm that drive the display, and the effect of these displays on process and patient outcomes. MATERIALS AND METHODS The scoping review followed Arksey and O'Malley's framework. Five databases were searched with dates between January 1, 2009 and January 26, 2022. Inclusion criteria were: participants-clinicians in inpatient settings; concepts-intervention as deterioration information displays that leveraged automated AI algorithms; comparison as usual care or alternative displays; outcomes as clinical, workflow process, and usability outcomes; and context as simulated or real-world in-hospital settings in any country. Screening, full-text review, and data extraction were reviewed independently by 2 researchers in each step. Display categories were identified inductively through consensus. RESULTS Of 14 575 articles, 64 were included in the review, describing 61 unique displays. Forty-one displays were designed for specific deteriorations (eg, sepsis), 24 provided simple alerts (ie, text-based prompts without relevant patient data), 48 leveraged well-accepted score-based algorithms, and 47 included nurses as the target users. Only 1 out of the 10 randomized controlled trials reported a significant effect on the primary outcome. CONCLUSIONS Despite significant advancements in surveillance algorithms, most information displays continue to leverage well-understood, well-accepted score-based algorithms. Users' trust, algorithmic transparency, and workflow integration are significant hurdles to adopting new algorithms into effective decision support tools.
Collapse
Affiliation(s)
- Yik-Ki Jacob Wan
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT 84108, United States
| | - Melanie C Wright
- College of Pharmacy, Idaho State University, Meridian, ID 83642, United States
| | - Mary M McFarland
- Eccles Health Sciences Library, University of Utah, Salt Lake City, UT 84112, United States
| | - Deniz Dishman
- Cizik School of Nursing Department of Research, University of Texas Health Science Center at Houston, Houston, TX 77030, United States
| | - Mary A Nies
- College of Health, Idaho State University, Pocatello, ID 83209, United States
| | - Adriana Rush
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT 84108, United States
| | - Karl Madaras-Kelly
- College of Pharmacy, Idaho State University, Meridian, ID 83642, United States
| | - Amanda Jeppesen
- College of Pharmacy, Idaho State University, Meridian, ID 83642, United States
| | - Guilherme Del Fiol
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT 84108, United States
| |
Collapse
|
5
|
Wang H, Wang M, Chen J, Hou H, Guo Z, Yang H, Tang H, Chen B. Interleukin-36 is overexpressed in human sepsis and IL-36 receptor deletion aggravates lung injury and mortality through epithelial cells and fibroblasts in experimental murine sepsis. Crit Care 2023; 27:490. [PMID: 38093296 PMCID: PMC10717293 DOI: 10.1186/s13054-023-04777-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Accepted: 12/11/2023] [Indexed: 12/17/2023] Open
Abstract
BACKGROUND Sepsis is defined as a life-threatening syndrome caused by an unbalanced host response to infection. The role of interleukin (IL)-36 cytokines binding to the IL-36 receptor (IL-36R) in host response during sepsis remains unknown. METHODS Serum IL-36 level was measured in 47 septic patients sampled on the day of intensive care unit (ICU) and emergency department admission, 21 non-septic ICU patient controls, and 21 healthy volunteers. In addition, the effects of IL-36R deletion on host inflammatory response in cecal ligation and puncture (CLP)-induced polymicrobial sepsis was determined. RESULTS On the day of ICU and emergency department admission, the patients with sepsis showed a significant increase in serum IL-36 levels compared with ICU patient controls and healthy volunteers, and the serum IL-36 levels were related to the severity of sepsis. Non-survivors of septic patients displayed significantly lower serum IL-36 levels compared with survivors. A high serum IL-36 level in ICU and emergency department admission was associated with 28-day mortality, and IL-36 was found to be an independent predictor of 28-day mortality in septic patients by logistic regression analysis. Furthermore, IL-36R deletion increased lethality in CLP-induced polymicrobial sepsis. Septic mice with IL-36R deletion had higher bacterial load and demonstrated more severe multiple organ injury (including lung, liver, and kidney) as indicated by clinical chemistry and histopathology. Mechanistically, IL-36R ligands released upon lung damage activated IL-36R+lung fibroblasts thereby inducing expression of the antimicrobial protein lipocalin 2. Moreover, they induced the apoptosis of lung epithelial cells. CONCLUSIONS Septic patients had elevated serum IL-36 levels, which may correlate with disease severity and mortality. In experimental sepsis, we demonstrated a previously unrecognized role of IL-36R deletion in increasing lethality.
Collapse
Affiliation(s)
- Huachen Wang
- Institute of Infectious Diseases, The Second Hospital of Tianjin Medical University, 23 Pingjiang Road, Tianjin, 300211, People's Republic of China
- Intensive Care Unit, The Second Hospital of Tianjin Medical University, Tianjin, China
| | - Meixiang Wang
- The First Affiliated Hospital of Shandong First Medical University, Jinan, China
| | - Junlan Chen
- State Key Laboratory of Oral and Maxillofacial Reconstruction and Regeneration, Key Laboratory of Oral Biomedicine Ministry of Education, Hubei Key Laboratory of Stomatology, School and Hospital of Stomatology, Wuhan University, Wuhan, Hubei, China
| | - Hongda Hou
- Institute of Infectious Diseases, The Second Hospital of Tianjin Medical University, 23 Pingjiang Road, Tianjin, 300211, People's Republic of China
- Intensive Care Unit, The Second Hospital of Tianjin Medical University, Tianjin, China
| | - Zheng Guo
- Division of Epidemiology, Department of Medicine, Vanderbilt University Medical Center, 2525 West End Ave, Nashville, TN, USA
| | - Hong Yang
- Intensive Care Unit, The Second Hospital of Tianjin Medical University, Tianjin, China
- The Province and Ministry Co-Sponsored Collaborative Innovation Center for Medical Epigenetics, Department of Pharmacology, School of Basic Medical Sciences, Tianjin Medical University, No. 22 Qixiangtai Road, Heping District, Tianjin, China
| | - Hua Tang
- Department of Rheumatology and Autoimmunology, Shandong Provincial Key Laboratory for Rheumatic Disease and Translational Medicine, The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital, Jinan, 250014, Shandong, China.
- Institute of Infection and Immunity, Medical Science and Technology Innovation Center, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, 250000, Shandong, China.
| | - Bing Chen
- Institute of Infectious Diseases, The Second Hospital of Tianjin Medical University, 23 Pingjiang Road, Tianjin, 300211, People's Republic of China.
- Intensive Care Unit, The Second Hospital of Tianjin Medical University, Tianjin, China.
| |
Collapse
|
6
|
Monti G, Rezoagli E, Calini A, Nova A, Marchesi S, Nattino G, Carrara G, Morra S, Cortellaro F, Savioli M, Capra Marzani F, Tresoldi M, Villa P, Greco S, Bonfanti P, Spitoni MG, Vesconi S, Caironi P, Fumagalli R. Effect of a quality improvement program on compliance to the sepsis bundle in non-ICU patients: a multicenter prospective before and after cohort study. Front Med (Lausanne) 2023; 10:1215341. [PMID: 38020128 PMCID: PMC10680451 DOI: 10.3389/fmed.2023.1215341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Accepted: 10/16/2023] [Indexed: 12/01/2023] Open
Abstract
Objective Sepsis and septic shock are major challenges and economic burdens to healthcare, impacting millions of people globally and representing significant causes of mortality. Recently, a large number of quality improvement programs focused on sepsis resuscitation bundles have been instituted worldwide. These educational initiatives have been shown to be associated with improvements in clinical outcomes. We aimed to evaluate the impact of a multi-faceted quality implementing program (QIP) on the compliance of a "simplified 1-h bundle" (Sepsis 6) and hospital mortality of severe sepsis and septic shock patients out of the intensive care unit (ICU). Methods Emergency departments (EDs) and medical wards (MWs) of 12 academic and non-academic hospitals in the Lombardy region (Northern Italy) were involved in a multi-faceted QIP, which included educational and organizational interventions. Patients with a clinical diagnosis of severe sepsis or septic shock according to the Sepsis-2 criteria were enrolled in two different periods: from May 2011 to November 2011 (before-QIP cohort) and from August 2012 to June 2013 (after-QIP cohort). Measurements and main results The effect of QIP on bundle compliance and hospital mortality was evaluated in a before-after analysis. We enrolled 467 patients in the before-QIP group and 656 in the after-QIP group. At the time of enrollment, septic shock was diagnosed in 50% of patients, similarly between the two periods. In the after-QIP group, we observed increased compliance to the "simplified rapid (1 h) intervention bundle" (the Sepsis 6 bundle - S6) at three time-points evaluated (1 h, 13.7 to 18.7%, p = 0.018, 3 h, 37.1 to 48.0%, p = 0.013, overall study period, 46.2 to 57.9%, p < 0.001). We then analyzed compliance with S6 and hospital mortality in the before- and after-QIP periods, stratifying the two patients' cohorts by admission characteristics. Adherence to the S6 bundle was increased in patients with severe sepsis in the absence of shock, in patients with serum lactate <4.0 mmol/L, and in patients with hypotension at the time of enrollment, regardless of the type of admission (from EDs or MWs). Subsequently, in an observational analysis, we also investigated the relation between bundle compliance and hospital mortality by logistic regression. In the after-QIP cohort, we observed a lower in-hospital mortality than that observed in the before-QIP cohort. This finding was reported in subgroups where a higher adherence to the S6 bundle in the after-QIP period was found. After adjustment for confounders, the QIP appeared to be independently associated with a significant improvement in hospital mortality. Among the single S6 procedures applied within the first hour of sepsis diagnosis, compliance with blood culture and antibiotic therapy appeared significantly associated with reduced in-hospital mortality. Conclusion A multi-faceted QIP aimed at promoting an early simplified bundle of care for the management of septic patients out of the ICU was associated with improved compliance with sepsis bundles and lower in-hospital mortality.
Collapse
Affiliation(s)
- Gianpaola Monti
- Department of Anesthesia and Intensive Care, ASST GOM Niguarda Ca’ Granda, Milan, Italy
| | - Emanuele Rezoagli
- School of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
- Department of Anesthesia and Intensive Care, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| | - Angelo Calini
- Department of Anesthesia and Intensive Care, ASST GOM Niguarda Ca’ Granda, Milan, Italy
| | - Alice Nova
- School of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
| | - Silvia Marchesi
- Intensiv och perioperativ vard, Skane Universitetssjukhus, Malmo, Sweden
| | - Giovanni Nattino
- Istituto di ricerche farmacologiche Mario Negri IRCCS, Ranica, Bergamo, Italy
| | - Greta Carrara
- Istituto di ricerche farmacologiche Mario Negri IRCCS, Ranica, Bergamo, Italy
| | - Sergio Morra
- Department of Anesthesia and Intensive Care, ASST Ovest Milano, Legnano, Italy
| | | | - Monica Savioli
- Department of Anesthesia, Intensive Care and Emergency, Fondazione IRCCSC Ca' Granda-Ospedale Maggiore Policlinico, Milan, Italy
| | - Federico Capra Marzani
- Department of Anesthesia and Intensive Care, Fondazione IRCCS Policlinico San Matteo, Pavia, Italy
| | - Moreno Tresoldi
- Unit of General Medicine and Advanced Care, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Paolo Villa
- Department of Emergency, ASST FBF - Sacco, Ospedale L. Sacco, Milan, Italy
| | - Stefano Greco
- Department of Anesthesia and Intensive Care, ASST Valle Olona, Ospedale Busto Arsitio, Busto Arsitio, Italy
| | - Paolo Bonfanti
- Infectious Diseases, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| | | | - Sergio Vesconi
- Department of Anesthesia and Intensive Care, ASST GOM Niguarda Ca’ Granda, Milan, Italy
| | - Pietro Caironi
- Department of Anesthesia and Intensive Care, AOU S. Luigi Gonzaga, Università degli Studi di Torino, Orbassano, Italy
| | - Roberto Fumagalli
- Department of Anesthesia and Intensive Care, ASST GOM Niguarda Ca’ Granda, Milan, Italy
- School of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
| |
Collapse
|
7
|
Lóser MK, Horowitz JK, England P, Esteitie R, Kaatz S, McLaughlin E, Munroe E, Heath M, Posa P, Flanders SA, Prescott HC. Institutional Structures and Processes to Support Sepsis Care: A Multihospital Study. Crit Care Explor 2023; 5:e1004. [PMID: 37954901 PMCID: PMC10637402 DOI: 10.1097/cce.0000000000001004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2023] Open
Abstract
OBJECTIVES To identify opportunities for improving hospital-based sepsis care and to inform an ongoing statewide quality improvement initiative in Michigan. DESIGN Surveys on hospital sepsis processes, including a self-assessment of practices using a 3-point Likert scale, were administered to 51 hospitals participating in the Michigan Hospital Medicine Safety Consortium, a Collaborative Quality Initiative sponsored by Blue Cross Blue Shield of Michigan, at two time points (2020, 2022). Forty-eight hospitals also submitted sepsis protocols for structured review. SETTING Multicenter quality improvement consortium. SUBJECTS Fifty-one hospitals in Michigan. INTERVENTIONS None. MEASUREMENTS AND MAIN RESULTS Of the included hospitals, 92.2% (n = 47/51) were nonprofit, 88.2% (n = 45/51) urban, 11.8% (n = 6/51) rural, and 80.4% (n = 41/51) teaching hospitals. One hundred percent (n = 51/51) responded to the survey, and 94.1% (n = 48/51) provided a sepsis policy/protocol. All surveyed hospitals used at least one quality improvement approach, including audit/feedback (98.0%, n = 50/51) and/or clinician education (68.6%, n = 35/51). Protocols included the Sepsis-1 (18.8%, n = 9/48) or Sepsis-2 (31.3%, n = 15/48) definitions; none (n = 0/48) used Sepsis-3. All hospitals (n = 51/51) used at least one process to facilitate rapid sepsis treatment, including order sets (96.1%, n = 49/51) and/or stocking of commonly used antibiotics in at least one clinical setting (92.2%, n = 47/51). Treatment protocols included guidance on antimicrobial therapy (68.8%, n = 33/48), fluid resuscitation (70.8%, n = 34/48), and vasopressor administration (62.5%, n = 30/48). On self-assessment, hospitals reported the lowest scores for peridischarge practices, including screening for cognitive impairment (2.0%, n = 1/51 responded "we are good at this") and providing anticipatory guidance (3.9%, n = 2/51). There were no meaningful associations of the Centers for Medicare and Medicaid Services' Severe Sepsis and Septic Shock: Management Bundle performance with differences in hospital characteristics or sepsis policy document characteristics. CONCLUSIONS Most hospitals used audit/feedback, order sets, and clinician education to facilitate sepsis care. Hospitals did not consistently incorporate organ dysfunction criteria into sepsis definitions. Existing processes focused on early recognition and treatment rather than recovery-based practices.
Collapse
Affiliation(s)
- Meghan K Lóser
- Department of Internal Medicine, University of Michigan, Ann Arbor, MI
| | | | - Peter England
- Department of Emergency Medicine, University of Michigan, Ann Arbor, MI
| | - Rania Esteitie
- Division of Pulmonary & Critical Care Medicine, Covenant Healthcare, Saginaw, MI
| | - Scott Kaatz
- Division of Hospital Medicine, Henry Ford Hospital, Detroit, MI
| | | | - Elizabeth Munroe
- Division of Pulmonary & Critical Care Medicine, University of Michigan, Ann Arbor, MI
| | - Megan Heath
- Department of Internal Medicine, University of Michigan, Ann Arbor, MI
| | - Pat Posa
- Quality and Patient Safety Program, University of Michigan, Ann Arbor, MI
| | - Scott A Flanders
- Department of Internal Medicine, University of Michigan, Ann Arbor, MI
| | - Hallie C Prescott
- Division of Pulmonary & Critical Care Medicine, University of Michigan, Ann Arbor, MI
- Veterans Affairs Center for Clinical Management Research, Ann Arbor, MI
| |
Collapse
|
8
|
Spees LP, Young LA, Rees J, Mottus K, Leeman J, Boynton MH, Richman E, Vu MB, Donahue KE. A Cost Analysis of Rethink the Strip: De-implementing a Low-value Practice in Primary Care. Med Care 2023; 61:708-714. [PMID: 37943526 PMCID: PMC10478673 DOI: 10.1097/mlr.0000000000001899] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2023]
Abstract
BACKGROUND Routine self-monitoring of blood glucose is a low-value practice that provides limited benefit for patients with non-insulin-treated type 2 diabetes mellitus. OBJECTIVES We estimated the costs of Rethink the Strip (RTS), a multistrategy approach to the de-implementation of self-monitoring of blood glucose in primary care. RESEARCH DESIGN RTS was conducted among 20 primary care clinics in North Carolina. We estimated the non-site-based and site-based costs of the 5 RTS strategies (practice facilitation, audit and feedback, provider champions, educational meetings, and educational materials) from the analytic perspective of an integrated health care system for 12 and 27-month time horizons. Material costs were tracked through project records, and personnel costs were assessed using activity-based costing. We used nationally based wage estimates. RESULTS Total RTS costs equaled $68,941 for 12 months. Specifically, non-site-based costs comprised $16,560. Most non-site-based costs ($11,822) were from the foundational programming and coding updates to the electronic health record data to develop the audit and feedback reports. The non-site-based costs of educational meetings, practice facilitation, and educational materials were substantially lower, ranging between ~$400 and $1000. Total 12-month site-based costs equaled $2569 for a single clinic (or $52,381 for 20 clinics). Educational meetings were the most expensive strategy, averaging $1401 per clinic. The site-based costs for the 4 other implementation strategies were markedly lower, ranging between $51 for educational materials and $555 for practice facilitation per clinic. CONCLUSIONS This study provides detailed cost information for implementation strategies used to support evidence-based programs in primary care clinics.
Collapse
Affiliation(s)
- Lisa P. Spees
- Department of Health Policy and Management, Gillings School of Global Public Health
- Lineberger Comprehensive Cancer Center
| | - Laura A. Young
- Department of Medicine, Division of Endocrinology and Metabolism
| | - Jennifer Rees
- North Carolina Translational and Clinical Sciences Institute
| | | | - Jennifer Leeman
- Lineberger Comprehensive Cancer Center
- North Carolina Translational and Clinical Sciences Institute
- School of Nursing
| | - Marcella H. Boynton
- North Carolina Translational and Clinical Sciences Institute
- Department of Medicine, Division of Endocrinology and Metabolism
| | | | - Maihan B. Vu
- Department of Health Behavior, Gillings School of Global Public Health
- Department of Family Medicine
| | - Katrina E. Donahue
- Cecil G. Sheps Center for Health Services Research
- Center for Health Promotion and Disease Prevention, University of North Carolina at Chapel Hill, Chapel Hill, NC
| |
Collapse
|
9
|
Li ECK, Tagoola A, Komugisha C, Nabweteme AM, Pillay Y, Ansermino JM, Khowaja AR. Cost-effectiveness analysis of Smart Triage, a data-driven pediatric sepsis triage platform in Eastern Uganda. BMC Health Serv Res 2023; 23:932. [PMID: 37653477 PMCID: PMC10468891 DOI: 10.1186/s12913-023-09977-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 08/28/2023] [Indexed: 09/02/2023] Open
Abstract
BACKGROUND Sepsis, characterized by organ dysfunction due to presumed or proven infection, has a case-fatality over 20% in severe cases in low-and-middle income countries. Early diagnosis and treatment have proven benefits, prompting our implementation of Smart Triage at Jinja Regional Referral Hospital in Uganda, a program that expedites treatment through a data-driven triage platform. We conducted a cost-effectiveness analysis of Smart Triage to explore its impact on patients and inform multicenter scale up. METHODS The parent clinical trial for Smart Triage was pre-post in design, using the proportion of children receiving sepsis treatment within one hour as the primary outcome, a measure linked to mortality benefit in existing literature. We used a decision-analytic model with Monte Carlo simulation to calculate the cost per year-of-life-lost (YLL) averted of Smart Triage from societal, government, and patient perspectives. Healthcare utilization and lost work for seven days post-discharge were translated into costs and productivity losses via secondary linkage data. RESULTS In 2021 United States dollars, Smart Triage requires an annuitized program cost of only $0.05 per child, but results in $15.32 saved per YLL averted. At a willingness-to-pay threshold of only $3 per YLL averted, well below published cost-effectiveness threshold estimates for Uganda, Smart Triage approaches 100% probability of cost-effectiveness over the baseline manual triage system. This cost-effectiveness was observed from societal, government, and patient perspectives. The cost-effectiveness observed was driven by a reduction in admission that, while explainable by an improved triage mechanism, may also be partially attributable to changes in healthcare utilization influenced by the coronavirus pandemic. However, Smart Triage remains cost-effective in sensitivity analyses introducing a penalty factor of up to 50% in the reduction in admission. CONCLUSION Smart Triage's ability to both save costs and avert YLLs indicates that patients benefit both economically and clinically, while its high probability of cost-effectiveness strongly supports multicenter scale up. Areas for further research include the incorporation of years lived with disability when sepsis disability weights in low-resource settings become available and analyzing budget impact during multicenter scale up. TRIAL REGISTRATION NCT04304235 (registered on 11/03/2020, clinicaltrials.gov).
Collapse
Affiliation(s)
- Edmond C K Li
- Department of Anesthesiology, Pharmacology & Therapeutics, University of British Columbia, Vancouver, BC, Canada.
- Department of Anesthesiology, Royal Columbian Hospital, Vancouver, BC, Canada.
| | | | - Clare Komugisha
- World Alliance for Lung and Intensive Care Medicine in Uganda, Kololo, Kampala, Uganda
| | | | - Yashodani Pillay
- Department of Anesthesiology, Pharmacology & Therapeutics, University of British Columbia, Vancouver, BC, Canada
- Center for International Child Health, British Columbia Children's Hospital, Vancouver, BC, Canada
| | - J Mark Ansermino
- Department of Anesthesiology, Pharmacology & Therapeutics, University of British Columbia, Vancouver, BC, Canada
- Center for International Child Health, British Columbia Children's Hospital, Vancouver, BC, Canada
| | - Asif R Khowaja
- Faculty of Applied Health Sciences, Brock University, St. Catharines, ON, Canada
| |
Collapse
|
10
|
Dantes RB, Kaur H, Bouwkamp BA, Haass KA, Patel P, Dudeck MA, Srinivasan A, Magill SS, Wilson WW, Whitaker M, Gladden NM, McLaughlin ES, Horowitz JK, Posa PJ, Prescott HC. Sepsis Program Activities in Acute Care Hospitals - National Healthcare Safety Network, United States, 2022. MMWR. MORBIDITY AND MORTALITY WEEKLY REPORT 2023; 72:907-911. [PMID: 37616184 PMCID: PMC10468219 DOI: 10.15585/mmwr.mm7234a2] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/26/2023]
Abstract
Sepsis, life-threatening organ dysfunction secondary to infection, contributes to at least 1.7 million adult hospitalizations and at least 350,000 deaths annually in the United States. Sepsis care is complex, requiring the coordination of multiple hospital departments and disciplines. Sepsis programs can coordinate these efforts to optimize patient outcomes. The 2022 National Healthcare Safety Network (NHSN) annual survey evaluated the prevalence and characteristics of sepsis programs in acute care hospitals. Among 5,221 hospitals, 3,787 (73%) reported having a committee that monitors and reviews sepsis care. Prevalence of these committees varied by hospital size, ranging from 53% among hospitals with 0-25 beds to 95% among hospitals with >500 beds. Fifty-five percent of all hospitals provided dedicated time (including assigned protected time or job description requirements) for leaders of these committees to manage a program and conduct daily activities, and 55% of committees reported involvement with antibiotic stewardship programs. These data highlight opportunities, particularly in smaller hospitals, to improve the care and outcomes of patients with sepsis in the United States by ensuring that all hospitals have sepsis programs with protected time for program leaders, engagement of medical specialists, and integration with antimicrobial stewardship programs. CDC's Hospital Sepsis Program Core Elements provides a guide to assist hospitals in developing and implementing effective sepsis programs that complement and facilitate the implementation of existing clinical guidelines and improve patient care. Future NHSN annual surveys will monitor uptake of these sepsis core elements.
Collapse
|
11
|
Lafon T, Baisse A, Karam HH, Organista A, Boury M, Otranto M, Blanchet A, Daix T, François B, Vignon P. SEPSIS UNIT IN THE EMERGENCY DEPARTMENT: IMPACT ON MANAGEMENT AND OUTCOME OF SEPTIC PATIENTS. Shock 2023; 60:157-162. [PMID: 37314202 DOI: 10.1097/shk.0000000000002155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
ABSTRACT Study hypothesis : Implementation of a new pathway dedicated to septic patients within the emergency department (ED) would improve early management, organ dysfunction, and outcome. Methods: During phase 1, all consecutive adult patients with infection and qualifying quick Sequential Organ Failure Assessment (qSOFA) score upon ED admission were managed according to standards of care. A multifaceted intervention was then performed (implementation phase): educational program, creation of a sepsis alert upon ED admission incorporated in the professional software, together with severity scores and Surviving Sepsis Campaign (SSC) bundle reminders, and dedication of two rooms to the management of septic patients (sepsis unit). During phase 2, patients were managed according to this new organization. Results: Of the 89,040 patients admitted to the ED over the two phases, 2,643 patients (3.2%) had sepsis including 277 with a qualifying qSOFA score on admission (phase 1, 141 patients; phase 2, 136 patients). Recommendations of SSC 3-h bundle significantly improved between the two periods regarding lactate measurement (87% vs. 96%, P = 0.006), initiation of fluid resuscitation (36% vs. 65%, P < 0.001), blood cultures sampling (83% vs. 93%, P = 0.014), and administration of antibiotics (18% vs. 46%, P < 0.001). The Sequential Organ Failure Assessment score between H0 and H12 varied significantly more during phase 2 (1.9 ± 1.9 vs. 0.8 ± 2.6, P < 0.001). Mortality significantly decreased during the second phase, on day 3 (28% vs. 15%, P = 0.008) and on day 28 (40% vs. 28%, P = 0.013). Conclusion: Systematic detection, education, and per protocol organization with a sepsis unit dedicated to the early management of septic patients appear to improve compliance with SSC bundles, organ dysfunction, and short-term mortality. These results warrant to be confirmed by prospective studies.
Collapse
Affiliation(s)
| | - Arthur Baisse
- Emergency Department, Limoges University Hospital Center, Limoges, France
| | - Henry Hani Karam
- Emergency Department, Limoges University Hospital Center, Limoges, France
| | | | - Marion Boury
- Emergency Department, Limoges University Hospital Center, Limoges, France
| | - Marcela Otranto
- Emergency Department, Limoges University Hospital Center, Limoges, France
| | - Aloïse Blanchet
- Emergency Department, Limoges University Hospital Center, Limoges, France
| | | | | | | |
Collapse
|
12
|
White NM, Carter HE, Kularatna S, Borg DN, Brain DC, Tariq A, Abell B, Blythe R, McPhail SM. Evaluating the costs and consequences of computerized clinical decision support systems in hospitals: a scoping review and recommendations for future practice. J Am Med Inform Assoc 2023; 30:1205-1218. [PMID: 36972263 PMCID: PMC10198542 DOI: 10.1093/jamia/ocad040] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Revised: 02/23/2023] [Accepted: 03/03/2023] [Indexed: 11/14/2023] Open
Abstract
OBJECTIVE Sustainable investment in computerized decision support systems (CDSS) requires robust evaluation of their economic impacts compared with current clinical workflows. We reviewed current approaches used to evaluate the costs and consequences of CDSS in hospital settings and presented recommendations to improve the generalizability of future evaluations. MATERIALS AND METHODS A scoping review of peer-reviewed research articles published since 2010. Searches were completed in the PubMed, Ovid Medline, Embase, and Scopus databases (last searched February 14, 2023). All studies reported the costs and consequences of a CDSS-based intervention compared with current hospital workflows. Findings were summarized using narrative synthesis. Individual studies were further appraised against the Consolidated Health Economic Evaluation and Reporting (CHEERS) 2022 checklist. RESULTS Twenty-nine studies published since 2010 were included. Studies evaluated CDSS for adverse event surveillance (5 studies), antimicrobial stewardship (4 studies), blood product management (8 studies), laboratory testing (7 studies), and medication safety (5 studies). All studies evaluated costs from a hospital perspective but varied based on the valuation of resources affected by CDSS implementation, and the measurement of consequences. We recommend future studies follow guidance from the CHEERS checklist; use study designs that adjust for confounders; consider both the costs of CDSS implementation and adherence; evaluate consequences that are directly or indirectly affected by CDSS-initiated behavior change; examine the impacts of uncertainty and differences in outcomes across patient subgroups. DISCUSSION AND CONCLUSION Improving consistency in the conduct and reporting of evaluations will enable detailed comparisons between promising initiatives, and their subsequent uptake by decision-makers.
Collapse
Affiliation(s)
- Nicole M White
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Hannah E Carter
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Sanjeewa Kularatna
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - David N Borg
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - David C Brain
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Amina Tariq
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Bridget Abell
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Robin Blythe
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Steven M McPhail
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
- Digital Health and Informatics Directorate, Metro South Health, Brisbane, Queensland, Australia
| |
Collapse
|
13
|
Donovan T, Abell B, Fernando M, McPhail SM, Carter HE. Implementation costs of hospital-based computerised decision support systems: a systematic review. Implement Sci 2023; 18:7. [PMID: 36829247 PMCID: PMC9960445 DOI: 10.1186/s13012-023-01261-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Accepted: 01/17/2023] [Indexed: 02/26/2023] Open
Abstract
BACKGROUND The importance of accurately costing implementation strategies is increasingly recognised within the field of implementation science. However, there is a lack of methodological guidance for costing implementation, particularly within digital health settings. This study reports on a systematic review of costing analyses conducted alongside implementation of hospital-based computerised decision support systems. METHODS PubMed, Embase, Scopus and CINAHL databases were searched between January 2010 and August 2021. Two reviewers independently screened and selected original research studies that were conducted in a hospital setting, examined the implementation of a computerised decision support systems and reported implementation costs. The Expert Recommendations for Implementing Change Framework was used to identify and categorise implementation strategies into clusters. A previously published costing framework was applied to describe the methods used to measure and value implementation costs. The reporting quality of included studies was assessed using the Consolidated Health Economic Evaluation Reporting Standards checklist. RESULTS Titles and abstracts of 1836 articles were screened, with nine articles eligible for inclusion in the review. Implementation costs were most frequently reported under the 'evaluative and iterative strategies' cluster, followed by 'provide interactive assistance'. Labour was the largest implementation-related cost in the included papers, irrespective of implementation strategy. Other reported costs included consumables, durable assets and physical space, which was mostly associated with stakeholder training. The methods used to cost implementation were often unclear. There was variation across studies in the overall quality of reporting. CONCLUSIONS A relatively small number of papers have described computerised decision support systems implementation costs, and the methods used to measure and value these costs were not well reported. Priorities for future research should include establishing consistent terminology and appropriate methods for estimating and reporting on implementation costs. TRIAL REGISTRATION The review protocol is registered with PROSPERO (ID: CRD42021272948).
Collapse
Affiliation(s)
- Thomasina Donovan
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD, Australia.
| | - Bridget Abell
- grid.1024.70000000089150953Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD Australia
| | - Manasha Fernando
- grid.1024.70000000089150953Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD Australia
| | - Steven M. McPhail
- grid.1024.70000000089150953Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD Australia ,grid.474142.0Digital Health and Informatics, Metro South Health, Brisbane, QLD Australia
| | - Hannah E. Carter
- grid.1024.70000000089150953Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD Australia
| |
Collapse
|
14
|
Rodos A, Aaronson E, Rothenberg C, Goyal P, Sharma D, Slesinger T, Schuur J, Venkatesh A. Improving Sepsis Management Through the Emergency Quality Network Sepsis Initiative. Jt Comm J Qual Patient Saf 2022; 48:572-580. [PMID: 36137885 DOI: 10.1016/j.jcjq.2022.08.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 07/29/2022] [Accepted: 08/01/2022] [Indexed: 12/30/2022]
Abstract
BACKGROUND Public reporting of the Centers for Medicare & Medicaid (CMS) SEP-1 sepsis quality measure is often too late and without the data granularity to inform real-time quality improvement (QI). In response, the American College of Emergency Physicians (ACEP) Emergency Quality Network (E-QUAL) Sepsis Initiative sought to support QI efforts through benchmarking of preliminary draft SEP-1 scores for emergency department (ED) patients. This study sought to determine the anticipatory value of these preliminary SEP-1 benchmarking scores and publicly reported performance. METHODS Cross-sectional analysis was performed on QI data collected from hospital-based ED sites participating in the E-QUAL Sepsis Collaborative in 2017 and 2018. Participating EDs submitted SEP-1 benchmarking scores semiannually, which were compared to publicly reported CMS SEP-1 data. EDs also reported implementation data on a variety of sepsis-related QI activities for comparison based on SEP-1 performance. RESULTS Among 220 EDs participating in E-QUAL, SEP-1 benchmarking scores showed weak but statistically significant correlation with CMS SEP-1 scores (r = 0.189, p = 0.01). Mean E-QUAL SEP-1 benchmarking scores were higher than mean CMS SEP-1 scores (74.1% vs. 57.2%), with 83.2% of sites reporting a benchmarking score higher than the CMS SEP-1 score. EDs with SEP-1 scores in the bottom 20% reported completion of more sepsis-related QI activities than EDs with average or top 20% SEP-1 scores. CONCLUSION Preliminary benchmarking results demonstrate a weak, statistically significant correlation with subsequent publicly reported CMS SEP-1 scores and suggest that ED performance in sepsis care may exceed overall hospital performance inclusive of all inpatients. Sepsis quality measurement and sepsis QI efforts may be best guided by separating ED sepsis cases from in-hospital sepsis cases as is done for other acute time-sensitive conditions.
Collapse
|
15
|
Michaud TL, Pereira E, Porter G, Golden C, Hill J, Kim J, Wang H, Schmidt C, Estabrooks PA. Scoping review of costs of implementation strategies in community, public health and healthcare settings. BMJ Open 2022; 12:e060785. [PMID: 35768106 PMCID: PMC9240875 DOI: 10.1136/bmjopen-2022-060785] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
OBJECTIVES To identify existing evidence concerning the cost of dissemination and implementation (D&I) strategies in community, public health and health service research, mapped with the 'Expert Recommendations for Implementing Change' (ERIC) taxonomy. DESIGN Scoping review. DATA SOURCES MEDLINE, EMBASE, CINAHL, PsycINFO, Scopus and the Cochrane Library were searched to identify any English language reports that had been published between January 2008 and December 2019 concerning the cost of D&I strategies. DATA EXTRACTION We matched the strategies identified in each article using ERIC taxonomies; further classified them into five areas (eg, dissemination, implementation, integration, capacity building and scale-up); and extracted the corresponding costs (total costs and cots per action target and per evidence-based programme (EBP) participant). We also recorded the reported level of costing methodology used for cost assessment of D&I strategies. RESULTS Of the 6445 articles identified, 52 studies were eligible for data extraction. Lack of D&I strategy cost data was the predominant reason (55% of the excluded studies) for study exclusion. Predominant topic, setting, country and research design in the included studies were mental health (19%), primary care settings (44%), the US (35%) and observational (42%). Thirty-five (67%) studies used multicomponent D&I strategies (ranging from two to five discrete strategies). The most frequently applied strategies were Conduct ongoing training (50%) and Conduct educational meetings (23%). Adoption (42%) and reach (27%) were the two most frequently assessed outcomes. The overall costs of Conduct ongoing training ranged from $199 to $105 772 ($1-$13 973 per action target and $0.02-$412 per EBP participant); whereas the cost of Conduct educational meetings ranged from $987 to $1.1-$2.9 million/year ($33-$54 869 per action target and $0.2-$146 per EBP participant). The wide range of costs was due to the varying scales of the studies, intended audiences/diseases and the complexities of the strategy components. Most studies presented limited information on costing methodology, making interpretation difficult. CONCLUSIONS The quantity of published D&I strategy cost analyses is increasing, yet guidance on conducting and reporting of D&I strategy cost analysis is necessary to facilitate and promote the application of comparative economic evaluation in the field of D&I research.
Collapse
Affiliation(s)
- Tzeyu L Michaud
- Department of Health Promotion, University of Nebraska Medical Center, Omaha, Nebraska, USA
- Center for Reducing Health Disparities, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Emiliane Pereira
- Department of Health Promotion, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Gwenndolyn Porter
- Department of Health Promotion, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Caitlin Golden
- Department of Health Promotion, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Jennie Hill
- Department of Population Health Sciences, University of Utah, Salt Lake City, Utah, USA
| | - Jungyoon Kim
- Department of Health Services Research and Administration, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Hongmei Wang
- Department of Health Services Research and Administration, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Cindy Schmidt
- McGoogan Health Sciences Library, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Paul A Estabrooks
- Department of Health and Kinesiology, University of Utah, Salt Lake City, Utah, USA
| |
Collapse
|
16
|
Mohr NM, Schuette AR, Ullrich F, Mack LJ, DeJong K, Camargo CA, Zachrison KS, Boggs KM, Skibbe A, Bell A, Pals M, Shane DM, Carter KD, Merchant KA, Ward MM. An economic and health outcome evaluation of telehealth in rural sepsis care: a comparative effectiveness study. J Comp Eff Res 2022; 11:703-716. [PMID: 35608080 DOI: 10.2217/cer-2022-0019] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Aim: Sepsis is a top contributor to in-hospital mortality and, healthcare expenditures and telehealth have been shown to improve short-term sepsis care in rural hospitals. This study will evaluate the effect of provider-to-provider video telehealth in rural emergency departments (EDs) on healthcare costs and long-term outcomes for sepsis patients. Materials & methods: We will use Medicare administrative claims to compare total healthcare expenditures, mortality, length-of-stay, readmissions, and category-specific costs between telehealth-subscribing and control hospitals. Results: The results of this work will demonstrate the extent to which telehealth use is associated with total healthcare expenditures for sepsis care. Conclusion: These findings will be important to inform future policy initiatives to improve sepsis care in rural EDs. Clinical Trial Registration: NCT05072145 (ClinicalTrials.gov).
Collapse
Affiliation(s)
- Nicholas M Mohr
- Department of Emergency Medicine, University of Iowa College of Medicine, Iowa City, IA 52242, USA.,Department of Anesthesia, Division of Critical Care, University of Iowa Carver College of Medicine, Iowa City, IA 52242, USA.,Department of Epidemiology, University of Iowa College of Public Health, Iowa City, IA 52242, USA
| | - Allison R Schuette
- Department of Emergency Medicine, University of Iowa College of Medicine, Iowa City, IA 52242, USA.,Department of Biostatistics, University of Iowa College of Public Health, Iowa City, IA 52242, USA
| | - Fred Ullrich
- Department of Health Management & Policy, University of Iowa College of Public Health, Iowa City, IA 52242, USA
| | - Luke J Mack
- Avera eCARE, Sioux Falls, SD 57104, USA.,Department of Family Medicine, University of South Dakota Sanford School of Medicine, Sioux Falls, SD 57104, USA
| | | | - Carlos A Camargo
- Department of Emergency Medicine, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Kori S Zachrison
- Department of Emergency Medicine, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Krislyn M Boggs
- Department of Emergency Medicine, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Adam Skibbe
- Department of Geographical & Sustainability Sciences, University of Iowa College of Liberal Arts & Sciences, Iowa City, IA 52242, USA
| | | | - Mark Pals
- Avera eCARE, Sioux Falls, SD 57104, USA
| | - Dan M Shane
- Department of Health Management & Policy, University of Iowa College of Public Health, Iowa City, IA 52242, USA
| | - Knute D Carter
- Department of Biostatistics, University of Iowa College of Public Health, Iowa City, IA 52242, USA
| | - Kimberly As Merchant
- Department of Health Management & Policy, University of Iowa College of Public Health, Iowa City, IA 52242, USA
| | - Marcia M Ward
- Department of Health Management & Policy, University of Iowa College of Public Health, Iowa City, IA 52242, USA
| |
Collapse
|
17
|
Brant EB, Kennedy JN, King AJ, Gerstley LD, Mishra P, Schlessinger D, Shalaby J, Escobar GJ, Angus DC, Seymour CW, Liu VX. Developing a shared sepsis data infrastructure: a systematic review and concept map to FHIR. NPJ Digit Med 2022; 5:44. [PMID: 35379946 PMCID: PMC8979949 DOI: 10.1038/s41746-022-00580-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 02/24/2022] [Indexed: 12/26/2022] Open
Abstract
The development of a shared data infrastructure across health systems could improve research, clinical care, and health policy across a spectrum of diseases, including sepsis. Awareness of the potential value of such infrastructure has been heightened by COVID-19, as the lack of a real-time, interoperable data network impaired disease identification, mitigation, and eradication. The Sepsis on FHIR collaboration establishes a dynamic, federated, and interoperable system of sepsis data from 55 hospitals using 2 distinct inpatient electronic health record systems. Here we report on phase 1, a systematic review to identify clinical variables required to define sepsis and its subtypes to produce a concept mapping of elements onto Fast Healthcare Interoperability Resources (FHIR). Relevant papers described consensus sepsis definitions, provided criteria for sepsis, severe sepsis, septic shock, or detailed sepsis subtypes. Studies not written in English, published prior to 1970, or “grey” literature were prospectively excluded. We analyzed 55 manuscripts yielding 151 unique clinical variables. We then mapped variables to their corresponding US Core FHIR resources and specific code values. This work establishes the framework to develop a flexible infrastructure for sharing sepsis data, highlighting how FHIR could enable the extension of this approach to other important conditions relevant to public health.
Collapse
|
18
|
Economic evaluations for intensive care unit randomised clinical trials in Australia and New Zealand: Practical recommendations for researchers. Aust Crit Care 2022; 36:431-437. [PMID: 35341668 DOI: 10.1016/j.aucc.2022.02.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2021] [Revised: 01/25/2022] [Accepted: 02/07/2022] [Indexed: 11/22/2022] Open
Abstract
OBJECTIVES Economic evaluations of intensive care unit (ICU) interventions have specific considerations, including how to cost ICU stays and accurately measure quality of life in survivors. The aim of this article was to develop best practice recommendations for economic evaluations alongside future ICU randomised controlled trials (RCTs). REVIEW METHODS We collated our experience based on expert consensus across several recent economic evaluations to provide best-practice, practical recommendations for researchers conducting economic evaluations alongside RCTs in the ICU. Recommendations were structured according to the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Consolidated Health Economic Evaluation Reporting Standards (CHEERS) Task Force Report. RESULTS We discuss recommendations across the components of economic evaluations, including: types of economic evaluation, the population and sample size, study perspective, comparators, time horizon, choice of health outcomes, measurement of effectiveness, measurement and valuation of quality of life, estimating resources and costs, analytical methods, and the increment cost-effectiveness ratio. We also provide future directions for research with regard to developing more robust economic evaluations for the ICU. CONCLUSION Economic evaluations should be built alongside ICU RCTs and should be designed a priori using appropriate follow-up and data collection to capture patient-relevant outcomes. Further work is needed to improve the quality of data available for linkage in Australia as well as developing costing methods for the ICU and appropriate quality of life measurements.
Collapse
|
19
|
Ackermann K, Baker J, Green M, Fullick M, Varinli H, Westbrook J, Li L. Computerized Clinical Decision Support Systems for the Early Detection of Sepsis Among Adult Inpatients: Scoping Review. J Med Internet Res 2022; 24:e31083. [PMID: 35195528 PMCID: PMC8908200 DOI: 10.2196/31083] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Revised: 09/23/2021] [Accepted: 10/29/2021] [Indexed: 12/21/2022] Open
Abstract
Background Sepsis is a significant cause of morbidity and mortality worldwide. Early detection of sepsis followed promptly by treatment initiation improves patient outcomes and saves lives. Hospitals are increasingly using computerized clinical decision support (CCDS) systems for the rapid identification of adult patients with sepsis. Objective This scoping review aims to systematically describe studies reporting on the use and evaluation of CCDS systems for the early detection of adult inpatients with sepsis. Methods The protocol for this scoping review was previously published. A total of 10 electronic databases (MEDLINE, Embase, CINAHL, the Cochrane database, LILACS [Latin American and Caribbean Health Sciences Literature], Scopus, Web of Science, OpenGrey, ClinicalTrials.gov, and PQDT [ProQuest Dissertations and Theses]) were comprehensively searched using terms for sepsis, CCDS, and detection to identify relevant studies. Title, abstract, and full-text screening were performed by 2 independent reviewers using predefined eligibility criteria. Data charting was performed by 1 reviewer with a second reviewer checking a random sample of studies. Any disagreements were discussed with input from a third reviewer. In this review, we present the results for adult inpatients, including studies that do not specify patient age. Results A search of the electronic databases retrieved 12,139 studies following duplicate removal. We identified 124 studies for inclusion after title, abstract, full-text screening, and hand searching were complete. Nearly all studies (121/124, 97.6%) were published after 2009. Half of the studies were journal articles (65/124, 52.4%), and the remainder were conference abstracts (54/124, 43.5%) and theses (5/124, 4%). Most studies used a single cohort (54/124, 43.5%) or before-after (42/124, 33.9%) approach. Across all 124 included studies, patient outcomes were the most frequently reported outcomes (107/124, 86.3%), followed by sepsis treatment and management (75/124, 60.5%), CCDS usability (14/124, 11.3%), and cost outcomes (9/124, 7.3%). For sepsis identification, the systemic inflammatory response syndrome criteria were the most commonly used, alone (50/124, 40.3%), combined with organ dysfunction (28/124, 22.6%), or combined with other criteria (23/124, 18.5%). Over half of the CCDS systems (68/124, 54.8%) were implemented alongside other sepsis-related interventions. Conclusions The current body of literature investigating the implementation of CCDS systems for the early detection of adult inpatients with sepsis is extremely diverse. There is substantial variability in study design, CCDS criteria and characteristics, and outcomes measured across the identified literature. Future research on CCDS system usability, cost, and impact on sepsis morbidity is needed. International Registered Report Identifier (IRRID) RR2-10.2196/24899
Collapse
Affiliation(s)
- Khalia Ackermann
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Australia
| | - Jannah Baker
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Australia
| | | | - Mary Fullick
- Clinical Excellence Commission, Sydney, Australia
| | | | - Johanna Westbrook
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Australia
| | - Ling Li
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Australia
| |
Collapse
|
20
|
D Somogyi R, C Sheridan D. Recent Advances in Bedside Device-Based Early Detection of Sepsis. J Intensive Care Med 2021; 37:849-856. [PMID: 34967252 DOI: 10.1177/08850666211044124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Early detection of sepsis is challenging to achieve with current diagnostic methods, leading to expenditures of $27 billion annually in the United States with significant associated mortality. Various scoring systems have been proposed such as the sequential organ failure assessment (SOFA) and systemic inflammatory response syndrome (SIRS) criteria for identification of sepsis, but their sensitivities range from 60% to 70% when used in the emergency department triage. Other methods for the recognition of sepsis may rely on laboratory work, in addition to vitals monitoring, and are often outpaced by the development of sepsis. Automated alerts have not shown any reduction in mortality thus far. New technology may fill a critical gap in the early detection of sepsis. The ideal bedside screening device for would demonstrate rapid time to result, high portability, and high sensitivity to not miss cases, but also reasonable specificity to prevent provider fatigue from excessive false alerts. Non-invasive end-organ perfusion devices analyzing lactate and capillary refill time (CRT) tend to perform well in speed and portability, but may be less sensitive. Biomarker devices demonstrate a wider array of performance metrics. Those analyzing a single biomarker tend to be more sensitive but are less specific to the diagnosis of sepsis than technologies that assess multiple biomarkers, which in turn have lower sensitivity. Additionally, biomarker devices are generally invasive requiring blood samples, which may or may not be feasible in all patients especially when serial draws are needed. Sepsis is a complex disease process and most likely will require a combination of improved technology in addition to vital signs and high-risk patient history for better recognition. This review examines recent advances in the device-based early detection of sepsis between 2017 and 2020 with emphasis on bedside diagnostics, divided into markers of perfusion and biomarkers commonly implicated in sepsis.
Collapse
Affiliation(s)
- Rita D Somogyi
- 6684Oregon Health & Science University, Portland, OR, USA
| | | |
Collapse
|
21
|
Li ECK, Grays S, Tagoola A, Komugisha C, Nabweteme AM, Ansermino JM, Mitton C, Kissoon N, Khowaja AR. Cost-effectiveness analysis protocol of the Smart Triage program: A point-of-care digital triage platform for pediatric sepsis in Eastern Uganda. PLoS One 2021; 16:e0260044. [PMID: 34788338 PMCID: PMC8598020 DOI: 10.1371/journal.pone.0260044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Accepted: 11/01/2021] [Indexed: 12/03/2022] Open
Abstract
Background Sepsis is a clinical syndrome characterized by organ dysfunction due to presumed or proven infection. Severe cases can have case fatality ratio 25% or higher in low-middle income countries, but early diagnosis and timely treatment have a proven benefit. The Smart Triage program in Jinja Regional Referral Hospital in Uganda will provide expedited sepsis treatment in children through a data-driven electronic patient triage system. To complement the ongoing Smart Triage interventional trial, we propose methods for a concurrent cost-effectiveness analysis of the Smart Triage platform. Methods We will use a decision-analytic model taking a societal perspective, combining government and out-of-pocket costs, as patients bear a sizeable portion of healthcare costs in Uganda due to the lack of universal health coverage. Previously published secondary data will be used to link healthcare utilization with costs and intermediate outcomes with mortality. We will model uncertainty via probabilistic sensitivity analysis and present findings at various willingness-to-pay thresholds using a cost-effectiveness acceptability curve. Discussion Our proposed analysis represents a first step in evaluating the cost-effectiveness of an innovative digital triage platform designed to improve clinical outcomes in pediatric sepsis through expediting care in low-resource settings. Our use of a decision analytic model to link secondary costing data, incorporate post-discharge healthcare utilization, and model clinical endpoints is also novel in the pediatric sepsis triage literature for low-middle income countries. Our analysis, together with subsequent analyses modelling budget impact and scale up, will inform future modifications to the Smart Triage platform, as well as motivate scale-up to the district and national levels. Trial registration Trial registration of parent clinical trial: NCT04304235, https://clinicaltrials.gov/ct2/show/NCT04304235. Registered 11 March 2020.
Collapse
Affiliation(s)
- Edmond C. K. Li
- School of Population and Public Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Sela Grays
- Department of Anesthesiology, Pharmacology & Therapeutics, University of British Columbia, Vancouver, British Columbia, Canada
- * E-mail:
| | | | | | | | - J. Mark Ansermino
- Department of Anesthesiology, Pharmacology & Therapeutics, University of British Columbia, Vancouver, British Columbia, Canada
| | - Craig Mitton
- School of Population and Public Health, University of British Columbia, Vancouver, British Columbia, Canada
- Centre for Clinical Epidemiology and Evaluation, Vancouver Coastal Health, Vancouver, Canada
| | - Niranjan Kissoon
- Department of Pediatrics, University of British Columbia, Vancouver, British Columbia, Canada
| | - Asif R. Khowaja
- Faculty of Applied Health Sciences, Brock University, St. Catharines, Canada
| |
Collapse
|
22
|
Fijačko N, Masterson Creber R, Gosak L, Kocbek P, Cilar L, Creber P, Štiglic G. A Review of Mortality Risk Prediction Models in Smartphone Applications. J Med Syst 2021; 45:107. [PMID: 34735603 PMCID: PMC8566656 DOI: 10.1007/s10916-021-01776-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 09/27/2021] [Indexed: 01/08/2023]
Abstract
Healthcare professionals in healthcare systems need access to freely available, real-time, evidence-based mortality risk prediction smartphone applications to facilitate resource allocation. The objective of this study is to evaluate the quality of smartphone mobile health applications that include mortality prediction models, and corresponding information quality.
We conducted a systematic review of commercially available smartphone applications in Google Play for Android, and iTunes for iOS smartphone applications. We performed initial screening, data extraction, and rated smartphone application quality using the Mobile Application Rating Scale: user version (uMARS). The information quality of smartphone applications was evaluated using two patient vignettes, representing low and high risk of mortality, based on critical care data from the Medical Information Mart for Intensive Care (MIMIC) III database.
Out of 3051 evaluated smartphone applications, 33 met our final inclusion criteria. We identified 21 discrete mortality risk prediction models in smartphone applications. The most common mortality predicting models were Sequential Organ Failure Assessment (SOFA) (n = 15) and Acute Physiology and Clinical Health Assessment II (n = 13). The smartphone applications with the highest quality uMARS scores were Observation—NEWS 2 (4.64) for iOS smartphones, and MDCalc Medical Calculator (4.75) for Android smartphones. All SOFA-based smartphone applications provided consistent information quality with the original SOFA model for both the low and high-risk patient vignettes.
We identified freely available, high-quality mortality risk prediction smartphone applications that can be used by healthcare professionals to make evidence-based decisions in critical care environments.
Collapse
Affiliation(s)
- Nino Fijačko
- Faculty of Health Sciences, University of Maribor, Zitna 15, Maribor, Slovenia.
| | - Ruth Masterson Creber
- Department of Population Health Sciences, Division of Health Informatics, Weill Cornell Medicine, New York, NY, USA
| | - Lucija Gosak
- Faculty of Health Sciences, University of Maribor, Maribor, Slovenia
| | - Primož Kocbek
- Faculty of Health Sciences, University of Maribor, Maribor, Slovenia
| | - Leona Cilar
- Faculty of Health Sciences, University of Maribor, Maribor, Slovenia
| | - Peter Creber
- Department of Respiratory Medicine, North Bristol NHS Trust, Bristol, UK
| | - Gregor Štiglic
- Faculty of Health Sciences and Faculty of Electrical Engineering and Computer Science, University of Maribor, Maribor, Slovenia
| |
Collapse
|
23
|
Wong A, Otles E, Donnelly JP, Krumm A, McCullough J, DeTroyer-Cooley O, Pestrue J, Phillips M, Konye J, Penoza C, Ghous M, Singh K. External Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized Patients. JAMA Intern Med 2021; 181:1065-1070. [PMID: 34152373 PMCID: PMC8218233 DOI: 10.1001/jamainternmed.2021.2626] [Citation(s) in RCA: 260] [Impact Index Per Article: 86.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
IMPORTANCE The Epic Sepsis Model (ESM), a proprietary sepsis prediction model, is implemented at hundreds of US hospitals. The ESM's ability to identify patients with sepsis has not been adequately evaluated despite widespread use. OBJECTIVE To externally validate the ESM in the prediction of sepsis and evaluate its potential clinical value compared with usual care. DESIGN, SETTING, AND PARTICIPANTS This retrospective cohort study was conducted among 27 697 patients aged 18 years or older admitted to Michigan Medicine, the academic health system of the University of Michigan, Ann Arbor, with 38 455 hospitalizations between December 6, 2018, and October 20, 2019. EXPOSURE The ESM score, calculated every 15 minutes. MAIN OUTCOMES AND MEASURES Sepsis, as defined by a composite of (1) the Centers for Disease Control and Prevention surveillance criteria and (2) International Statistical Classification of Diseases and Related Health Problems, Tenth Revision diagnostic codes accompanied by 2 systemic inflammatory response syndrome criteria and 1 organ dysfunction criterion within 6 hours of one another. Model discrimination was assessed using the area under the receiver operating characteristic curve at the hospitalization level and with prediction horizons of 4, 8, 12, and 24 hours. Model calibration was evaluated with calibration plots. The potential clinical benefit associated with the ESM was assessed by evaluating the added benefit of the ESM score compared with contemporary clinical practice (based on timely administration of antibiotics). Alert fatigue was evaluated by comparing the clinical value of different alerting strategies. RESULTS We identified 27 697 patients who had 38 455 hospitalizations (21 904 women [57%]; median age, 56 years [interquartile range, 35-69 years]) meeting inclusion criteria, of whom sepsis occurred in 2552 (7%). The ESM had a hospitalization-level area under the receiver operating characteristic curve of 0.63 (95% CI, 0.62-0.64). The ESM identified 183 of 2552 patients with sepsis (7%) who did not receive timely administration of antibiotics, highlighting the low sensitivity of the ESM in comparison with contemporary clinical practice. The ESM also did not identify 1709 patients with sepsis (67%) despite generating alerts for an ESM score of 6 or higher for 6971 of all 38 455 hospitalized patients (18%), thus creating a large burden of alert fatigue. CONCLUSIONS AND RELEVANCE This external validation cohort study suggests that the ESM has poor discrimination and calibration in predicting the onset of sepsis. The widespread adoption of the ESM despite its poor performance raises fundamental concerns about sepsis management on a national level.
Collapse
Affiliation(s)
- Andrew Wong
- Department of Internal Medicine, University of Michigan Medical School, Ann Arbor
| | - Erkin Otles
- Medical Scientist Training Program, University of Michigan Medical School, Ann Arbor.,Department of Industrial and Operations Engineering, University of Michigan College of Engineering, Ann Arbor
| | - John P Donnelly
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| | - Andrew Krumm
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| | | | | | | | - Marie Phillips
- Health Information Technology and Services, Michigan Medicine, Ann Arbor
| | - Judy Konye
- Nursing Informatics, Michigan Medicine, Ann Arbor
| | | | - Muhammad Ghous
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| | - Karandeep Singh
- Department of Internal Medicine, University of Michigan Medical School, Ann Arbor.,Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| |
Collapse
|
24
|
Barbash IJ, Davis BS, Yabes JG, Seymour CW, Angus DC, Kahn JM. Treatment Patterns and Clinical Outcomes After the Introduction of the Medicare Sepsis Performance Measure (SEP-1). Ann Intern Med 2021; 174:927-935. [PMID: 33872042 PMCID: PMC8844885 DOI: 10.7326/m20-5043] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND Medicare requires that hospitals report on their adherence to the Severe Sepsis and Septic Shock Early Management Bundle (SEP-1). OBJECTIVE To evaluate the effect of SEP-1 on treatment patterns and patient outcomes. DESIGN Longitudinal study of hospitals using repeated cross-sectional cohorts of patients. SETTING 11 hospitals within an integrated health system. PATIENTS 54 225 encounters between January 2013 and December 2017 for adults with sepsis who were hospitalized through the emergency department. INTERVENTION Onset of the SEP-1 reporting requirement in October 2015. MEASUREMENTS Changes in SEP-1-targeted processes, including antibiotic administration, lactate measurement, and fluid administration at 3 hours from sepsis onset; repeated lactate and vasopressor administration for hypotension within 6 hours of sepsis onset; and sepsis outcomes, including risk-adjusted intensive care unit (ICU) admission, in-hospital mortality, and home discharge among survivors. RESULTS Two years after its implementation, SEP-1 was associated with variable changes in process measures, with the greatest effect being an increase in lactate measurement within 3 hours of sepsis onset (absolute increase, 23.7 percentage points [95% CI, 20.7 to 26.7 percentage points]; P < 0.001). There were small increases in antibiotic administration (absolute increase, 4.7 percentage points [CI, 1.9 to 7.6 percentage points]; P = 0.001) and fluid administration of 30 mL/kg of body weight within 3 hours of sepsis onset (absolute increase, 3.4 percentage points [CI, 1.5 to 5.2 percentage points]; P < 0.001). There was no change in vasopressor administration. There was a small increase in ICU admissions (absolute increase, 2.0 percentage points [CI, 0 to 4.0 percentage points]; P = 0.055) and no changes in mortality (absolute change, 0.1 percentage points [CI, -0.9 to 1.1 percentage points]; P = 0.87) or discharge to home. LIMITATION Data are from a single health system. CONCLUSION Implementation of the SEP-1 mandatory reporting program was associated with variable changes in process measures, without improvements in clinical outcomes. Revising the measure may optimize its future effect. PRIMARY FUNDING SOURCE Agency for Healthcare Research and Quality.
Collapse
Affiliation(s)
- Ian J Barbash
- University of Pittsburgh School of Medicine and UPMC Health System, Pittsburgh, Pennsylvania (I.J.B., C.W.S.)
| | - Billie S Davis
- University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania (B.S.D., J.G.Y.)
| | - Jonathan G Yabes
- University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania (B.S.D., J.G.Y.)
| | - Chris W Seymour
- University of Pittsburgh School of Medicine and UPMC Health System, Pittsburgh, Pennsylvania (I.J.B., C.W.S.)
| | - Derek C Angus
- University of Pittsburgh School of Medicine, University of Pittsburgh Graduate School of Public Health, and UPMC Health System, Pittsburgh, Pennsylvania (D.C.A., J.M.K.)
| | - Jeremy M Kahn
- University of Pittsburgh School of Medicine, University of Pittsburgh Graduate School of Public Health, and UPMC Health System, Pittsburgh, Pennsylvania (D.C.A., J.M.K.)
| |
Collapse
|
25
|
Abstract
OBJECTIVES Initial evidence suggests that state-level regulatory mandates for sepsis quality improvement are associated with decreased sepsis mortality. However, sepsis mandates require financial investments on the part of hospitals and may lead to increased spending. We evaluated the effects of the 2013 New York State sepsis regulations on the costs of care for patients hospitalized with sepsis. DESIGN Retrospective cohort study using state discharge data from the U.S. Healthcare Costs and Utilization Project and a comparative interrupted time series analytic approach. Costs were calculated from admission-level charge data using hospital-specific cost-to-charge ratios. SETTING General, short stay, acute care hospitals in New York, and four control states: Florida, Massachusetts, Maryland, and New Jersey. PATIENTS All patients hospitalized with sepsis between January 1, 2011, and September 30, 2015. INTERVENTIONS The 2013 New York mandate that all hospitals develop and implement protocols for sepsis identification and treatment, educate staff, and report performance data to the state. MEASUREMENTS AND MAIN RESULTS The analysis included 1,026,664 admissions in 520 hospitals. Mean unadjusted costs per hospitalization in New York State were $42,036 ± $60,940 in the pre-regulation period and $39,719 ± $59,063 in the post-regulation period, compared with $34,642 ± $52,403 pre-regulation and $31,414 ± $48,155 post-regulation in control states. In the comparative interrupted time series analysis, the regulations were not associated with a significant difference in risk-adjusted mean cost per hospitalization (p = 0.12) or risk-adjusted mean cost per hospital day (p = 0.44). For example, in the 10th quarter after implementation of the regulations, risk-adjusted mean cost per hospitalization was $3,627 (95% CI, -$681 to $7,934) more than expected in New York State relative to control states. CONCLUSIONS Mandated protocolized sepsis care was not associated with significant changes in hospital costs in patients hospitalized with sepsis in New York State.
Collapse
|
26
|
Siddiqui M, Abuelroos D, Qu L, Jackson RE, Berger DA. Emergency Department Urosepsis and Abdominal Imaging. Cureus 2021; 13:e14752. [PMID: 34084678 PMCID: PMC8164387 DOI: 10.7759/cureus.14752] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
Introduction Insufficient attention has been directed towards urosepsis. Notably, no protocols or clinical decision rules currently exist outlining the appropriate use of imaging in uroseptic patients. The primary objective of our study was to retrospectively evaluate uroseptic emergency department (ED) patients who underwent abdominal imaging, to report the proportion of patients with imaging findings necessitating emergent surgical consultation. Methods We retrospectively identified 1142 patients ≥ 18 years of age that presented to the ED from January 2009 to December 2012 with ICD9 code indicative of urosepsis. All included patients underwent ED-ordered abdominal computerized tomography (CT) or retroperitoneal ultrasound (US). Imaging and urinalysis (UA) results were categorized. We report proportions with odds ratios and 95% confidence intervals. Results Of 1142 patients, we excluded 80 for neg UA, 167 for < 2 SIRS (systemic inflammatory response syndrome), 320 for positive blood cultures, and 37 for incomplete data. This yielded 538 patients which the authors reviewed the results of the CT or US to determine the proportion who required emergent surgical consultation and who underwent surgical or interventional procedure. There were 243 (45%) that had CT or US results that necessitated emergency surgical consultation, of those 180 (33%) underwent surgical or interventional procedure. Similar rates of emergency surgical consultation occurred when sub-divided by positive versus equivocal UA, with 43% and 47%, respectively. Conclusions Forty-five percent of our abdominally imaged urosepsis cohort had imaging findings that necessitated emergent surgical consultation, with a similar proportion in the subset with positive versus equivocal UA. The utility of abdominal imaging in this population should be studied prospectively.
Collapse
Affiliation(s)
| | | | - Lihua Qu
- Research, Beaumont Health, Royal Oak, MI, USA
| | | | | |
Collapse
|
27
|
Wang P, Mu X, Zhao H, Li Y, Wang L, Wolfe V, Cui SN, Wang X, Peng T, Zingarelli B, Wang C, Fan GC. Administration of GDF3 Into Septic Mice Improves Survival via Enhancing LXRα-Mediated Macrophage Phagocytosis. Front Immunol 2021; 12:647070. [PMID: 33679812 PMCID: PMC7925632 DOI: 10.3389/fimmu.2021.647070] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2020] [Accepted: 01/26/2021] [Indexed: 12/26/2022] Open
Abstract
The defective eradication of invading pathogens is a major cause of death in sepsis. As professional phagocytic cells, macrophages actively engulf/kill microorganisms and play essential roles in innate immune response against pathogens. Growth differentiation factor 3 (GDF3) was previously implicated as an important modulator of inflammatory response upon acute sterile injury. In this study, administration of recombinant GDF3 protein (rGDF3) either before or after CLP surgery remarkably improved mouse survival, along with significant reductions in bacterial load, plasma pro-inflammatory cytokine levels, and organ damage. Notably, our in vitro experiments revealed that rGDF3 treatment substantially promoted macrophage phagocytosis and intracellular killing of bacteria in a dose-dependent manner. Mechanistically, RNA-seq analysis results showed that CD5L, known to be regulated by liver X receptor α (LXRα), was the most significantly upregulated gene in rGDF3-treated macrophages. Furthermore, we observed that rGDF3 could promote LXRα nuclear translocation and thereby, augmented phagocytosis activity in macrophages, which was similar as LXRα agonist GW3965 did. By contrast, pre-treating macrophages with LXRα antagonist GSK2033 abolished beneficial effects of rGDF3 in macrophages. In addition, rGDF3 treatment failed to enhance bacteria uptake and killing in LXRα-knockout (KO) macrophages. Taken together, these results uncover that GDF3 may represent a novel mediator for controlling bacterial infection.
Collapse
Affiliation(s)
- Peng Wang
- Department of Critical Care Medicine, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China.,Department of Pharmacology and Systems Physiology, University of Cincinnati College of Medicine, Cincinnati, OH, United States
| | - Xingjiang Mu
- Department of Pharmacology and Systems Physiology, University of Cincinnati College of Medicine, Cincinnati, OH, United States
| | - Hongyan Zhao
- Department of Pharmacology and Systems Physiology, University of Cincinnati College of Medicine, Cincinnati, OH, United States.,Department of Critical Care Medicine, The Second Hospital, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Yutian Li
- Department of Pharmacology and Systems Physiology, University of Cincinnati College of Medicine, Cincinnati, OH, United States
| | - Lu Wang
- Department of Pharmacology and Systems Physiology, University of Cincinnati College of Medicine, Cincinnati, OH, United States.,Department of Critical Care Medicine, Renmin Hospital of Wuhan University, Wuhan, China
| | - Vivian Wolfe
- Division of Critical Care Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.,Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, United States
| | - Shu-Nan Cui
- Department of Pharmacology and Systems Physiology, University of Cincinnati College of Medicine, Cincinnati, OH, United States.,Department of Anesthesiology, Beijing Cancer Hospital, Peking University School of Oncology, Beijing, China
| | - Xiaohong Wang
- Department of Pharmacology and Systems Physiology, University of Cincinnati College of Medicine, Cincinnati, OH, United States
| | - Tianqing Peng
- The Centre for Critical Illness Research, Lawson Health Research Institute, London, ON, Canada
| | - Basilia Zingarelli
- Division of Critical Care Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.,Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, United States
| | - Chunting Wang
- Department of Critical Care Medicine, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China
| | - Guo-Chang Fan
- Department of Pharmacology and Systems Physiology, University of Cincinnati College of Medicine, Cincinnati, OH, United States
| |
Collapse
|
28
|
Fenner BP, Darden DB, Kelly LS, Rincon J, Brakenridge SC, Larson SD, Moore FA, Efron PA, Moldawer LL. Immunological Endotyping of Chronic Critical Illness After Severe Sepsis. Front Med (Lausanne) 2021; 7:616694. [PMID: 33659259 PMCID: PMC7917137 DOI: 10.3389/fmed.2020.616694] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 12/14/2020] [Indexed: 12/15/2022] Open
Abstract
Improved management of severe sepsis has been one of the major health care accomplishments of the last two decades. Due to enhanced recognition and improved management of severe sepsis, in-hospital mortality has been reduced by up to 40%. With that good news, a new syndrome has unfortunately replaced in-hospital multi-organ failure and death. This syndrome of chronic critical illness (CCI) includes sepsis patients who survive the early "cytokine or genomic storm," but fail to fully recover, and progress into a persistent state of manageable organ injury requiring prolonged intensive care. These patients are commonly discharged to long-term care facilities where sepsis recidivism is high. As many as 33% of sepsis survivors develop CCI. CCI is the result, at least in part, of a maladaptive host response to chronic pattern-recognition receptor (PRR)-mediated processes. This maladaptive response results in dysregulated myelopoiesis, chronic inflammation, T-cell atrophy, T-cell exhaustion, and the expansion of suppressor cell functions. We have defined this panoply of host responses as a persistent inflammatory, immune suppressive and protein catabolic syndrome (PICS). Why is this important? We propose that PICS in survivors of critical illness is its own common, unique immunological endotype driven by the constant release of organ injury-associated, endogenous alarmins, and microbial products from secondary infections. While this syndrome can develop as a result of a diverse set of pathologies, it represents a shared outcome with a unique underlying pathobiological mechanism. Despite being a common outcome, there are no therapeutic interventions other than supportive therapies for this common disorder. Only through an improved understanding of the immunological endotype of PICS can rational therapeutic interventions be designed.
Collapse
Affiliation(s)
- Brittany P Fenner
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - D B Darden
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Lauren S Kelly
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Jaimar Rincon
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Scott C Brakenridge
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Shawn D Larson
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Frederick A Moore
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Philip A Efron
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Lyle L Moldawer
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| |
Collapse
|
29
|
Utilization of a multidisciplinary emergency department sepsis huddle to reduce time to antibiotics and improve SEP-1 compliance. Am J Emerg Med 2020; 38:2400-2404. [PMID: 33041123 DOI: 10.1016/j.ajem.2020.09.014] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2020] [Revised: 09/03/2020] [Accepted: 09/06/2020] [Indexed: 11/20/2022] Open
Abstract
Sepsis is a significant public health crisis in the United States, contributing to 50% of inpatient hospital deaths. Given its dramatic health effects and implications in the setting of new CMS care guidelines, ED leaders have renewed focus on appropriate and timely sepsis care, including timely administration of antibiotics in patients at risk for sepsis. Modeling the success of multidisciplinary bedside huddles in improving compliance with appropriate care in other healthcare settings, a Sepsis Huddle was implemented in a large, academic ED, with the goal of driving compliance with standardized sepsis care as described in the CMS SEP-1 measure. A retrospective cohort analysis was performed, with the primary finding that utilization of the Sepsis Huddle resulted in antibiotics being administered on average 41 min sooner than when the Sepsis Huddle was not performed. Given that literature suggests that early administration of appropriate antibiotic therapy is a major driver of mortality reduction in patients with sepsis, this study represents a proof of concept that utilization of a Sepsis Huddle may serve to improve outcomes among ED patients at risk for sepsis.
Collapse
|
30
|
Potential Confounders for Applying a Novel Sepsis Care Quality Improvement Program. Crit Care Med 2020; 48:e161-e162. [PMID: 31939826 DOI: 10.1097/ccm.0000000000004069] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
|
31
|
The authors reply. Crit Care Med 2020; 48:e162-e163. [PMID: 31939827 DOI: 10.1097/ccm.0000000000004106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
32
|
More Than We Bargained For: The "Dominating" Cost Effectiveness of Sepsis Quality Improvement? Crit Care Med 2020; 47:1464-1467. [PMID: 31524700 DOI: 10.1097/ccm.0000000000003944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
33
|
Uffen JW, Oosterheert JJ, Schweitzer VA, Thursky K, Kaasjager HAH, Ekkelenkamp MB. Interventions for rapid recognition and treatment of sepsis in the emergency department: a narrative review. Clin Microbiol Infect 2020; 27:192-203. [PMID: 32120030 DOI: 10.1016/j.cmi.2020.02.022] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2019] [Revised: 01/17/2020] [Accepted: 02/17/2020] [Indexed: 12/11/2022]
Abstract
BACKGROUND Sepsis is a major cause of morbidity and mortality worldwide. Early recognition and treatment of sepsis is associated with improved outcome. The emergency department (ED) is the department where patients with sepsis seek care. However, recognition of sepsis in the ED remains difficult. Different alert and triage systems, screening scores and intervention strategies have been developed to assist clinicians in early recognition of sepsis and to optimize management. OBJECTIVES This narrative review describes currently applied interventions or interventions we can start using today, such as screening scores, (automated) triage systems, sepsis teams and clinical pathways in sepsis care; and it summarizes evidence for the effect of implementation of these interventions in the ED on patient management and outcomes. SOURCES A systematic literature search was conducted in PubMed, resulting in 39 eligible studies. CONTENT The main sepsis interventions in the ED are (automated) triage systems, sepsis teams and clinical pathways, the most integrative being a clinical pathway. Implementation of any of these interventions in sepsis care will generally lead to increased protocol adherence. Presumably increased adherence to sepsis guidelines and bundles will lead to better patient outcomes, but the level of evidence to support this improvement is low, whereas implementation of interventions is often complex and costly. No studies comparing different interventions were identified. Two essential factors for success of interventions in the ED are obtaining the support from all professionals and providing ongoing education. The vulnerability of these interventions lies in the lack of accurate tools to identify sepsis; diagnosing sepsis ultimately still relies on clinical assessments. A lack of specificity or sepsis alerts may lead to alert fatigue and/or overtreatment. IMPLICATIONS The severity and poor outcome of sepsis as well as the frequency of its presentation in EDs make a structured, protocol-based approach towards these patients essential, preferably as part of a clinical pathway.
Collapse
Affiliation(s)
- J W Uffen
- Division of Acute Medicine, Department of Internal Medicine, University Medical Center Utrecht, the Netherlands.
| | - J J Oosterheert
- Division of Infectious Diseases, Department of Internal Medicine, University Medical Center Utrecht, the Netherlands
| | - V A Schweitzer
- Department of Microbiology, University Medical Center Utrecht, the Netherlands
| | - K Thursky
- Department of Infectious Disease, Royal Melbourne Hospital, Melbourne, Australia
| | - H A H Kaasjager
- Division of Acute Medicine, Department of Internal Medicine, University Medical Center Utrecht, the Netherlands
| | - M B Ekkelenkamp
- Department of Microbiology, University Medical Center Utrecht, the Netherlands
| |
Collapse
|
34
|
|