Usage Patterns of Web-Based Stroke Calculators in Clinical Decision Support: Retrospective Analysis

Clinical risk calculators informing the decision to admit: A methodologic evaluation and assessment of applicability

INTRODUCTION

Clinical prediction and decision tools that generate outcome-based risk stratification and/or intervention recommendations are prevalent. Appropriate use and validity of these tools, especially those that inform complex clinical decisions, remains unclear. The objective of this study was to assess the methodologic quality and applicability of clinical risk scoring tools used to guide hospitalization decision-making.

METHODS

In February 2021, a comprehensive search was performed of a clinical calculator online database (mdcalc.com) that is publicly available and well-known to clinicians. The primary reference for any calculator tool informing outpatient versus inpatient disposition was considered for inclusion. Studies were restricted to the adult, acute care population. Those focused on obstetrics/gynecology or critical care admission were excluded. The Wasson-Laupacis framework of methodologic standards for clinical prediction rules was applied to each study.

RESULTS

A total of 22 calculators provided hospital admission recommendations for 9 discrete medical conditions using adverse events (14/22), mortality (6/22), or confirmatory diagnosis (2/22) as outcomes of interest. The most commonly met methodologic standards included mathematical technique description (22/22) and clinical sensibility (22/22) and least commonly met included reproducibility of the rule (1/22) and measurement of effect on clinical use (1/22). Description of the studied population was often lacking, especially patient race/ethnicity (2/22) and mental or behavioral health (0/22). Only one study reported any item related to social determinants of health.

CONCLUSION

Studies commonly do not meet rigorous methodologic standards and often fail to report pertinent details that would guide applicability. These clinical tools focus primarily on specific disease entities and clinical variables, missing the breadth of information necessary to make a disposition determination and raise significant validation and generalizability concerns.

Moving Towards Equity With Digital Health Innovations for Stroke Care

Digital health has long been championed as a means to expanding access to health care. Now that the COVID-19 pandemic accelerated many health systems' integration of digital tools for care, digital health may provide a path towards more accessible stroke prevention and treatment, particularly for historically disadvantaged patient populations. Stroke management is composed of multiple time points where digital health innovations have the potential to augment health access and treatment: from primary prevention, to the time-sensitive detection of ischemic stroke, administration of thrombolytic agents and consideration for endovascular interventions, to appropriate post-acute care, rehabilitation, and lifelong secondary stroke prevention-stroke care relies on a multidisciplinary and standardized approach. However, as we discuss pointedly in this Focused Update, underrepresented individuals face multilevel digital health disparities that potentially diminish the benefits of these digital advances. As such, these multilevel needs must be discussed and accounted for as health systems seek to integrate innovative and equitable digital health solutions towards stroke care.