Design and implementation of electronic health record-based tools to support a weight management program in primary care

Objectives

This paper reports on a mixed methods formative evaluation to support the design and implementation of information technology (IT) tools for a primary care weight management intervention delivered through the patient portal using primary care staff as coaches.

Methods

We performed a qualitative needs assessment, designed the IT tools to support the weight management program, and developed implementation tracking metrics. Implementation tracking metrics were designed to use real world electronic health record (EHR) data.

Results

The needs assessment revealed IT requirements as well as barriers and facilitators to implementation of EHR-based weight management interventions in primary care. We developed implementation metrics for the IT tools. These metrics were used in weekly project team calls to make sure that project resources were allocated to areas of need.

Conclusion

This study identifies the important role of IT in supporting weight management through patient identification, weight and activity tracking in the patient portal, and the use of the EHR as a population management tool. An intensive multi-level implementation approach is required for successful primary care-based weight management interventions including well-designed IT tools, comprehensive involvement of clinic leadership, and implementation tracking metrics to guide the process of workflow integration. This study helps to bridge the gap between informatics and implementation by using socio-technical formative evaluation methods early in order to support the implementation of IT tools.

Trial registration

clinicaltrials.gov, NCT04420936. Registered June 9, 2020.

Implementing weight maintenance with existing staff and electronic health record tools in a primary care setting: Baseline results from the MAINTAIN PRIME trial

BACKGROUND

There is need for interventions that can assist with long-term maintenance of healthy body weight and be sustainably integrated into existing primary care teams. The goal of MAINTAIN PRIME (Promoting Real (World) IMplEmentation) is to evaluate whether a successful electronic health record (EHR)-based weight maintenance intervention can be adapted to a new clinical setting with primary care staff serving as coaches.

METHODS

EHR tools include tracking tools, standardized surveys, and standardized "SmartPhrases" for coaching. Inclusion criteria were age 18-75 years, voluntary 5% weight loss in the past 2 years with prior BMI ≥ 25 kg/m2, and no bariatric procedures in past 2 years. Participants were randomized 1:1 to tailored online coaching with EHR tracking tools (coaching) or EHR tracking tools alone (tracking).

RESULTS

We screened 405 individuals between September 2021 and April 2023; 269 participants enrolled (134 coaching; 135 tracking). The most common reason for not enrolling was ineligibility (55%). At baseline, participants were 50.3 (SD 15.02) years old, 66.4% female, and 84% White; 83.7% reported moderate physical activity. Average weight and BMI at baseline were 205.0 (SD 48.9) lbs. and 33.2 (6.8) kg/m2, respectively. Participants lost an average of 10.7% (SD 5.2) of their body weight before enrolling. We recruited 39 primary care coaches over the same period. Conclusion The study successfully identified and recruited primary care patients with recent intentional weight loss for participation in a weight maintenance program that uses EHR-based tools. We also successfully recruited and trained primary care staff as coaches.

Implementation of Lung Cancer Screening in Primary Care and Pulmonary Clinics: Pragmatic Clinical Trial of Electronic Health Record-Integrated Everyday Shared Decision-Making Tool and Clinician-Facing Prompts

BACKGROUND

Although low-dose CT (LDCT) scan imaging lung cancer screening (LCS) can reduce lung cancer mortality, it remains underused. Shared decision-making (SDM) is recommended to assess the balance of benefits and harms for each patient.

RESEARCH QUESTION

Do clinician-facing electronic health record (EHR) prompts and an EHR-integrated everyday SDM tool designed to support routine incorporation of SDM into primary care improve LDCT scan imaging ordering and completion?

STUDY DESIGN AND METHODS

A preintervention and postintervention analysis was conducted in 30 primary care and four pulmonary clinics for visits with patients who met United States Preventive Services Task Force criteria for LCS. Propensity scores were used to adjust for covariates. Subgroup analyses were conducted based on the expected benefit from screening (high benefit vs intermediate benefit), pulmonologist involvement (ie, whether the patient was seen in a pulmonary clinic in addition to a primary care clinic), sex, and race and ethnicity.

RESULTS

In the 12-month preintervention phase among 1,090 eligible patients, 77 patients (7.1%) had LDCT scan imaging orders and 48 patients (4.4%) completed screenings. In the 9-month intervention phase among 1,026 eligible patients, 280 patients (27.3%) had LDCT scan imaging orders and 182 patients (17.7%) completed screenings. Adjusted ORs were 4.9 (95% CI, 3.4-6.9; P < .001) and 4.7 (95% CI, 3.1-7.1; P < .001) for LDCT imaging ordering and completion, respectively. Subgroup analyses showed increases in ordering and completion for all patient subgroups. In the intervention phase, the SDM tool was used by 23 of 102 ordering providers (22.5%) and for 69 of 274 patients (25.2%) for whom LDCT scan imaging was ordered and who needed SDM at the time of ordering.

INTERPRETATION

Clinician-facing EHR prompts and an EHR-integrated everyday SDM tool are promising approaches to improving LCS in the primary care setting. However, room for improvement remains. As such, further research is warranted.

TRIAL REGISTRY

ClinicalTrials.gov; No.: NCT04498052; URL: www.

CLINICALTRIALS

gov.

Impact of electronic health record-coaching features in weight change: A secondary analysis from the MAINTAIN-pc randomized trial

OBJECTIVE

This study aimed to evaluate whether coaching features were successfully transmitted via electronic health record (EHR) communication and to evaluate their relationship with weight change in a previously tested EHR-based coaching intervention.

METHODS

A secondary analysis from the Maintaining Activity and Nutrition through Technology-Assisted Innovation in Primary Care (MAINTAIN-pc) study randomized clinical trial was conducted in nine primary care practices and one specialty practice (endocrinology) affiliated with the University of Pittsburgh Medical Center. Eligibility included age 18 to 75 years, intentional 5% weight loss in the previous 2 years, access to an internet-connected computer, and receipt of care from a University of Pittsburgh Medical Center primary care provider. Survey data were collected during the randomized clinical trial.

RESULTS

Participants content with intervention delivery via the EHR and those who felt a strong connection to their coach had significantly less weight regain (p = 0.013 and p < 0.01, respectively). Participants who had needs unmet by the intervention (e.g., "in-person" support in a group setting or individual settings) regained more weight (p < 0.01).

CONCLUSIONS

The data suggest heterogeneity in the patient population regarding preference for in-person versus EHR-based coaching formats. Such heterogeneity might result in the differential success of EHR-based interventions.

Electronic Health Record-Integrated Clinical Decision Support for Clinicians Serving Populations Facing Health Care Disparities: Literature Review

OBJECTIVES

To review current studies about designing and implementing clinician-facing clinical decision support (CDS) integrated or interoperable with an electronic health record (EHR) to improve health care for populations facing disparities.

METHODS

We searched PubMed to identify studies published between January 1, 2011 and October 22, 2021 about clinician-facing CDS integrated or interoperable with an EHR. We screened abstracts and titles and extracted study data from articles using a protocol developed by team consensus. Extracted data included patient population characteristics, clinical specialty, setting, EHR, clinical problem, CDS type, reported user-centered design, implementation strategies, and outcomes.

RESULTS

There were 28 studies (36 articles) included. Most studies were performed at safety net institutions (14 studies) or Indian Health Service sites (6 studies). CDS tools were implemented in primary care outpatient settings in 24 studies (86%) for screening or treatment. CDS included point-of-care alerts (93%), order facilitators (46%), workflow support (39%), relevant information display (36%), expert systems (11%), and medication dosing support (7%). Successful outcomes were reported in 19 of 26 studies that reported outcomes (73%). User-centered design was reported during CDS planning (39%), development (32%), and implementation phase (25%). Most frequent implementation strategies were education (89%) and consensus facilitation (50%).

CONCLUSIONS

CDS tools may improve health equity and outcomes for patients who face disparities. The present review underscores the need for high-quality analyses of CDS-associated health outcomes, reporting of user-centered design and implementation strategies used in low-resource settings, and methods to disseminate CDS created to improve health equity.

Association of Mobile Workstations and Rounding-in-Flow with Resident Efficiency: A Controlled Study at an Academic Internal Medicine Department

BACKGROUND

Residents commonly use a batched workflow to round on hospitalized patients, creating redundancy and decreasing efficiency.

OBJECTIVE

To improve resident efficiency through a novel workflow using mobile laptops and modified rounding-in-flow.

DESIGN, SETTING, PARTICIPANTS

A controlled experimental study conducted at an academic medical center for 3 months. One internal medicine team served as the intervention group, and two other teams served as a control group; 34 interns and 20 senior residents participated.

INTERVENTION

Residents in the intervention group were provided a novel workflow and a mobile laptop to allow them to round "in-flow." Control group residents rounded as usual (batched workflow without laptops).

MAIN MEASURES

Fourteen interns were monitored for a time-motion study. Time-stamped electronic medical record (EMR) data were used to assess percentage of progress notes and orders placed during rounds (9 a.m.-12:30 p.m.) and percentage of discharge summaries signed within 24 h of discharge. A post-intervention survey measured perceived efficiency.

RESULTS

A time-motion study showed non-significant differences between time in the intervention group and that in the control group: communication time with patients (128 min vs 105 min, p = 0.37) and computer time (289 min vs 306 min, p = 0.71). EMR data for 664 visits in the control group and 374 in the intervention group showed that rounding-in-flow was associated with an odds ratio (OR) of 1.5 for placing progress notes during rounds (95% CI: 1.2-1.7, p < 0.001), an OR of 1.1 for placing non-discharge orders during rounds (95% CI: 1.0-1.2, p = 0.01), and an OR of 3.9 for signing discharge summaries within 24 h of discharge (95% CI: 2.3-7.2, p < 0.001). Post-intervention survey, completed by 23 of 34 interns, showed that interns in the intervention group perceived that orders were completed during rounds more often than the control group (OR 7.8; 95% CI: 1.3-60.1, p = 0.03).

CONCLUSIONS

Using mobile laptops with modified rounding-in-flow was associated with earlier completion of residents' work, suggesting improved efficiency.

Assessing perceived effectiveness of career development efforts led by the women in American Medical Informatics Association Initiative

OBJECTIVE

We sought to ascertain perceived factors affecting women's career development efforts in the American Medical Informatics Association (AMIA) and to provide recommendations for improvements.

MATERIALS AND METHODS

Data were collected using a 27-item survey administered via the AMIA newsletter and other social channels. Survey questions comprised 3 demographics, 15 Likert-scale, and 9 open-ended items. Likert-scale responses were summarized across respondent ages, career stages, and career domains, and open-ended responses were thematically analyzed.

RESULTS

We received survey responses from 109 AMIA women members. Our findings demonstrate that AMIA had made strides in promoting career development, and the most effective AMIA efforts included social events (83%), panel discussions (80%), and scientific sessions (79%). However, despite these efforts, women members perceived that gender-specific challenges persisted within AMIA, and recognized the need for increased networking opportunities (96%), raising awareness of gender-specific challenges (95%), and encouraging gender proportional representation in leadership (92%).

DISCUSSION

International and national biomedical informatics professional communities have put forth efforts to address gender-specific issues in career development. Yet, our study identified that some of these, including the deep-rooted gender power hierarchy and bias, are still perceived as profound in AMIA.

CONCLUSION

Even though existing career development efforts for women are highly effective, important perceived gender-specific career development issues require further attention and investigation to improve existing AMIA activities.

Using CDS Hooks to increase SMART on FHIR app utilization: a cluster-randomized trial

OBJECTIVE

HL7 SMART on FHIR apps have the potential to improve healthcare delivery and EHR usability, but providers must be aware of the apps and use them for these potential benefits to be realized. The HL7 CDS Hooks standard was developed in part for this purpose. The objective of this study was to determine if contextually relevant CDS Hooks prompts can increase utilization of a SMART on FHIR medical reference app (MDCalc for EHR).

MATERIALS AND METHODS

We conducted a 7-month, provider-randomized trial with 70 providers in a single emergency department. The intervention was a collection of CDS Hooks prompts suggesting the use of 6 medical calculators in a SMART on FHIR medical reference app. The primary outcome was the percentage of provider-patient interactions in which the app was used to view a recommended calculator. Secondary outcomes were app usage stratified by individual calculators.

RESULTS

Intervention group providers viewed a study calculator in the app in 6.0% of interactions compared to 2.6% in the control group (odds ratio = 2.45, 95% CI, 1.2-5.2, P value .02), an increase of 130%. App use was significantly greater for 2 of 6 calculators.

DISCUSSION AND CONCLUSION

Contextually relevant CDS Hooks prompts led to a significant increase in SMART on FHIR app utilization. This demonstrates the potential of using CDS Hooks to guide appropriate use of SMART on FHIR apps and was a primary motivation for the development of the standard. Future research may evaluate potential impacts on clinical care decisions and outcomes.

Evaluation in Life Cycle of Information Technology (ELICIT) framework: Supporting the innovation life cycle from business case assessment to summative evaluation

OBJECTIVE

Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation.

METHODS

The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies.

RESULTS

The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment.

DISCUSSION

Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation.

CONCLUSION

As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations.

OUP accepted manuscript

Objective

Materials and Methods

Results

Discussion

Conclusion

Establishing a multidisciplinary initiative for interoperable electronic health record innovations at an academic medical center

Objective

To establish an enterprise initiative for improving health and health care through interoperable electronic health record (EHR) innovations.

Materials and Methods

We developed a unifying mission and vision, established multidisciplinary governance, and formulated a strategic plan. Key elements of our strategy include establishing a world-class team; creating shared infrastructure to support individual innovations; developing and implementing innovations with high anticipated impact and a clear path to adoption; incorporating best practices such as the use of Fast Healthcare Interoperability Resources (FHIR) and related interoperability standards; and maximizing synergies across research and operations and with partner organizations.

Results

University of Utah Health launched the ReImagine EHR initiative in 2016. Supportive infrastructure developed by the initiative include various FHIR-related tooling and a systematic evaluation framework. More than 10 EHR-integrated digital innovations have been implemented to support preventive care, shared decision-making, chronic disease management, and acute clinical care. Initial evaluations of these innovations have demonstrated positive impact on user satisfaction, provider efficiency, and compliance with evidence-based guidelines. Return on investment has included improvements in care; over $35 million in external grant funding; commercial opportunities; and increased ability to adapt to a changing healthcare landscape.

Discussion

Key lessons learned include the value of investing in digital innovation initiatives leveraging FHIR; the importance of supportive infrastructure for accelerating innovation; and the critical role of user-centered design, implementation science, and evaluation.

Conclusion

EHR-integrated digital innovation initiatives can be key assets for enhancing the EHR user experience, improving patient care, and reducing provider burnout.

Integrated displays to improve chronic disease management in ambulatory care: A SMART on FHIR application informed by mixed-methods user testing

OBJECTIVE

The study sought to evaluate a novel electronic health record (EHR) add-on application for chronic disease management that uses an integrated display to decrease user cognitive load, improve efficiency, and support clinical decision making.

MATERIALS AND METHODS

We designed a chronic disease management application using the technology framework known as SMART on FHIR (Substitutable Medical Applications and Reusable Technologies on Fast Healthcare Interoperability Resources). We used mixed methods to obtain user feedback on a prototype to support ambulatory providers managing chronic obstructive pulmonary disease. Each participant managed 2 patient scenarios using the regular EHR with and without access to our prototype in block-randomized order. The primary outcome was the percentage of expert-recommended ideal care tasks completed. Timing, keyboard and mouse use, and participant surveys were also collected. User experiences were captured using a retrospective think-aloud interview analyzed by concept coding.

RESULTS

With our prototype, the 13 participants completed more recommended care (81% vs 48%; P < .001) and recommended tasks per minute (0.8 vs 0.6; P = .03) over longer sessions (7.0 minutes vs 5.4 minutes; P = .006). Keystrokes per task were lower with the prototype (6 vs 18; P < .001). Qualitative themes elicited included the desire for reliable presentation of information which matches participants' mental models of disease and for intuitive navigation in order to decrease cognitive load.

DISCUSSION

Participants completed more recommended care by taking more time when using our prototype. Interviews identified a tension between using the inefficient but familiar EHR vs learning to use our novel prototype. Concept coding of user feedback generated actionable insights.

CONCLUSIONS

Mixed methods can support the design and evaluation of SMART on FHIR EHR add-on applications by enhancing understanding of the user experience.

A Pathway for Community-Acquired Pneumonia With Rapid Conversion to Oral Therapy Improves Health Care Value

Background

Evidence supports streamlined approaches for inpatients with community-acquired pneumonia (CAP) including early transition to oral antibiotics and shorter therapy. Uptake of these approaches is variable, and the best approaches to local implementation of infection-specific guidelines are unknown. Our objective was to evaluate the impact of a clinical decision support (CDS) tool linked with a clinical pathway on CAP care.

Methods

This is a retrospective, observational pre–post intervention study of inpatients with pneumonia admitted to a single academic medical center. Interventions were introduced in 3 sequential 6-month phases; Phase 1: education alone; Phase 2: education and a CDS-driven CAP pathway coupled with active antimicrobial stewardship and provider feedback; and Phase 3: education and a CDS-driven CAP pathway without active stewardship. The 12 months preceding the intervention were used as a baseline. Primary outcomes were length of intravenous antibiotic therapy and total length of antibiotic therapy. Clinical, process, and cost outcomes were also measured.

Results

The study included 1021 visits. Phase 2 was associated with significantly lower length of intravenous and total antibiotic therapy, higher procalcitonin lab utilization, and a 20% cost reduction compared with baseline. Phase 3 was associated with significantly lower length of intravenous antibiotic therapy and higher procalcitonin lab utilization compared with baseline.

Conclusions

A CDS-driven CAP pathway supplemented by active antimicrobial stewardship review led to the most robust improvements in antibiotic use and decreased costs with similar clinical outcomes.

Modified early warning score-based clinical decision support: cost impact and clinical outcomes in sepsis

OBJECTIVE

The objective of this study was to assess the clinical and financial impact of a quality improvement project that utilized a modified Early Warning Score (mEWS)-based clinical decision support intervention targeting early recognition of sepsis decompensation.

MATERIALS AND METHODS

We conducted a retrospective, interrupted time series study on all adult patients who received a diagnosis of sepsis and were exposed to an acute care floor with the intervention. Primary outcomes (total direct cost, length of stay [LOS], and mortality) were aggregated for each study month for the post-intervention period (March 1, 2016-February 28, 2017, n = 2118 visits) and compared to the pre-intervention period (November 1, 2014-October 31, 2015, n = 1546 visits).

RESULTS

The intervention was associated with a decrease in median total direct cost and hospital LOS by 23% (P = .047) and .63 days (P = .059), respectively. There was no significant change in mortality.

DISCUSSION

The implementation of an mEWS-based clinical decision support system in eight acute care floors at an academic medical center was associated with reduced total direct cost and LOS for patients hospitalized with sepsis. This was seen without an associated increase in intensive care unit utilization or broad-spectrum antibiotic use.

CONCLUSION

An automated sepsis decompensation detection system has the potential to improve clinical and financial outcomes such as LOS and total direct cost. Further evaluation is needed to validate generalizability and to understand the relative importance of individual elements of the intervention.

Improving Physician Communication With Patients as Measured by HCAHPS Using a Standardized Communication Model

Physicians often fail to communicate well with patients. The objective of this retrospective controlled interrupted time series study was to evaluate the impact of a standardized communication intervention to improve physician communication. All patients ages 18 years or older (N = 7739 visits) admitted to University of Utah Health Care in Salt Lake City, Utah, from July 1, 2012, to June 31, 2014, were included. Obstetrics, rehabilitation, and psychiatric patients were excluded. The primary outcome was the percentage of patients who answered "Always" to all HCAHPS questions regarding physician-patient communication. Among the intervention group, the primary outcome increased from 56% to 63% ( P = .014, N = 1021) while remaining stable for the control group (65% to 66%, P = .6, N = 6718). The downward trend reversed after the intervention (-0.6% to +1.7% per month, P < .001). Standardized communication was associated with improvement in physician communication HCAHPS scores.

Multifaceted intervention including education, rounding checklist implementation, cost feedback, and financial incentives reduces inpatient laboratory costs

BACKGROUND

Inappropriate laboratory testing is a contributor to waste in healthcare.

OBJECTIVE

To evaluate the impact of a multifaceted laboratory reduction intervention on laboratory costs.

DESIGN

A retrospective, controlled, interrupted time series (ITS) study.

SETTING

University of Utah Health Care, a 500-bed academic medical center in Salt Lake City, Utah.

POPULATION

All patients 18 years or older admitted to the hospital to a service other than obstetrics, rehabilitation, or psychiatry.

INTERVENTION

Multifaceted quality-improvement initiative in a hospitalist service including education, process change, cost feedback, and financial incentive.

MEASUREMENTS

Primary outcomes of lab cost per day and per visit. Secondary outcomes of number of basic metabolic panel (BMP), comprehensive metabolic panel (CMP), complete blood count (CBC), and prothrombin time/international normalized ratio tests per day; length of stay (LOS); and 30-day readmissions.

RESULTS

A total of 6310 hospitalist patient visits (intervention group) were compared to 25,586 nonhospitalist visits (control group). Among the intervention group, the unadjusted mean cost per day was reduced from $138 before the intervention to $123 after the intervention (P < 0.001), and the unadjusted mean cost per visit decreased from $618 to $558 (P = 0.005). The ITS analysis showed significant reductions in cost per day, cost per visit, and the number of BMP, CMP, and CBC tests per day (P = 0.034, 0.02, <0.001, 0.004, and <0.001). LOS was unchanged and 30-day readmissions decreased in the intervention group.

CONCLUSION

A multifaceted approach to laboratory reduction demonstrated a significant reduction in laboratory cost per day and per visit, as well as common tests per day at a major academic medical center. Journal of Hospital Medicine 2016;11:348-354. © 2016 Society of Hospital Medicine.

Evidence-based care pathway for cellulitis improves process, clinical, and cost outcomes

BACKGROUND

Cellulitis is a common infection with wide variation of clinical care.

OBJECTIVE

To implement an evidence-based care pathway and evaluate changes in process metrics, clinical outcomes, and cost for cellulitis.

DESIGN

A retrospective observational pre-/postintervention study was performed.

SETTING

University of Utah Health Care, a 500-bed academic medical center in Salt Lake City, Utah.

PATIENTS

All patients 18 years or older admitted to the emergency department observation unit or hospital with a primary diagnosis of cellulitis.

INTERVENTION

Development of an evidence-based care pathway for cellulitis embedded into the electronic medical record with education for all emergency and internal medicine physicians.

MEASUREMENTS

Primary outcome of broad-spectrum antibiotic use. Secondary outcomes of computed tomography/magnetic resonance imaging orders, length of stay (LOS), 30-day readmission, and pharmacy, lab, imaging, and total facility costs.

RESULTS

A total of 677 visits occurred, including 370 visits where order sets were used. Among all patients, there was a 59% decrease in the odds of ordering broad-spectrum antibiotics (P < 0.001), 23% decrease in pharmacy cost (P = 0.002), and 13% decrease in total facility cost (P = 0.006). Compared to patients for whom order sets were not used, patients for whom order sets were used had a 75%, 13%, and 25% greater decrease in the odds of ordering broad-spectrum antibiotics (P < 0.001), clinical LOS (P = 0.041), and pharmacy costs (P = 0.074), respectively.

CONCLUSION

The evidence-based care pathway for cellulitis improved care at an academic medical center by reducing broad-spectrum antibiotic use, pharmacy costs, and total facility costs without an adverse change in LOS or 30-day readmissions.

Challenges and Solutions in Optimizing Execution Performance of a Clinical Decision Support-Based Quality Measurement (CDS-QM) Framework

Given the close relationship between clinical decision support (CDS) and quality measurement (QM), it has been proposed that a standards-based CDS Web service could be leveraged to enable QM. Benefits of such a CDS-QM framework include semantic consistency and implementation efficiency. However, earlier research has identified execution performance as a critical barrier when CDS-QM is applied to large populations. Here, we describe challenges encountered and solutions devised to optimize CDS-QM execution performance. Through these optimizations, the CDS-QM execution time was optimized approximately three orders of magnitude, such that approximately 370,000 patient records can now be evaluated for 22 quality measure groups in less than 5 hours (approximately 2 milliseconds per measure group per patient). Several key optimization methods were identified, with the most impact achieved through population-based retrieval of relevant data, multi-step data staging, and parallel processing. These optimizations have enabled CDS-QM to be operationally deployed at an enterprise level.

Clinical Decision Support-based Quality Measurement (CDS-QM) Framework: Prototype Implementation, Evaluation, and Future Directions

Electronic quality measurement (QM) and clinical decision support (CDS) are closely related but are typically implemented independently, resulting in significant duplication of effort. While it seems intuitive that technical approaches could be re-used across these two related use cases, such reuse is seldom reported in the literature, especially for standards-based approaches. Therefore, we evaluated the feasibility of using a standards-based CDS framework aligned with anticipated EHR certification criteria to implement electronic QM. The CDS-QM framework was used to automate a complex national quality measure (SCIP-VTE-2) at an academic healthcare system which had previously relied on time-consuming manual chart abstractions. Compared with 305 manually-reviewed reference cases, the recall of automated measurement was 100%. The precision was 96.3% (CI:92.6%-98.5%) for ascertaining the denominator and 96.2% (CI:92.3%-98.4%) for the numerator. We therefore validated that a standards-based CDS-QM framework can successfully enable automated QM, and we identified benefits and challenges with this approach.

A peer-educator network HIV prevention intervention among injection drug users: results of a randomized controlled trial in St. Petersburg, Russia

We evaluated the efficacy of a peer-educator network intervention as a strategy to reduce HIV acquisition among injection drug users (IDUs) and their drug and/or sexual networks. A randomized controlled trial was conducted in St. Petersburg, Russia among IDU index participants and their risk network participants. Network units were randomized to the control or experimental intervention. Only the experimental index participants received training sessions to communicate risk reduction techniques to their network members. Analysis includes 76 index and 84 network participants who were HIV uninfected. The main outcome measure was HIV sero-conversion. The incidence rates in the control and experimental groups were 19.57 (95 % CI 10.74-35.65) and 7.76 (95 % CI 3.51-17.19) cases per 100 p/y, respectively. The IRR was 0.41 (95 % CI 0.15-1.08) without a statistically significant difference between the two groups (log rank test statistic X(2) = 2.73, permutation p value = 0.16). Retention rate was 67 % with a third of the loss due to incarceration or death. The results show a promising trend that this strategy would be successful in reducing the acquisition of HIV among IDUs.