What drives adoption of a computerised, multifaceted quality improvement intervention for cardiovascular disease management in primary healthcare settings? A mixed methods analysis using normalisation process theory

Teamwork and implementation of innovations in healthcare and human service settings: a systematic review

BACKGROUND

Implementation of new practices in team-based settings requires teams to work together to respond to new demands and changing expectations. However, team constructs and team-based implementation approaches have received little attention in the implementation science literature. This systematic review summarizes empirical research examining associations between teamwork and implementation outcomes when evidence-based practices and other innovations are implemented in healthcare and human service settings.

METHODS

We searched MEDLINE, CINAHL, APA PsycINFO and ERIC for peer-reviewed empirical articles published from January 2000 to March 2022. Additional articles were identified by searches of reference lists and a cited reference search for included articles (completed in February 2023). We selected studies using quantitative, qualitative, or mixed methods to examine associations between team constructs and implementation outcomes in healthcare and human service settings. We used the Mixed Methods Appraisal Tool to assess methodological quality/risk of bias and conducted a narrative synthesis of included studies. GRADE and GRADE-CERQual were used to assess the strength of the body of evidence.

RESULTS

Searches identified 10,489 results. After review, 58 articles representing 55 studies were included. Relevant studies increased over time; 71% of articles were published after 2016. We were unable to generate estimates of effects for any quantitative associations because of very limited overlap in the reported associations between team variables and implementation outcomes. Qualitative findings with high confidence were: 1) Staffing shortages and turnover hinder implementation; 2) Adaptive team functioning (i.e., positive affective states, effective behavior processes, shared cognitive states) facilitates implementation and is associated with better implementation outcomes; Problems in team functioning (i.e., negative affective states, problematic behavioral processes, lack of shared cognitive states) act as barriers to implementation and are associated with poor implementation outcomes; and 3) Open, ongoing, and effective communication within teams facilitates implementation of new practices; poor communication is a barrier.

CONCLUSIONS

Teamwork matters for implementation. However, both team constructs and implementation outcomes were often poorly specified, and there was little overlap of team constructs and implementation outcomes studied in quantitative studies. Greater specificity and rigor are needed to understand how teamwork influences implementation processes and outcomes. We provide recommendations for improving the conceptualization, description, assessment, analysis, and interpretation of research on teams implementing innovations.

TRIAL REGISTRATION

This systematic review was registered in PROSPERO, the international prospective register of systematic reviews.

REGISTRATION NUMBER

CRD42020220168.

Optimising a clinical decision support tool to improve chronic kidney disease management in general practice

BACKGROUND

Early identification and treatment of chronic disease is associated with better clinical outcomes, lower costs, and reduced hospitalisation. Primary care is ideally placed to identify patients at risk of, or in the early stages of, chronic disease and to implement prevention and early intervention measures. This paper evaluates the implementation of a technological intervention called Future Health Today that integrates with general practice EMRs to (1) identify patients at-risk of, or with undiagnosed or untreated, chronic kidney disease (CKD), and (2) provide guideline concordant recommendations for patient care. The evaluation aimed to identify the barriers and facilitators to successful implementation.

METHODS

Future Health Today was implemented in 12 general practices in Victoria, Australia. Fifty-two interviews with 30 practice staff were undertaken between July 2020 and April 2021. Practice characteristics were collected directly from practices via survey. Data were analysed using inductive and deductive qualitative analysis strategies, using Clinical Performance - Feedback Intervention Theory (CP-FIT) for theoretical guidance.

RESULTS

Future Health Today was acceptable, user friendly and useful to general practice staff, and supported clinical performance improvement in the identification and management of chronic kidney disease. CP-FIT variables supporting use of FHT included the simplicity of design and delivery of actionable feedback via FHT, good fit within existing workflow, strong engagement with practices and positive attitudes toward FHT. Context variables provided the main barriers to use and were largely situated in the external context of practices (including pressures arising from the COVID-19 pandemic) and technical glitches impacting installation and early use. Participants primarily utilised the point of care prompt rather than the patient management dashboard due to its continued presence, and immediacy and relevance of the recommendations on the prompt, suggesting mechanisms of compatibility, complexity, actionability and credibility influenced use. Most practices continued using FHT after the evaluation phase was complete.

CONCLUSIONS

This study demonstrates that FHT is a useful and acceptable software platform that provides direct support to general practice in identifying and managing patients with CKD. Further research is underway to explore the effectiveness of FHT, and to expand the conditions on the platform.

Development of a communication platform for patients with head and neck cancer for effective information delivery and improvement of doctor-patient relationship: application of treatment journey-based service blueprint

BACKGROUND

Effective communication and information delivery enhance doctor-patient relationships, improves adherence to treatment, reduces work burden, and supports decision-making. The study developed a head and neck cancer (HNC) communication platform to support effective delivery of information about HNC treatment and improve the doctor-patient relationship.

METHODS

This study was structured in three main phases: 1) The requirement elicitation phase sought an understanding of the HNC treatment journey and service failure points (FPs) obtained through patient/medical staff interviews and observations, along with a review of the electronic health record system; 2) The development phase involved core needs analysis, solutions development through a co-creation workshop, and validation of the solutions through focus groups; and 3) the proposed HNC communication platform was integrated with the current treatment system, and the flow and mechanism of the interacting services were structured using a service blueprint (SB).

RESULTS

Twenty-two service FPs identified through interviews and observations were consolidated into four core needs, and solutions were proposed to address each need: an HNC treatment journey map, cancer survivor stories, operation consent redesign with surgical illustrations, and a non-verbal communication toolkit. The communication platform was designed through the SB in terms of the stage at which the solution was applied and the actions and interactions of the service providers.

CONCLUSIONS

The developed platform has practical significance, reflecting a tangible service improvement for both patients and medical staff, making it applicable in hospital settings.

Study of Whole blood in Frontline Trauma (SWiFT): implementation study protocol

INTRODUCTION

Uncontrolled bleeding is a major cause of death for patients with major trauma. Current transfusion practices vary, and there is uncertainty about the optimal strategy. Whole blood (WB) transfusion, which contains all components in one bag, is considered potentially advantageous, particularly for resuscitating patients with major bleeding in the prehospital setting. It could potentially improve survival, reduce donor risk and simplify the processes of delivering blood transfusions outside hospitals. However, the evidence supporting the effectiveness and safety of WB compared with the standard separate blood component therapy is limited. A multicentre randomised controlled trial will be conducted, alongside an implementation study, to assess the efficacy, cost-effectiveness and implementation of prehospital WB transfusion in the prehospital environment. The implementation study will focus on evaluating the acceptability and integration of the intervention into clinical settings and on addressing broader contextual factors that may influence its success or failure.

METHODS AND ANALYSIS

A type 1 effectiveness-implementation hybrid design will be employed. The implementation study will use qualitative methods, encompassing comprehensive interviews and focus groups with operational staff, patients and blood donor representatives. Staff will be purposefully selected to ensure a wide range of perspectives based on their professional background and involvement in the WB pathway. The study design includes: (1) initial assessment of current practice and processes in the WB pathway; (2) qualitative interviews with up to 40 operational staff and (3) five focus groups with staff and donor representatives. Data analysis will be guided by the theoretical lenses of the Normalisation Process Theory and the Theoretical Framework of Acceptability.

ETHICS AND DISSEMINATION

The study was prospectively registered and approved by the South Central-Oxford C Research Ethics Committee and the Health Research Authority and Health and Care Research Wales. The results will be published in peer-reviewed journals and provided to all relevant stakeholders.

TRIAL REGISTRATION NUMBER

ISRCTN23657907; EudraCT: 2021-006876-18; IRAS Number: 300414; REC: 22/SC/0072.

Strategies for Implementing Machine Learning Algorithms in the Clinical Practice of Radiology

Despite recent advancements in machine learning (ML) applications in health care, there have been few benefits and improvements to clinical medicine in the hospital setting. To facilitate clinical adaptation of methods in ML, this review proposes a standardized framework for the step-by-step implementation of artificial intelligence into the clinical practice of radiology that focuses on three key components: problem identification, stakeholder alignment, and pipeline integration. A review of the recent literature and empirical evidence in radiologic imaging applications justifies this approach and offers a discussion on structuring implementation efforts to help other hospital practices leverage ML to improve patient care. Clinical trial registration no. 04242667 © RSNA, 2024 Supplemental material is available for this article.

Supporting translation of research evidence into practice-the use of Normalisation Process Theory to assess and inform implementation within randomised controlled trials: a systematic review

BACKGROUND

The status of randomised controlled trials (RCTs) as the 'gold standard' for evaluating efficacy in healthcare interventions is increasingly debated among the research community, due to often insufficient consideration for implementation. Normalisation Process Theory (NPT), which focuses on the work required to embed processes into practice, offers a potentially useful framework for addressing these concerns. While the theory has been deployed in numerous RCTs to date, more work is needed to consolidate understanding of if, and how, NPT may aid implementation planning and processes within RCTs. Therefore, this review seeks to understand how NPT contributes to understanding the dynamics of implementation processes within RCTs. Specifically, this review will identify and characterise NPT operationalisation, benefits and reported challenges and limitations in RCTs.

METHODS

A qualitative systematic review with narrative synthesis of peer-reviewed journal articles from eight databases was conducted. Studies were eligible for inclusion if they reported sufficient detail on the use of NPT within RCTs in a healthcare domain. A pre-specified data extraction template was developed based on the research questions of this review. A narrative synthesis was performed to identify recurrent findings.

RESULTS

Searches identified 48 articles reporting 42 studies eligible for inclusion. Findings suggest that NPT is primarily operationalised prospectively during the data collection stage, with limited sub-construct utilisation overall. NPT is beneficial in understanding implementation processes by aiding the identification and analysis of key factors, such as understanding intervention fidelity in real-world settings. Nearly three-quarters of studies failed to report the challenges and limitations of utilising NPT, though coding difficulties and data falling outside the NPT framework are most common.

CONCLUSIONS

NPT appears to be a consistent and generalisable framework for explaining the dynamics of implementation processes within RCTs. However, operationalisation of the theory to its full extent is necessary to improve its use in practice, as it is currently deployed in varying capacities. Recommendations for future research include investigation of NPT alongside other frameworks, as well as earlier operationalisation and greater use of NPT sub-constructs.

TRIAL REGISTRATION

The protocol for this systematic review was accepted for public registration on PROSPERO (registration number: CRD42022345427) on 26 July 2022.

Sustainability, spread, and scale in trials using audit and feedback: a theory-informed, secondary analysis of a systematic review

BACKGROUND

Audit and feedback (A&F) is a widely used implementation strategy to influence health professionals' behavior that is often tested in implementation trials. This study examines how A&F trials describe sustainability, spread, and scale.

METHODS

This is a theory-informed, descriptive, secondary analysis of an update of the Cochrane systematic review of A&F trials, including all trials published since 2011. Keyword searches related to sustainability, spread, and scale were conducted. Trials with at least one keyword, and those identified from a forward citation search, were extracted to examine how they described sustainability, spread, and scale. Results were qualitatively analyzed using the Integrated Sustainability Framework (ISF) and the Framework for Going to Full Scale (FGFS).

RESULTS

From the larger review, n = 161 studies met eligibility criteria. Seventy-eight percent (n = 126) of trials included at least one keyword on sustainability, and 49% (n = 62) of those studies (39% overall) frequently mentioned sustainability based on inclusion of relevant text in multiple sections of the paper. For spread/scale, 62% (n = 100) of trials included at least one relevant keyword and 51% (n = 51) of those studies (31% overall) frequently mentioned spread/scale. A total of n = 38 studies from the forward citation search were included in the qualitative analysis. Although many studies mentioned the need to consider sustainability, there was limited detail on how this was planned, implemented, or assessed. The most frequent sustainability period duration was 12 months. Qualitative results mapped to the ISF, but not all determinants were represented. Strong alignment was found with the FGFS for phases of scale-up and support systems (infrastructure), but not for adoption mechanisms. New spread/scale themes included (1) aligning affordability and scalability; (2) balancing fidelity and scalability; and (3) balancing effect size and scalability.

CONCLUSION

A&F trials should plan for sustainability, spread, and scale so that if the trial is effective, the benefits can continue. A deeper empirical understanding of the factors impacting A&F sustainability is needed. Scalability planning should go beyond cost and infrastructure to consider other adoption mechanisms, such as leadership, policy, and communication, that may support further scalability.

TRIAL REGISTRATION

Registered with Prospero in May 2022. CRD42022332606.

Readiness for Change in the Implementation of a 3D Printing Initiative in a Catalan Tertiary Hospital Using the Normalization Process Theory: Survey Study

BACKGROUND

The high failure rate of innovation projects motivates us to understand the perceptions about resistances and barriers of the main stakeholders to improving success rates.

OBJECTIVE

This study aims to analyze the readiness for change in the implementation of a 3D printing project in a Catalan tertiary hospital prior to its implementation.

METHODS

We used a web-based, voluntary, and anonymous survey using the Normalization Measurement Development questionnaire (NoMAD) to gather views and perceptions from a selected group of health care professionals at Germans Trias i Pujol University Hospital.

RESULTS

In this study, 58 professionals, including heads of service (n=30, 51%), doctors (n=18, 31%), nurses (n=7, 12%), and support staff (n=3, 5%), responded to the questionnaire. All groups saw the value of the project and were willing to enroll and support it. Respondents reported the highest scores (out of 5) in cognitive participation (mean 4.45, SD 0.04), coherence (mean 3.72, SD 0.13), and reflective monitoring (mean 3.80, SD 0.25). The weakest score was in collective action (mean 3.52, SD 0.12). There were no statistically significant differences in scores among professions in the survey.

CONCLUSIONS

The 3D printing project implementation should pay attention to preparing, defining, sharing, and supporting the operational work involved in its use and implementation. It should also understand, assess, and communicate the ways in which the new set of practices can affect the users and others around them. We suggest that health officers and politicians consider this experience as a solid ground toward the development of a more efficient health innovation system and as a catalyst for transformation.

Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

Introduction

Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation.

Methods

Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized.

Results

Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%).

Conclusion

TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science's translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the "AI chasm" continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice.

Using multi-criteria decision analysis to describe stakeholder preferences for new quality improvement initiatives that could optimise prescribing in England

Background

Hospital decision-makers have limited resources to implement quality improvement projects. To decide which interventions to take forward, trade-offs must be considered that inevitably turn on stakeholder preferences. The multi-criteria decision analysis (MCDA) approach could make this decision process more transparent.

Method

An MCDA was conducted to rank-order four types of interventions that could optimise medication use in England's National Healthcare System (NHS) hospitals, including Computerised Interface, Built Environment, Written Communication, and Face-to-Face Interactions. Initially, a core group of quality improvers (N = 10) was convened to determine criteria that could influence which interventions are taken forward according to the Consolidated Framework for Implementation Research. Next, to determine preference weightings, a preference survey was conducted with a diverse group of quality improvers (N = 356) according to the Potentially All Pairwise Ranking of All Possible Alternatives method. Then, rank orders of four intervention types were calculated according to models with criteria unweighted and weighted according to participant preferences using an additive function. Uncertainty was estimated by probabilistic sensitivity analysis using 1,000 Monte Carlo Simulation iterations.

Results

The most important criteria influencing what interventions were preferred was whether they addressed "patient needs" (17.6%)' and their financial "cost (11.5%)". The interventions' total scores (unweighted score out of 30 | weighted out of 100%) were: Computerised Interface (25 | 83.8%), Built Environment (24 | 79.6%), Written Communication (22 | 71.6%), and Face-to-Face (22 | 67.8%). The probabilistic sensitivity analysis revealed that the Computerised Interface would be the most preferred intervention over various degrees of uncertainty.

Conclusions

An MCDA was conducted to rank order intervention types that stand to increase medication optimisation across hospitals in England. The top-ranked intervention type was the Computerised Interface. This finding does not imply Computerised Interface interventions are the most effective interventions but suggests that successfully implementing lower-ranked interventions may require more conversations that acknowledge stakeholder concerns.

Snakes and ladders: A qualitative study understanding the active ingredients of social interaction around the use of audit and feedback

Explore characteristics of the facilitator, group, and interaction that influence whether a group discussion about data leads to the identification of a clearly specified action plan. Peer-facilitated group discussions among primary care physicians were carried out and recorded. A follow-up focus group was conducted with peer facilitators to explore which aspects of the discussion promoted action planning. Qualitative data was analyzed using an inductive-deductive thematic analysis approach using the conceptual model developed by Cooke et al. Group discussions were coded case-specifically and then analyzed to identify which themes influenced action planning as it relates to performance improvement. Physicians were more likely to interact with practice-level data and explore actions for performance improvement when the group facilitator focused the discussion on action planning. Only one of the three sites (Site C) converged on an action plan following the peer-facilitated group discussion. At Site A, physicians shared skepticism of the data, were defensive about performance, and explained performance as a product of factors beyond their control. Site B identified several potential actions but had trouble focusing on a single indicator or deciding between physician- and group-level actions. None of the groups discussed variation in physician-level performance indicators, or how physician actions might contribute to the reported outcomes. Peer facilitators can support data interpretation and practice change; however their success depends on their personal beliefs about the data and their ability to identify and leverage change cues that arise in conversation. Further research is needed to understand how to create a psychologically safe environment that welcomes open discussion of physician variation.

Barriers and enablers to implementing and using clinical decision support systems for chronic diseases: a qualitative systematic review and meta-aggregation

BACKGROUND

Clinical decision support (CDS) is increasingly used to facilitate chronic disease care. Despite increased availability of electronic health records and the ongoing development of new CDS technologies, uptake of CDS into routine clinical settings is inconsistent. This qualitative systematic review seeks to synthesise healthcare provider experiences of CDS-exploring the barriers and enablers to implementing, using, evaluating, and sustaining chronic disease CDS systems.

METHODS

A search was conducted in Medline, CINAHL, APA PsychInfo, EconLit, and Web of Science from 2011 to 2021. Primary research studies incorporating qualitative findings were included if they targeted healthcare providers and studied a relevant chronic disease CDS intervention. Relevant CDS interventions were electronic health record-based and addressed one or more of the following chronic diseases: cardiovascular disease, diabetes, chronic kidney disease, hypertension, and hypercholesterolaemia. Qualitative findings were synthesised using a meta-aggregative approach.

RESULTS

Thirty-three primary research articles were included in this qualitative systematic review. Meta-aggregation of qualitative data revealed 177 findings and 29 categories, which were aggregated into 8 synthesised findings. The synthesised findings related to clinical context, user, external context, and technical factors affecting CDS uptake. Key barriers to uptake included CDS systems that were simplistic, had limited clinical applicability in multimorbidity, and integrated poorly into existing workflows. Enablers to successful CDS interventions included perceived usefulness in providing relevant clinical knowledge and structured chronic disease care; user confidence gained through training and post training follow-up; external contexts comprised of strong clinical champions, allocated personnel, and technical support; and CDS technical features that are both highly functional, and attractive.

CONCLUSION

This systematic review explored healthcare provider experiences, focussing on barriers and enablers to CDS use for chronic diseases. The results provide an evidence-base for designing, implementing, and sustaining future CDS systems. Based on the findings from this review, we highlight actionable steps for practice and future research.

TRIAL REGISTRATION

PROSPERO CRD42020203716.

Data-driven quality improvement program to prevent hospitalisation and improve care of people living with coronary heart disease: Protocol for a process evaluation

BACKGROUND

Practice-level quality improvement initiatives using rapidly advancing technology offers a multidimensional approach to reduce cardiovascular disease burden. For the "QUality improvement in primary care to prevent hospitalisations and improve Effectiveness and efficiency of care for people Living with heart disease" (QUEL) cluster randomised controlled trial, a 12-month quality improvement intervention was designed for primary care practices to use data and implement progressive changes using "Plan, Do, Study, Act" cycles within their practices with training in a series of interactive workshops. This protocol aims to describe the systematic methods to conduct a process evaluation of the data-driven intervention within the QUEL study.

METHODS

A mixed-method approach will be used to conduct the evaluation. Quantitative data collected throughout the intervention period, via surveys and intervention materials, will be used to (1) identify the key elements of the intervention and how, for whom and in what context it was effective; (2) determine if the intervention is delivered as intended; and (3) describe practice engagement, commitment and capacity associated with various intervention components. Qualitative data, collected via semi-structured interviews and open-ended questions, will be used to gather in-depth understanding of the (1) satisfaction, utility, barriers and enablers; (2) acceptability, uptake and feasibility, and (3) effect of the COVID-19 pandemic on the implementation of the intervention.

CONCLUSION

Findings from the evaluation will provide new knowledge on the implementation of a complex, multi-component intervention at practice-level using their own electronic patient data to enhance secondary prevention of cardiovascular disease.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ANZCTR) number ACTRN12619001790134.

Implementation of a web-based computerised decision support system for Community Mental Health Services using national electronic health records (Preprint)

Background

A high proportion of patients with severe mental illness relapse due to nonadherence to psychotropic medication. In this paper, we use the normalization process theory (NPT) to describe the implementation of a web-based clinical decision support system (CDSS) for Community Mental Health Services (CMHS) called Actionable Intime Insights or AI². AI² has two distinct functions: (1) it provides an overview of medication and treatment history to assist in reviewing patient adherence and (2) gives alerts indicating nonadherence to support early intervention.

Objective

Our objective is to evaluate the pilot implementation of the AI² application to better understand the challenges of implementing a web-based CDSS to support medication adherence and early intervention in CMHS.

Methods

The NPT and participatory action framework were used to both explore and support implementation. Qualitative data were collected over the course of the 14-month implementation, in which researchers were active participants. Data were analyzed and coded using the NPT framework. Qualitative data included discussions, meetings, and work products, including emails and documents.

Results

This study explores the barriers and enablers of implementing a CDSS to support early intervention within CMHS using Medicare data from Australia’s national electronic record system, My Health Record (MyHR). The implementation was a series of ongoing negotiations, which resulted in a staged implementation with compromises on both sides. Clinicians were initially hesitant about using a CDSS based on MyHR data and expressed concerns about the changes to their work practice required to support early intervention. Substantial workarounds were required to move the implementation forward. This pilot implementation allowed us to better understand the challenges of implementation and the resources and support required to implement and sustain a model of care based on automated alerts to support early intervention.

Conclusions

The use of decision support based on electronic health records is growing, and while implementation is challenging, the potential benefits of early intervention to prevent relapse and hospitalization and ensure increased efficiency of the health care system are worth pursuing.

The Challenge of Integrating eHealth Into Health Care: Systematic Literature Review of the Donabedian Model of Structure, Process, and Outcome

BACKGROUND

Health care organizations are increasingly working with eHealth. However, the integration of eHealth into regular health care is challenging. It requires organizations to change the way they work and their structure and care processes to be adapted to ensure that eHealth supports the attainment of the desired outcomes.

OBJECTIVE

The aims of this study are to investigate whether there are identifiable indicators in the structure, process, and outcome categories that are related to the successful integration of eHealth in regular health care, as well as to investigate which indicators of structure and process are related to outcome indicators.

METHODS

A systematic literature review was conducted using the Donabedian Structure-Process-Outcome (SPO) framework to identify indicators that are related to the integration of eHealth into health care organizations. Data extraction sheets were designed to provide an overview of the study characteristics, eHealth characteristics, and indicators. The extracted indicators were organized into themes and subthemes of the structure, process, and outcome categories.

RESULTS

Eleven studies were included, covering a variety of study designs, diseases, and eHealth tools. All studies identified structure, process, and outcome indicators that were potentially related to the integration of eHealth. The number of indicators found in the structure, process, and outcome categories was 175, 84, and 88, respectively. The themes with the most-noted indicators and their mutual interaction were inner setting (51 indicators, 16 interactions), care receiver (40 indicators, 11 interactions), and technology (38 indicators, 12 interactions)-all within the structure category; health care actions (38 indicators, 15 interactions) within the process category; and efficiency (30 indicators, 15 interactions) within the outcome category. In-depth examination identified four most-reported indicators, namely "deployment of human resources" (n=11), in the inner setting theme within the structure category; "ease of use" (n=16) and "technical issue" (n=10), both in the technology theme within the structure category; and "health logistics" (n=26), in the efficiency theme within the outcome category.

CONCLUSIONS

Three principles are important for the successful integration of eHealth into health care. First, the role of the care receiver needs to be incorporated into the organizational structure and daily care process. Second, the technology must be well attuned to the organizational structure and daily care process. Third, the deployment of human resources to the daily care processes needs to be aligned with the desired end results. Not adhering to these points could negatively affect the organization, daily process, or the end results.

An electronic decision support-based complex intervention to improve management of cardiovascular risk in primary health care: a cluster randomised trial (INTEGRATE)

OBJECTIVES

To determine whether a multifaceted primary health care intervention better controlled cardiovascular disease (CVD) risk factors in patients with high risk of CVD than usual care.

DESIGN, SETTING

Parallel arm, cluster randomised trial in 71 Australian general practices, 5 December 2016 - 13 September 2019.

PARTICIPANTS

General practices that predominantly used an electronic medical record system compatible with the HealthTracker electronic decision support tool, and willing to implement all components of the INTEGRATE intervention.

INTERVENTION

Electronic point-of-care decision support for general practices; combination cardiovascular medications (polypills); and a pharmacy-based medication adherence program.

MAIN OUTCOME MEASURES

Proportion of patients with high CVD risk not on an optimal preventive medication regimen at baseline who had achieved both blood pressure and low-density lipoprotein (LDL) cholesterol goals at study end.

RESULTS

After a median 15 months' follow-up, primary outcome data were available for 4477 of 7165 patients in the primary outcome cohort (62%). The proportion of patients who achieved both treatment targets was similar in the intervention (423 of 2156; 19.6%) and control groups (466 of 2321; 20.1%; relative risk, 1.06; 95% CI, 0.85-1.32). Further, no statistically significant differences were found for a number of secondary outcomes, including risk factor screening, preventive medication prescribing, and risk factor levels. Use of intervention components was low; it was highest for HealthTracker, used at least once for 347 of 3236 undertreated patients with high CVD risk (10.7%).

CONCLUSIONS

Despite evidence for the efficacy of its individual components, the INTEGRATE intervention was not broadly implemented and did not improve CVD risk management in participating Australian general practices.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry, ACTRN12616000233426 (prospective).

The effects of clinical decision support system for prescribing medication on patient outcomes and physician practice performance: a systematic review and meta-analysis

Background

Clinical Decision Support Systems (CDSSs) for Prescribing are one of the innovations designed to improve physician practice performance and patient outcomes by reducing prescription errors. This study was therefore conducted to examine the effects of various CDSSs on physician practice performance and patient outcomes.

Methods

This systematic review was carried out by searching PubMed, Embase, Web of Science, Scopus, and Cochrane Library from 2005 to 2019. The studies were independently reviewed by two researchers. Any discrepancies in the eligibility of the studies between the two researchers were then resolved by consulting the third researcher. In the next step, we performed a meta-analysis based on medication subgroups, CDSS-type subgroups, and outcome categories. Also, we provided the narrative style of the findings. In the meantime, we used a random-effects model to estimate the effects of CDSS on patient outcomes and physician practice performance with a 95% confidence interval. Q statistics and I² were then used to calculate heterogeneity.

Results

On the basis of the inclusion criteria, 45 studies were qualified for analysis in this study. CDSS for prescription drugs/COPE has been used for various diseases such as cardiovascular diseases, hypertension, diabetes, gastrointestinal and respiratory diseases, AIDS, appendicitis, kidney disease, malaria, high blood potassium, and mental diseases. In the meantime, other cases such as concurrent prescribing of multiple medications for patients and their effects on the above-mentioned results have been analyzed. The study shows that in some cases the use of CDSS has beneficial effects on patient outcomes and physician practice performance (std diff in means = 0.084, 95% CI 0.067 to 0.102). It was also statistically significant for outcome categories such as those demonstrating better results for physician practice performance and patient outcomes or both. However, there was no significant difference between some other cases and traditional approaches. We assume that this may be due to the disease type, the quantity, and the type of CDSS criteria that affected the comparison. Overall, the results of this study show positive effects on performance for all forms of CDSSs.

Conclusions

Our results indicate that the positive effects of the CDSS can be due to factors such as user-friendliness, compliance with clinical guidelines, patient and physician cooperation, integration of electronic health records, CDSS, and pharmaceutical systems, consideration of the views of physicians in assessing the importance of CDSS alerts, and the real-time alerts in the prescription.

Future Health Today: codesign of an electronic chronic disease quality improvement tool for use in general practice using a service design approach

OBJECTIVE

To codesign an electronic chronic disease quality improvement tool for use in general practice.

DESIGN

Service design employing codesign strategies.

SETTING

General practice.

PARTICIPANTS

Seventeen staff (general practitioners, nurses and practice managers) from general practice in metropolitan Melbourne and regional Victoria and five patients from metropolitan Melbourne.

INTERVENTIONS

Codesign sessions with general practice staff, using a service design approach, were conducted to explore key design criteria and functionality of the audit and feedback and clinical decision support tools. Think aloud interviews were conducted in which participants articulated their thoughts of the resulting Future Health Today (FHT) prototype as they used it. One codesign session was held with patients. Using inductive and deductive coding, content and thematic analyses explored the development of a new technological platform and factors influencing implementation of the platform.

RESULTS

Participants identified that the prototype needed to work within their existing workflow to facilitate automated patient recall and track patients with or at-risk of specific conditions. It needed to be simple, provide visual snapshots of information and easy access to relevant guidelines and facilitate quality improvement activities. Successful implementation may be supported by: accuracy of the algorithms in FHT and data held in the practice; the platform supporting planned and spontaneous interactions with patients; the ability to hide tools; links to Medicare Benefits Schedule; and prefilled management plans. Participating patients supported the use of the platform in general practice. They suggested that use of the platform demonstrates a high level of patient care and could increase patient confidence in health practitioners.

CONCLUSION

Study participants worked together to design a platform that is clear, simple, accurate and useful and that sits within any given general practice setting. The resulting FHT platform is currently being piloted in general practices and will continue to be refined based on user feedback.

Integration of absolute cardiovascular disease risk assessment into routine blood cholesterol testing at pathology services

BACKGROUND

Absolute cardiovascular disease (CVD) risk assessment is recommended for primary prevention of CVD, yet uptake in general practice is limited. Cholesterol requests at pathology services provide an opportunity to improve uptake by integrating absolute CVD risk assessment with this service.

OBJECTIVE

This study aimed to assess the feasibility of such an additional service.

METHODS

Two-hundred and ninety-nine patients (45-74 years) referred to pathology services for blood cholesterol had measurement of all variables required to determine absolute CVD risk according to Framingham calculator (blood pressure, age, sex, smoking and diabetes status via self-report). Data were recorded via computer-based application. The absolute risk score was communicated via the report sent to the referring medical practitioner as per usual practice. Evaluation questionnaires were completed immediately post visit and at 1-, 3- and 6-month follow-up via telephone (n = 262).

RESULTS

Absolute CVD risk reports were issued for 90% of patients. Most patients (95%) reported that the length of time for the pathology service assessment was acceptable, and 91% that the self-directed computer-based application was easy to use. Seventy-eight per cent reported a preference for pathology services to conduct absolute CVD risk assessment. Only 2% preferred a medical practitioner. Of follow-up patients, 202 (75%) had a consultation with a medical practitioner, during which, aspects of CVD risk prevention were discussed (cholesterol and blood pressure 74% and 69% of the time, respectively).

CONCLUSIONS

Measurement of absolute CVD risk in pathology services is feasible, highly acceptable among middle-to-older adults and may increase uptake of guideline-directed care in general practice.

Comparing a standard and tailored approach to scaling up an evidence-based intervention for antiretroviral therapy for people who inject drugs in Vietnam: study protocol for a cluster randomized hybrid type III trial

Background

People who inject drugs (PWID) bear a disproportionate burden of HIV infection and experience poor outcomes. A randomized trial demonstrated the efficacy of an integrated System Navigation and Psychosocial Counseling (SNaP) intervention in improving HIV outcomes, including antiretroviral therapy (ART) and medications for opioid use disorder (MOUD) uptake, viral suppression, and mortality. There is limited evidence about how to effectively scale such intervention. This protocol presents a hybrid type III effectiveness-implementation trial comparing two approaches for scaling-up SNaP. We will evaluate the effectiveness of SNaP implementation approaches as well as cost and the characteristics of HIV testing sites achieving successful or unsuccessful implementation of SNaP in Vietnam.

Methods

Design: In this cluster randomized controlled trial, two approaches to scaling-up SNaP for PWID in Vietnam will be compared. HIV testing sites (n = 42) were randomized 1:1 to the standard approach or the tailored approach. Intervention mapping was used to develop implementation strategies for both arms. The standard arm will receive a uniform package of these strategies, while implementation strategies for the tailored arm will be designed to address site-specific needs.

Participants: HIV-positive PWID participants (n = 6200) will be recruited for medical record assessment at baseline; of those, 1500 will be enrolled for detailed assessments at baseline, 12, and 24 months. Site directors and staff at each of the 42 HIV testing sites will complete surveys at baseline, 12, and 24 months.

Outcomes: Implementation outcomes (fidelity, penetration, acceptability) and effectiveness outcomes (ART, MOUD uptake, viral suppression) will be compared between the arms. To measure incremental costs, we will conduct an empirical costing study of each arm and the actual process of implementation from a societal perspective. Qualitative and quantitative site-level data will be used to explore key characteristics of HIV testing sites that successfully or unsuccessfully implement the intervention for each arm.

Discussion

Scaling up evidence-based interventions poses substantial challenges. The proposed trial contributes to the field of implementation science by applying a systematic approach to designing and tailoring implementation strategies, conducting a rigorous comparison of two promising implementation approaches, and assessing their incremental costs. Our study will provide critical guidance to Ministries of Health worldwide regarding the most effective, cost-efficient approach to SNaP implementation.

Trial registration

NCT03952520 on Clinialtrials.gov. Registered 16 May 2019.

A computer-guided quality improvement tool for primary health care: cost-effectiveness analysis based on TORPEDO trial data

OBJECTIVE

To assess the cost-effectiveness of a computer-guided quality improvement intervention for primary health care management of cardiovascular disease (CVD) in people at high risk.

DESIGN

Modelled cost-effectiveness analysis of the HealthTracker intervention and usual care for people with high CVD risk, based on TORPEDO trial data on prescribing patterns, changes in intermediate risk factors (low-density lipoprotein cholesterol, systolic blood pressure), and Framingham risk scores.

PARTICIPANTS

Hypothetical population of people with high CVD risk attending primary health care services in a New South Wales primary health network (PHN) of mean size.

INTERVENTION

HealthTracker, integrated into health care provider electronic health record systems, provides real time decision support, risk communication, a clinical audit tool, and a web portal for performance feedback.

MAIN OUTCOME MEASURES

Incremental cost-effectiveness ratios (ICERs): difference in costs of the intervention and usual care divided by number of CVD events averted with HealthTracker.

RESULTS

The estimated numbers of major CVD events over five years per 1000 patients at high CVD risk were lower in PHNs using HealthTracker, both for patients with prior CVD events (secondary prevention; 259 v 267 with usual care) and for those without prior events (primary prevention; 168 v 176). Medication costs were higher and hospitalisation costs lower with HealthTracker than with usual care for both primary and secondary prevention. The estimated ICER for one averted CVD event was $7406 for primary prevention and $17 988 for secondary prevention.

CONCLUSION

Modelled cost-effectiveness analyses provide information that can assist decisions about investing in health care quality improvement interventions. We estimate that HealthTracker could prevent major CVD events for less than $20 000 per event averted.

TRIAL REGISTRATION (TORPEDO)

Australian New Zealand Clinical Trials Registry, ACTRN 12611000478910.