Improving the normalization of complex interventions: part 1 - development of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT)

Using normalisation process theory (NPT) to explore implementation of the maternal perinatal death surveillance and response (MPDSR) policy in Uganda: a reflection

BACKGROUND

The implementation of the maternal perinatal death surveillance and response (MPDSR) policy is among the envisaged strategies to reduce the high global burden of maternal and perinatal mortality and morbidity. However, implementation of this policy across various contexts is inconsistent. Theoretically informed approaches to process evaluation can support assessment the implementation of policy interventions such as MPDSR, particularly in understanding what the actors involved actually do. In this article, we reflect on how the normalisation process theory (NPT) was used to explore implementation of the MPDSR policy in Uganda. NPT is a sociological theory concerned with the social organisation of the work (implementation) of making practices routine elements of everyday life (embedding) and of sustaining embedded practices in their social contexts (integration).

METHODS

This qualitative multiple case study conducted across eight districts in Uganda and among 10 health facilities (cases) representing four out of the seven levels of the Uganda health care system. NPT was utilised in several ways including informing the study design, structuring the data collection tools (semi-structured interview guides), providing an organising framework for analysis, interpreting and reporting of study findings as well as making recommendations. Study participants were purposely selected to reflect the range of actors involved in the policy implementation process. This included direct care providers located at each of the cases, the Ministry of Health and from agencies and professional associations. Data were collected using semi-structured, in-depth interviews and were inductively and deductively analysed using NPT constructs and subconstructs.

RESULTS AND CONCLUSION

NPT served useful for process evaluation, particularly in identifying factors that contribute to variations in policy implementation. Considering the NPT focus on the agency of people involved in implementation, additional efforts are required to understand how recipients of the policy intervention influence how the intervention becomes embedded within the various contexts.

Embedding the 'CoolCuddle' intervention for infants undergoing therapeutic hypothermia for hypoxic-ischaemic encephalopathy in NICU: an evaluation using normalisation process theory

OBJECTIVES

Newborn infants exposed to lack of oxygen and blood flow to the brain around birth may develop brain dysfunction (hypoxic-ischaemic encephalopathy-HIE). These infants undergo 72 hours of cooling therapy and most are not held by their parents in the UK. We examined the implementation of 'CoolCuddle', identifying factors that impact embedding of this complex intervention in neonatal intensive care units (NICUs) across England.

DESIGN

Process evaluation and qualitative study using a standard questionnaire and interviews. Normalisation Process Theory (NPT) core constructs were used to assess relevant issues to staff embedding 'CoolCuddle', to discern change over time and different settings. Qualitative interviews provided valuable contextual exploration of implementation.

SETTING AND PARTICIPANTS

Six tertiary NICUs in England. Thirty-seven families with a newborn baby undergoing cooling therapy for HIE were recruited from September 2022 to August 2023; 17 NICU staff Normalisation MeAsure Development (NoMADs) at six NICUs over 6 months were included; 14 neonatal/research nurses from three participating NICUs were interviewed.

INTERVENTION

The family-centred intervention 'CoolCuddle' was developed to enable parents to hold their infant during cooling, without affecting the cooling therapy or intensive care.

OUTCOME MEASURES

NoMAD questionnaires at three timepoints over 6 months and NPT informed qualitative interviews.

RESULTS

NoMAD questionnaires at baseline showed more variation between units, for intervention acceptability, than those at 3 and 6 months. Qualitative data highlighted that staff understood the benefits of CoolCuddle but were apprehensive due to perceived risks involved in moving cooling babies. A rigorous standard operating procedure was flexible enough to incorporate the use of local processes and equipment and provided the relevant procedural knowledge to deliver CoolCuddle safely.

CONCLUSIONS

The CoolCuddle intervention can be implemented safely under the supervision of standard neonatal teams as part of usual practice in diverse NICU settings in England. The importance of having a rigorous standard operating procedure, which can be adapted to support local settings, is highlighted.

TRIAL REGISTRATION NUMBER

ISRCTN10018542; Results: registered on 30 August 2022.

Recommendations for implementing digital alcohol interventions in primary care: lessons learned from a Norwegian feasibility study

Introduction

Excessive alcohol consumption is a leading global risk factor for ill-health and premature death. Digital alcohol interventions can be effective at reducing alcohol consumption, but their widespread adoption is lagging behind. This study aimed to identify factors promoting or inhibiting the implementation of a digital alcohol intervention in Norwegian primary care, by using Normalization Process Theory (NPT).

Methods

A mixed methods feasibility study combining quantitative and qualitative methods. A digital alcohol intervention called "Endre" was implemented across four GP practices in Stavanger and Oslo. Usage of the intervention was logged on the digital platform. General practitioners (GPs) reported their perceived uptake of the intervention via a web-based survey. The Normalization MeAsure Development (NoMAD) survey was used to measure support staff's perceived normalization of the intervention. Qualitative data were analyzed using the NPT framework, with quantitative data analyzed descriptively and using χ 2 and Wilcoxon signed-rank test for differences in current and future normalization.

Results

Thirty-seven GPs worked in the clinics and could recruit patients for the digital intervention. Thirty-six patients registered for the intervention. Nine patients dropped out early and 25 completed the intervention as intended. Low normalization scores at follow-up (n = 27) indicated that Endre did not become fully embedded in and across practices. Nonetheless, staff felt somewhat confident about their use of Endre and thought it may become a more integral part of their work in the future. Findings from six semi-structured group interviews suggested that limited implementation success may have been due to a lack of tailored implementation support, staff's lack of involvement, their diminished trust in Endre, and a lack of feedback on intervention usage. The outbreak of the Covid-19 pandemic further limited opportunities for GPs to use Endre.

Conclusion

This study investigated the real-world challenges of implementing a digital alcohol intervention in routine clinical practice. Future research should involve support staff in both the development and implementation of digital solutions to maximize compatibility with professional workflows and needs. Integration of digital solutions may further be improved by including features such as dashboards that enable clinicians to access and monitor patient progress and self-reported outcomes.

Implementation of the four habits model in intermediate care services in Norway: a process evaluation

BACKGROUND

Intermediate care (IC) services bridge the transition for older patients from the hospital to the home. Despite the goal of involving individuals in their recovery process, these services often become standardised, leading to communication breakdowns. While evidence-based practices, such as the Four Habits Model (4HM), for effective communication are crucial for enhancing high-quality healthcare, research suggests their integration into routine practice remains limited. In this study, we aimed to investigate the implementation process of the 4HM through a two-day course that engaged healthcare professionals and managers in IC.

METHODS

We conducted a process evaluation employing qualitative and quantitative methods: (i) individual interviews with three managers and two course participants pre-course, (ii) two focus group interviews with course participants (N = 11) and individual interviews with the same three managers post-course, and (iii) the NoMAD questionnaire (Normalisation MeAsure Development) administered four months later to assess the short- and long-term impact on course participants (N = 14). Reflexive thematic analyses were guided by Normalisation Process Theory (NPT), which offers insight into how new interventions become routine practices. The analysis of the NoMAD involved descriptive statistics.

RESULTS

We identified four themes in the qualitative data: (i) Decoding Interactions: Making Sense of the 4HM in IC services, (ii) Fostering Change: Legitimising 4HM Through Staff Engagement, (iii) Harmonising Practice: Integrating 4HM into Complex Situations, and (iv) Embedding Value: Normalising the 4HM into Everyday Work. These themes illustrate the normalisation process of the 4HM course within IC, establishing standard practices. Healthcare professionals and managers highlighted the urgent need to integrate communication skills based on the 4HM into daily care. They noted positive changes in their communication habits following the course. The consistent findings from the NoMAD questionnaire underscore the sustainability of implementing the 4HM programme, as participants continue to utilise it in their clinical practice beyond the initial four-month period.

CONCLUSION

The 4HM course programme was deemed feasible for expansion within IC services. Both managers and staff found its focus on addressing communication breakdowns and readiness for change sensible. The study findings may benefit the stakeholders involved in IC service routines, potentially improving services for older patients and relatives.

Implementing Montessori approaches after training: A mixed methods study to examine staff understanding and movement toward action

Background: This paper uses Normalization Process Theory (NPT) to examine staff impressions of Montessori-based program training and implementation at Veterans Affairs Community Living Centers (VA CLCs; nursing homes). Methods: We conducted a mixed-methods evaluation of Montessori Approaches to Person-Centered Care (MAP-VA) at eight VA CLCs. Trainings were conducted as either a live virtual course or a pre-recorded asynchronous class. Two NPT constructs, coherence building and cognitive participation, informed qualitative interview questions, surveys, and analyses focused on staff movement from knowledge to action during initial implementation. Data collection included staff-completed standardized post-training exams (N = 906), post-training evaluations (N = 761), and optional validated surveys on perceptions of Montessori training (N = 307). Champions (peer-leaders) from each CLC completed semi-structured qualitative interviews post-training (N = 22). Findings: The majority of staff (83%-90%) passed all courses. Staff evaluated the training highly (80%+ agreement) on learning relevant new knowledge and confidence applying new skills. On average, staff felt MAP-VA would become a normal part of their work (7.68/10 scale), and reported increased familiarity with Montessori approaches after training (p = .002). Qualitative interview data from staff trained in Montessori supported three themes concordant with the NPT dimensions of coherence building and cognitive participation. (1) Coherence regarding Montessori: staff demonstrated an understanding of the program and mentioned the benefits of Montessori compared to their previous usual routines. Cognitive participation or engagement with Montessori: (2) staff had positive feelings about Montessori principles/applications and demonstrated a willingness to try the Montessori approach, and (3) staff made sense of the new intervention through early rehearsal of Montessori principles/practices and recognized opportunities for using Montessori in future interactions. Conclusions: Montessori virtual training resulted in high levels of coherence and cognitive participation among multidisciplinary staff, evidenced by high knowledge, self-efficacy, and readiness to act. The asynchronous and synchronous trainings were accessible, relevant, and supported diverse learners.

A real-world longitudinal study implementing digital screening and treatment for distress in inflammatory bowel disease (IBD): The COMPASS-IBD study protocol

INTRODUCTION

Co-morbid anxiety and depression (distress) in inflammatory bowel disease (IBD) results in poorer outcomes and increased healthcare burden. IBD services require scalable treatment pathways for distress to meet this need. This real-world longitudinal study evaluates the implementation of a new integrated care pathway for distress including: 1) routine mental health screening and 2) therapist-guided, digital CBT tailored to the challenges of living with IBD (compass with adaptations for IBD: COMPASS-IBD) in a UK National Health Service (NHS) large gastroenterology service (∼ 5000 patients).

METHODS

We describe a mixed-methods, observational, real-world longitudinal study. Routine mental health screening in the IBD service will identify patients with distress (using pre-defined clinical cut-offs), who will be triaged to determine appropriate treatment pathways (including participation in the COMPASS-IBD study). Participants will receive COMPASS-IBD online for ∼12 weeks (including 6 × 30-min therapist sessions). Key implementation outcomes will assess reach and adoption of the new pathway using aggregate data on uptake of mental health screening, eligibility, and consent rates for COMPASS-IBD, and number of COMPASS-IBD sessions completed. Interviews with patients and healthcare providers will primarily assess acceptability of the new pathway. Potential effectiveness will be assessed using participant questionnaires at pre-intervention, 12-weeks (post-intervention), and 6-month follow-up. The primary effectiveness outcome will be pre-post changes in distress (PHQ-ADS scores). Quantitative data will be summarised using descriptive statistics and qualitative data analysed using reflexive thematic analysis.

CONCLUSION

Study findings will inform treatment pathways for co-morbid distress in IBD, and highlight adaptations required to increase future scalability and effectiveness.

TRIAL REGISTRATION NUMBER

NCT05330299 (clinicaltrials.gov).

A mixed methods evaluation of the breastfeeding memory aide CHINS

Breastfeeding rates remain persistently low in the United Kingdom (UK) despite wide-scale rollout of UNICEF Baby Friendly Initiative training and accreditation. More must be done to ensure breastfeeding practitioners can provide effective support. The memory aide CHINS (Close, Head free, In-line, Nose to Nipple and Sustainable) could help practitioners remember, recall, and apply breastfeeding theory in practice and this paper presents a UK evaluation of its impact. A concurrent, convergent mixed methods approach was adopted using Normalisation Process Theory (NPT) as an overarching framework. An online survey targeted breastfeeding practitioners and academics from the UK (n = 115). A sub-set (n = 16) of respondents took part in qualitative focus groups. Survey data was subjected to descriptive and inferential statistical analysis, and the focus group data was analysed, using NPT. CHINS is widely used in breastfeeding education and practice largely because of its simplicity and ease of integration in everyday practice, as well as its sustained inclusion in UNICEF Baby Friendly Initiative training. CHINS has introduced a standardised approach to the principles of positioning for effective breastfeeding. Doing so has helped address inconsistencies and poor practice in this area, and CHINS plays a role in assisting practitioners in building confidence in their breastfeeding practice. More needs to be done to ensure the breastfeeding workforce develop and maintain the requisite skills to promote and support breastfeeding, including the role of memory aides such as CHINS in achieving this.

Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C): development and psychometric evaluation of a measure of sustainability determinants in the early childhood education and care setting

BACKGROUND

There is a need for valid and reliable measures of determinants of sustainability of public health interventions in early childhood education and care (ECEC) settings. This study aimed to develop and evaluate the psychometric and pragmatic properties of such a measure - the Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C).

METHODS

We undertook a two-phase process guided by the COnsensus-based Standards for the selection of health status Measurement INstruments checklist (COSMIN) and Psychometric and Pragmatic Evidence Rating Scale (PAPERS). Phase 1 involved measure development; i.e., determining items and scales through an iterative process and assessment of face and content validity. Phase 2 involved the evaluation of psychometric and pragmatic properties. The 29-item measure completed by service executives (directors and nominated supervisors) was embedded in a larger survey from a national sample of Australian ECEC services assessing their implementation of nutrition and physical activity programs. Structural validity, concurrent validity, known groups validity, internal consistency, floor and ceiling effects, norms, and pragmatic qualities of the measure were assessed according to the PAPERS criteria.

RESULTS

The final measure contained 26 items, with respondents reporting how strongly they agreed or disagreed on a five-point Likert scale. Phase 1 assessments confirmed the relevance, and face and content validity of the scale. In Phase 2, we obtained 482 completed surveys, of which 84% (n = 405) completed the entire measure across 405 ECEC settings (one executive per service). Three of the four fit indices for the confirmatory factor analysis met the pre-specified criteria (SRMR = 0.056, CFI = 0.993, RMSEA = 0.067) indicating 'good' structural validity. The IMPRESS-C illustrated: 'good' internal consistency, with Cronbach's alpha values from 0.53 to 0.92; 'emerging' concurrent validity; 'poor' known groups validity; 'good' norms; and 'good' overall pragmatic qualities (cost, readability, length, and assessor burden).

CONCLUSIONS

The IMPRESS-C possesses strong psychometric and pragmatic qualities for assessing service executive-level perceptions of determinants influencing sustainment of public health interventions within ECEC settings. To achieve a full range of perspectives in this setting, future work should be directed to also develop and test measures of sustainability determinants at the implementer level (e.g., among individual educators and staff).

Telephone support vs. self-guidance in an Internet-based self-administered psychological program for the treatment of depression: Protocol for a hybrid type 1 effectiveness-implementation randomized controlled trial

Background

Depression is already the leading psychological disability around the world, impairing daily life, well-being, and social functioning and leading to personal and social costs. Despite the effectiveness of Evidence-Based Psychological Practices (EBPP), a significant percentage of depressive individuals remain untreated, especially in Primary Care (PC) settings in Spain. There are numerous barriers that limit access to EBPPs, including high costs, professional training, and adherence problems. Information and Communication Technologies (ICTs) offer a cost-effective way to disseminate and scale EBPPs to address these barriers. The iCBT program Smiling is Fun has been demonstrated to be a cost-effective treatment for depression in various Randomized Control Trials. However, adherence and implementation problems in real-world settings need to be addressed. Implementation research can help evaluate these challenges by identifying facilitators and barriers to the implementation process in PC. In this regard, including human support has been pointed out as a possible key factor in addressing the population's mental health needs and promoting treatment adherence.

Objective

The current study aims to examine the effectiveness, adherence rates, and implementation process of Smiling is Fun to address depression in a PC setting considering the influence of telephone support vs no support.

Methods

The proposed research is a Hybrid Effectiveness-Implementation Type I study, with a two-armed randomized controlled design, which will test a clinical intervention for major depressive disorder while gathering information on its implementation in a real-world setting. The study will include adult patients with mild to moderate symptoms of depression. Participants will be randomly assigned to one of two groups: self-applied psychotherapy or self-applied psychotherapy with psychotherapeutic telephone support. The trial will recruit 110 patient participants, with a loss-to-follow-up rate of 30 %.

Discussion

A study protocol for a hybrid effectiveness-implementation study is presented with the aim to assess the implementation of Smiling is Fun for the treatment of depression in PC. The study evaluates the influence of telephone support during a self-administered intervention compared to unguided self-administration. The main goal is to address the barriers and facilitators of the implementation process and to promote treatment adherence. Ultimately, the results of the study could help in the uptake of sustainable resources so that the population could gain better access to psychological interventions in mental health services.

Registration

ClinicalTrials.gov; NCT06230237.

Geriatric Assessment in CKD Care: An Implementation Study

Rationale & Objective

Older people with progressive chronic kidney disease (CKD) have complex health care needs. Geriatric evaluation preceding decision making for kidney replacement is recommended in guidelines, but implementation is lacking in routine care. We aimed to evaluate implementation of geriatric assessment in CKD care.

Study Design

Mixed methods implementation study.

Setting & Participants

Dutch nephrology centers were approached for implementation of geriatric assessment in patients aged ≥70 years and with an estimated glomerular filtration rate of ≤20 mL/min/1.73 m2.

Quality Improvement Activities/Exposure

We implemented a consensus-based nephrology-tailored geriatric assessment: a patient questionnaire and professionally administered test set comprising 16 instruments covering functional, cognitive, psychosocial, and somatic domains and patient-reported outcome measures.

Outcomes

We aimed for implementation in 10 centers and 200 patients. Implementation was evaluated by (i) perceived enablers and barriers of implementation, including integration in work routines (Normalization Measure Development Tool) and (ii) relevance of the instruments to routine care for the target population.

Analytical Approach

Variations in implementation practices were described based on field notes. The postimplementation survey among health care professionals was analyzed descriptively, using an explanatory qualitative approach for open-ended questions.

Results

Geriatric assessment was implemented in 10 centers among 191 patients. Survey respondents (n = 71, 88% response rate) identified determinants that facilitated implementation, ie, multidisciplinary collaboration (with geriatricians) -meetings and reports and execution of assessments by nurses. Barriers to implementation were patient illiteracy or language barrier, time constraints, and patient burden. Professionals considered geriatric assessment sufficiently integrated into work routines (mean, 6.7/10 ± 2.0 [SD]) but also subject to improvement. Likewise, the relevance of geriatric assessment for routine care was scored as 7.8/10 ± 1.2. The Clinical Frailty Score and Montreal Cognitive Assessment were perceived as the most relevant instruments.

Limitations

Selection bias of interventions' early adopters may limit generalizability.

Conclusions

Geriatric assessment could successfully be integrated in CKD care and was perceived relevant to health care professionals.

Systematic review of applications and properties of the NoMAD instrument for assessing implementation outcomes: Study protocol

Background

Implementation outcomes measures can be used to assess the implementation of complex health and social care interventions, but evidence for the use of these measures, and their psychometric properties, remains limited. The NoMAD ( Normalisation Me asure Development) survey, based on Normalisation Process Theory, was developed to assess, monitor, or measure factors likely to affect normalisation of a new practice from the perspective of participants who are engaged in an implementation process. Since publication in 2015, NoMAD has been translated into several languages and is increasingly being used in health and care research. This systematic review will identify, appraise, and synthesise the existing literature on the use of NoMAD as an implementation outcome measure, focusing on use and application across different studies and settings, and on its properties as a measurement tool.

Methods

We will systematically search the bibliographic databases Web of Science, Scopus and PubMed for articles reporting empirical data in peer-reviewed journals. A citation search will also be undertaken in Google Scholar for primary NoMAD publications. Studies will be eligible for inclusion if they: (a) specify using NoMAD as a method and report results from using it, and/or (b) report a translation and/or validation study of NoMAD's measurement properties. Screening of abstracts and full text articles will be done independently by two researchers. Data extraction will be structured to allow collection and descriptive synthesis of data on study characteristics, use of NoMAD, psychometric results, and authors' reflections and recommendations.

Conclusions

This review will provide the first synthesis of how NoMAD has been applied in health and care research, and evidence on its properties as an outcome measure since its publication. This will be used to update existing freely accessible guidance for researchers and other users, and disseminated through peer-reviewed publications, and engagement activities with researchers and practitioners.

Tailored implementation of national recommendations on fall prevention among older adults in municipalities in Norway (FALLPREVENT trial): a study protocol for a cluster-randomised trial

BACKGROUND

Despite substantial research evidence indicating the effectiveness of a range of interventions to prevent falls, uptake into routine clinical practice has been limited by several implementation challenges. The complexity of fall prevention in municipality health care underlines the importance of flexible implementation strategies tailored both to general determinants of fall prevention and to local contexts. This cluster-randomised trial (RCT) investigates the effectiveness of a tailored intervention to implement national recommendations on fall prevention among older home-dwelling adults compared to usual practice on adherence to the recommendations in health professionals.

METHODS

Twenty-five municipalities from four regions in Norway will be randomised to intervention or control arms. Each municipality cluster will recruit up to 30 health professionals to participate in the study as responders. The tailored implementation intervention comprises four components: (1) identifying local structures for implementation, (2) establishing a resource team from different professions and levels, (3) promoting knowledge on implementation and fall prevention and (4) supporting the implementation process. Each of these components includes several implementation activities. The Consolidated Framework for Implementation Research (CFIR) will be used to categorise determinants of the implementation process and the Expert Recommendations for Implementing Change (ERIC) will guide the matching of barriers to implementation strategies. The primary outcome measure for the study will be health professionals' adherence to the national recommendations on fall prevention measured by a questionnaire. Secondary outcomes include injurious falls, the feasibility of the intervention, the experiences of the implementation process and intervention costs. Measurements will be carried out at baseline in August 2023, post-intervention in May 2024 and at a follow-up in November 2024.

DISCUSSION

This study will provide evidence on the effectiveness, intervention costs and underlying processes of change of tailored implementation of evidence-based fall prevention recommendations.

TRIAL REGISTRATION

The trial is registered in the Open Science Registry: https://doi.org/10.17605/OSF.IO/JQ9T5 . Registered: March 03, 2023.

Attitudes to the Implementation of Speech and Language Therapist Led Low Risk Two Week Wait Clinic in the UK: A Survey Exploration Using Normalization Process Theory

OBJECTIVES

The aim of this study was to identify the factors which might shape the implementation of speech and language therapist led low risk 2 week wait clinic (SLTLR-2WW).

STUDY DESIGN

An online survey was designed, piloted, and disseminated through UK speech and language professional groups. The survey asked questions about, the skills of, and equipment available, to SLT respondents. Using a modified NoMAD instrument (based on Normalization Process Theory) the survey explored attitudes to the prospect of the development of the SLTLR-2WW clinical model in the UK. Responses were tallied and calculated as percentage of responses. The free text question responses were analyzed using a qualitative content approach, responses were coded and grouped into categories and mapped onto the Normalization Process Theory domains by the two authors.

RESULTS

There were 129 responses to the survey questions from SLTs from all regions of the UK and 72 respondents supplied free text comments for analysis.

CONCLUSIONS

The collected responses indicate there is enthusiasm for the potential development of SLTLR-2WW clinics. The survey demonstrates that there are disparities in terms of resource availability, departmental, management and clinical support, around the UK. There is limited but successful experience of SLTLR-2WW in the UK but the survey responses indicate there is potential for expanding the scope of practice for SLTs into the delivery of clinical care for patients referred as suspected cancer with hoarseness and swallowing issues. The responses to the NoMAD derived questions and free text analysis identify some factors which could impede the development of this new service model include, resistance, lack of training, supervision, and support from colleagues and management.

Psychometric properties of two implementation measures: Normalization MeAsure Development questionnaire (NoMAD) and organizational readiness for implementing change (ORIC)

Background

Effective interventions need to be implemented successfully to achieve impact. Two theory-based measures exist for measuring the effectiveness of implementation strategies and monitor implementation progress. The Normalization MeAsure Development questionnaire (NoMAD) explores the four core concepts (Coherence, Cognitive Participation, Collective Action, Reflexive Monitoring) of the Normalization Process Theory. The Organizational Readiness for Implementing Change (ORIC) is based on the theory of Organizational Readiness for Change, measuring organization members' psychological and behavioral preparedness for implementing a change. We examined the measurement properties of the NoMAD and ORIC in a multi-national implementation effectiveness study.

Method

Twelve mental health organizations in nine countries implemented Internet-based cognitive behavioral therapy (iCBT) for common mental disorders. Staff involved in iCBT service delivery (n = 318) participated in the study. Both measures were translated into eight languages using a standardized forward-backward translation procedure. Correlations between measures and subscales were estimated to examine convergent validity. The theoretical factor structures of the scales were tested using confirmatory factor analysis (CFA). Test-retest reliability was based on the correlation between scores at two time points 3 months apart. Internal consistency was assessed using Cronbach's alpha. Floor and ceiling effects were quantified using the proportion of zero and maximum scores.

Results

NoMAD and ORIC measure related but distinct latent constructs. The CFA showed that the use of a total score for each measure is appropriate. The theoretical subscales of the NoMAD had adequate internal consistency. The total scale had high internal consistency. The total ORIC scale and subscales demonstrated high internal consistency. Test-retest reliability was suboptimal for both measures and floor and ceiling effects were absent.

Conclusions

This study confirmed the psychometric properties of the NoMAD and ORIC in multi-national mental health care settings. While measuring on different but related aspects of implementation processes, the NoMAD and ORIC prove to be valid and reliable across different language settings.

"Diving in the deep-end and swimming": a mixed methods study using normalization process theory to evaluate a learning collaborative approach for the implementation of palliative care practices in hemodialysis centers

BACKGROUND

Normalization Process Theory (NPT) is an implementation theory that can be used to explain how and why implementation strategies work or not in particular circumstances. We used it to understand the mechanisms that lead to the adoption and routinization of palliative care within hemodialysis centers.

METHODS

We employed a longitudinal, mixed methods approach to comprehensively evaluate the implementation of palliative care practices among ten hemodialysis centers participating in an Institute for Healthcare Improvement Breakthrough- Series learning collaborative. Qualitative methods included longitudinal observations of collaborative activities, and interviews with implementers at the end of the study. We used an inductive and deductive approach to thematic analysis informed by NPT constructs (coherence, cognitive participation, collective action, reflexive monitoring) and implementation outcomes. The NoMAD survey, which measures NPT constructs, was completed by implementers at each hemodialysis center during early and late implementation.

RESULTS

The four mechanisms posited in NPT had a dynamic and layered relationship during the implementation process. Collaborative participants participated because they believed in the value and legitimacy of palliative care for patients receiving hemodialysis and thus had high levels of cognitive participation at the start. Didactic Learning Sessions were important for building practice coherence, and sense-making was solidified through testing new skills in practice and first-hand observation during coaching visits by an expert. Collective action was hampered by limited time among team members and practical issues such as arranging meetings with patients. Reflexive monitoring of the positive benefit to patient and family experiences was key in shifting mindsets from disease-centric towards a patient-centered model of care. NoMAD survey scores showed modest improvement over time, with collective action having the lowest scores.

CONCLUSIONS

NPT was a useful framework for understanding the implementation of palliative care practices within hemodialysis centers. We found a nonlinear relationship among the mechanisms which is reflected in our model of implementation of palliative care practices through a learning collaborative. These findings suggest that the implementation of complex practices such as palliative care may be more successful through iterative learning and practice opportunities as the mechanisms for change are layered and mutually reinforcing.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04125537 . Registered 14 October 2019 - Retrospectively registered.

Validation of the German Normalisation Process Theory Measure G-NoMAD: translation, adaptation, and pilot testing

BACKGROUND

Implementing evidence-based healthcare practices (EBPs) is a complex endeavour and often lags behind research-informed decision processes. Understanding and systematically improving implementation using implementation theory can help bridge the gap between research findings and practice. This study aims to translate, pilot, and validate a German version of the English NoMAD questionnaire (G-NoMAD), an instrument derived from the Normalisation Process Theory, to explore the implementation of EBPs.

METHODS

Survey data has been collected in four German research projects and subsequently combined into a validation data set. Two versions of the G-NoMAD existed, independently translated from the original English version by two research groups. A measurement invariance analysis was conducted, comparing latent scale structures between groups of respondents to both versions. After determining the baseline model, the questionnaire was tested for different degrees of invariance (configural, metric, scalar, and uniqueness) across samples. A confirmatory factor analysis for three models (a four-factor, a unidimensional, and a hierarchical model) was used to examine the theoretical structure of the G-NoMAD. Finally, psychometric results were discussed in a consensus meeting, and the final instructions, items, and scale format were consented to.

RESULTS

A total of 539 health care professionals completed the questionnaire. The results of the measurement invariance analysis showed configural, partial metric, and partial scalar invariance indicating that the questionnaire versions are comparable. Internal consistency ranged from acceptable to good (0.79 ≤ α ≤ 0.85) per subscale. Both the four factor and the hierarchical model achieved a better fit than the unidimensional model, with indices from acceptable (SRMR = 0.08) to good (CFI = 0.97; TLI = 0.96). However, the RMSEA values were only close to acceptable (four-factor model: χ2164 = 1029.84, RMSEA = 0.10; hierarchical model: χ2166 = 1073.43, RMSEA = 0.10).

CONCLUSIONS

The G-NoMAD provides a reliable and promising tool to measure the degree of normalisation among individuals involved in implementation activities. Since the fit was similar in the four-factor and the hierarchical model, priority should be given to the practical relevance of the hierarchical model, including a total score and four subscale scores. The findings of this study support the further usage of the G-NoMAD in German implementation settings.

TRIAL REGISTRATION

Both the AdAM project (No. NCT03430336, 06/02/2018) and the EU-project ImpleMentAll (No. NCT03652883, 29/08/2018) were registered on ClinicalTrials.gov. The ImplementIT study was registered at the German Clinical Trial Registration (No. DRKS00017078, 18/04/2019). The G-NoMAD validation study was registered at the Open Science Framework (No7u9ab, 17/04/2023).

Using normalisation process theory for intervention development, implementation and refinement in musculoskeletal and orthopaedic interventions: a qualitative systematic review

BACKGROUND

Normalisation process theory (NPT) provides researchers with a set of tools to support the understanding of the implementation, normalisation and sustainment of an intervention in practice. Previous reviews of published research have explored NPT's use in the implementation processes of healthcare interventions. However, its utility in intervention research, specifically in orthopaedic and musculoskeletal interventions, remains unclear. The aim of this review is to explore how NPT (including extended NPT, ENPT) has been used in orthopaedic/musculoskeletal intervention research.

METHODS

A qualitative systematic review was conducted. Two bibliographic databases (Scopus and Web of Science) and a search engine (Google Scholar) were searched for peer-reviewed journal articles citing key papers outlining the development of NPT, related methods, tools or the web-based toolkit. We included studies of any method, including protocols, and did not exclude based on published language. A data extraction tool was developed, and data were analysed using a framework approach.

RESULTS

Citation searches, of the 12 key studies, revealed 10,420 citations. Following duplicate removal, title, abstract and full-text screening, 14 papers from 12 studies were included. There were 8 key findings assessed against GRADE-CERQual (Confidence in Evidence from Reviews of Qualitative research). Five were of high confidence supporting NPT/ENPT's use in the implementation process for interventions targeting a range of MSK/orthopaedic conditions. NPT/ENPT offers a useful analytical lens to focus attention and consider implementation factors robustly. There is limited evidence for the selection of NPT/ENPT and for the use of the Normalisation Measure Development instrument. Three findings of moderate confidence suggest that coherence is seen as a fundamental initial step in implementation, there is limited evidence that study population limits NPT's utility and the application of ENPT may pose a challenge to researchers.

CONCLUSION

This review demonstrates NPT's utility in supporting intervention implementation for orthopaedic and musculoskeletal conditions. We have theorised the benefits ENPT offers to intervention development and refinement and recommend future researchers consider its use. We also encourage future researchers to offer clear justification for NPT's use in their methodology.

TRIAL REGISTRATION

The review protocol is registered with PROSPERO (CRD42022358558).

The National Coordinated Citrien eHealth Program to Scale Up Telemonitoring: Protocol for a Before-and-After Evaluation Study

BACKGROUND

Sustainable implementation of telemonitoring in health care is challenging, especially if one aims to scale up telemonitoring initiatives nationwide. The National collaborative eHealth program in the Netherlands is supporting the nationwide upscaling of telemonitoring in 3 clinical domains by implementing telemonitoring in all Dutch university medical centers (UMCs). The chosen telemonitoring concepts are (1) telemonitoring solutions in the domain of cardiology, (2) telemonitoring solutions providing care from a distance in obstetrics, and (3) telemonitoring solutions monitoring vital functions in hospital wards.

OBJECTIVE

The aim of this study is to evaluate the upscaling of telemonitoring in Dutch university hospitals in order to gain a better knowledge of the process, methods, and outcomes of nationwide upscaling strategies. Our hypothesis is that by the completion of the Citrien program's scale-up, telemonitoring will be operational in all UMCs but not normalized in routine care.

METHODS

A before-and-after study will be conducted to assess upscaling. The theoretical frameworks used are the framework for nonadoption, abandonment, scale-up, spread, and sustainability; the Normalization Process Theory; and a project management tool Project Canvas. The primary outcome of the study is the degree of normalization to which health care providers at UMCs consider telemonitoring a part of their routine practice, measured using the Normalization MeAsurement Development tool (NoMAD). Our secondary outcome is the uptake of telemonitoring at the Dutch UMCs, using management data from UMCs' business intelligence systems query.

RESULTS

Data will be collected between May 2020 and December 2022. Results were retrieved in June 2023. UMCs' business intelligence systems are queried for data for the secondary outcome measures. There is a risk that the UMCs will not be able to provide this management information. The laws and regulations governing telemonitoring in the Netherlands are changing, with the Electronic Data Exchange in Health Care Act (Wet elektronische gegevensuitwisseling in de zorg) and the European Health Data Space Act expected to positively influence implementation and upscaling.

CONCLUSIONS

The Citrien program is a nationally coordinated change management program that is scaling up telemonitoring across contexts and settings. This study will produce original data on the uptake and upscaling of telemonitoring at Dutch UMCs. Future initiatives to implement eHealth in the health care sector may be guided by the wide range of success factors, obstacles, and experiences collected through this program. The network itself may be of great value impacting future acceleration of eHealth initiatives.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/45201.

Implementing shared decision making for early-stage breast cancer treatment using a coproduction learning collaborative: the SHAIR Collaborative protocol

BACKGROUND

Shared decision making (SDM) in breast cancer care improves outcomes, but it is not routinely implemented. Results from the What Matters Most trial demonstrated that early-stage breast cancer surgery conversation aids, when used by surgeons after brief training, improved SDM and patient-reported outcomes. Trial surgeons and patients both encouraged using the conversation aids in routine care. We will develop and evaluate an online learning collaborative, called the SHared decision making Adoption Implementation Resource (SHAIR) Collaborative, to promote early-stage breast cancer surgery SDM by implementing the conversation aids into routine preoperative care. Learning collaboratives are known to be effective for quality improvement in clinical care, but no breast cancer learning collaborative currently exists. Our specific aims are to (1) provide the SHAIR Collaborative resources to clinical sites to use with eligible patients, (2) examine the relationship between the use of the SHAIR Collaborative resources and patient reach, and (3) promote the emergence of a sustained learning collaborative in this clinical field, building on a partnership with the American Society of Breast Surgeons (ASBrS).

METHODS

We will conduct a two-phased implementation project: phase 1 pilot at five sites and phase 2 scale up at up to an additional 32 clinical sites across North America. The SHAIR Collaborative online platform will offer free access to conversation aids, training videos, electronic health record and patient portal integration guidance, a feedback dashboard, webinars, support center, and forum. We will use RE-AIM for data collection and evaluation. Our primary outcome is patient reach. Secondary data will include (1) patient-reported data from an optional, anonymous online survey, (2) number of active sites and interviews with site champions, (3) Normalization MeAsure Development questionnaire data from phase 1 sites, adaptations data utilizing the Framework for Reporting Adaptations and Modifications-Extended/-Implementation Strategies, and tracking implementation facilitating factors, and (4) progress on sustainability strategy and plans with ASBrS.

DISCUSSION

The SHAIR Collaborative will reach early-stage breast cancer patients across North America, evaluate patient-reported outcomes, engage up to 37 active sites, and potentially inform engagement factors affecting implementation success and may be sustained by ASBrS.

Upscaling telemonitoring in Dutch University Medical Centres: A baseline measurement

INTRODUCTION AND OBJECTIVE

The Dutch university medical centres (UMC's) are on the forefront when it comes to validation, implementation and research of telemonitoring. To aid the UMC's in their effort, the Dutch Government has supported the UMC's by fostering the 'Citrien eHealth program'. This program aims at nationwide implementation and upscaling of telemonitoring via a collaborative network. To quantify the success of this program, this study aims to provide insights into the current adoption of telemonitoring by health care professionals (HCP) within Dutch UMC's.

METHODS

Based on the evaluation framework as adapted from the Normalization Process Theory (NPT) a cross-sectional study was conducted in all Dutch UMC's. Thirty healthcare professionals (HCPs) per UMC were invited to complete the 23-item Normalization MeAsure Development (NoMAD) questionnaire, a tool to assess the degree of normalisation of telemonitoring.

RESULTS

The over-all response rate was 52.4% (124/240). Over 80% of respondents agreed or strongly agreed that they understand how telemonitoring affects the nature of their work, with a mean score of 1.49 (N = 117, SD 0.74). HCPs reported to believe telemonitoring will become a normal part of their work in the near future (N = 124, mean = 8.67, SD = 1.38). Using the Wilcoxon signed-rank test, the difference between current practise and future use of telemonitoring predicts to be statistically significant (Z =  - 7.505, p ≤ 0.001). Mean scores for appropriate training and sufficient resources are relatively low (2.39 and 2.70 respectively), indicating a barrier for collective action.

CONCLUSION

This is the first study to assess the implementation of telemonitoring as standard practise across Dutch UMCs. The HCPs in this study are the frontrunners, believing that telemonitoring will become standard practise in the future despite the fact that it is currently not. Based on the results of this study, both educational and implementation strategies including practical skills training are highly recommended in order to scale up telemonitoring widely.

Healthcare professionals' views on implementing the STAR care pathway for people with chronic pain after total knee replacement: A qualitative study

For many people with advanced osteoarthritis, total knee replacement is an effective treatment to relieve pain and improve function. However, 10-34% of people experience chronic postsurgical pain in the months and years after total knee replacement. The Support and Treatment After Replacement (STAR) randomised controlled trial (ISCRTN92545361) evaluated the clinical- and cost-effectiveness of a new multifaceted and personalised care pathway, compared with usual care, for people with pain at three months after total knee replacement. Our objective was to identify factors promoting or inhibiting its implementation, and to inform future training and wider implementation of the pathway. We conducted a prospective process evaluation using qualitative interviews with eight Extended Scope Practitioners and six Principal Investigators from seven trial sites who were involved in delivering the STAR care pathway during the trial. We used Normalization Process Theory as a theoretical framework for qualitative data collection and content analysis. We identified that factors promoting the implementation of the pathway were quick familiarisation with the pathway, valuing patient-centredness, formalising referral processes, and increasing confidence to address neuropathic pain. Challenges to implementation were availability of time and resources, sensitivity in referral process, and ensuring collective understanding of the pathway. These findings have enabled us to make recommendations about the future implementation of the STAR care pathway and will inform the development of a training package, and updated manual for successful delivery in usual care. Furthermore, this model of care has potential value in diverse elective surgeries and pain conditions.

PROMs and PREMs in routine perinatal care: mixed methods evaluation of their implementation into integrated obstetric care networks

BACKGROUND

In the transition towards value-based healthcare, patient-reported outcome and experience measures (PROM and PREM) are recommended by international collaborations and government programs to guide clinical practice and quality improvement. For many conditions, using PROM/PREM over the complete continuum of care requires implementation across care organizations and disciplines. Along PROM/PREM implementation in obstetric care networks (OCN), we aimed to evaluate implementation outcomes and the processes influencing these outcomes in the complex context of care networks across the continuum of perinatal care.

METHODS

Three OCN in the Netherlands implemented PROM/PREM in routine practice, using an internationally developed outcomes set with care professionals and patient advocates. Their aim was to use PROM/PREM results individually to guide patient-specific care decisions and at group-level to improve quality of care. The implementation process was designed following the principles of action research: iteratively planning implementation, action, data generation and reflection to refine subsequent actions, involving both researchers and care professionals. During the one-year implementation period in each OCN, implementation outcomes and processes were evaluated in this mixed-methods study. Data generation (including observation, surveys and focus groups) and analysis were guided by two theoretical implementation frameworks: the Normalization Process Theory and Proctor's taxonomy for implementation outcomes. Qualitative findings were supplemented with survey data to solidify findings in a broader group of care professionals.

RESULTS

Care professionals in OCN found the use of PROM/PREM acceptable and appropriate, recognized their benefits and felt facilitated in their patient-centered goals and vision. However, feasibility for daily practice was low, mainly due to IT issues and time constraints. Hence PROM/PREM implementation did not sustain, but strategies for future PROM/PREM implementation were formulated in all OCN. Processes contributing positively to implementation outcomes were internalization (understand the value) and initiation (driven by key-participants), whereas challenges in relational integration (maintain confidence) and reconfiguration (refine activities) affected implementation negatively.

CONCLUSION

Although implementation did not sustain, network-broad PROM/PREM use in clinic and quality improvement matched professionals' motivation. This study provides recommendations to implement PROM/PREM meaningfully in practice in ways that support professionals in their drive towards patient-centered care. In order for PROM/PREM to fulfill their potential for value-based healthcare, our work highlights the need for sustainable IT infrastructures, as well as an iterative approach to refine their complex implementation into local contexts.

Effectiveness of Self-guided Tailored Implementation Strategies in Integrating and Embedding Internet-Based Cognitive Behavioral Therapy in Routine Mental Health Care: Results of a Multicenter Stepped-Wedge Cluster Randomized Trial

BACKGROUND

Internet-based cognitive behavioral therapy (iCBT) services for common mental health disorders have been found to be effective. There is a need for strategies that improve implementation in routine practice. One-size-fits-all strategies are likely to be ineffective. Tailored implementation is considered as a promising approach. The self-guided integrated theory-based Framework for intervention tailoring strategies toolkit (ItFits-toolkit) supports local implementers in developing tailored implementation strategies. Tailoring involves identifying local barriers; matching selected barriers to implementation strategies; developing an actionable work plan; and applying, monitoring, and adapting where necessary.

OBJECTIVE

This study aimed to compare the effectiveness of the ItFits-toolkit with implementation-as-usual (IAU) in implementing iCBT services in 12 routine mental health care organizations in 9 countries in Europe and Australia.

METHODS

A stepped-wedge cluster randomized trial design with repeated measures was applied. The trial period lasted 30 months. The primary outcome was the normalization of iCBT delivery by service providers (therapists, referrers, IT developers, and administrators), which was measured with the Normalization Measure Development as a proxy for implementation success. A 3-level linear mixed-effects modeling was applied to estimate the effects. iCBT service uptake (referral and treatment completion rates) and implementation effort (hours) were used as secondary outcomes. The perceived satisfaction (Client Satisfaction Questionnaire), usability (System Usability Scale), and impact of the ItFits-toolkit by implementers were used to assess the acceptability of the ItFits-toolkit.

RESULTS

In total, 456 mental health service providers were included in this study. Compared with IAU, the ItFits-toolkit had a small positive statistically significant effect on normalization levels in service providers (mean 0.09, SD 0.04; P=.02; Cohen d=0.12). The uptake of iCBT by patients was similar to that of IAU. Implementers did not spend more time on implementation work when using the ItFits-toolkit and generally regarded the ItFits-toolkit as usable and were satisfied with it.

CONCLUSIONS

The ItFits-toolkit performed better than the usual implementation activities in implementing iCBT services in routine practice. There is practical utility in the ItFits-toolkit for supporting implementers in developing and applying effective tailored implementation strategies. However, the effect on normalization levels among mental health service providers was small. These findings warrant modesty regarding the effectiveness of self-guided tailored implementation of iCBT services in routine practice.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03652883; https://clinicaltrials.gov/ct2/show/NCT03652883.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s13063-020-04686-4.

Protocol for a hybrid II study exploring the feasibility of delivering, evaluating, and implementing a self-management programme for people with neuromuscular diseases at a specialist neuromuscular centre

BACKGROUND

Self-management support (SMS) forms a central pillar in the management of long-term conditions. It is firmly aligned with UK health policy but there is a paucity of evidence exploring how it is enacted in the context of neuromuscular diseases (NMDs). Bridges is a SMS programme originally developed in stroke. A new version of the programme (Neuromuscular Bridges) has recently been co-designed with people with lived experience of NMD and requires evaluation. The implementation of SMS is inherently complex with potential barriers at the level of the patient, provider, and wider organisation. The success of implementing programmes can be highly dependent on context, indicating a rationale for considering implementation determinants at an early stage. This study aims to explore the feasibility of (1) delivering, (2) evaluating, and (3) implementing Neuromuscular Bridges at a specialist neuromuscular centre.

METHODS

This study employs a hybrid II design underpinned by Normalisation Process Theory (NPT), which has been used prospectively to inform the implementation plan and will also inform the analysis. The feasibility of delivering, evaluating, and implementing Neuromuscular Bridges will be assessed using a single-arm pre-post design. In terms of delivery and evaluation, we will explore acceptability, demand within the service, performance of outcome measures, recruitment, and retention. Implementation strategies have been selected from a refined taxonomy of strategies, mapped to NPT, and targeted at known barriers and facilitators at the specialist centre that were identified from preliminary stakeholder engagement activities. The impact of the strategy bundle on fidelity, acceptability, appropriateness, and adoption will be evaluated using qualitative interviews, administrative data, surveys, and a notes audit.

CONCLUSIONS

This this study will provide valuable feasibility data on a co-designed SMS programme for people with NMDs that will be used to inform a larger implementation study, requirements for embedding it in a specialist centre, and rollout to other specialist centres. Using hybrid methodology at the feasibility stage is unusual and this study will provide important insights into the usefulness of taking this approach at this point in the research pipeline.

TRIAL REGISTRATION

ISRCTN Trial ID: ISRCTN14208138 . Date registered: 18/08/2021.

Implementation and evaluation of crowdsourcing in global health education

BACKGROUND

Current global health course is most set as elective course taught in traditional teacher-taught model with low credit and short term. Innovate teaching models are required. Crowdsourcing characterized by high flexibility and strong application-orientation holds its potential to enhance global health education. We applied crowdsourcing to global health teaching for undergraduates, aiming to develop and evaluate a new teaching model for global health education.

METHODS

Crowdsourcing was implemented into traditional course-based teaching via introducing five COVID-19 related global health debates. Undergraduate students majoring in preventative medicine and nursing grouped in teams of 5-8, were asked to resolve these debates in reference to main content of the course and with manner they thought most effective to deliver the messages. Students' experience and teaching effect, were evaluated by questionnaires and teachers' ratings, respectively. McNemar's test was used to compare the difference in students' experience before and after the course, and regression models were used to explore the influencing factors of the teaching effect.

RESULTS

A total of 172 undergraduates were included, of which 122 (71%) were females. Students' evaluation of the new teaching model improved after the course, but were polarized. Students' self-reported teaching effect averaged 67.53 ± 16.8 and the teachers' rating score averaged 90.84 ± 4.9. Students majoring in preventive medicine, participated in student union, spent more time on revision, and had positive feedback on the new teaching model tended to perform better.

CONCLUSION

We innovatively implemented crowdsourcing into global health teaching, and found this new teaching model was positively received by undergraduate students with improved teaching effects. More studies are needed to optimize the implementation of crowdsourcing alike new methods into global health education, to enrich global health teaching models.

Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review

BACKGROUND

Sustainability is concerned with the long-term delivery and subsequent benefits of evidence-based interventions. To further this field, we require a strong understanding and thus measurement of sustainability and what impacts sustainability (i.e., sustainability determinants). This systematic review aimed to evaluate the quality and empirical application of measures of sustainability and sustainability determinants for use in clinical, public health, and community settings.

METHODS

Seven electronic databases, reference lists of relevant reviews, online repositories of implementation measures, and the grey literature were searched. Publications were included if they reported on the development, psychometric evaluation, or empirical use of a multi-item, quantitative measure of sustainability, or sustainability determinants. Eligibility was not restricted by language or date. Eligibility screening and data extraction were conducted independently by two members of the research team. Content coverage of each measure was assessed by mapping measure items to relevant constructs of sustainability and sustainability determinants. The pragmatic and psychometric properties of included measures was assessed using the Psychometric and Pragmatic Evidence Rating Scale (PAPERS). The empirical use of each measure was descriptively analyzed.

RESULTS

A total of 32,782 articles were screened from the database search, of which 37 were eligible. An additional 186 publications were identified from the grey literature search. The 223 included articles represented 28 individual measures, of which two assessed sustainability as an outcome, 25 covered sustainability determinants and one explicitly assessed both. The psychometric and pragmatic quality was variable, with PAPERS scores ranging from 14 to 35, out of a possible 56 points. The Provider Report of Sustainment Scale had the highest PAPERS score and measured sustainability as an outcome. The School-wide Universal Behaviour Sustainability Index-School Teams had the highest PAPERS score (score=29) of the measure of sustainability determinants.

CONCLUSIONS

This review can be used to guide selection of the most psychometrically robust, pragmatic, and relevant measure of sustainability and sustainability determinants. It also highlights that future research is needed to improve the psychometric and pragmatic quality of current measures in this field.

TRIAL REGISTRATION

This review was prospectively registered with Research Registry (reviewregistry1097), March 2021.

State-wide implementation of patient-reported outcome measures (PROMs) in specialized outpatient palliative care teams (ELSAH): A mixed-methods evaluation and implications for their sustainable use

BACKGROUND

Such patient-reported outcome measures (PROMs) and patient-centered outcome measures as the Integrated Palliative Care Outcome Scale (IPOS), Phase of Illness, and IPOS Views on Care (IPOS VoC), facilitate patient-centered care and help improve quality. To ensure sustainability, implementation and usage should be adapted according to setting. When settings involve several distinct teams that differ in terms of views and working practices, it is more difficult to integrate outcome measures into daily care. The ELSAH study aimed to learn how health professionals working in specialized outpatient palliative care (SOPC) viewed the use of these outcome measures in daily care, and what they express is needed for successful sustainable, state-wide application.

METHODS

We used a parallel mixed-methods design involving three focus groups (n = 14) and an online-survey based on normalization process theory (n = 76). Most participants were nurses and physicians from 19 SOPC-teams in Hesse, Germany. We used a triangulation protocol including convergence coding matrices to triangulate findings.

RESULTS

The majority of health professionals were able to integrate the outcome measures into their working lives and said that it had become a normal part of their day-to-day work. To ensure their sustainable integration into daily care, the motivation and concerns of health professionals should be taken into consideration. Health professionals must clearly recognize how the measures help improve daily care and quality evaluation.

CONCLUSIONS

To implement the outcome measures in a number of teams, it will be necessary to take individual team characteristics into account, because they influence motivation and concerncs. Further, it will be necessary to offer opportunities for them to engage in peer support and share information with other teams. The sustainable use of outcome measures in SOPC will require continuous support within each team as well as across teams. When several distinct teams are working in the same setting, a cross-team coordination unit can help to coordinate their work efficiently.

TRIAL REGISTRATION

German Clinical Trials Register DRKS-ID: DRKS00012421; www.germanctr.de/DRKS00012421.

Using Normalization Process Theory to Evaluate an End-of-Life Pediatric Palliative Care Web-Based Training Program for Nurses: Protocol for a Randomized Controlled Trial

BACKGROUND

Palliative care (PC) is a new concept in Iraq, and there is no training for health care specialists or the public. The lack of education and training programs is the most important barrier for PC. Intermediate training is needed for nurses who regularly manage patients with life-threatening diseases. The End-of-Life Nursing Education Consortium for pediatric palliative care (PPC) program is intended for nurses who are interested in providing care to children with life-limiting diseases or providing support in the event of an accident or unexpected death.

OBJECTIVE

Our trial aims to evaluate the effect of a web-based training course, using the Normalization Process Theory. It focuses on how complex interventions become routinely embedded in practice and on training of a sample of academic nurses in the application of PPC in routine daily practice. It hypothesizes that nurses will be able to provide PC for the pediatric population after completing the training.

METHODS

This is a multicenter, parallel, pragmatic trial in 5 health care settings spread across a single city in Babylon Province, Iraq. Participants will be recruited and stratified into 2 categories (critical care units and noncritical care units). In the experimental condition, 86 nurses will be trained in the application of PPC for 2 weeks through a web-based training course powered by the Relais Platform. The nurses will be invited to participate via email or instant messaging (WhatsApp, Telegram, or Viber). They will provide end-of-life care in addition to usual care to children and adolescents with life-limiting conditions. In the control condition, 86 nurses will continue usual care. The program's effectiveness will be assessed at the level of nurses only. We will compare baseline findings (before the intervention) with postintervention findings (after completing the training course). A further assessment will be performed 3 months after the course. As numerous unidentified factors can influence the effect of the training, we will perform a progressive evaluation to assess sample selection, application, and intervention value, as well as implementation difficulties. The nursing staff will not be blinded to the intervention, but will be blinded to the results.

RESULTS

The study trial recruitment opened in July 2020. The first outcomes became available in December 2020.

CONCLUSIONS

The trial attempts to clarify the delivery of PC at the end of life through the implementation of a web-based training course among Iraqi nurses in the pediatric field. The study strengths include the usual practice setting, staff training, readiness of staff to participate in the study, and random allocation to the intervention. However, participants may drop out after being transferred to another department during the study period.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04461561; https://clinicaltrials.gov/ct2/show/NCT04461561.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/23783.

Validity and reliability of the Chinese version of the Normalization MeAsure Development(NoMAD)

Background

The Normalization MeAsure Development (NoMAD) is a brief quantitative tool based on the Normalization Process Theory (NPT), which can measure the implementation process of new technologies and complex interventions. The aim of our study was to translate and culturally adapt the NoMAD into Chinese, and to evaluate the psychometric properties of the Chinese version of NoMAD.

Methods

According to the NoMAD translation guideline, we undertook forward translation, backward translation, and compared these translations to get a satisfactory result, then we performed cognitive interviews to achieve cross-culture adaptation. And the psychometric properties of the final version were evaluated among clinical nurses who used the pressure injuries management system via WeChat mini-program at a tertiary hospital in northwestern China.

Results

A total of 258 nurses were enrolled in our study, and the response rate was 92.1%. The Cronbach’s alpha of four dimensions were as follow: Coherence (0.768), Cognitive Participation (0.904), Collective Action (0.820), and Reflexive Monitoring (0.808). The overall internal consistency was 0.941. The confirmatory factor analysis results showed a good fit for its theoretical structure (CFI = 0.924, TLI = 0.910, RMSEA = 0.0079, SRMSR = 0.046, χ2/df = 2.61). The item-level content validity index ranged from 0.857 to 1, and the scale-level content validity index was 0.95. There were positive correlations between four constructs scores and three general normalization scores.

Conclusions

The Chinese version of NoMAD is a reliable and valid tool to evaluate the implementation process of innovations.

Implementation of a psychological online intervention for low to moderate depression in primary care: study protocol

BACKGROUND

Depression affects millions of people all over the world and implies a great socioeconomic burden. Despite there are different effective evidence-based interventions for treating depression, only a small proportion of these patients receives an appropriate treatment. In this regard, information and communication technologies (ICTs) can be used with therapeutic aims and this can contribute to make interventions more accessible. One example is "Smiling is fun", an internet-based treatment which has proved to be effective and cost-effective for treating depression in Spanish Primary Care (PC). However, the "know-do gap" between research and clinical settings implies that the actual implementation of such interventions could last up to 20 years. To overcome this obstacle, the implementation research establishes the methodology to implement the advances developed in the laboratories to the health care services maintaining the validity of the intervention and offering specific strategies for the implementation process.

OBJECTIVE

This is the protocol of an implementation study for the Internet-based program "Smiling is fun", which will be conducted on patients with mild-to-moderate depression of Spanish PC settings. In the implementation study, the feasibility, efficacy, cost-efficacy, acceptability, adoption, appropriateness, fidelity, penetration, normalization, and sustainability will be assessed.

METHODS

The current investigation is a Hybrid Effectiveness-Implementation Type II design. A Stepped Wedge randomized controlled trial design will be used, with a cohort of 420 adults diagnosed with depression (mild-to-moderate) who will undergo a first control phase (no treatment) followed by the intervention, which will last 16 weeks, and finishing with an optional use of the intervention. All patients will be assessed at baseline, during the treatment, and at post-treatment. The study will be conducted in three Spanish regions: Andalusia, Aragon, and the Balearic Islands. Two primary care centers of each region will participate, one located in the urban setting and the other in the rural setting. The primary outcome will be implementation success of the intervention assessing the reach, clinical effect, acceptability, appropriateness, adoption, feasibility, fidelity, penetration, implementation costs and sustainability services.

DISCUSSION

"Smiling is Fun", which has already been established as effective and cost-effective, will be adapted according to users' experiences and opinions, and the efficacy and cost-efficacy of the program will again be assessed. The study will point out barriers and facilitators to consider in the implementation process of internet-based psychological interventions in health services. The ultimate goal is to break the research-to-practice split, which would undoubtedly contribute to reduce the high burden of depression in our society.

TRIAL REGISTRATION

ClinicalTrials.gov, Identifier: NCT05294614.

What GPs do to meet accreditation standards - implementation activities and perceived improvements attributed to general practice accreditation

BACKGROUND

Healthcare accreditation is a widely implemented tool used to enhance the quality of care and underpin quality control. However, research is sparse on the accreditation process in general practice. The aim of this study was to explore how team-based implementation activities preceding accreditation were associated with self-perceived improvements in emergency preparedness (preparedness for urgent disease and cardiac arrest) and handling of prescription renewals in Danish general practice.

METHODS

GPs (general practitioners) completed a questionnaire exploring practice-team activities conducted to implement two specific accreditation standards and the related improvements as perceived by the GPs. The following implementation activities were selected, inspired by Normalization Process Theory: Common understanding (obtaining a common understanding of the purpose of implementing changes according to the accreditation standard), key person (assigning a key person responsible for working with the standard), and easy integration (finding it easy to integrate changes into existing working procedures). Data were analysed with logistic regression, and adjusted analyses included practice type, number of GP partners, number of staff, training site for junior GPs and administrative region.

RESULTS

The total response rate was 74% (n = 920). Around 80% of the clinics reported having conducted team-based implementation activities. Almost half of the clinics (48%) reported perceived improvements in the emergency preparedness, and 30% reported perceived improvements in the handling of prescription renewals. Obtaining a common understanding was found to have a strong, significant association with perceived improvements in the emergency preparedness (OR = 5.07 (3.06-8.40)) and handling of prescription renewals (OR = 3.66 (2.07-6.46)). Easy integration of changes was also significantly associated with improvements in both emergency preparedness (OR = 1.88 (1.24-2.85)) and handling of prescription renewals (OR = 2.34 (1.44-3.79)), whereas assigning a key person was only significantly associated with improved emergency preparedness (OR = 1.95 (1.19-3.19)).

CONCLUSION

Clinical quality initiatives that involve collaboration within a practice team are more likely to cause improvements if specific team-based implementation activities are conducted. It is particularly important to facilitate a common understanding of the purpose of the initiative. Therefore, external support for quality initiatives aiming at the practice level in general practice should facilitate such team-based activities.

Patient-Reported Outcome Dashboards Within the Electronic Health Record to Support Shared Decision-making: Protocol for Co-design and Clinical Evaluation With Patients With Advanced Cancer and Chronic Kidney Disease

BACKGROUND

Patient-reported outcomes-symptoms, treatment side effects, and health-related quality of life-are important to consider in chronic illness care. The increasing availability of health IT to collect patient-reported outcomes and integrate results within the electronic health record provides an unprecedented opportunity to support patients' symptom monitoring, shared decision-making, and effective use of the health care system.

OBJECTIVE

The objectives of this study are to co-design a dashboard that displays patient-reported outcomes along with other clinical data (eg, laboratory tests, medications, and appointments) within an electronic health record and conduct a longitudinal demonstration trial to evaluate whether the dashboard is associated with improved shared decision-making and disease management outcomes.

METHODS

Co-design teams comprising study investigators, patients with advanced cancer or chronic kidney disease, their care partners, and their clinicians will collaborate to develop the dashboard. Investigators will work with clinic staff to implement the co-designed dashboard for clinical testing during a demonstration trial. The primary outcome of the demonstration trial is whether the quality of shared decision-making increases from baseline to the 3-month follow-up. Secondary outcomes include longitudinal changes in satisfaction with care, self-efficacy in managing treatments and symptoms, health-related quality of life, and use of costly and potentially avoidable health care services. Implementation outcomes (ie, fidelity, appropriateness, acceptability, feasibility, reach, adoption, and sustainability) during the co-design process and demonstration trial will also be collected and summarized.

RESULTS

The dashboard co-design process was completed in May 2020, and data collection for the demonstration trial is anticipated to be completed by the end of July 2022. The results will be disseminated in at least one manuscript per study objective.

CONCLUSIONS

This protocol combines stakeholder engagement, health care coproduction frameworks, and health IT to develop a clinically feasible model of person-centered care delivery. The results will inform our current understanding of how best to integrate patient-reported outcome measures into clinical workflows to improve outcomes and reduce the burden of chronic disease on patients and health care systems.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/38461.

Strategies for enhancing the implementation of school-based policies or practices targeting diet, physical activity, obesity, tobacco or alcohol use

BACKGROUND

Several school-based interventions are effective in improving child diet and physical activity, and preventing excessive weight gain, and tobacco or harmful alcohol use. However, schools are frequently unsuccessful in implementing such evidence-based interventions.

OBJECTIVES

1. To evaluate the benefits and harms of strategies aiming to improve school implementation of interventions to address student diet, physical activity, tobacco or alcohol use, and obesity. 2. To evaluate the benefits and harms of strategies to improve intervention implementation on measures of student diet, physical activity, obesity, tobacco use or alcohol use; describe their cost or cost-effectiveness; and any harms of strategies on schools, school staff or students.

SEARCH METHODS

We used standard, extensive Cochrane search methods. The latest search was between 1 September 2016 and 30 April 2021 to identify any relevant trials published since the last published review.

SELECTION CRITERIA

We defined 'Implementation' as the use of strategies to adopt and integrate evidence-based health interventions and to change practice patterns within specific settings. We included any trial (randomised controlled trial (RCT) or non-randomised controlled trial (non-RCT)) conducted at any scale, with a parallel control group that compared a strategy to implement policies or practices to address diet, physical activity, overweight or obesity, tobacco or alcohol use by students to 'no intervention', 'usual' practice or a different implementation strategy.

DATA COLLECTION AND ANALYSIS

We used standard Cochrane methods. Given the large number of outcomes reported, we selected and included the effects of a single outcome measure for each trial for the primary (implementation) and secondary (student health behaviour and obesity) outcomes using a decision hierarchy. Where possible, we calculated standardised mean differences (SMDs) to account for variable outcome measures with 95% confidence intervals (CI). For RCTs, we conducted meta-analyses of primary and secondary outcomes using a random-effects model, or in instances where there were between two and five studies, a fixed-effect model. The synthesis of the effects for non-randomised studies followed the 'Synthesis without meta-analysis' (SWiM) guidelines.

MAIN RESULTS

We included an additional 11 trials in this update bringing the total number of included studies in the review to 38. Of these, 22 were conducted in the USA. Twenty-six studies used RCT designs. Seventeen trials tested strategies to implement healthy eating, 12 physical activity and six a combination of risk factors. Just one trial sought to increase the implementation of interventions to delay initiation or reduce the consumption of alcohol. All trials used multiple implementation strategies, the most common being educational materials, educational outreach and educational meetings. The overall certainty of evidence was low and ranged from very low to moderate for secondary review outcomes. Pooled analyses of RCTs found, relative to a control, the use of implementation strategies may result in a large increase in the implementation of interventions in schools (SMD 1.04, 95% CI 0.74 to 1.34; 22 RCTs, 1917 participants; low-certainty evidence). For secondary outcomes we found, relative to control, the use of implementation strategies to support intervention implementation may result in a slight improvement on measures of student diet (SMD 0.08, 95% CI 0.02 to 0.15; 11 RCTs, 16,649 participants; low-certainty evidence) and physical activity (SMD 0.09, 95% CI -0.02 to 0.19; 9 RCTs, 16,389 participants; low-certainty evidence). The effects on obesity probably suggest little to no difference (SMD -0.02, 95% CI -0.05 to 0.02; 8 RCTs, 18,618 participants; moderate-certainty evidence). The effects on tobacco use are very uncertain (SMD -0.03, 95% CIs -0.23 to 0.18; 3 RCTs, 3635 participants; very low-certainty evidence). One RCT assessed measures of student alcohol use and found strategies to support implementation may result in a slight increase in use (odds ratio 1.10, 95% CI 0.77 to 1.56; P = 0.60; 2105 participants). Few trials reported the economic evaluations of implementation strategies, the methods of which were heterogeneous and evidence graded as very uncertain. A lack of consistent terminology describing implementation strategies was an important limitation of the review.

AUTHORS' CONCLUSIONS

The use of implementation strategies may result in large increases in implementation of interventions, and slight improvements in measures of student diet, and physical activity. Further research is required to assess the impact of implementation strategies on such behavioural- and obesity-related outcomes, including on measures of alcohol use, where the findings of one trial suggest it may slightly increase student risk. Given the low certainty of the available evidence for most measures further research is required to guide efforts to facilitate the translation of evidence into practice in this setting.

Implementation of a Health Promotion Practice Using Individually Targeted Lifestyle Interventions in Primary Health Care: Protocol for the "Act in Time" Mixed Methods Process Evaluation Study

Background

There is growing evidence that noncommunicable diseases (NCDs) can be attributable to unhealthy lifestyle habits. However, there has been little application of this knowledge in primary health care (PHC).

Objective

This study aims to evaluate the process and outcomes of a multifaceted implementation strategy for a healthy lifestyle-promoting practice in a PHC setting. This practice is based on national guidelines targeting unhealthy lifestyle habits with a potential risk for NCDs.

Methods

A pre-post implementation study design with a control group is used in a PHC setting in central Sweden. The Medical Research Council guidelines for process evaluation of complex interventions will be applied. The implementation process and outcomes will be assessed using a mix of qualitative and quantitative methods. A strategic sample of up to 6 PHC centers will be included as intervention centers, which will receive a 12-month multifaceted implementation strategy. Up to 6 matched PHC centers will serve as controls. Core components in the implementation strategy are external and internal facilitators in line with the integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) framework and the Astrakan change leadership model. Data will be collected at baseline, during the implementation phase, and 4-6 months after the implementation strategy. Questionnaires will be sent to roughly 500 patients in every PHC center and 200 health care professionals (HCPs) before and after implementation. In addition, purposeful sampling will be used for interviews and focus group discussions with managers, HCPs, patient representatives, and internal and external facilitators. Use of data from medical records and activity logs will be an additional data source.

Results

Recruitment of PHC centers began in March 2021 and ended in Spring 2022. Based on the planned timeline with the 12-month implementation strategy and 4-6-month follow-up, we expect to collect the final data in Summer 2023.

Conclusions

This study will explain implementation process and outcomes using a multifaceted implementation strategy for a healthy lifestyle-promoting practice in a real-world PHC context. The study is expected to provide new knowledge about the role of facilitators and their contribution to implementation outcomes. These findings can guide policy makers, managers, and PHC staff to integrate health promotion and disease prevention in PHC and provide methodological support to facilitators.

Trial Registration

ClinicalTrials.gov NCT04799860; https://clinicaltrials.gov/ct2/show/NCT04799860

International Registered Report Identifier (IRRID)

DERR1-10.2196/37634

A workplace organisational intervention to improve hospital nurses' and physicians' mental health: study protocol for the Magnet4Europe wait list cluster randomised controlled trial

INTRODUCTION

The increasing burden of mental distress reported by healthcare professionals is a matter of serious concern and there is a growing recognition of the role of the workplace in creating this problem. Magnet hospitals, a model shown to attract and retain staff in US research, creates positive work environments that aim to support the well-being of healthcare professionals.

METHODS AND ANALYSIS

Magnet4Europe is a cluster randomised controlled trial, with wait list controls, designed to evaluate the effects of organisational redesign, based on the Magnet model, on nurses' and physicians' well-being in general acute care hospitals, using a multicomponent implementation strategy. The study will be conducted in more than 60 general acute care hospitals in Belgium, England, Germany, Ireland, Norway and Sweden. The primary outcome is burnout among nurses and physicians, assessed in longitudinal surveys of nurses and physicians at participating hospitals. Additional data will be collected from them on perceived work environments, patient safety and patient quality of care and will be triangulated with data from medical records, including case mix-adjusted in-hospital mortality. The process of implementation will be evaluated using qualitative data from focus group and key informant interviews.

ETHICS AND DISSEMINATION

This study was approved by the Ethics Committee Research UZ/KU Leuven, Belgium; additionally, ethics approval is obtained in all other participating countries either through a central or decentral authority. Findings will be disseminated at conferences, through peer-reviewed manuscripts and via social media.

TRIAL REGISTRATION NUMBER

ISRCTN10196901.

Implementation, mechanisms of change and contextual factors of a complex intervention to improve interprofessional collaboration and the quality of medical care for nursing home residents: study protocol of the process evaluation of the interprof ACT intervention package

BACKGROUND

To improve interprofessional collaboration between registered nurses (RNs) and general practitioners (GPs) for nursing home residents (NHRs), the interprof ACT intervention package was developed. This complex intervention includes six components (e.g., shared goal setting, standardized procedures for GPs' nursing home visits) that can be locally adapted. The cluster-randomized interprof ACT trial evaluates the effects of this intervention on the cumulative incidence of hospital admissions (primary outcome) and secondary outcomes (e.g., length of hospital stays, utilization of emergency care services, and quality of life) within 12 months. It also includes a process evaluation which is subject of this protocol. The objectives of this evaluation are to assess the implementation of the interprof ACT intervention package and downstream effects on nurse-physician collaboration as well as preconditions and prospects for successive implementation into routine care.

METHODS

This study uses a mixed methods triangulation design involving all 34 participating nursing homes (clusters). The quantitative part comprises paper-based surveys among RNs, GPs, NHRs, and nursing home directors at baseline and 12 months. In the intervention group (17 clusters), data on the implementation of preplanned implementation strategies (training and supervision of nominated IPAVs, interprofessional kick-off meetings) and local implementation activities will be recorded. Major outcome domains are the dose, reach and fidelity of the implementation of the intervention package, changes in interprofessional collaboration, and contextual factors. The qualitative part will be conducted in a subsample of 8 nursing homes (4 per study group) and includes repeated non-participating observations and semistructured interviews on the interaction between involved health professionals and their work processes. Quantitative and qualitative data will be descriptively analyzed and then triangulated by means of joint displays and mixed methods informed regression models.

DISCUSSION

By integrating a variety of qualitative and quantitative data sources, this process evaluation will allow comprehensive assessment of the implementation of the interprof ACT intervention package, the changes induced in interprofessional collaboration, and the influence of contextual factors. These data will reveal expected and unexpected changes in the procedures of interprofessional care delivery and thus facilitate accurate conclusions for the further design of routine care services for NHRs.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03426475 . Registered on 07/02/2018.

A multi-center, pragmatic, effectiveness-implementation (hybrid I) cluster randomized controlled trial to evaluate a child-oriented goal-setting approach in paediatric rehabilitation (the ENGAGE approach): a study protocol

BACKGROUND

Child-oriented goal-setting in pediatric rehabilitation may improve child motivation, engagement in therapy, child outcomes related to therapy, and service delivery efficiency. The primary objective of this trial is to determine the effectiveness of a principles-driven, child-focused approach to goal-setting, Enhancing Child Engagement in Goal-Setting (ENGAGE), on pediatric rehabilitation outcomes compared to usual practice. The three secondary objectives are to 1) compare costs and secondary outcomes of the ENGAGE approach to usual practice, 2) determine the influence of child, parent and therapist characteristics on child engagement in therapy and rehabilitation outcomes, and 3) identify barriers and facilitators to the implementation of ENGAGE.

METHODS

This research protocol describes a pragmatic, multi-site, cluster, effectiveness-implementation (hybrid type 1 design) randomized controlled trial. Therapists (n = 12 clusters of two therapists) at participating sites (n = 6) will be randomized to 1) the ENGAGE intervention group, or 2) usual care (control) using a computer-generated, permuted-block randomization sequence with site as a stratification variable designed by a statistician (RR). Each therapist will recruit four children 5-12 years old with neurodevelopmental conditions (n = 96), who will receive ENGAGE or usual care, according to therapist group allocation. ENGAGE therapists will be trained to use a 'toolbox' of evidence-driven, theory-informed principles to optimize child and parent motivation, engagement in the goal-setting process, and performance feedback strategies. Outcomes include goal performance (primary outcome), engagement in therapy, functional abilities, participation, and parent and child quality of life. Qualitative interviews with children, parents, ENGAGE therapists, and managers will explore challenges to implementation and potential mitigation strategies. Mixed effects multiple linear regression models will be developed for each outcome to assess group differences adjusted for clustering. A cost-effectiveness analysis will combine cost and a measure of effectiveness into an incremental cost-effectiveness ratio. Qualitative data on implementation will be analyzed inductively (thematic analysis) and deductively using established implementation science frameworks.

DISCUSSION

This study will evaluate the effects of collaborative goal-setting in pediatric rehabilitation and inform effective implementation of child-focused goal-setting practices.

TRIAL REGISTRATION

NCT05017363 (registered August 23, 2021 on ClinicalTrials.gov).

The implementation and validation of the NoMAD during a complex primary care intervention

Background

Normalization process theory (NPT) has been widely used to better understand how new interventions are implemented and embedded. The NoMAD (Normalization Measurement Development questionnaire) is a 23-item NPT instrument based on NPT. As the NoMAD is a relatively new instrument, the objectives of this paper are: to describe the experience of implementing the NoMAD, to describe it being used as a feedback mechanism to gain insight into the normalization process of a complex health intervention, and to further explore the psychometric properties of the instrument.

Methods

Health TAPESTRY was implemented in six Family Health Teams (total of seven sites) across Ontario. Healthcare team members at each site were invited to complete the NoMAD, and three general questions about normalization, six times over a 12-month period. Each site was then provided a visual traffic light summary (TLS) reflecting the implementation of the Health TAPESTRY. The internal consistency of each sub-scale and validity of the NoMAD were assessed. Learnings from the implementation of the NoMAD and subsequent feedback mechanism (TLS) are reported descriptively.

Results

In total, 56 diverse health care team members from six implementation sites completed the NoMAD. Each used it at least once during the 12-month study period. The implementation of the NoMAD and TLS was time consuming to do with multiple collection (and feedback) points. Most (60%) internal consistency values of the four subscales (pooled across site) across each collection point were satisfactory. All correlations were positive, and most (86%) were statistically significant among NoMAD subscales. All but one correlation between the NoMAD subscales and the general questions were positive, and most (72%) were significant. Generally, scores on the subscales were higher at 12-month than baseline, albeit did not follow a linear pattern of change across implementation. Generally, scores were higher for experienced sites compared to first-time implementors.

Conclusion

Our experience would suggest fewer collection points; three timepoints spaced out by several months are adequate, if repeated administration of the NoMAD is used for feedback loops. We provide additional evidence of the psychometric properties of the NoMAD.

Trial Registration

Registered at ClinicalTrials.gov: NCT03397836.

Evaluation of Normalization After Implementation of the Digital Dutch Obstetric Telephone Triage System: Mixed Methods Study With a Questionnaire Survey and Focus Group Discussion

Background

The Dutch Obstetric Telephone Triage System (DOTTS) was developed to improve the quality of acute obstetric care. To achieve optimal effect, the DOTTS should be adopted in the daily care process by triage staff.

Objective

The primary aim was to evaluate the degree of implementation (ie, normalization) of the DOTTS, and the secondary aim was to evaluate which lessons can be learned from its current implementation in Dutch hospitals.

Methods

An evaluation study with a mixed methods design was performed. All triage staff in 9 Dutch hospitals that implemented the DOTTS before September 1, 2019, were invited to complete the Normalization Measure Development (NoMAD) questionnaire between December 2019 and July 2020. The questionnaire is based on the Normalization Process Theory (NPT). This self-reported questionnaire provides insights into the work people do in order to integrate and embed new practice in routine care. The NPT is based on the following 4 constructs: coherence, cognitive participation, collective action, and reflexive monitoring. Within the questionnaire, each construct is represented by 4-7 questions. Questions are scored on a 5-point normalization process scale. Descriptive statistics were used for analysis of questionnaire scores. Subsequently, the questionnaire findings were discussed during a focus group. Template analysis following the 4 constructs was used for analyzing the results of the focus group.

Results

Overall, 173 of 294 (58.8%) triage staff members completed the NoMAD questionnaire, and 90.2% (156/173) of the participants had used the DOTTS for over 6 months. The digital application was used as much as possible or always by 137 of 173 (79.2%) participants. The overall normalization process score was 3.77 (SD 0.36). The constructs coherence, cognitive participation, collective action, and reflexive monitoring scored 4.01 (SD 0.47), 4.05 (SD 0.45), 3.5 (SD 0.45), and 3.72 (SD 0.47), respectively. Analysis of the focus group discussion showed that the added value of the DOTTS was seen as a quality improvement for the care of pregnant women. Dedication of the complete multidisciplinary implementation team was important for facilitating normalization. Support from the medical staff and proper use by all disciplines involved in the triage were seen as facilitating factors. Participants appreciated training and evaluation, and indicated a need for ongoing training and evaluation in relation to goal achievement.

Conclusions

The DOTTS has been integrated into normal care in daily practice. Evaluation by the NoMAD questionnaire provided a positive overall score. These results are in line with or, in some aspects, better than the results of other evaluation studies. Key factors in the normalization process of the DOTTS in obstetric triage are the shared added value for stakeholders, the dedication of the complete multidisciplinary implementation team, and implementation plans that are tailor made in the practical context of the hospital.

Implementation of physical activity on prescription for children with obesity in paediatric health care (IMPA): protocol for a feasibility and evaluation study using quantitative and qualitative methods

BACKGROUND

Physical inactivity is a main cause of childhood obesity which tracks into adulthood obesity, making it important to address early in life. Physical activity on prescription (PAP) is an evidence-based intervention that has shown good effect on physical activity levels in adults, but has not been evaluated in children with obesity. This project aims to evaluate the prerequisites, determinants, and feasibility of implementing PAP adapted to children with obesity and to explore children's, parents', and healthcare providers' experiences of PAP.

METHODS

In the first phase of the project, healthcare providers and managers from 26 paediatric clinics in Region Västra Götaland, Sweden, will be invited to participate in a web-based survey and a subset of this sample for a focus group study. Findings from these two data collections will form the basis for adaptation of PAP to the target group and context. In a second phase, this adapted PAP intervention will be evaluated in a clinical study in a sample of approximately 60 children with obesity (ISO-BMI > 30) between 6 and 12 years of age and one of their parents/legal guardians. Implementation process and clinical outcomes will be assessed pre- and post-intervention and at 8 and 12 months' follow-up. Implementation outcomes are the four core constructs of the Normalization Process Theory; coherence, cognitive participation, collective action, and reflexive monitoring; and appropriateness, acceptability, and feasibility of the PAP intervention. Additional implementation process outcomes are recruitment and attrition rates, intervention fidelity, dose, and adherence. Clinical outcomes are physical activity pattern, BMI, metabolic risk factors, health-related quality of life, sleep, and self-efficacy and motivation for physical activity. Lastly, we will explore the perspectives of children and parents in semi-structured interviews. Design and analysis of the included studies are guided by the Normalization Process Theory.

DISCUSSION

This project will provide new knowledge regarding the feasibility of PAP for children with obesity and about whether and how an evidence-based intervention can be fitted and adapted to new contexts and populations. The results may inform a larger scale trial and future implementation and may enhance the role of PAP in the management of obesity in paediatric health care in Sweden.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04847271 , registered 14 April 2021.

Protocol for a type 2 hybrid effectiveness-implementation study expanding, implementing and evaluating electronic health record-integrated patient-reported symptom monitoring in a multisite cancer centre

INTRODUCTION

Cancer symptom monitoring and management interventions can address concerns that may otherwise go undertreated. However, such programmes and their evaluations remain largely limited to trials versus healthcare systemwide applications. We previously developed and piloted an electronic patient-reported symptom and need assessment ('cPRO' for cancer patient-reported outcomes) within the electronic health record (EHR). This study will expand cPRO implementation to medical oncology clinics across a large healthcare system. We will conduct a formal evaluation via a stepped wedge trial with a type 2 hybrid effectiveness-implementation design.

METHODS AND ANALYSIS

Aim 1 comprises a mixed method evaluation of cPRO implementation. Adult outpatients will complete cPRO assessments (pain, fatigue, physical function, depression, anxiety and supportive care needs) before medical oncology visits. Results are available in the EHR; severe symptoms and endorsed needs trigger clinician notifications. We will track implementation strategies using the Longitudinal Implementation Strategy Tracking System. Aim 2 will evaluate cPRO's impact on patient and system outcomes over 12 months via (a) a quality improvement study (n=4000 cases) and (b) a human subjects substudy (n=1000 patients). Aim 2a will evaluate EHR-documented healthcare usage and patient satisfaction. In aim 2b, participating patients will complete patient-reported healthcare utilisation and quality, symptoms and health-related quality of life measures at baseline, 6 and 12 months. We will analyse data using generalised linear mixed models and estimate individual trajectories of patient-reported symptom scores at baseline, 6 and 12 months. Using growth mixture modelling, we will characterise the overall trajectories of each symptom. Aim 3 will identify cPRO implementation facilitators and barriers via mixed methods research gathering feedback from stakeholders. Patients (n=50) will participate in focus groups or interviews. Clinicians and administrators (n=40) will complete surveys to evaluate implementation. We will graphically depict longitudinal implementation survey results and code qualitative data using directed content analysis.

ETHICS AND DISSEMINATION

This study was approved by the Northwestern University Institutional Review Board (STU00207807). Findings will be disseminated via local and conference presentations and peer-reviewed journals.

TRIAL REGISTRATION NUMBER

NCT04014751; ClinicalTrials.gov.

Normalizing Telemonitoring in Nurse-Led Care Models for Complex Chronic Patient Populations: Case Study

BACKGROUND

The implementation of telemonitoring (TM) has been successful in terms of the overall feasibility and adoption in single disease care models. However, a lack of available research focused on nurse-led implementations of TM that targets patients with multiple and complex chronic conditions (CCC) hinders the scale and spread to these patient populations. In particular, little is known about the clinical perspective on the implementation of TM for patients with CCC in outpatient care.

OBJECTIVE

This study aims to better understand the perspective of the clinical team (both frontline clinicians and those in administrative positions) on the implementation and normalization of TM for complex patients in a nurse-led clinic model.

METHODS

A pragmatic, 6-month implementation study was conducted to embed multicondition TM, including heart failure, hypertension, and diabetes, into an integrated nurse-led model of care. Throughout the study, clinical team members were observed, and a chart review was conducted of the care provided during this time. At the end of the study, clinical team members participated in qualitative interviews and completed the adapted Normalization Measure Development questionnaires. The Normalization Process Theory guided the deductive data analysis.

RESULTS

Overall, 9 team members participated in the study as part of a larger feasibility study of the TM program, of which 26 patients were enrolled. Team members had a shared understanding of the purpose and value of TM as an intervention embedded within their practice to meet the diverse needs of their patients with CCC. TM aligned well with existing chronic care practices in several ways, yet it changed the process of care delivery (ie, interactional workability subconstruct). Effective TM normalization in nurse-led care requires rethinking of clinical workflows to incorporate TM, relationship development between the clinicians and their patients, communication with the interdisciplinary team, and frequent clinical care oversight. This was captured well through the subconstructs of skill set workability, relational integration, and contextual integration of the Normalization Process Theory.

CONCLUSIONS

Clinicians successfully adopted TM into their everyday practice such that some providers felt their role would be significantly and negatively affected without TM. This study demonstrated that smartphone-based TM systems complemented the routine and challenging clinical work caring for patients with CCC in an integrated nurse-led care model.

Changing healthcare professionals' non-reflective processes to improve the quality of care

RATIONALE

Translating research evidence into clinical practice to improve care involves healthcare professionals adopting new behaviours and changing or stopping their existing behaviours. However, changing healthcare professional behaviour can be difficult, particularly when it involves changing repetitive, ingrained ways of providing care. There is an increasing focus on understanding healthcare professional behaviour in terms of non-reflective processes, such as habits and routines, in addition to the more often studied deliberative processes. Theories of habit and routine provide two complementary lenses for understanding healthcare professional behaviour, although to date, each perspective has only been applied in isolation.

OBJECTIVES

To combine theories of habit and routine to generate a broader understanding of healthcare professional behaviour and how it might be changed.

METHODS

Sixteen experts met for a two-day multidisciplinary workshop on how to advance implementation science by developing greater understanding of non-reflective processes.

RESULTS

From a psychological perspective 'habit' is understood as a process that maintains ingrained behaviour through a learned link between contextual cues and behaviours that have become associated with those cues. Theories of habit are useful for understanding the individual's role in developing and maintaining specific ways of working. Theories of routine add to this perspective by describing how clinical practices are formed, adapted, reinforced and discontinued in and through interactions with colleagues, systems and organisational procedures. We suggest a selection of theory-based strategies to advance understanding of healthcare professionals' habits and routines and how to change them.

CONCLUSION

Combining theories of habit and routines has the potential to advance implementation science by providing a fuller understanding of the range of factors, operating at multiple levels of analysis, which can impact on the behaviours of healthcare professionals, and so quality of care provision.

Implementation of Nationwide Evidence- and Consensus-Based Guidelines to Harmonize Neonatal Care in The Netherlands

Background

A Dutch committee for National Guidelines in Neonatology developed nineteen evidence- and consensus-based guidelines to be used in all Dutch neonatal intensive care units (NICUs). The primary goal was to make clinical practices more uniform and consistent.

Objective

This study investigated to what extent the guidelines were implemented and which factors played a role in implementation.

Study design

A mixed method study design was used to investigate both the level and the process of implementation. A nationwide, multicenter, cross-sectional survey was performed using a validated instrument for measuring the level of implementation (Normalization MeAsure Development questionnaire, NoMAD). The number of implemented guidelines per NICU and the frequency and content of the amendments that NICUs made to the original consensus guidelines were analyzed. Through semi-structured interviews, perceived barriers and facilitators for implementation were explored.

Participants

Fellows and neonatologists working at all ten Dutch level 3–4 NICUs were eligible.

Results

On an average, NICUs implemented 12.6 (of 19) guidelines (range 6–17). The Normalization Process Scale was 54 (of 65). Main influencing factors impeding implementation were guideline-related (e.g., unpractical, lengthy guidelines) and personal (e.g., an active representative responsible for local implementation).

Conclusion

The implementation of our guidelines appears to be successful. Ways for improvement can be distinguished in personal, guideline-related and external factors. Empowerment of local representatives was considered most essential.

Electronic Supplementary Material

Supplementary material is available in the online version of this article at 10.1007/s13312-022-2516-3.

Implementation and evaluation of Illness Management and Recovery (IMR) in mandated forensic psychiatric care – Study protocol for a multicenter cluster randomized trial

Introduction

Forensic mental health care is hampered by lack of evidence-based treatments. The Swedish forensic mental health population consists of patients suffering from severe illnesses such as schizophrenia and bipolar disorders, similar to populations in international studies. Illness Management and Recovery (IMR) is an intervention for patients with serious mental illness, based on psychoeducational, cognitive-behavioral and motivational components. The purpose is to strengthen participants’ illness management skills and recovery.

Objective

To test effectiveness of IMR within forensic mental health by comparing it to treatment as usual.

Method

This is a cluster-randomized controlled trial. Patients in forensic mental health inpatient units are randomized to an active (IMR) or a control condition (treatment as usual). Clustering of patients is based on ward-units where inpatients are admitted. Patients in the active condition receive two group and one individual IMR sessions per week. The treatment phase is estimated to last nine months. Outcomes include illness related disability, illness management skills, sense of recovery, hope, mental health and security related problems. Outcomes are measured at baseline, four months into treatment, at treatment completion and at three months follow-up. Staff experiences of implementing IMR will be explored by a self-report measure and semi-structured interview based on Normalization Process Theory.

Ethics and dissemination

The study is approved by the Swedish Ethical Review Authority (Registration No. 2020–02046). Participation will be voluntary based on written informed consent. Results will be disseminated through peer-reviewed articles and conferences. The study is registered in the US registry of clinical trials (NCT04695132).

Translational framework for implementation evaluation and research: a normalisation process theory coding manual for qualitative research and instrument development

Background

Normalisation Process Theory (NPT) is frequently used to inform qualitative research that aims to explain and evaluate processes that shape late-stage translation of innovations in the organisation and delivery of healthcare. A coding manual for qualitative researchers using NPT will facilitate transparent data analysis processes and will also reduce the cognitive and practical burden on researchers.

Objectives

(a) To simplify the theory for the user. (b) To describe the purposes, methods of development, and potential application of a coding manual that translates normalisation process theory (NPT) into an easily usable framework for qualitative analysis. (c) To present an NPT coding manual that is ready for use.

Method

Qualitative content analysis of papers and chapters that developed normalisation process theory, selection and structuring of theory constructs, and testing constructs against interview data and published empirical studies using NPT.

Results

A coding manual for NPT was developed. It consists of 12 primary NPT constructs and conforms to the Context-Mechanism-Outcome configuration of realist evaluation studies. Contexts are defined as settings in which implementation work is done, in which strategic intentions, adaptive execution, negotiating capability, and reframing organisational logics are enacted. Mechanisms are defined as the work that people do when they participate in implementation processes and include coherence-building, cognitive participation, collective action, and reflexive monitoring. Outcomes are defined as effects that make visible how things change as implementation processes proceed and include intervention mobilisation, normative restructuring, relational restructuring, and sustainment.

Conclusion

The coding manual is ready to use and performs three important tasks. It consolidates several iterations of theory development, makes the application of NPT simpler for the user, and links NPT constructs to realist evaluation methods. The coding manual forms the core of a translational framework for implementation research and evaluation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01191-x.

Translational framework for implementation evaluation and research: a normalisation process theory coding manual for qualitative research and instrument development

BACKGROUND

Normalisation Process Theory (NPT) is frequently used to inform qualitative research that aims to explain and evaluate processes that shape late-stage translation of innovations in the organisation and delivery of healthcare. A coding manual for qualitative researchers using NPT will facilitate transparent data analysis processes and will also reduce the cognitive and practical burden on researchers.

OBJECTIVES

(a) To simplify the theory for the user. (b) To describe the purposes, methods of development, and potential application of a coding manual that translates normalisation process theory (NPT) into an easily usable framework for qualitative analysis. (c) To present an NPT coding manual that is ready for use.

METHOD

Qualitative content analysis of papers and chapters that developed normalisation process theory, selection and structuring of theory constructs, and testing constructs against interview data and published empirical studies using NPT.

RESULTS

A coding manual for NPT was developed. It consists of 12 primary NPT constructs and conforms to the Context-Mechanism-Outcome configuration of realist evaluation studies. Contexts are defined as settings in which implementation work is done, in which strategic intentions, adaptive execution, negotiating capability, and reframing organisational logics are enacted. Mechanisms are defined as the work that people do when they participate in implementation processes and include coherence-building, cognitive participation, collective action, and reflexive monitoring. Outcomes are defined as effects that make visible how things change as implementation processes proceed and include intervention mobilisation, normative restructuring, relational restructuring, and sustainment.

CONCLUSION

The coding manual is ready to use and performs three important tasks. It consolidates several iterations of theory development, makes the application of NPT simpler for the user, and links NPT constructs to realist evaluation methods. The coding manual forms the core of a translational framework for implementation research and evaluation.

Delivering colon cancer survivorship care in primary care; a qualitative study on the experiences of general practitioners

BACKGROUND

With more patients in need of oncological care, there is a growing interest to transfer survivorship care from specialist to general practitioner (GP). The ongoing I CARE study was initiated in 2015 in the Netherlands to compare (usual) surgeon- to GP-led survivorship care, with or without access to a supporting eHealth application (Oncokompas).

METHODS

Semi-structured interviews were held at two separate points in time (i.e. after 1- and 5-years of care) to explore GPs' experiences with delivering this survivorship care intervention, and study its implementation into daily practice. Purposive sampling was used to recruit 17 GPs. Normalisation Process Theory (NPT) was used as a conceptual framework.

RESULTS

Overall, delivering survivorship care was not deemed difficult and dealing with cancer repercussions was already considered part of a GPs' work. Though GPs readily identified advantages for patients, caregivers and society, differences were seen in GPs' commitment to the intervention and whether it felt right for them to be involved. Patients' initiative with respect to planning, absence of symptoms and regular check-ups due to other chronic care were considered to facilitate the delivery of care. Prominent barriers included GPs' lack of experience and routine, but also lack of clarity regarding roles and responsibilities for organising care. Need for a monitoring system was often mentioned to reduce the risk of non-compliance. GPs were reticent about a possible future transfer of survivorship care towards primary care due to increases in workload and financial constraints. GPs were not aware of their patients' use of eHealth.

CONCLUSIONS

GPs' opinions and beliefs about a possible future role in colon cancer survivorship care vary. Though GPs recognize potential benefit, there is no consensus about transferring survivorship care to primary care on a permanent basis. Barriers and facilitators to implementation highlight the importance of both personal and system level factors. Conditions are put forth relating to time, reorganisation of infrastructure, extra personnel and financial compensation.

TRIAL REGISTRATION

Netherlands Trial Register; NTR4860 . Registered on the 2nd of October 2014.

Protocol for the Addressing the Social Determinants and Consequences of Tuberculosis in Nepal (ASCOT) pilot trial

BACKGROUND: The World Health Organization's End TB (tuberculosis) Strategy advocates social and economic support for TB-affected households but evidence from low-income settings is scarce. We will evaluate the feasibility and acceptability of a locally-appropriate socioeconomic support intervention for TB-affected households in Nepal. METHODS: We will conduct a pilot randomised-controlled trial with mixed-methods process evaluation in four TB-endemic, impoverished districts of Nepal: Pyuthan, Chitwan, Mahottari, and Morang. We will recruit 128 people with TB notified to the Nepal National TB Program (NTP) and 40 multisectoral stakeholders including NTP staff, civil-society members, policy-makers, and ASCOT (Addressing the Social Determinants and Consequences of Tuberculosis) team members. People with TB will be randomised 1:1:1:1 to four study arms (n=32 each): control; social support; economic support; and combined social and economic (socioeconomic) support. Social support will be TB education and peer-led mutual-support TB Clubs providing TB education and stigma-reduction counselling. Economic support will be monthly unconditional cash transfers during TB treatment with expectations (not conditions) of meeting NTP goals. At 0, 2, and 6 months following TB treatment initiation, participants will be asked to complete a survey detailing the social determinants and consequences of TB and their feedback on ASCOT. Complementary process evaluation will use focus group discussions (FGD), key informant interviews (KII), and a workshop with multi-sectoral stakeholders to consider the challenges to ASCOT's implementation and scale-up. A sample of ~100 people with TB is recommended to estimate TB-related costs. Information power is estimated to be reached with approximately 25 FGD and 15 KII participants. CONCLUSIONS: The ASCOT pilot trial will both generate robust evidence on a locally-appropriate, socioeconomic support intervention for TB-affected households in Nepal and inform a large-scale future ASCOT trial, which will evaluate the intervention's impact on catastrophic costs mitigation and TB outcomes. The trial is registered with the ISRCTN ( ISRCTN17025974).