Psychometric properties of two implementation measures: Normalization MeAsure Development questionnaire (NoMAD) and organizational readiness for implementing change (ORIC)

Background

Effective interventions need to be implemented successfully to achieve impact. Two theory-based measures exist for measuring the effectiveness of implementation strategies and monitor implementation progress. The Normalization MeAsure Development questionnaire (NoMAD) explores the four core concepts (Coherence, Cognitive Participation, Collective Action, Reflexive Monitoring) of the Normalization Process Theory. The Organizational Readiness for Implementing Change (ORIC) is based on the theory of Organizational Readiness for Change, measuring organization members' psychological and behavioral preparedness for implementing a change. We examined the measurement properties of the NoMAD and ORIC in a multi-national implementation effectiveness study.

Method

Twelve mental health organizations in nine countries implemented Internet-based cognitive behavioral therapy (iCBT) for common mental disorders. Staff involved in iCBT service delivery (n = 318) participated in the study. Both measures were translated into eight languages using a standardized forward-backward translation procedure. Correlations between measures and subscales were estimated to examine convergent validity. The theoretical factor structures of the scales were tested using confirmatory factor analysis (CFA). Test-retest reliability was based on the correlation between scores at two time points 3 months apart. Internal consistency was assessed using Cronbach's alpha. Floor and ceiling effects were quantified using the proportion of zero and maximum scores.

Results

NoMAD and ORIC measure related but distinct latent constructs. The CFA showed that the use of a total score for each measure is appropriate. The theoretical subscales of the NoMAD had adequate internal consistency. The total scale had high internal consistency. The total ORIC scale and subscales demonstrated high internal consistency. Test-retest reliability was suboptimal for both measures and floor and ceiling effects were absent.

Conclusions

This study confirmed the psychometric properties of the NoMAD and ORIC in multi-national mental health care settings. While measuring on different but related aspects of implementation processes, the NoMAD and ORIC prove to be valid and reliable across different language settings.

Characteristics of collaborative care networks in functional disorders: A systematic review

OBJECTIVE

Functional disorders (FD) are complex conditions, for which multidisciplinary involvement is often recommended. Collaborative care networks (CCN) may unlock the potential of the multidisciplinary team (MDT) in FD care. To understand what characteristics should be part of CCNs in FD, we studied the composition and characteristics of existing CCNs in FD.

METHODS

We performed a systematic review following PRISMA guidelines. A search of PubMed, WebofScience, PsycInfo, SocINDEX, AMED and CINAHL was undertaken to select studies describing CCNs in FD. Two reviewers extracted characteristics of the different CCNs. Characteristics were classified as relating to structure and processes of networks.

RESULTS

A total of 62 studies were identified representing 39 CCNs across 11 countries. Regarding structural characteristics, we found that most networks are outpatient, secondary-care based, with teams of between two and 19 members. Medical specialists were most commonly involved and the typical team leads as well as main patient contacts were general practitioners (GPs) or nurses. Regarding processes, collaboration was demonstrated mostly during assessment, management and patient education, less often during rehabilitation and follow-up, mostly using MDT meetings. CCNs provided a wide range of treatment modalities, reflecting a biopsychosocial approach, including psychological therapies, physiotherapy and social and occupational therapy.

CONCLUSION

CCNs for FD are heterogeneous, showing a wide variety of structures as well as processes. The heterogeneity of results provides a broad framework, demonstrating considerable variation in how this framework is applied in different contexts. Better development of network evaluation, as well as professional collaboration and education processes is needed.

Effectiveness of Self-guided Tailored Implementation Strategies in Integrating and Embedding Internet-Based Cognitive Behavioral Therapy in Routine Mental Health Care: Results of a Multicenter Stepped-Wedge Cluster Randomized Trial

BACKGROUND

Internet-based cognitive behavioral therapy (iCBT) services for common mental health disorders have been found to be effective. There is a need for strategies that improve implementation in routine practice. One-size-fits-all strategies are likely to be ineffective. Tailored implementation is considered as a promising approach. The self-guided integrated theory-based Framework for intervention tailoring strategies toolkit (ItFits-toolkit) supports local implementers in developing tailored implementation strategies. Tailoring involves identifying local barriers; matching selected barriers to implementation strategies; developing an actionable work plan; and applying, monitoring, and adapting where necessary.

OBJECTIVE

This study aimed to compare the effectiveness of the ItFits-toolkit with implementation-as-usual (IAU) in implementing iCBT services in 12 routine mental health care organizations in 9 countries in Europe and Australia.

METHODS

A stepped-wedge cluster randomized trial design with repeated measures was applied. The trial period lasted 30 months. The primary outcome was the normalization of iCBT delivery by service providers (therapists, referrers, IT developers, and administrators), which was measured with the Normalization Measure Development as a proxy for implementation success. A 3-level linear mixed-effects modeling was applied to estimate the effects. iCBT service uptake (referral and treatment completion rates) and implementation effort (hours) were used as secondary outcomes. The perceived satisfaction (Client Satisfaction Questionnaire), usability (System Usability Scale), and impact of the ItFits-toolkit by implementers were used to assess the acceptability of the ItFits-toolkit.

RESULTS

In total, 456 mental health service providers were included in this study. Compared with IAU, the ItFits-toolkit had a small positive statistically significant effect on normalization levels in service providers (mean 0.09, SD 0.04; P=.02; Cohen d=0.12). The uptake of iCBT by patients was similar to that of IAU. Implementers did not spend more time on implementation work when using the ItFits-toolkit and generally regarded the ItFits-toolkit as usable and were satisfied with it.

CONCLUSIONS

The ItFits-toolkit performed better than the usual implementation activities in implementing iCBT services in routine practice. There is practical utility in the ItFits-toolkit for supporting implementers in developing and applying effective tailored implementation strategies. However, the effect on normalization levels among mental health service providers was small. These findings warrant modesty regarding the effectiveness of self-guided tailored implementation of iCBT services in routine practice.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03652883; https://clinicaltrials.gov/ct2/show/NCT03652883.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s13063-020-04686-4.

Tailored implementation of internet-based cognitive behavioural therapy in the multinational context of the ImpleMentAll project: a study protocol for a stepped wedge cluster randomized trial

BACKGROUND

Internet-based Cognitive Behavioural Therapy (iCBT) is found effective in treating common mental disorders. However, the use of these interventions in routine care is limited. The international ImpleMentAll study is funded by the European Union's Horizon 2020 programme. It is concerned with studying and improving methods for implementing evidence-based iCBT services for common mental disorders in routine mental health care. A digitally accessible implementation toolkit (ItFits-toolkit) will be introduced to mental health care organizations with the aim to facilitate the ongoing implementation of iCBT services within local contexts. This study investigates the effectiveness of the ItFits-toolkit by comparing it to implementation-as-usual activities.

METHODS

A stepped wedge cluster randomized controlled trial (SWT) design will be applied. Over a trial period of 30 months, the ItFits-toolkit will be introduced sequentially in twelve routine mental health care organizations in primary and specialist care across nine countries in Europe and Australia. Repeated measures are applied to assess change over time in the outcome variables. The effectiveness of the ItFits-toolkit will be assessed in terms of the degree of normalization of the use of the iCBT services. Several exploratory outcomes including uptake of the iCBT services will be measured to feed the interpretation of the primary outcome. Data will be collected via a centralized data collection system and analysed using generalized linear mixed modelling. A qualitative process evaluation of routine implementation activities and the use of the ItFits-toolkit will be conducted within this study.

DISCUSSION

The ImpleMentAll study is a large-scale international research project designed to study the effectiveness of tailored implementation. Using a SWT design that allows to examine change over time, this study will investigate the effect of tailored implementation on the normalization of the use of iCBT services and their uptake. It will provide a better understanding of the process and methods of tailoring implementation strategies. If found effective, the ItFits-toolkit will be made accessible for mental health care service providers, to help them overcome their context-specific implementation challenges.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03652883 . Retrospectively registered on 29 August 2018.

Personalized, Web-Based, Guided Self-Help for Patients With Medically Unexplained Symptoms in Primary Care: Protocol for a Randomized Controlled Trial

Background

Medically unexplained symptoms (MUS) constitute a major health problem because of their high prevalence, the suffering and disability they cause, and the associated medical costs. Web-based interventions may provide an accessible and convenient tool for managing MUS. We developed a personalized, Web-based, guided self-help intervention for MUS in primary care (Grip self-help) and would compare its effectiveness with that of usual care.

Objective

This paper aims to describe the rationale, objectives, and design of a pragmatic randomized controlled trial (RCT) assessing the effectiveness of Grip self-help.

Methods

For a pragmatic multicenter RCT, 165 adult patients with mild to moderate MUS will be recruited through general practices in the Netherlands. Randomization will be performed at general practice level. Over the course of several months, patients in the intervention group will receive a personalized set of Web-based self-help exercises, targeting the unhelpful cognitions, emotions, behaviors, and social factors that are relevant to them. The intervention is guided by a general practice mental health worker. The control group will receive care-as-usual. Primary outcome is physical health-related quality of life (RAND-36 or 36-item general health survey, physical component score). Secondary outcomes include severity of physical and psychological symptoms, mental health–related quality of life, cost-effectiveness, and acceptability. Assessments will take place at baseline, end of treatment, and at 16-, 26-, and 52-week follow-ups.

Results

Recruitment started in December 2018, and enrolment is ongoing. The first results are expected to be submitted for publication in December 2021.

Conclusions

To our knowledge, this is the first study to combine the concepts of electronic health, self-help, and personalized medicine in the treatment of MUS. By improving the quality of life and reducing symptoms of patients with MUS, Grip self-help has the potential to reduce costs and conserve scarce health care resources.

Trial Registration

Dutch Trial Register NTR7390; https://www.trialregister.nl/trial/7390.

International Registered Report Identifier (IRRID)

PRR1-10.2196/13738

Big Five personality traits and medically unexplained symptoms in later life

BACKGROUND

Personality dysfunction has been postulated as the most clinically salient problem of persons suffering from medically unexplained symptoms (MUS) but empirical studies are scarce. This study aims to compare the personality profile of older patients suffering from MUS with two comparison groups and a control group.

METHODS

Ninety-six older patients with MUS were compared with 153 frequent attenders in primary care suffering from medically explained symptoms (MES), 255 patients with a past-month depressive disorder (DSM-IV-TR), and a control group of 125 older persons. The Big Five personality domains (NEO-Five-Factor Inventory) were compared between groups by multiple ANCOVAs adjusted for age, sex, education, partner status and cognitive functioning. Linear regression analyses were applied to examine the association between health anxiety (Whitley Index) and somatization (Brief Symptom Inventory).

RESULTS

The four groups differed with respect to neuroticism (P<0.001), extraversion (P<0.001), and agreeableness (P=0.045). Post hoc analyses, showed that MUS patients compared to controls scored higher on neuroticism and agreeableness, and compared to depressed patients lower on neuroticism and higher on extraversion as well agreeableness. Interestingly, MUS and MES patients had a similar personality profile. Health anxiety and somatization were associated with a higher level of neuroticism and a lower level of extraversion and conscientiousness, irrespective whether the physical symptom was explained or not.

CONCLUSIONS

Older patients with MUS have a specific personality profile, comparable to MES patients. Health anxiety and somatization may be better indicators of psychopathology than whether a physical symptom is medically explained or not.