Development and cross-cultural validation of the Goal Content for Weight Maintenance Scale (GCWMS)

Conducting cross-cultural, multi-lingual or multi-country scale development and validation in health care research: A 10-step framework based on a scoping review

Background

Valid, reliable and cross-cultural equivalent scales and measurement instruments that enable comparisons across diverse populations in different countries are important for global health research and practice. We developed a 10-step framework through a scoping review of the common strategies and techniques used for scale development and validation in a cross-cultural, multi-lingual, or multi-country setting, especially in health care research.

Methods

We searched MEDLINE, Embase, and PsycINFO for peer-reviewed studies that collected data from two or more countries or in two or more languages at any stages of scale development or validation and published between 2010-22. We categorised the techniques into three commonly used scale development and validation stages (item generation, scale development, and scale evaluation) as well as during the translation stage. We described the most commonly used techniques at each stage.

Results

We identified 141 studies that were included in the analysis. We summarised 14 common techniques and strategies, including focus groups or interviews with diverse target populations, and involvement of measurement experts and linguists for item content validity expert panel at the item generation stage; back-and-forth translation, collaborative team approach for the translation stage; cognitive interviews and different recruitment strategies and incentives in different settings for scale development stage; and three approaches for measurement invariance (multigroup confirmatory factor analysis, differential item functioning and multiple indicator multiple causes) for scale evaluation stage.

Conclusions

We provided a 10-step framework for cross-cultural, multi-lingual or multi-country scale development and validation based on these techniques and strategies. More research and synthesis are needed to make scale development more culturally competent and enable scale application to better meet local health and development needs.

Are motivational and self-regulation factors associated with 12 months' weight regain prevention in the NoHoW study? An analysis of European adults

PURPOSE

Preventing weight regain can only be achieved by sustained changes in energy balance-related behaviors that are associated with weight, such as diet and physical activity. Changes in motivation and self-regulatory skills can support long-term behavioral changes in the context of weight loss maintenance. We propose that experiencing a supportive climate care is associated with enhanced satisfaction of basic psychological needs, intrinsic goals, and autonomous motivation. These factors are expected to be associate with the utilization of self-regulation skills, leading to more sustained behavior changes and ultimately preventing weight regain. This hypothesis was tested in this ancillary analysis of the NoHoW trial, where the study arms were pooled and followed for 12 months.

METHODS

The NoHoW was a three-center, large-scale weight regain prevention full factorial trial. In this longitudinal study, data were collected in adults who lost > 5% weight in the past year (N = 870, complete data only, 68.7% female, 44.10 ± 11.86 years, 84.47 ± 17.03 kg) during their participation in a 12-month digital behavior change intervention. Weight and validated measures of motivational- and self-regulatory skills-related variables were collected at baseline, six- and 12 months. Change variables were used in Mplus' path analytical models informed by NoHoW's logic model.

RESULTS

The bivariate correlations confirmed key mediators' potential effect on weight outcomes in the expected causal direction. The primary analysis showed that a quarter of the variance (r2 = 23.5%) of weight regain prevention was achieved via the mechanisms of action predicted in the logic model. Specifically, our results show that supportive climate care is associated with needs satisfaction and intrinsic goal content leading to better weight regain prevention via improvements in self-regulatory skills and exercise-controlled motivation. The secondary analysis showed that more mechanisms of action are significant in participants who regained or maintained their weight.

CONCLUSIONS

These results contribute to a better understanding of the mechanisms of action leading to behavior change in weight regain prevention. The most successful participants used only a few intrinsic motivation-related mechanisms of action, suggesting that habits may have been learned. While developing a digital behavior change intervention, researchers and practitioners should consider creating supportive climate care to improve needs satisfaction and intrinsic goal contents.

TRIAL REGISTRATION

ISRCTN, ISRCTN88405328 , registered 12/22/2016.

Testing motivational and self-regulatory mechanisms of action on device-measured physical activity in the context of a weight loss maintenance digital intervention: A secondary analysis of the NoHoW trial

BACKGROUND

To date, few digital behavior change interventions for weight loss maintenance focusing on long-term physical activity promotion have used a sound intervention design grounded on a logic model underpinned by behavior change theories. The current study is a secondary analysis of the weight loss maintenance NoHoW trial and investigated putative mediators of device-measured long-term physical activity levels (six to 12 months) in the context of a digital intervention.

METHODS

A subsample of 766 participants (Age = 46.2 ± 11.4 years; 69.1% female; original NoHoW sample: 1627 participants) completed all questionnaires on motivational and self-regulatory variables and had all device-measured physical activity data available for zero, six and 12 months. We examined the direct and indirect effects of Virtual Care Climate on post intervention changes in moderate-to-vigorous physical activity and number of steps (six to 12 months) through changes in the theory-driven motivational and self-regulatory mechanisms of action during the intervention period (zero to six months), as conceptualized in the logic model.

RESULTS

Model 1 tested the mediation processes on Steps and presented a poor fit to the data. Model 2 tested mediation processes on moderate-to-vigorous physical activity and presented poor fit to the data. Simplified models were also tested considering the autonomous motivation and the controlled motivation variables independently. These changes yielded good results and both models presented very good fit to the data for both outcome variables. Percentage of explained variance was negligible for all models. No direct or indirect effects were found from Virtual Care Climate to long term change in outcomes. Indirect effects occurred only between the sequential paths of the theory-driven mediators.

CONCLUSION

This was one of the first attempts to test a serial mediation model considering psychological mechanisms of change and device-measured physical activity in a 12-month longitudinal trial. The model explained a small proportion of variance in post intervention changes in physical activity. We found different pathways of influence on theory-driven motivational and self-regulatory mechanisms but limited evidence that these constructs impacted on actual behavior change. New approaches to test these relationships are needed. Challenges and several alternatives are discussed.

TRIAL REGISTRATION

ISRCTN Registry, ISRCTN88405328. Registered December 16, 2016, https://www.isrctn.com/ISRCTN88405328.

Development and Application of Global Health Events-Mental Stress Scale for Assessment of Medical Staff's Acute Mental Stress Responses

Background

Medical workers have been increasingly involved in emergent public health events, which can lead to severe stress. However, no standardized, officially recognized, unified tool exists for mental distress measurement in medical workers who experienced the public health events.

Purpose

In the present study, we propose the Global Health Events-Mental Stress Scale (GHE-MSS), as a revised version of the Impact of Event Scale-Revision (IES-R), for assessment of medical workers’ acute mental stress responses within one month and their chronic mental stress responses within six months after major health events.

Patients and methods

The IES-R was slightly modified, developed, and its reliability and validity were tested using the Delphi survey, primary survey with 115 participants, formal survey with 300 participants, and clinical evaluation with 566 participants.

Results

Exploratory factor analysis and confirmatory factor analysis confirmed a promising validity of the scale. The values of Cronbach’s alpha coefficient, the Spearman-Brown coefficient, and the retested Cronbach’s alpha coefficient of the scale applied for the clinical evaluation were 0.88, 0.87, and 0.98, respectively, which confirmed a good internal consistency and stability. The results of the goodness-of-fit test indicated a good adaptation of the model. A correlation analysis was conducted to assess the correlation between the GHE-MSS and the PCL-C, which had a correlation coefficient of 0.68 (P<0.01).

Conclusion

GHE-MSS can be applied with a promising reliability and validity for the assessment of the acute mental stress response of medical workers experiencing public health events. This method can also be used for the screening of mental stress-associated disorders.