Psychometric testing of a self-report measure of engagement in productive occupations

Patient-reported outcome measures for life engagement in mental health: a systematic review

Background

Life engagement in the context of mental health is a broad term that describes positive health aspects relating to cognition, vitality, motivation and reward, and the ability to feel pleasure—concepts that are meaningful to patients. The aim of this systematic literature review was to identify validated patient-reported outcomes (PROs) that can assess any aspect of life engagement in adults, in the field of general mental health.

Methods

This was a systematic literature review of articles in English from the MEDLINE database (date of search: September 9, 2020). The search strategy had three components: (1) terms to capture PROs; (2) terms to capture mental health; and (3) terms to capture aspects of life engagement. Articles were eligible if they included a PRO that: (1) is named; (2) can be used across mental health disorders; (3) is used to assess any aspect of life engagement; and (4) has undergone psychometric validation and/or qualitative content validation. A list of PROs was extracted.

Results

A total of 1585 records were screened and 233 articles were eligible for inclusion. Within these 233 articles, 49 distinct PROs were identified, two of which specifically captured their authors’ interpretation of life engagement: the Engaged Living Scale (ELS) and the Life Engagement Test (LET). However, while the ELS and LET covered motivation and reward, life fulfillment, and value-based living, neither scale captured the cognitive or vitality aspects of life engagement. The remaining identified PROs generally captured single aspects of life engagement, most commonly motivation/reward/energy–apathy, pleasure–anhedonia, and mental/psychological well-being.

Conclusion

Numerous PROs are available that may capture aspects of life engagement. However, a need remains for a new PRO that can be used in clinical trials to provide a more comprehensive description of the improvements in life engagement that patients with mental health disorders may experience with successful treatment.

Effectiveness of Balancing Everyday Life (BEL) versus standard occupational therapy for activity engagement and functioning among people with mental illness - a cluster RCT study

BACKGROUND

Many with a mental illness have an impoverished everyday life with few meaningful activities and a sedentary lifestyle. The study aim was to evaluate the effectiveness of the 16-week Balancing Everyday Life (BEL) program, compared to care as usual (CAU), for people with mental illness in specialized and community-based psychiatric services. The main outcomes concerned different aspects of subjectively evaluated everyday activities, in terms of the engagement and satisfaction they bring, balance among activities, and activity level. Secondary outcomes pertained to various facets of well-being and functioning. It was hypothesized that those who received the BEL intervention would improve more than the comparison group regarding activity, well-being and functioning outcomes.

METHODS

BEL is a group and activity-based lifestyle intervention. CAU entailed active support, mainly standard occupational therapy. The BEL group included 133 participants and the CAU group 93. They completed self-report questionnaires targeting activity and well-being on three occasions - at baseline, after completed intervention (at 16 weeks) and at a six-month follow-up. A research assistant rated the participants' level of functioning and symptom severity on the same occasions. Non-parametric statistics were used since these instruments produced ordinal data.

RESULTS

The BEL group improved more than the CAU group from baseline to 16 weeks on primary outcomes in terms of activity engagement (p < 0.001), activity level (p = 0.036) and activity balance (p < 0.042). The BEL group also improved more on the secondary outcomes of symptom severity (p < 0.018) and level of functioning (p < 0.046) from baseline to 16 weeks, but not on well-being. High intra-class correlations (0.12-0.22) indicated clustering effects for symptom severity and level of functioning. The group differences on activity engagement (p = 0.001) and activity level (p = 0.007) remained at the follow-up. The BEL group also improved their well-being (quality of life) more than the CAU group from baseline to the follow-up (p = 0.049). No differences were found at that time for activity balance, level of functioning and symptom severity.

CONCLUSION

The BEL program was effective compared to CAU in terms of activity engagement. Their improvements were not, however, greater concerning other subjective perceptions, such as satisfaction with daily activities and self-rated health, and clustering effects lowered the dependability regarding findings of improvements on symptoms and functioning. Although the CAU group had "caught up" at the follow-up, the BEL group had improved more on general quality of life. BEL appeared to be important in shortening the time required for participants to develop their engagement in activity and in attaining improved quality of life in a follow-up perspective.

TRIAL REGISTRATION

The study was registered with ClinicalTrial.gov. Reg. No. NCT02619318 .

Empowerment, self and engagement in day center occupations: A longitudinal study among people with long-term mental illness

BACKGROUND

Day centers are a common form of mental health service internationally. They are aimed at enhancing occupational engagement and social relations, but there is a need to clarify the outcomes of day center programs, including the impact on important aspects of recovery such as empowerment.

AIMS

The aim of this study was to explore whether perceived empowerment changed over time among Swedish day center users and whether self-esteem, quality of life, socio-demographic data and self-reported diagnosis, type of program and level of engagement in day center occupations could predict future empowerment.

METHOD

The study involved a re-analysis of longitudinal data from 14 day centers, where measures of perceived empowerment and other individual factors were collected over a 15-month period. Non-parametric statistics were used, including Wilcoxon's signed-rank test and logistic regression analysis.

RESULTS

There were no significant changes in day center attendee empowerment scores. Self-esteem and level of engagement in day center occupations were found to be predictors of empowerment, together explaining 34% of the variation.

CONCLUSIONS

Developing empowerment in the day center context involves a complex interaction of individual, social and material factors. Potential barriers to empowerment are discussed along with considerations related to measuring empowerment as an outcome of day center programs.

Quality of Life Among People with Psychiatric Disabilities: Does Day Centre Attendance Make a Difference?

The purpose was to investigate (i) how people with psychiatric disabilities who attend day centres experience their quality of life (QoL) compared to non-attendees, (ii) differences in QoL between those who attend meeting place-oriented centres and those who attend work-oriented centres, (iii) possible correlates of QoL among day centre attendees. Ninety-three day centre attendees and 82 non-attendees completed questionnaires addressing QoL and selected correlates. No group difference was found regarding QoL. Factors related with a good QoL were high levels of self-mastery and motivation. Thus, promoting day centre attendees' self-mastery and motivation might enhance their QoL.

Well-being and perceptions of everyday activities among those who attend community-based day centres for people with mental illness in Sweden - Does an immigrant background make a difference?

BACKGROUND

Community-based day centres (CBDCs) for people with mental illness are a common service for both people with an immigrant background and native Swedes.

AIM

The aim was to compare CBDC attendees with an immigrant background with attendees who were native Swedes in terms of well-being and perceptions of everyday activities and investigate whether ethnic background could predict these factors.

METHODS

Attendees at nine CBDCs were invited to participate. In all, 56 with an immigrant background and 69 native Swedes completed self-report questionnaires that addressed various aspects of well-being and everyday activities.

RESULTS

Attendees with an immigrant background had a worse situation regarding perceived self-esteem, empowerment and satisfaction with everyday activities. In multivariate logistic regression analyses, ethnic background only became a significant predictor in regard to empowerment. Quality of life and activity level were of importance for satisfaction with everyday activities. Empowerment and self-esteem mutually influenced each other.

CONCLUSION

Having a mental illness and an immigrant background may infer a particular risk for low empowerment. The mental health services and society at large should consider measures for adjusting the support to this group, including an analysis of how environments and contexts may act as barriers to activity enrichment and culturally congruent support.

How do Swedish day center attendees with psychiatric disabilities view their worker role? A structural equation modeling study

AIM

To investigate how day center attendees with psychiatric disabilities perceived their worker role and the importance of current work situation and personal factors in that respect.

METHODS

Two-hundred attendees completed the Worker Role Self-assessment and questionnaires addressing possible predictors of the worker role: current employment situation, satisfaction with that situation, and a personal factor (encompassing self-esteem, self-mastery and engagement). Structural equation modeling was used.

RESULTS

A model indicated two worker role factors; belief in a future worker role (WR1) and current capacities and routines (WR2). WR1 was positively influenced by having a job, younger age and the personal factor. Satisfaction with current work situation (usually unemployment) was negatively associated with WR1. The personal factor was single predictor of WR2. The attendees rated WR2 more positively than WR1.

CONCLUSIONS

The personal factor was crucial for both WR1 and WR2. Work-related factors were only important for WR1. The more negative rating of belief in a future worker role may be interpreted as mistrust in the services. The attendees' positive ratings of capacities indicate, however, that they had a rehabilitation potential to develop. Enhancing self-esteem, mastery and engagement may be an avenue for staff in efforts to support the attendee's worker role.

Staff ratings of occupational engagement among people with severe mental illness - psychometric properties of a screening tool in the day center context

Background

Staff who plan and organize day center activities may need to observe the attendees’ performance and progression. This led us to develop a tool for that purpose, termed General Occupational Engagement in people with Severe mental illness (GOES). The aim was to investigate its psychometric properties in terms of factor structure, internal consistency, corrected item-total correlations (CITC), convergent and discriminant validity, and test-retest stability.

Methods

Ninety-three day center attendees were assessed by the GOES and instruments addressing constructs hypothesized to be either similar to (activity level, motivation for day center attendance, perceptions of the worker role, hours spent in the day center) or divergent from the GOES (attendees’ ratings of engagement in specified occupations, self-rated health, psychosocial functioning, psychiatric symptoms). A second sample of 41 attendees were included for the test-retest analysis. Exploratory factor analysis, Cronbach’s alpha analysis, Pearson correlations and paired-samples t-tests were performed.

Results

Exploratory factor analysis indicated one factor, which was in line with the intentions of the scale. The alpha value was 0.85 and all CITC were above 0.30. The tests for convergent validity resulted in correlations ranging between 0.23 and 0.47, most of which were moderately strong and mainly confirmed the hypotheses. Discriminant validity was clearly indicated, since all correlations with the selected constructs were <0.20. GOES also showed preliminary test-retest stability (r = 0.32).

Conclusions

The GOES is ready for use in rehabilitation services and research where productive and other types of activities are of interest. It may serve as an important supplement to attendees’ self-reported occupational engagement.

Programme characteristics and everyday occupations in day centres and clubhouses in Sweden

BACKGROUND

Meaningful everyday occupations are important for mental health and recovery and are provided by both community-based day centres (DCs) and clubhouses. It is unknown, however, if any of the two has more recovery-promoting features.

OBJECTIVE

This nine-month longitudinal study compared DC and clubhouses, concerning the users' perceptions of unit and programme characteristics, and aspects of everyday occupations in terms of engagement and satisfaction. Stability over time in these respects, as well as motivation for participation and relationships with occupational engagement and satisfaction, were explored.

METHODS

Participants from 10 DCs (n = 128) and 5 clubhouses (n = 57) completed self-report instruments.

RESULTS

DC attendees rated lower levels on two organizational factors; choice and ability to influence decisions, and the unit's social network. Motivation showed to be an important factor for perceived occupational engagement, which did not differ between the two groups. DC attendees were more satisfied with their everyday occupations at baseline, but that factor increased more in the clubhouse group and there was no group difference at follow-up. The unit and programme characteristics and occupational engagement showed stability over time.

DISCUSSION

Clubhouses seemed more advantageous and DC services may consider developing users' opportunities for choice and decision-making, and peer support.

Factor Structure and Construct Validity of the Worker Role Self-Assessment (WRS) When Used for People With Psychiatric Disabilities in Sweden

A self-report instrument assessing work-related factors among people with psychiatric disabilities would be useful when trying to match possible employment or prevocational opportunities with people's desires and capacities. The aim of this study was to explore the factor structure, internal consistency, and construct and criterion validity of the Worker Role Self-Assessment (WRS) in this group as well as possible floor and ceiling effects. The participants were 283 clients from day centers for people with psychiatric disabilities and from outpatient units for people with psychosis. They completed the WRS and instruments selected to assess construct validity in terms of convergent (motivation for work and current activity level as reference variables) and discriminant validity (quality of life and self-rated health as reference variables). Two factors were identified, one tapping beliefs in a future worker role and one reflecting current capacities and routines. The internal consistency for the scale as a whole was good at 0.84. The factor reflecting a future worker role correlated as expected with the reference variables used to assess convergent and discriminant validity, whereas current capacities and routines showed a moderate association with quality of life and self-rated health, assumed to indicate discriminant validity. Criterion validity was shown in that those who had recent work experiences scored higher than the others on WRS. No floor or ceiling effects were identified. The findings indicate acceptable psychometric properties of the WRS. Further development is still warranted, however; the factor solution needs to be replicated and the construct validity should be further established.

Work experiences among attendees of day centres for people with psychiatric disabilities

BACKGROUND

It is possible that people with psychiatric disabilities who visit day centres have previous work experiences that may be seen as resources for their current engagement in day centre activities. Research in this respect seems to lack, however.

OBJECTIVE

To investigate work experiences among attendees at day centres for people with psychiatric disabilities and relationships with current type of day centre (work-oriented, meeting place-oriented or mixed), engagement in day centre activities, motivation and socio-demographic and health-related factors.

METHODS

Seventy-seven attendees responded to questionnaires. Global Assessment of Functioning, GAF, was also used. Work was categorised into Group I (professionals, semi-professionals), Group II (clerical support, services workers) and Group III (e.g. craft workers, elementary occupations).

RESULTS

Almost everyone had previously had open-market employment; more than half for ≥ 10 years. Group I was more common in mixed centres, Group II in meeting place-oriented ones and Group III in work-oriented ones. Group I more frequently had college degree and was rated high on GAF functioning. Women were over-represented in Group II, and men in Group III and in meeting place-oriented centres. Attending mixed centres was more likely when having a college degree, scoring high on GAF functioning and being highly engaged in activities. Attendees at work-oriented day centres were characterised by being motivated for spending time alone and reporting a diagnosis of psychosis.

CONCLUSIONS

The participants had unused working capacity. No clear-cut relationships were found between work experiences and the investigated correlates.

Factors influencing occupational engagement in day centers for people with psychiatric disabilities

Occupational engagement is a vital factor in people's lives since it has been shown to be important for health and well-being. Community-based day centers (DCs), both meeting place-oriented and work-oriented ones, are common service alternatives in many western countries for enabling engagement in productive and leisure occupations among people with psychiatric disabilities. Little is, however, known about factors influencing occupational engagement in such settings. We aimed to investigate how factors pertaining to day center attendance, socio-demographics, motivation, clinical and self-related characteristics were related to how day center attendees rated their occupational engagement in productive occupations. These variables were assessed among day center attendees in meeting place-oriented (n = 39) and work-oriented (n = 54) DCs in Sweden through questionnaires and interviews. Logistic regression models showed that (1) less general psychopathology and more time spent on day center occupations were indicators of belonging to the group with a high level of occupational engagement according to a median cut; (2) higher perceived self-mastery was the only important factor with respect to ratings of occupational engagement above the third quartile. The models may be seen as creating a stepwise indication on which factors are important for reaching a medium level of occupational engagement (less severe general psychopathology and time spent at the day center) and for reaching a still higher level (a high level self-mastery), respectively, of occupational engagement. The findings may also be discussed in relation to different levels of engagement in a recovery process.

Empowerment and occupational engagement among people with psychiatric disabilities

BACKGROUND

Empowerment is essential in the rehabilitation process for people with psychiatric disabilities and knowledge about factors that may play a key role within this process would be valuable for further development of the day centre services.

OBJECTIVE

The present study investigates day centre attendees' perceptions of empowerment. The aim was to investigate which factors show the strongest relationships to empowerment when considering occupational engagement, client satisfaction with day centres, and health-related and socio-demographic factors as correlates.

METHODS

123 Swedish day centre attendees participated in a cross-sectional study by completing questionnaires regarding empowerment and the targeted correlates. Data were analysed with non-parametric statistics.

RESULTS

Empowerment was shown to be significantly correlated with occupational engagement and client satisfaction and also with self-rated health and symptoms rated by a research assistant. The strongest indicator for belonging to the group with the highest ratings on empowerment was self-rated health, followed by occupational engagement and symptom severity.

IMPLICATIONS

Occupational engagement added to the beneficial influence of self-rated health on empowerment. Enabling occupational engagement in meaningful activities and providing occupations that can generate client satisfaction is an important focus for day centres in order to assist the attendees' rehabilitation process so that it promotes empowerment.

Predictors of valued everyday occupations, empowerment and satisfaction in day centres: implications for services for persons with psychiatric disabilities

This study addresses predictors of occupational value, empowerment and satisfaction with the rehabilitation received in day centres for people with psychiatric disabilities. These outcomes represent varying aspects of relevance for the day centre context and together create a manifold outcome picture. This was a longitudinal study with approval from the regional research vetting board. Self-report instruments were used, and the investigated predictors motivation for going to the day centre, occupational engagement, socio-demographic factors and self-reported diagnosis. Attendees (N = 108) at 8 day centres participated and filled in self-report questionnaires regarding the predictor and outcome variables. A baseline measurement and a 14-month follow-up composed the data. Occupational engagement at baseline could predict all three outcomes at the follow-up. Motivation for the day centre activities and not preferring work before attending the day centre were positive for satisfaction with the day centre. A low participation rate, although comparable with previous studies on the target group, was a limitation of this study. To conclude, both occupational engagement and motivation are factors that can be stimulated by the staff in day centres. Actions for how to accomplish that, and thereby also more positive outcomes of the day centre services, are proposed, such as a system of freedom of choice among day centres, and between day centres and supported employment.