Study protocol of an effect and process evaluation of the Stamina model; a Structured and Time-effective Approach through Methods for an Inclusive and Active working life

Navigating process evaluation in co-creation: a Health CASCADE scoping review of used frameworks and assessed components

BACKGROUND

Co-creation is seen as a way to ensure all relevant needs and perspectives are included and to increase its potential for beneficial effects and uptake process evaluation is crucial. However, existing process evaluation frameworks have been built on practices characterised by top-down developed and implemented interventions and may be limited in capturing essential elements of co-creation. This study aims to provide a review of studies planning and/or conducting a process evaluation of public health interventions adopting a co-creation approach and aims to derive assessed process evaluation components, used frameworks and insights into formative and/or participatory evaluation.

METHODS

We searched for studies on Scopus and the Health CASCADE Co-Creation Database. Co-authors performed a concept-mapping exercise to create a set of overarching dimensions for clustering the identified process evaluation components.

RESULTS

54 studies were included. Conceptualisation of process evaluation included in studies concerned intervention implementation, outcome evaluation, mechanisms of impact, context and the co-creation process. 22 studies (40%) referenced ten existing process evaluation or evaluation frameworks and most referenced were the frameworks developed by Moore et al (14%), Saunders et al (5%), Steckler and Linnan (5%) and Nielsen and Randall (5%).38 process evaluation components were identified, with a focus on participation (48%), context (40%), the experience of co-creators (29%), impact (29%), satisfaction (25%) and fidelity (24%).13 studies (24%) conducted formative evaluation, 37 (68%) conducted summative evaluation and 2 studies (3%) conducted participatory evaluation.

CONCLUSION

The broad spectrum of process evaluation components addressed in co-creation studies, covering both the evaluation of the co-creation process and the intervention implementation, highlights the need for a process evaluation tailored to co-creation studies. This work provides an overview of process evaluation components, clustered in dimensions and reflections which researchers and practitioners can use to plan a process evaluation of a co-creation process and intervention.

A Quantitative Study on Employees' Experiences of a Support Model for Systematic Work Environment Management in Swedish Municipalities

Today's working life is constantly changing, and work environmental risk factors can alter swiftly. Besides the traditional physical work environment risk factors, somewhat more abstract organizational and social work environment factors also play an ever-increasing role, both in preventing and causing work-related illness. This requires a preventive work environment management that can respond to rapid changes, and where the assessment and remedies rely more on employee participation than on predetermined threshold limits. This study aimed to investigate if the use of a support model (the Stamina model) for workplace improvements could render the same positive effects in quantitative measures that have previously been shown in qualitative studies. Employees from six municipalities used the model for 12 months. They answered a questionnaire at baseline and after six and 12 months, to detect any changes in how they characterized their current work situation and perceived their influence, productivity, short-term recovery, and organizational justice. The results showed that employees felt more influential in work situations related to communication/collaboration and roles/tasks at the follow-up compared to the baseline. These results are consistent with previous qualitative studies. We found no significant changes in the other endpoints. The results strengthen previous conclusions, namely that the Stamina model can be used as part of inclusive, modern, and systematic work environment management.

How Human Resources Index, Relational Justice, and Perceived Productivity Change after Reorganization at a Hospital in Sweden That Uses a Structured Support Model for Systematic Work Environment Management

To facilitate systematic work environment management, which should be a natural part of business development, a structured support model was developed. The Stamina model has previously been used in Swedish municipalities, showing positive results. The aim was to study how the Human Resources Index (HRI), relational justice, short-term recovery and perceived productivity changed in a recently reorganised perioperative setting in a hospital in Sweden that uses a structured support model for systematic work environment management. A longitudinal design that took measurements at four time points was used in a sample of 500 employees in a perioperative hospital department. The results for the overall sample indicated a positive trend in the HRI (Mt1 = 48.5, SDt1 = 22.5; Mt3 = 56.7, SDt1 = 21.2; p < 0.001). Perceived health-related production loss (Mdt1 = 2, IQR = 3; Mdt3 = 0, IQR = 3; p < 0.001) and perceived work environment-related production loss (Mdt1 = 2, IQR = 3; Mdt3 = 0, IQR = 4; p < 0.001) showed major improvements. Short-term recovery showed a minor improvement (Mt1 = 2.61, SDt1 = 1.33; Mt3 = 2.65, SDt3 = 1.22; p = 0.872). In conclusion, the implementation of the Stamina model, of which the HRI constitutes an important part, seems to be a helpful tool to follow-up on work environment processes, and minimise production losses due to health and work environment-related issues.

Can the Human Resources Index (HRI) Be Used as a Process Feedback Measurement in a Structured Support Model for Systematic Work Environment Management?

The aim of the study was to estimate the level of the human resources index (HRI) measure among Swedish municipal employees, and to investigate the association between human resources index (HRI) and relational justice, short-term recovery, work environment-related production loss, and health-related production loss. A cross-sectional design was used with one sample of municipal employees (n = 6402). The results showed a positive association (r = 0.31) between human resources index (HRI) and relational justice; a positive (r = 0.27) association between HRI and short-term recovery; a negative association between HRI and work environment-related production loss (r = −0.37); and a negative association between HRI and health-related production loss (r = −0.23). The findings implicate that HRI captures important aspects of the work environment such as productivity, relational justice, and short-term recovery. The HRI measure is part of a support model used in workplaces to systematically address work environment-related issues. Monitoring changes in the HRI measure, it is possible to determine whether the measures taken effect production loss, perceived leadership, and short-term recovery in a work group. The support model using HRI may thus be used to complement traditional work environment surveys conducted in Swedish organizations as obliged by legal provisions.

Implementing New Working Practices Through a Structured Support Model for Systematic Work Environment Management: A Qualitative Study From Swedish Municipalities

OBJECTIVE

To describe factors that facilitate and hinder implementation of a structured support model focusing on psychosocial work environment in Swedish municipalities.

METHODS

This qualitative study was conducted in six Swedish municipalities. In total, 63 semi-structured interviews and focus groups were conducted with key stakeholders in the municipalities during a 2-year period. The consolidated framework for implementation research (CFIR) was used for data analysis.

RESULTS

Findings suggest that the support model needs to have an easy enough structure to understand and use, and it must be immediately applicable for work groups and employees. An important factor for facilitating implementation was the support from first-line managers and upper management.

CONCLUSIONS

Upper management need to be committed to the model and communicate clearly to lower levels of the implementing organization on the purpose and objectives of the model.

A Mixed-Method Study of Providing and Implementing a Support Model Focusing on Systematic Work Environment Management

AIMS

To explore how a support model (Stamina) targeting the systematic work environment management was experienced, provided and implemented in Swedish municipalities.

METHODS

A mixed method approach was applied, including material from interviews and questionnaire. The questionnaire was answered by 123 persons (67.5%), and 18 participants were interviewed twice during a one year period. Data were analysed using descriptive statistics and qualitative content analysis.

RESULTS

The participants followed the structure of the Stamina model in their practical work. Still, there was variation in the practical provision of the model. The implementation was supported by their organizations and was influenced by various actors. Creating commitment was an essential part to facilitate implementation.

CONCLUSION

To promote implementation of the Stamina model, there is a need to create commitment among stakeholders that will participate in the implementation.

First-Line Managers' Experiences of Working with a Structured Support Model for Systematic Work Environment Management

Background: This paper describes the experiences of first-line managers when working with a structured support model for systematic work environment management in their work groups. First-line managers play a key part in influencing the work environment. Methods: In this study, a sample of managers implementing a structured support model, the Stamina model, in Swedish municipalities were interviewed. A total of 31 (n = 31) interviews were conducted at two time points during a one-year period. The collected data were analysed using a qualitative thematic approach. Results: The results showed that managers experienced discomfort when giving the responsibility of working with work environmental issues to employees. However, managers also experienced and were impressed by how well it worked in allowing employees to take on work environmental issues. Managers found that they balanced between being quiescent and, at the same time, actively monitoring progress in the work groups. Conclusions: The results from this study implicate that managers need to be sensitive to the needs and capacity of their work groups. The oracle in Delphi stated know yourself. We conclude: Know your group!

Experiences of the Initial Phase Implementation of the STAMINA-Model in Perioperative Context Addressing Environmental Issues Systematically-A Qualitative Study

(1) Background: Challenges in perioperative settings put demands on staff working with systematic work environment management. A support model, STAMINA (Structured and Time-effective Approach through Methods for an Inclusive and Active working life), was implemented in a hospital in Sweden, to help staff address environmental issues systematically. The aim was to describe the experiences of the initial phase of implementation of the adapted STAMINA model in perioperative context. (2) Methods: Qualitative individual interviews were held with 14 managers and employees (three men and 11 women). Data were analysed by systematic text condensation. (3) Results: Five themes were identified: Limited knowledge of the model and the implementation process; scepticism, lack of confidence in the model and a passive attitude; the model offered increased participation; the culture in the organization-to understand one's role as employees and managers; and endurance and feedback are key factors for success in the implementation process. (4) Conclusions: Scepticism turned to positive attitude by recognising that the STAMINA model offered increased participation. In order to have successful implementation, the organisational culture must be taken into consideration by giving the employees increased responsibilities and timely feedbacks. Role description, goal definition, feedback, and sticking to one model are key factors for success.

A Qualitative Study on Employees' Experiences of a Support model for Systematic Work Environment Management

Background: The aim is to explore how an organisational work environment support model, the Stamina model, influences employees' work situations and the development of sustainable work systems. Methods: It was a qualitative study with semi-structured, focus-group interviews, including 45 employees from six work groups. Eighteen focus group interviews were conducted over a period of two years. Data were analysed with constant comparative method. Results: The core category, shifting focus from an individual to an organisational perspective of work, illustrated how communication and increased understanding of one's work tasks changed over time and contributed to deeper focus on the actual operation. These insights were implemented at different time points among the work groups during the two-year process. Conclusions: Our results indicate that working with the model engages employees in the work environment management, puts emphasis on reflections and discussions about the meaning and purpose of the operations and enables a shared platform for communication. These are important features that need to continue over time in order to create a sustainable work system. The Stamina model, thus seems to have the potential to promote productive and healthy work places.