Translating research in elder care: an introduction to a study protocol series

Building a Program Theory of Implementation Using Process Evaluation of a Complex Quality Improvement Trial in Nursing Homes

BACKGROUND AND OBJECTIVES

Significant quality problems exist in long-term care (LTC). Interventions to improve care are complex and often have limited success. Implementation remains a black box. We developed a program theory explaining how implementation of a complex intervention occurs in LTC settings-examining mechanisms of impact, effects of context on implementation, and implementation outcomes such as fidelity.

RESEARCH DESIGN AND METHODS

Concurrent process evaluation of Safer Care for Older Persons in residential Environments (SCOPE)-a frontline worker (care aide) led improvement trial in 31 Canadian LTC homes. Using a mixed-methods exploratory sequential design, qualitative data were analyzed using grounded theory to develop a conceptual model illustrating how teams implemented the intervention and how it produced change. Quantitative analyses (mixed-effects regression) tested aspects of the program theory.

RESULTS

Implementation fidelity was moderate. Implementation is facilitated by (a) care aide engagement with core intervention components; (b) supportive leadership (internal facilitation) to create positive team dynamics and help negotiate competing workplace priorities; (c) shifts in care aide role perceptions and power differentials. Mixed-effects model results suggest intervention acceptability, perceived intervention benefits, and leadership support predict implementation fidelity. When leadership support is high, fidelity is high regardless of intervention acceptability or perceived benefits.

DISCUSSION AND IMPLICATIONS

Our program theory addresses important knowledge gaps regarding implementation of complex interventions in nursing homes. Results can guide scaling of complex interventions and future research.

Safer Care for Older Persons in (residential) Environments (SCOPE): a pragmatic controlled trial of a care aide-led quality improvement intervention

BACKGROUND

The increased complexity of residents and increased needs for care in long-term care (LTC) have not been met with increased staffing. There remains a need to improve the quality of care for residents. Care aides, providers of the bulk of direct care, are well placed to contribute to quality improvement efforts but are often excluded from so doing. This study examined the effect of a facilitation intervention enabling care aides to lead quality improvement efforts and improve the use of evidence-informed best practices. The eventual goal was to improve both the quality of care for older residents in LTC homes and the engagement and empowerment of care aides in leading quality improvement efforts.

METHODS

Intervention teams participated in a year-long facilitative intervention which supported care aide-led teams to test changes in care provision to residents using a combination of networking and QI education meetings, and quality advisor and senior leader support. This was a controlled trial with random selection of intervention clinical care units matched 1:1 post hoc with control units. The primary outcome, between group change in conceptual research use (CRU), was supplemented by secondary staff- and resident-level outcome measures. A power calculation based upon pilot data effect sizes resulted in a sample size of 25 intervention sites.

RESULTS

The final sample included 32 intervention care units matched to 32 units in the control group. In an adjusted model, there was no statistically significant difference between intervention and control units for CRU or in secondary staff outcomes. Compared to baseline, resident-adjusted pain scores were statistically significantly reduced (less pain) in the intervention group (p=0.02). The level of resident dependency significantly decreased statistically for residents whose teams addressed mobility (p<0.0001) compared to baseline.

CONCLUSIONS

The Safer Care for Older Persons in (residential) Environments (SCOPE) intervention resulted in a smaller change in its primary outcome than initially expected resulting in a study underpowered to detect a difference. These findings should inform sample size calculations of future studies of this nature if using similar outcome measures. This study highlights the problem with measures drawn from current LTC databases to capture change in this population. Importantly, findings from the trial's concurrent process evaluation provide important insights into interpretation of main trial data, highlight the need for such evaluations of complex trials, and suggest the need to consider more broadly what constitutes "success" in complex interventions.

TRIAL REGISTRATION

ClinicalTrials.gov , NCT03426072, registered August 02, 2018, first participant site April, 05, 2018.

Factors Associated with Falls in Canadian Long Term Care Homes: a Retrospective Cohort Study

Background

Half of Canadians living in long-term care (LTC) homes will fall each year resulting in consequences to independence, quality of life, and health. The objective in this study was to analyze factors that contribute to, or are protective against, falls in Canadian LTC homes.

Methods

We analyzed of a retrospective cohort of a stratified random sample of Canadian LTC homes in Western Canada from 2011-2017. We accessed variables from the RAI-MDS 2.0 to assess the association of the dependent variable "fall within the last 31-180 days" with multiple independent factors, using generalized estimating equation models.

Results

A total of 28,878 LTC residents were analyzed. Factors found to increase the odds of falling were other fractures (OR 3.64 [95% confidence interval; CI 3.27, 4.05]), hip fractures (OR 3.58 [3.27, 3.93]), moderately impaired cognitive skills (OR 2.45 [2.28, 2.64]), partial support to balance standing (OR 2.44 [2.30, 2.57]), wandering (OR 2.31 [2.18, 2.44]).

Conclusion

A range of factors identified were associated with falls for people living in LTC homes. Individual physical ability represented the largest group of independent factors contributing to falls. Residents who experience any fracture or an acute change in behaviour, mobility, or activities of daily living (ADL) should be considered at increased risk of falls.

Relationship between environmental factors and responsive behaviours in long-term care homes: a secondary data analysis

OBJECTIVE

Responsive behaviours (eg, wandering, resisting care and verbal abuse) are a continuing issue for staff and individuals living in long-term care (LTC) homes. The LTC environment can influence responsive behaviours and is a factor in determining the quality of life for those living there. The ways in which the quality of the environment might influence responsive behaviours has not been investigated yet. We hypothesised that better quality environments would be associated with reduced rates of responsive behaviours. We used a tool that simultaneously encompasses human and structural elements of the environment, a novel approach in this field of research.

DESIGN

Cross-sectional study, using data collected from September 2014 to May 2015 as part of the Translating Research in Elder Care research programme.

SETTING

A representative, stratified (size, owner-operator model and health region) random sample of 76 LTC homes in British Columbia, Alberta, Manitoba.

PARTICIPANTS

13 224 individuals (67.3% females) living in participating LTC homes.

OUTCOME MEASURES

Quality of care unit work environment was assessed using the observable indicators of quality (OIQ) tool. Responsive behaviours were assessed using routinely collected Resident Assessment Instrument-Minimum Data Set V.2.0 data.

RESULTS

Adjusted regression coefficients of overall Aggressive Behaviour Scale score and interpersonal communication were 0.02 (95% CI -0.011 to 0.045), grooming 0.06 (95% CI -0.032 to 0.157), environment-basics 0.067 (95% CI 0.024 to 0.110), odour -0.066 (95% CI -0.137 to -0.004), care delivery -0.007 (95% CI -0.033 to 0.019), environment-access -0.027 (95% CI -0.062 to 0.007), environment-homelike -0.034 (95% CI -0.065 to -0.002) and total OIQ score 0.003 (95% CI -0.004 to 0.010).

CONCLUSIONS

We found small associations between the environmental quality and responsive behaviours in Western Canadian LTC homes. Higher scores on homelikeness were associated with decreased responsive behaviours. Higher scores on basic environmental quality were associated with increased responsive behaviours.

Evolving partnerships: engagement methods in an established health services research team

BACKGROUND

The Translating Research in Elder Care (TREC) program is a partnered health services research team that aims to improve the quality of care and quality of life for residents and quality of worklife for staff in nursing homes. This team includes academic researchers, trainees, research staff, citizens (persons living with dementia and family/friend caregivers of persons living in nursing homes), and decision-makers (ministries of health, health authorities, operators of nursing homes). The TREC team has experience working with health system partners but wanted to undertake activities to enhance the collaboration between the academic researchers and citizen members. The aim of this paper is to describe the TREC team members' experiences and perceptions of citizen engagement and identify necessary supports to promote meaningful engagement in health research teams.

METHODS

We administered two online surveys (May 2018, July 2019) to all TREC team members (researchers, trainees, staff, decision-makers, citizens). The surveys included closed and open-ended questions guided by regional and international measures of engagement and related to respondents' experience with citizen engagement, their perceptions of the benefits and challenges of citizen engagement, and their needs for training and other tools to support engagement. We analyzed the closed-ended responses using descriptive statistics.

RESULTS

We had a 78% response rate (68/87) to the baseline survey, and 27% response rate (21/77) to the follow-up survey. At baseline, 30 (44%) of respondents reported they were currently engaged in a research project with citizen partners compared to 11(52%) in the follow-up survey. Nearly half (10(48%)) of the respondents in the follow-up reported an increase in citizen engagement over the previous year. Respondents identified many benefits to citizen engagement (unique perspectives, assistance with dissemination) and challenges (the need for specific communication skills, meeting organizing and facilitation, and financial/budget support), with little change between the two time points. Respondents reported that the amount of citizen engagement in their research (or related projects) had increased or stayed the same.

CONCLUSIONS

Despite increasing recognition of the benefits of including persons with lived experience and large-scale promotion efforts, the research team still lack sufficient training and resources to engage non-academic partners. Our research identified specific areas that could be addressed to improve the engagement of citizens in health research.

The voices of lived experience: reflections from citizen team members in a long-term care research program

BACKGROUND

The Translating Research in Elder Care (TREC) program is a partnered health services research team that aims to improve the quality of care and quality of life for residents and quality of worklife for staff in nursing homes. The TREC team undertook several activities to enhance the collaboration between the academic researchers and us, the citizen members. Known as VOICES (Voice Of (potential) Incoming residents, Caregivers Educating uS) we aim to share our experience working with a large research team.

METHODS

We reflect on the findings reported in the paper by Chamberlain et al. (2021). They described the findings from two surveys (May 2018, July 2019) that were completed by TREC team members (researchers, trainees, staff, decision-makers, citizens). The survey questions asked about the respondents' experience with citizen engagement, their perceptions of the benefits and challenges of citizen engagement, and their unmet needs for training.

RESULTS

The paper reported on the survey findings from all the survey respondents (research team, decision-makers, citizens), but much of the results focused on the researcher perspective. They reported that respondents believed that citizen engagement was a benefit to their research but noted many challenges. While we appreciate the researchers' positive perceptions of citizen engagement, much work remains to fully integrate us into all stages of the research. We offer our reflections and suggestions for how to work with citizen members and identify areas for more training and support.

CONCLUSIONS

Despite the increased interest in citizen engagement, we feel there is a lack of understanding and support to truly integrate non-academic team members on research teams. We hope the discussion in this commentary identifies specific areas that need to be addressed to support the continued engagement of citizens and show how the lived experience can bring value to research teams.

Citizen and stakeholder led priority setting for long-term care research: identifying research priorities within the Translating Research in Elder Care (TREC) Program

BACKGROUND

The Translating Research in Elder Care (TREC) program is a longitudinal partnered program of research in Western Canada that aims to improve the quality of care and quality of life for residents and quality of worklife for staff in long-term care settings. This program of research includes researchers, citizens (persons living with dementia and caregivers of persons living in long-term care), and stakeholders (representatives from provincial and regional health authorities, owner-operators of long-term care homes). The aim of this paper is to describe how we used priority setting methods with citizens and stakeholders to identify ten priorities for research using the TREC data.

METHODS

We adapted the James Lind Alliance Priority Setting Partnership method to ensure our citizens and stakeholders could identify priorities within the existing TREC data. We administered an online survey to our citizen and stakeholder partners. An in-person priority setting workshop was held in March 2019 in Alberta, Canada to establish consensus on ten research priorities. The in-person workshop used a nominal group technique and involved two rounds of small group prioritization and one final full group ranking.

RESULTS

We received 72 online survey respondents and 19 persons (citizens, stakeholders) attended the in-person priority setting workshop. The workshop resulted in an unranked list of their ten research priorities for the TREC program. These priorities encompassed a range of non-clinical topics, including: influence of staffing (ratios, type of care provider) on residents and staff work life, influence of the work environment on resident outcomes, and the impact of quality improvement activities on residents and staff.

CONCLUSIONS

This modified priority setting approach provided citizens and stakeholders with an opportunity to identify their own research priorities within the TREC program, without the external pressures of researchers. These priorities will inform the secondary analyses of the TREC data and the development of new projects. This modified priority setting may be a useful approach for research teams trying to engage their non-academic partners and to identify areas for future research.

The transfer of knowledge on integrated care among five European regions: a qualitative multi-method study

BACKGROUND

To examine how the knowledge transfer processes unfolded within SCIROCCO, a EU funded project (3rd Health Programme (2014-2020)) that aimed to facilitate the process of knowledge sharing across five European regions, to speed up adoption and scaling-up of integrated care initiatives.

METHODS

A qualitative multi-method design was used. Data collection methods included focus groups, project documents and action plans of the regions. The data was analysed using a qualitative content-analysis procedure, which was guided by the frameworks of knowledge exchange and the why, whose, what, how framework for knowledge mobilisers.

RESULTS

All five components (including the themes) of knowledge exchange could be identified in the approach developed on the knowledge transfer processes. The four questions and accompanying categories of the framework of knowledge mobilisation were also identified to a large degree.

CONCLUSIONS

The observed incorporation of distinct forms of knowledge from multiple sources and the observed dynamic and fluid knowledge transfer processes both suggest that SCIROCCO developed a comprehensive knowledge transfer approach aiming to enable the adoption and scaling-up of integrated care. Overall, the multi-method qualitative nature of this research has allowed some new and practical insights in the knowledge transfer activities on integrated care between several European regions. To obtain a clear understanding of the content of the knowledge transfer approaches, which could assist the operationalising of models to support the evaluation of knowledge transfer activities, it is strongly recommended that further research of this type should be conducted in other research settings.

Factors Associated With Nurses' Job Satisfaction In Residential Long-term Care: The Importance of Organizational Context

OBJECTIVES

We examined demographic, individual, and organizational context factors associated with nurses' job satisfaction in residential long-term care (LTC) settings. Job satisfaction has implications for staff turnover, staff health, and quality of care.

DESIGN

A cross-sectional analysis of survey data collected in the Translating Research in Elder Care program.

SETTING AND PARTICIPANTS

N = 756 nurses (registered nurses: n = 308; licensed practical nurses: n = 448) from 89 residential LTC settings in 3 Western Canadian provinces.

METHODS

We used a generalized estimating equation model to assess demographic, individual, and organizational context factors associated with job satisfaction. Job satisfaction was measured using the Michigan Organizational Assessment Questionnaire Job Satisfaction Scale.

RESULTS

Demographic, individual, and organizational context factors were associated with job satisfaction among nurses in residential LTC settings. At the demographic level, hours worked in 2 weeks (B = 0.002, P = .043) was associated with job satisfaction. At the individual level, emotional exhaustion-burnout (B = -0.063, P = .02) was associated with lower job satisfaction, while higher scores on empowerment (meaning) (B = 0.140, P = .015), work engagement (vigor) (B = 0.096, P = .01), and work engagement (dedication) (B = 0.129, P = .001) were associated with higher job satisfaction. With respect to organizational context, culture (B = 0.175, P < .001), organizational slack-space (eg, perceived availability and use of adequate space; B = 0.043, P = .040), and adequate orientation (B = 0.092, P < .001) were associated with higher job satisfaction.

CONCLUSIONS AND IMPLICATIONS

We identified previously unexamined modifiable organizational features (organizational slack-space and adequate orientation) as factors associated with LTC nurses' job satisfaction in the Canadian context. Our findings support future efforts to improve job satisfaction through improvements in organizational space and provision of adequate workplace orientation.

Predictors of Nurses' Research Use in Canadian Long-term Care Homes

OBJECTIVES

We examined the influence of individual characteristics and organizational context features on nurses' self-reported use of research evidence in long-term care (LTC) homes.

DESIGN

A cross-sectional analysis of survey data collected in the Translating Research in Elder Care program.

SETTING AND PARTICIPANTS

756 nurses (registered nurses and licensed practical nurses) from 89 LTC homes in Western Canada.

METHODS

Generalized estimating equation modeling was used to identify which individual characteristics and organizational context features significantly predicted (P < .05) 3 kinds of self-reported research use by nurses: instrumental (the direct application of research findings), conceptual (using research findings to change thinking), and persuasive (using research findings to convince others).

RESULTS

Nurses reported a moderate to high level of research use. There were no significant differences in mean research use scores by nursing role. Only 2 variables were associated with all 3 kinds of research use: having a positive attitude toward research, and availability of structural and electronic resources. Additional variables associated with instrumental research use were problem-solving ability, engaging in formal interactions (eg, education sessions), and better perceptions of organizational slack-staff (the availability of sufficient staff). Additional variables associated with conceptual research use were self-determination and job efficacy. Finally, additional variables associated with persuasive research use were belief suspension (the ability to suspend previously held beliefs), organizational citizenship behavior (one's voluntary commitment to the organization), self-determination, job efficacy, evaluation, and better perceptions of organizational slack-time (perceived availability of extra time).

CONCLUSIONS AND IMPLICATIONS

Conceptual and persuasive research use were most strongly influenced by individual characteristics, whereas instrumental research use was predicted equally by individual and organizational variables. Nurses working in LTC are positioned in leadership roles; by targeting both the individual- and organizational-level predictors of nurses' research use, they can improve conditions for individuals living in LTC.

Fusion Validity: Theory-Based Scale Assessment via Causal Structural Equation Modeling

Fusion validity assessments employ structural equation models to investigate whether an existing scale functions in accordance with theory. Fusion validity parallels criterion validity by depending on correlations with non-scale variables but differs from criterion validity because it requires at least one theorized effect of the scale, and because both the scale and scaled-items are included in the model. Fusion validity, like construct validity, will be most informative if the scale is embedded in as full a substantive context as theory permits. Appropriate scale functioning in a comprehensive theoretical context greatly enhances a scale's validity. Inappropriate scale functioning questions the scale but the scale's theoretical embedding encourages detailed diagnostic investigations potentially challenging specific items, the procedure used to calculate scale values, or aspects of the theory, but also possibly recommends incorporating additional items into the scale. The scaled items should have survived prior content and methodological assessments but the items may or may not reflect a common factor because items having diverse causal backgrounds can sometimes fuse to form a unidimensional entity. Though items reflecting a common cause can be assessed for fusion validity, we illustrate fusion validity in the more challenging context of a scale comprised of diverse items and embedded in a complicated theory. Specifically we consider the Leadership scale from the Alberta Context Tool with care aides working in Canadian long-term care homes.

Who Is (Still) Looking After Mom and Dad? Few Improvements in Care Aides' Quality-of-Work Life

ABSTRACTUnregulated care aides provide most of the direct care to nursing home residents. We previously reported the first demographic profile of care aides in Western Canada through the Translating Research in Elder Care (TREC) longitudinal research program (2007-2022) in applied health services. Here we describe demographic, health, and work life characteristics of aides from 91 nursing homes in Western Canada. Demographics and work life varied significantly across health regions and facility owner-operator models. Our longitudinal cohort of aides from Alberta and Winnipeg had higher emotional exhaustion (a negative attribute), professional efficacy (a positive attribute), and experience of dementia-related responsive behaviours from residents. Overall, results indicate little improvement or worsening of care aide health and quality of work life. Coupled with limited provincial or national initiatives for workforce planning and training of these workers, this signals a long-term care system ill-prepared to care effectively for Canada's aging population.

Importance of clinical educators to research use and suggestions for better efficiency and effectiveness: results of a cross-sectional survey of care aides in Canadian long-term care facilities

OBJECTIVE

This study explored the effect of clinical educators as facilitators of research use and how it may be modified by organisational context in the settings.

DESIGN

Cross-sectional observational study.

SETTING

A representative sample of 91 residential long-term care (LTC) facilities across Western Canada.

PARTICIPANTS

We used surveys to collect data from the frontline care aides and information about the organisational context of the care units.

OUTCOME MEASURE AND EXPLANATORY VARIABLES

We assessed research use (the outcome) with the Conceptual Research Utilization (CRU) scale. Explanatory variables in the multiple regression analysis were facilitation, organisational context and the interaction terms. Facilitation was measured by the frequency of contacts between care aides and clinical educator or person who brings new ideas about resident care. Three core organisational context variables were measured using the Alberta Context Tool.

RESULTS

We included data of 3873 care aides from 294 care units in the LTC facilities. We found significant associations between CRU and facilitation, leadership, culture and evaluation. Interactions of facilitation x leadership and facilitation x culture were negative. The coefficient of the facilitation x evaluation term in the regression model was positive (0.019, 95% CI 0.012 to 0.026), suggesting synergistic effects between facilitation and a well-developed process to evaluate care quality using relevant data.

CONCLUSIONS

Findings indicate clinical educators are effective facilitators of research use among the care aides, but the effect is modified by organisational context. For greatest impact, managers can direct efforts of the clinical educators to care units where leadership and culture ratings are lowest, but a proficient feedback and evaluation process is in place. This understanding enables managers to deploy clinical educators (a scarce resource in LTC settings) most efficiently.

Relationships between work outcomes, work attitudes and work environments of health support workers in Ontario long-term care and home and community care settings

BACKGROUND

Our overarching study objective is to further our understanding of the work psychology of Health Support Workers (HSWs) in long-term care and home and community care settings in Ontario, Canada. Specifically, we seek novel insights about the relationships among aspects of these workers' work environments, their work attitudes, and work outcomes in the interests of informing the development of human resource programs to enhance elder care.

METHODS

We conducted a path analysis of data collected via a survey administered to a convenience sample of Ontario HSWs engaged in the delivery of elder care over July-August 2015.

RESULTS

HSWs' work outcomes, including intent to stay, organizational citizenship behaviors, and performance, are directly and significantly related to their work attitudes, including job satisfaction, work engagement, and affective organizational commitment. These in turn are related to how HSWs perceive their work environments including their quality of work life (QWL), their perceptions of supervisor support, and their perceptions of workplace safety.

CONCLUSIONS

HSWs' work environments are within the power of managers to modify. Our analysis suggests that QWL, perceptions of supervisor support, and perceptions of workplace safety present particularly promising means by which to influence HSWs' work attitudes and work outcomes. Furthermore, even modest changes to some aspects of the work environment stand to precipitate a cascade of positive effects on work outcomes through work attitudes.

Influence of organizational context on nursing home staff burnout: A cross-sectional survey of care aides in Western Canada

PURPOSE

Our study examined care aide characteristics, organizational context, and frequency of dementia-related resident responsive behaviours associated with burnout. Burnout is the experience of emotional exhaustion, cynicism, and professional inefficacy. Care aide burnout has implications for turnover, staff health, and quality of care.

DESIGN AND METHODS

We used surveys collected from 1194 care aides from 30 urban nursing homes in three Western Canadian provinces. We used a mixed-effects regression analysis to assess care aide characteristics, dementia-related responsive behaviours, unit and facility characteristics, and organizational context predictors of care aide burnout. We measured burnout using the Maslach Burnout Inventory, Short Form.

RESULTS

We found that care aides were at high risk for emotional exhaustion and cynicism, but report high professional efficacy. Statistically significant predictors of emotional exhaustion included English as a second language, medium facility size, organizational slack-staff, organizational slack-space, health (mental and physical) and dementia-related responsive behaviours. Statistically significant predictors of cynicism were care aide age, English as a second language, unit culture, evaluation (feedback of data), formal interactions, health (mental and physical) and dementia-related responsive behaviours. Statistically significant predictors of professional efficacy were unit culture and structural resources. Greater care aide job satisfaction was significantly associated with increased professional efficacy.

IMPLICATIONS

This study suggests that individual care aide and organization features are both predictive of care aide burnout. Unlike care aide or structural characteristics of the facility elements of the organizational context are potentially modifiable, and therefore amenable to intervention.

Pathways for best practice diffusion: the structure of informal relationships in Canada's long-term care sector

Background

Initiatives to accelerate the adoption and implementation of evidence-based practices benefit from an association with influential individuals and organizations. When opinion leaders advocate or adopt a best practice, others adopt too, resulting in diffusion. We sought to identify existing influence throughout Canada’s long-term care sector and the extent to which informal advice-seeking relationships tie the sector together as a network.

Methods

We conducted a sociometric survey of senior leaders in 958 long-term care facilities operating in 11 of Canada’s 13 provinces and territories. We used an integrated knowledge translation approach to involve knowledge users in planning and administering the survey and in analyzing and interpreting the results. Responses from 482 senior leaders generated the names of 794 individuals and 587 organizations as sources of advice for improving resident care in long-term care facilities.

Results

A single advice-seeking network appears to span the nation. Proximity exhibits a strong effect on network structure, with provincial inter-organizational networks having more connections and thus a denser structure than interpersonal networks. We found credible individuals and organizations within groups (opinion leaders and opinion-leading organizations) and individuals and organizations that function as weak ties across groups (boundary spanners and bridges) for all studied provinces and territories. A good deal of influence in the Canadian long-term care sector rests with professionals such as provincial health administrators not employed in long-term care facilities.

Conclusions

The Canadian long-term care sector is tied together through informal advice-seeking relationships that have given rise to an emergent network structure. Knowledge of this structure and engagement with its opinion leaders and boundary spanners may provide a route for stimulating the adoption and effective implementation of best practices, improving resident care and strengthening the long-term care advice network. We conclude that informal relational pathways hold promise for helping to transform the Canadian long-term care sector.

Improving Nursing Home Care through Feedback On PerfoRMance Data (INFORM): Protocol for a cluster-randomized trial

BACKGROUND

Audit and feedback is effective in improving the quality of care. However, methods and results of international studies are heterogeneous, and studies have been criticized for a lack of systematic use of theory. In TREC (Translating Research in Elder Care), a longitudinal health services research program, we collect comprehensive data from care providers and residents in Canadian nursing homes to improve quality of care and life of residents, and quality of worklife of caregivers. The study aims are to a) systematically feed back TREC research data to nursing home care units, and b) compare the effectiveness of three different theory-based feedback strategies in improving performance within care units.

METHODS

INFORM (Improving Nursing Home Care through Feedback On PerfoRMance Data) is a 3.5-year pragmatic, three-arm, parallel, cluster-randomized trial. We will randomize 67 Western Canadian nursing homes with 203 care units to the three study arms, a standard feedback strategy and two assisted and goal-directed feedback strategies. Interventions will target care unit managerial teams. They are based on theory and evidence related to audit and feedback, goal setting, complex adaptive systems, and empirical work on feeding back research results. The primary outcome is the increased number of formal interactions (e.g., resident rounds or family conferences) involving care aides - non-registered caregivers providing up to 80% of direct care. Secondary outcomes are a) other modifiable features of care unit context (improved feedback, social capital, slack time) b) care aides' quality of worklife (improved psychological empowerment, job satisfaction), c) more use of best practices, and d) resident outcomes based on the Resident Assessment Instrument - Minimum Data Set 2.0. Outcomes will be assessed at baseline, immediately after the 12-month intervention period, and 18 months post intervention.

DISCUSSION

INFORM is the first study to systematically assess the effectiveness of different strategies to feed back research data to nursing home care units in order to improve their performance. Results of this study will enable development of a practical, sustainable, effective, and cost-effective feedback strategy for routine use by managers, policy makers and researchers. The results may also be generalizable to care settings other than nursing homes.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02695836 . Date of registration: 24 February 2016.

Individual and organizational predictors of health care aide job satisfaction in long term care

Background

Unregulated health care aides provide the majority of direct health care to residents in long term care homes. Lower job satisfaction as reported by care aides is associated with increased turnover of staff. Turnover leads to inferior job performance and negatively impacts quality of care for residents. This study aimed to determine the individual and organizational variables associated with job satisfaction in care aides.

Methods

We surveyed a sample of 1224 care aides from 30 long term care homes in three Western Canadian provinces. The care aides reported their job satisfaction and their perception of the work environment. We used a hierarchical, mixed-effects ordered logistic regression to model the relative odds of care aide job satisfaction for individual, care unit, and facility factors.

Results

Care aide exhaustion, professional efficacy, and cynicism were associated with job satisfaction. Factors in the organizational context that are associated with increased care aide job satisfaction include: leadership, culture, social capital, organizational slack—staff, organizational slack—space, and organizational slack—time.

Conclusions

Our findings suggest that organizational factors account for a greater increase in care aide job satisfaction than do individual factors. These features of the work environment are modifiable and predict care aide job satisfaction. Efforts to improve care aide work environment and quality of care should focus on organizational context.

Factor Structure, Reliability and Measurement Invariance of the Alberta Context Tool and the Conceptual Research Utilization Scale, for German Residential Long Term Care

We translated the Canadian residential long term care versions of the Alberta Context Tool (ACT) and the Conceptual Research Utilization (CRU) Scale into German, to study the association between organizational context factors and research utilization in German nursing homes. The rigorous translation process was based on best practice guidelines for tool translation, and we previously published methods and results of this process in two papers. Both instruments are self-report questionnaires used with care providers working in nursing homes. The aim of this study was to assess the factor structure, reliability, and measurement invariance (MI) between care provider groups responding to these instruments. In a stratified random sample of 38 nursing homes in one German region (Metropolregion Rhein-Neckar), we collected questionnaires from 273 care aides, 196 regulated nurses, 152 allied health providers, 6 quality improvement specialists, 129 clinical leaders, and 65 nursing students. The factor structure was assessed using confirmatory factor models. The first model included all 10 ACT concepts. We also decided a priori to run two separate models for the scale-based and the count-based ACT concepts as suggested by the instrument developers. The fourth model included the five CRU Scale items. Reliability scores were calculated based on the parameters of the best-fitting factor models. Multiple-group confirmatory factor models were used to assess MI between provider groups. Rather than the hypothesized ten-factor structure of the ACT, confirmatory factor models suggested 13 factors. The one-factor solution of the CRU Scale was confirmed. The reliability was acceptable (>0.7 in the entire sample and in all provider groups) for 10 of 13 ACT concepts, and high (0.90-0.96) for the CRU Scale. We could demonstrate partial strong MI for both ACT models and partial strict MI for the CRU Scale. Our results suggest that the scores of the German ACT and the CRU Scale for nursing homes are acceptably reliable and valid. However, as the ACT lacked strict MI, observed variables (or scale scores based on them) cannot be compared between provider groups. Rather, group comparisons should be based on latent variable models, which consider the different residual variances of each group.

The influence of organizational context on best practice use by care aides in residential long-term care settings

OBJECTIVE

This study assessed individual and organizational context (work environment) factors that influence use of best practices by care aides (nursing assistants) in nursing homes. Little scientific attention has been focused on understanding best practice use in nursing homes and almost none on care aides.

SETTING AND PARTICIPANTS

A total of 1262 care aides in 25 nursing homes in the 3 Canadian prairie provinces. Care aides are unregulated workers who provide 80% of direct care to residents in Canadian nursing homes.

METHOD

We used hierarchical linear modeling to (1) assess the amount of variance in use of best practices, as reported by care aides, that could be attributed to individual or organizational factors, and (2) identify predictors of best practices use by care aides.

RESULTS

At the individual level, statistically significant predictors of instrumental use of best practices included sex, age, shift worked, job efficacy, and belief suspension. At the unit level, significant predictors were social capital, organizational slack (staffing and time), number of informal interactions, and unit type. At the facility level, ownership model and province were significant. Significant predictors of conceptual use of best practices at the individual level included English as a first language, job efficacy, belief suspension, intent to use research, adequate knowledge, and number of information sources used. At the unit level, significant predictors were evaluation (feedback mechanisms), structural resources, and organizational slack (time). At the facility level, province was significant. The R(2) was 18.3% for instrumental use of best practices and 43.4% for conceptual use. Unit level factors added a substantial amount of explained variance whereas facility level factors added relatively little explained variance.

CONCLUSIONS

Our study suggests that context plays an important role in care aides' use of best practices in nursing homes. Individual characteristics played a more prominent role than contextual factors in predicting conceptual use of best practices.

A model for implementing guidelines for person-centered care in a nursing home setting

BACKGROUND

Systematic evaluations of knowledge translation interventions in nursing homes to improve practice are scarce. There is also a lack of studies focusing on creating sustainable evidence-based practice in the setting of residential dementia care.

METHODS

The aim of this paper is to describe a model for implementing national evidence-based guidelines for care of persons with dementia in nursing homes. The secondary aim is to outline the nursing home staff experiences during the first year of the implementation process. The intervention had a participatory action research approach. This included educational activities such as: (i) thematic seminars introducing national guidelines for dementia care, (ii) regular unit-based seminars; and (iii) later dissemination of information in reflective seminars and several days of poster-exhibitions. Areas of practice development were selected on each of the 24 units, based on unit-specific needs, and a quality improvement strategy was applied and evaluated. Each unit met ten times during a period of eight months. Data for this study were extracted from the reflective seminars and poster presentations, analyzed using a qualitative content analysis.

RESULTS

Findings showed that implementation of guidelines were perceived by staff as beneficial for both staff and the residents. However, barriers to identification of relevant sources of evidence and barriers to sustainable implementation were experienced.

CONCLUSIONS

One of our assumptions was that dementia nursing homes can benefit from becoming knowledge driven, with care practices founded in evidence-based sources. Our findings show that to be partly true, even though most staff units found their efforts to pursue and utilize knowledge adversely impacted by time-logistics and practical workload challenges.

Who is looking after Mom and Dad? Unregulated workers in Canadian long-term care homes

Older adults living in residential long-term care or nursing homes have increasingly complex needs, including more dementia than in the past, yet we know little about the unregulated workforce providing care. We surveyed 1,381 care aides in a representative sample of 30 urban nursing homes in the three Canadian Prairie provinces and report demographic, health and well-being, and work-related characteristics. Over 50 per cent of respondents were not born in Canada and did not speak English as their first language. They reported moderately high levels of burnout and a strong sense of their work's worth. Few respondents reported attending educational sessions. This direct caregiver workforce is poorly understood, has limited training or standards for minimum education, and training varies widely across provinces. Workplace characteristics affecting care aides reflect factors that precipitate burnout in allied health professions, with implications for quality of care, staff health, and staff retention.

Facility versus unit level reporting of quality indicators in nursing homes when performance monitoring is the goal

OBJECTIVES

To demonstrate the benefit of defining operational management units in nursing homes and computing quality indicators on these units as well as on the whole facility.

DESIGN

Calculation of adjusted Resident Assessment Instrument - Minimum Data Set 2.0 (RAI-MDS 2.0) quality indicators for: PRU05 (prevalence of residents with a stage 2-4 pressure ulcer), PAI0X (prevalence of residents with pain) and DRG01 (prevalence of residents receiving an antipsychotic with no diagnosis of psychosis), for quarterly assessments between 2007 and 2011 at unit and facility levels. Comparisons of these risk-adjusted quality indicators using statistical process control (control charts).

SETTING

A representative sample of 30 urban nursing homes in the three Canadian Prairie Provinces.

MEASUREMENTS

Explicit decision rules were developed and tested to determine whether the control charts demonstrated improving, worsening, unchanging or unclassifiable trends over the time period. Unit and facility performance were compared.

RESULTS

In 48.9% of the units studied, unit control chart performance indicated different changes in quality over the reporting period than did the facility chart. Examples are provided to illustrate that these differences lead to quite different quality interventions.

CONCLUSIONS

Our results demonstrate the necessity of considering facility-level and unit-level measurement when calculating quality indicators derived from the RAI-MDS 2.0 data, and quite probably from any RAI measures.

Linguistic validation of the Alberta Context Tool and two measures of research use, for German residential long term care

Background

To study the association between organizational context and research utilization in German residential long term care (LTC), we translated three Canadian assessment instruments: the Alberta Context Tool (ACT), Estabrooks’ Kinds of Research Utilization (RU) items and the Conceptual Research Utilization Scale. Target groups for the tools were health care aides (HCAs), registered nurses (RNs), allied health professionals (AHPs), clinical specialists and care managers. Through a cognitive debriefing process, we assessed response processes validity–an initial stage of validity, necessary before more advanced validity assessment.

Methods

We included 39 participants (16 HCAs, 5 RNs, 7 AHPs, 5 specialists and 6 managers) from five residential LTC facilities. We created lists of questionnaire items containing problematic items plus items randomly selected from the pool of remaining items. After participants completed the questionnaires, we conducted individual semi-structured cognitive interviews using verbal probing. We asked participants to reflect on their answers for list items in detail. Participants’ answers were compared to concept maps defining the instrument concepts in detail. If at least two participants gave answers not matching concept map definitions, items were revised and re-tested with new target group participants.

Results

Cognitive debriefings started with HCAs. Based on the first round, we modified 4 of 58 ACT items, 1 ACT item stem and all 8 items of the RU tools. All items were understood by participants after another two rounds. We included revised HCA ACT items in the questionnaires for the other provider groups. In the RU tools for the other provider groups, we used different wording than the HCA version, as was done in the original English instruments. Only one cognitive debriefing round was needed with each of the other provider groups.

Conclusion

Cognitive debriefing is essential to detect and respond to problematic instrument items, particularly when translating instruments for heterogeneous, less well educated provider groups such as HCAs. Cognitive debriefing is an important step in research tool development and a vital component of establishing response process validity evidence. Publishing cognitive debriefing results helps researchers to determine potentially critical elements of the translated tools and assists with interpreting scores.

German translation of the Alberta Context Tool and two measures of research use: methods, challenges and lessons learned

Background

Understanding the relationship between organizational context and research utilization is key to reducing the research-practice gap in health care. This is particularly true in the residential long term care (LTC) setting where relatively little work has examined the influence of context on research implementation. Reliable, valid measures and tools are a prerequisite for studying organizational context and research utilization. Few such tools exist in German. We thus translated three such tools (the Alberta Context Tool and two measures of research use) into German for use in German residential LTC. We point out challenges and strategies for their solution unique to German residential LTC, and demonstrate how resolving specific challenges in the translation of the health care aide instrument version streamlined the translation process of versions for registered nurses, allied health providers, practice specialists, and managers.

Methods

Our translation methods were based on best practices and included two independent forward translations, reconciliation of the forward translations, expert panel discussions, two independent back translations, reconciliation of the back translations, back translation review, and cognitive debriefing.

Results

We categorized the challenges in this translation process into seven categories: (1) differing professional education of Canadian and German care providers, (2) risk that German translations would become grammatically complex, (3) wordings at risk of being misunderstood, (4) phrases/idioms non-existent in German, (5) lack of corresponding German words, (6) limited comprehensibility of corresponding German words, and (7) target persons’ unfamiliarity with activities detailed in survey items. Examples of each challenge are described with strategies that we used to manage the challenge.

Conclusion

Translating an existing instrument is complex and time-consuming, but a rigorous approach is necessary to obtain instrument equivalence. Essential components were (1) involvement of and co-operation with the instrument developers and (2) expert panel discussions, including both target group and content experts. Equivalent translated instruments help researchers from different cultures to find a common language and undertake comparative research. As acceptable psychometric properties are a prerequisite for that, we are currently carrying out a study with that focus.

Practice sensitive quality indicators in RAI-MDS 2.0 nursing home data

BACKGROUND

In recent years, improving the quality of care for nursing home residents has generated a considerable amount of attention. In response, quality indicators (QIs), based on available evidence and expert consensus, have been identified within the Resident Assessment Instrument-Minimum Data Set 2.0 (RAI-MDS 2.0), and validated as proxy measures for quality of nursing home care. We sought to identify practice sensitive QIs; that is, those QIs believed to be the most sensitive to clinical practice.

METHOD

We enlisted two experts to review a list of 35 validated QIs and to select those that they believed to be the most sensitive to practice. We then asked separate groups of practicing physicians, nurses, and policy makers to (1) rank the items on the list for overall "practice sensitivity" and then, (2) to identify the domain to which the QI was most sensitive (nursing care, physician care, or policy maker).

RESULTS

After combining results of all three groups, pressure ulcers were identified as the most practice sensitive QI followed by worsening pain, physical restraint use, the use of antipsychotic medications without a diagnosis of psychosis, and indwelling catheters. When stratified by informant group, although the top five QIs stayed the same, the ranking of the 13 QIs differed by group.

CONCLUSIONS

In addition to identifying a reduced and manageable set of QIs for regular reporting, we believe that focusing on these 13 practice sensitive QIs provides both the greatest potential for improving resident function and slowing the trajectory of decline that most residents experience.

A Profile of Residents in Prairie Nursing Homes

Les maisons de soins infirmiers sont devenues des environnements offrant des soins complexes, dont les habitants ont des besoins importants et la plupart souffrent de la démence liée a l’âge. S’appuyant sur les recherches de Hirdes et al. (2011), nous décrivons un profil des résidents dans un échantillon représentatif de 30 maisons de soins infirmiers en milieu urbain dans les provinces des Prairies, en utilisant des données de L’Instrument d’évaluation des résidents/le recueil de données minimum (Resident Assistant Instrument – Minimum Data Set 2.0) de 5 196 évaluations résidents accomplies entre le 1ier octobre et le 31ieme décembre 3011. Les résidents avaient principalement plus de 85 ans, étaient des femmes, et souffraient d’une démence liée à l’âge. Nous avons comparé le soutien et les services connexes des établissements et les caractéristiques des résidents par province, par les modèles du propriétaire-gérant, et par le nombre d’unités dans une installation. Nous avons également constaté que les établissements publics ont tendance à s’occuper des résidents ayant des caractéristiques plus exigeants : notamment, la déficience cognitive, un comportement aggressif, et l’incontinence. Aucune tendance claire n’a été observée reliant le nombre d’unités dans un établissement aux caractéristiques des résidents.

The Hidden Complexity of Long-Term Care: how context mediates knowledge translation and use of best practices

PURPOSE

Context is increasingly recognized as a key factor to be considered when addressing healthcare practice. This study describes features of context as they pertain to knowledge use in long-term care (LTC).

DESIGN AND METHODS

As one component of the research program Translating Research in Elder Care, an in-depth qualitative case study was conducted to examine the research question "How does organizational context mediate the use of knowledge in practice in long-term care facilities?" A representative facility was chosen from the province of Saskatchewan, Canada. Data included document review, direct observation of daily care practices, and interviews with direct care, allied provider, and administrative staff.

RESULTS

The Hidden Complexity of Long-Term Care model consists of 8 categories that enmesh to create a context within which knowledge exchange and best practice are executed. These categories range from the most easily identifiable to the least observable: physical environment, resources, ambiguity, flux, relationships, and philosophies. Two categories (experience and confidence, leadership and mentoring) mediate the impact of other contextual factors. Inappropriate physical environments, inadequate resources, ambiguous situations, continual change, multiple relationships, and contradictory philosophies make for a complicated context that impacts care provision.

IMPLICATIONS

A hidden complexity underlays healthcare practices in LTC and each care provider must negotiate this complexity when providing care. Attending to this complexity in which care decisions are made will lead to improvements in knowledge exchange mechanisms and best practice uptake in LTC settings.

Older Persons' Transitions in Care (OPTIC): a study protocol

BACKGROUND

Changes in health status, triggered by events such as infections, falls, and geriatric syndromes, are common among nursing home (NH) residents and necessitate transitions between NHs and Emergency Departments (EDs). During transitions, residents frequently experience care that is delayed, unnecessary, not evidence-based, potentially unsafe, and fragmented. Furthermore, a high proportion of residents and their family caregivers report substantial unmet needs during transitions. This study is part of a program of research whose overall aim is to improve quality of care for frail older adults who reside in NHs. The purpose of this study is to identify successful transitions from multiple perspectives and to identify organizational and individual factors related to transition success, in order to inform improvements in care for frail elderly NH residents during transitions to and from acute care. Specific objectives are to: 1. define successful and unsuccessful elements of transitions from multiple perspectives; 2. develop and test a practical tool to assess transition success; 3. assess transition processes in a discrete set of transfers in two study sites over a one year period; 4. assess the influence of organizational factors in key practice locations, e.g., NHs, emergency medical services (EMS), and EDs, on transition success; and 5. identify opportunities for evidence-informed management and quality improvement decisions related to the management of NH - ED transitions.

METHODS/DESIGN

This is a mixed-methods observational study incorporating an integrated knowledge translation (IKT) approach. It uses data from multiple levels (facility, care unit, individual) and sources (healthcare providers, residents, health records, and administrative databases).

DISCUSSION

Key to study success is operationalizing the IKT approach by using a partnership model in which the OPTIC governance structure provides for team decision-makers and researchers to participate equally in developing study goals, design, data collection, analysis and implications of findings. As preliminary and ongoing study findings are developed, their implications for practice and policy in study settings will be discussed by the research team and shared with study site administrators and staff. The study is designed to investigate the complexities of transitions and to enhance the potential for successful and sustained improvement of these transitions.

A data quality control program for computer-assisted personal interviews

Researchers strive to optimize data quality in order to ensure that study findings are valid and reliable. In this paper, we describe a data quality control program designed to maximize quality of survey data collected using computer-assisted personal interviews. The quality control program comprised three phases: (1) software development, (2) an interviewer quality control protocol, and (3) a data cleaning and processing protocol. To illustrate the value of the program, we assess its use in the Translating Research in Elder Care Study. We utilize data collected annually for two years from computer-assisted personal interviews with 3004 healthcare aides. Data quality was assessed using both survey and process data. Missing data and data errors were minimal. Mean and median values and standard deviations were within acceptable limits. Process data indicated that in only 3.4% and 4.0% of cases was the interviewer unable to conduct interviews in accordance with the details of the program. Interviewers' perceptions of interview quality also significantly improved between Years 1 and 2. While this data quality control program was demanding in terms of time and resources, we found that the benefits clearly outweighed the effort required to achieve high-quality data.

Implementing nutrition guidelines for older people in residential care homes: a qualitative study using Normalization Process Theory

Background

Optimizing the dietary intake of older people can prevent nutritional deficiencies and diet-related diseases, thereby improving quality of life. However, there is evidence that the nutritional intake of older people living in care homes is suboptimal, with high levels of saturated fat, salt, and added sugars. The UK Food Standards Agency therefore developed nutrient- and food-based guidance for residential care homes. The acceptability of these guidelines and their feasibility in practice is unknown. This study used the Normalization Process Theory (NPT) to understand the barriers and facilitators to implementing the guidelines and inform future implementation.

Methods

We conducted a process evaluation in five care homes in the north of England using qualitative methods (observation and interviews) to explore the views of managers, care staff, catering staff, and domestic staff. Data were analyzed thematically and discussed in data workshops; emerging themes were then mapped to the constructs of NPT.

Results

Many staff perceived the guidelines as unnecessarily restrictive and irrelevant to older people. In terms of NPT, the guidelines simply did not make sense (coherence), and as a result, relatively few staff invested in the guidelines (cognitive participation). Even where staff supported the guidelines, implementation was hampered by a lack of nutritional knowledge and institutional support (collective action). Finally, the absence of observable benefits to clients confirmed the negative preconceptions of many staff, with limited evidence of reappraisal following implementation (reflexive monitoring).

Conclusions

The successful implementation of the nutrition guidelines requires that the fundamental issues relating to their perceived value and fit with other priorities and goals be addressed. Specialist support is needed to equip staff with the technical knowledge and skills required for menu analysis and development and to devise ways of evaluating the outcomes of modified menus. NPT proved useful in conceptualizing barriers to implementation; robust links with behavior-change theories would further increase the practical utility of NPT.

Translating research into practice in nursing homes: can we close the gap?

PURPOSE

A gap between research and practice in many nursing home (NH) care areas persists despite efforts by researchers, policy makers, advocacy groups, and NHs themselves to close it. The reasons are many, but two factors that have received scant attention are the dissemination process itself and the work of the disseminators or change agents. This review article examines these two elements through the conceptual lens of Roger's innovation dissemination model.

DESIGN AND METHODS

The application of general principles of innovation dissemination suggests that NHs are characteristically slow to innovate and thus may need more time as well as more contact with outside change agents to adopt improved practices.

RESULTS

A review of the translation strategies used by NH change agents to promote adoption of evidence-based practice in NHs suggests that their strategies inconsistently reflect lessons learned from the broader dissemination literature.

IMPLICATIONS

NH-related research, policy, and practice recommendations for improving dissemination strategies are presented. If we can make better use of the resources currently devoted to disseminating best practices to NHs, we may be able to speed NHs' adoption of these practices.

Identifying resident care areas for a quality improvement intervention in long-term care: a collaborative approach

BACKGROUND

In Canada, healthcare aides (also referred to as nurse aides, personal support workers, nursing assistants) are unregulated personnel who provide 70-80% of direct care to residents living in nursing homes. Although they are an integral part of the care team their contributions to the resident care planning process are not always acknowledged in the organization. The purpose of the Safer Care for Older Persons [in residential] Environments (SCOPE) project was to evaluate the feasibility of engaging front line staff (primarily healthcare aides) to use quality improvement methods to integrate best practices into resident care. This paper describes the process used by teams participating in the SCOPE project to select clinical improvement areas.

METHODS

The study employed a collaborative approach to identify clinical areas and through consensus, teams selected one of three areas. To select the clinical areas we recruited two nursing homes not involved in the SCOPE project and sampled healthcare providers and decision-makers within them. A vote counting method was used to determine the top five ranked clinical areas for improvement.

RESULTS

Responses received from stakeholder groups included gerontology experts, decision-makers, registered nurses, managers, and healthcare aides. The top ranked areas from highest to lowest were pain/discomfort management, behaviour management, depression, skin integrity, and assistance with eating.

CONCLUSIONS

Involving staff in selecting areas that they perceive as needing improvement may facilitate staff engagement in the quality improvement process.

Should we feed back research results in the midst of a study?

Background

This report is an introduction to a series of three research papers that describe the evolution of the approaches taken by the Translating Research in Elder Care (TREC) research team during its first four years to feed back the research findings to study participants. TREC is an observational multi-method health services research project underway in 36 nursing homes in the prairie provinces of Canada. TREC has actively involved decision makers from the sector in all stages from initial planning, through data collection to dissemination activities. However, it was not planned as a fully integrated knowledge translation project. These three papers describe our progress towards fully integrated knowledge translation—with respect to timely and requested feedback processes. The first paper reports on the process and outcomes of creating and evaluating the feedback of research findings to healthcare aides (unregulated health professionals). These aides provide over 80% of the direct care in our sample and actively requested the feedback as a condition of their continued cooperation in the data acquisition process. The second paper describes feedback from nursing home administrators on preliminary research findings (a facility annual report) and evaluation of the reports’ utility. The third paper discusses an approach to providing a more in-depth form of feedback (expanded feedback report) at one of the TREC nursing homes.

Findings

Survey and interview feedback from healthcare aides is presented in the first paper. Overall, healthcare aides’ opinions about presentation of the feedback report and the understand ability, usability, and usefulness of the content were positive. The second paper describes the use of telephone interviews with facility administrators and indicates that the majority of contextual areas (e.g., staff job satisfaction) addressed in facility annual report to be useful, meaningful, and understandable. More than one-half of the administrators would have liked to have received information on additional areas. The third paper explores how a case study that examined how involvement with the TREC study influenced management and staff at one of the TREC nursing homes. The importance of understanding organizational routines and the impact of corporate restructuring were key themes emerging from the case study. In addition, the Director of Care suggested changes to the structure and format of the feedback report that would have improved its usefulness.

Conclusions

We believe that these findings will inform others undertaking integrated knowledge translation activities and will encourage others to become more engaged in feedback processes.

Feedback reporting of survey data to healthcare aides

Background

This project occurred during the course of the Translating Research in Elder Care (TREC) program of research. TREC is a multilevel and longitudinal research program being conducted in the three Canadian Prairie Provinces of Alberta, Saskatchewan, and Manitoba. The main purpose of TREC is to increase understanding about the role of organizational context in influencing knowledge use in residential long-term care settings. The purpose of this study was to evaluate healthcare aides’ (HCAs) perceptions of a one-page poster designed to feed back aggregated data (including demographic information and perceptions about influences on best practice) from the TREC survey they had recently completed.

Methods

A convenience sample of 7 of the 15 nursing homes participating in the TREC research program in Alberta were invited to participate. Specific facility-level summary data were provided to each facility in the form of a one-page poster report. Two weeks following delivery of the report, a convenience sample of HCAs was surveyed using one-to-one structured interviews.

Results

One hundred twenty-three HCAs responded to the evaluation survey. Overall, HCAs’ opinions about presentation of the feedback report and the understandability, usability, and usefulness of the content were positive. For each report, analysis of data and production and inspection of the report took up to one hour. Information sessions to introduce and explain the reports averaged 18 minutes. Two feedback reports (minimum) were supplied to each facility at a cost of CAN$2.39 per report, for printing and laminating.

Conclusions

This study highlights not only the feasibility of producing understandable, usable, and useful feedback reports of survey data but also the value and importance of providing feedback to survey respondents. More broadly, the findings suggest that modest strategies may have a positive and desirable effect in participating sites.

Distance coursework and coaching to improve nursing home incontinence care: lessons learned

OBJECTIVES

To determine whether a distance coaching course on improving nursing home incontinence care could be replicated and brought to scale with a larger group of nursing homes without sacrificing outcomes.

DESIGN

The study collected descriptive and comparative data.

SETTING

Fourteen nursing homes in the original course and 34 in the replication course.

PARTICIPANTS

Participants in the study were supervisors and staff from enrolled nursing homes who completed the distance coaching courses on incontinence management.

MEASUREMENTS

Data for both courses were collected using a resident assessment form to evaluate implementation of new practices, pre- and posttraining quizzes, a course evaluation survey, and a supervisor's report.

RESULTS

There were few significant differences between the course groups with respect to course participation, knowledge transfer, and training program preferences. Although Course 1 nursing homes reported assessing more residents on average than Course 2 homes (22 vs 12), this difference is probably an artifact of differences in the reporting methodologies for the two courses.

CONCLUSION

This study found qualified support for using a distance coaching course to facilitate adoption of evidence-based incontinence care practices in nursing homes. The findings also underscore the challenges associated with designing dissemination and implementation programs that are effective and feasible to implement with nursing homes. Nursing home educators should consider this study's findings when designing new training programs. Outcomes may improve if some dissemination resources are diverted to distance coaching activities that support nursing home improvement efforts over extended periods.

An interdisciplinary knowledge translation intervention in long-term care: study protocol for the vitamin D and osteoporosis study (ViDOS) pilot cluster randomized controlled trial

BACKGROUND

Knowledge translation (KT) research in long-term care (LTC) is still in its early stages. This protocol describes the evaluation of a multifaceted, interdisciplinary KT intervention aimed at integrating evidence-based osteoporosis and fracture prevention strategies into LTC care processes.

METHODS AND DESIGN

The Vitamin D and Osteoporosis Study (ViDOS) is underway in 40 LTC homes (n = 19 intervention, n = 21 control) across Ontario, Canada. The primary objectives of this study are to assess the feasibility of delivering the KT intervention, and clinically, to increase the percent of LTC residents prescribed ≥800 IU of vitamin D daily. Eligibility criteria are LTC homes that are serviced by our partner pharmacy provider and have more than one prescribing physician. The target audience within each LTC home is the Professional Advisory Committee (PAC), an interdisciplinary team who meets quarterly. The key elements of the intervention are three interactive educational sessions led by an expert opinion leader, action planning using a quality improvement cycle, audit and feedback reports, nominated internal champions, and reminders/point-of-care tools. Control homes do not receive any intervention, however both intervention and control homes received educational materials as part of the Ontario Osteoporosis Strategy. Primary outcomes are feasibility measures (recruitment, retention, attendance at educational sessions, action plan items identified and initiated, internal champions identified, performance reports provided and reviewed), and vitamin D (≥800 IU/daily) prescribing at 6 and 12 months. Secondary outcomes include the proportion of residents prescribed calcium supplements and osteoporosis medications, and falls and fractures. Qualitative methods will examine the experience of the LTC team with the KT intervention. Homes are centrally randomized to intervention and control groups in blocks of variable size using a computer generated allocation sequence. Randomization is stratified by home size and profit/nonprofit status. Prescribing data retrieval and analysis are performed by blinded personnel.

DISCUSSION

Our study will contribute to an improved understanding of the feasibility and acceptability of a multifaceted intervention aimed at translating knowledge to LTC practitioners. Lessons learned from this study will be valuable in guiding future research and understanding the complexities of translating knowledge in LTC.

Advancing the argument for validity of the Alberta Context Tool with healthcare aides in residential long-term care

BACKGROUND

Organizational context has the potential to influence the use of new knowledge. However, despite advances in understanding the theoretical base of organizational context, its measurement has not been adequately addressed, limiting our ability to quantify and assess context in healthcare settings and thus, advance development of contextual interventions to improve patient care. We developed the Alberta Context Tool (the ACT) to address this concern. It consists of 58 items representing 10 modifiable contextual concepts. We reported the initial validation of the ACT in 2009. This paper presents the second stage of the psychometric validation of the ACT.

METHODS

We used the Standards for Educational and Psychological Testing to frame our validity assessment. Data from 645 English speaking healthcare aides from 25 urban residential long-term care facilities (nursing homes) in the three Canadian Prairie Provinces were used for this stage of validation. In this stage we focused on: (1) advanced aspects of internal structure (e.g., confirmatory factor analysis) and (2) relations with other variables validity evidence. To assess reliability and validity of scores obtained using the ACT we conducted: Cronbach's alpha, confirmatory factor analysis, analysis of variance, and tests of association. We also assessed the performance of the ACT when individual responses were aggregated to the care unit level, because the instrument was developed to obtain unit-level scores of context.

RESULTS

Item-total correlations exceeded acceptable standards (> 0.3) for the majority of items (51 of 58). We ran three confirmatory factor models. Model 1 (all ACT items) displayed unacceptable fit overall and for five specific items (1 item on adequate space for resident care in the Organizational Slack-Space ACT concept and 4 items on use of electronic resources in the Structural and Electronic Resources ACT concept). This prompted specification of two additional models. Model 2 used the 7 scaled ACT concepts while Model 3 used the 3 count-based ACT concepts. Both models displayed substantially improved fit in comparison to Model 1. Cronbach's alpha for the 10 ACT concepts ranged from 0.37 to 0.92 with 2 concepts performing below the commonly accepted standard of 0.70. Bivariate associations between the ACT concepts and instrumental research utilization levels (which the ACT should predict) were statistically significant at the 5% level for 8 of the 10 ACT concepts. The majority (8/10) of the ACT concepts also showed a statistically significant trend of increasing mean scores when arrayed across the lowest to the highest levels of instrumental research use.

CONCLUSIONS

The validation process in this study demonstrated additional empirical support for construct validity of the ACT, when completed by healthcare aides in nursing homes. The overall pattern of the data was consistent with the structure hypothesized in the development of the ACT and supports the ACT as an appropriate measure for assessing organizational context in nursing homes. Caution should be applied in using the one space and four electronic resource items that displayed misfit in this study with healthcare aides until further assessments are made.

Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare

Background

There is a lack of acceptable, reliable, and valid survey instruments to measure conceptual research utilization (CRU). In this study, we investigated the psychometric properties of a newly developed scale (the CRU Scale).

Methods

We used the Standards for Educational and Psychological Testing as a validation framework to assess four sources of validity evidence: content, response processes, internal structure, and relations to other variables. A panel of nine international research utilization experts performed a formal content validity assessment. To determine response process validity, we conducted a series of one-on-one scale administration sessions with 10 healthcare aides. Internal structure and relations to other variables validity was examined using CRU Scale response data from a sample of 707 healthcare aides working in 30 urban Canadian nursing homes. Principal components analysis and confirmatory factor analyses were conducted to determine internal structure. Relations to other variables were examined using: (1) bivariate correlations; (2) change in mean values of CRU with increasing levels of other kinds of research utilization; and (3) multivariate linear regression.

Results

Content validity index scores for the five items ranged from 0.55 to 1.00. The principal components analysis predicted a 5-item 1-factor model. This was inconsistent with the findings from the confirmatory factor analysis, which showed best fit for a 4-item 1-factor model. Bivariate associations between CRU and other kinds of research utilization were statistically significant (p < 0.01) for the latent CRU scale score and all five CRU items. The CRU scale score was also shown to be significant predictor of overall research utilization in multivariate linear regression.

Conclusions

The CRU scale showed acceptable initial psychometric properties with respect to responses from healthcare aides in nursing homes. Based on our validity, reliability, and acceptability analyses, we recommend using a reduced (four-item) version of the CRU scale to yield sound assessments of CRU by healthcare aides. Refinement to the wording of one item is also needed. Planned future research will include: latent scale scoring, identification of variables that predict and are outcomes to conceptual research use, and longitudinal work to determine CRU Scale sensitivity to change.

Examination of the utility of the promoting action on research implementation in health services framework for implementation of evidence based practice in residential aged care settings

AIM

This study examined the relevance and fit of the PARiHS framework (Promoting Action on Research Implementation in Health Services) as an explanatory model for practice change in residential aged care.

BACKGROUND

Translation of research knowledge into routine practice is a complex matter in health and social care environments. Examination of the environment may identify factors likely to support and hinder practice change, inform strategy development, predict and explain successful uptake of new ways of working. Frameworks to enable this have been described but none has been tested in residential aged care.

METHODS

This paper reports preliminary qualitative analyses from the Encouraging Best Practice in Residential Aged Care Nutrition and Hydration project conducted in New South Wales in 2007-2009. We examined congruence with the PARiHS framework of factors staff described as influential for practice change during 29 digitally recorded and transcribed staff interviews and meetings at three facilities.

FINDINGS

Unique features of the setting were flagged, with facilities simultaneously filling the roles of residents' home, staff's workplace and businesses. Participants discussed many of the same characteristics identified by the PARiHS framework, but in addition temporal dimensions of practice change were flagged.

CONCLUSION

Overall factors described by staff as important for practice change in aged care settings showed good fit with those of the PARiHS framework. This framework can be recommended for use in this setting. Widespread adoption will enable cross-project and international synthesis of findings, a major step towards building a cumulative science of knowledge translation and practice change.

The care unit in nursing home research: evidence in support of a definition

BACKGROUND

Defining what constitutes a resident care unit in nursing home research is both a conceptual and practical challenge. The aim of this paper is to provide evidence in support of a definition of care unit in nursing homes by demonstrating: (1) its feasibility for use in data collection, (2) the acceptability of aggregating individual responses to the unit level, and (3) the benefit of including unit level data in explanatory models.

METHODS

An observational study design was used. Research (project) managers, healthcare aides, care managers, nursing home administrators and directors of care from thirty-six nursing homes in the Canadian prairie provinces of Alberta, Saskatchewan and Manitoba provided data for the study. A definition of care unit was developed and applied in data collection and analyses. A debriefing session was held with research managers to investigate their experiences with using the care unit definition. In addition, survey responses from 1258 healthcare aides in 25 of the 36 nursing homes in the study, that had more than one care unit, were analyzed using a multi-level modeling approach. Trained field workers administered the Alberta Context Tool (ACT), a 58-item self-report survey reflecting 10 organizational context concepts, to healthcare aides using computer assisted personal interviews. To assess the appropriateness of obtaining unit level scores, we assessed aggregation statistics (ICC(1), ICC(2), η², and ω²), and to assess the value of using the definition of unit in explanatory models, we performed multi-level modeling.

RESULTS

In 10 of the 36 nursing homes, the care unit definition developed was used to align the survey data (for analytic purposes) to specific care units as designated by our definition, from that reported by the facility administrator. The aggregation statistics supported aggregating the healthcare aide responses on the ACT to the realigned unit level. Findings from the multi-level modeling further supported unit level aggregation. A significantly higher percentage of variance was explained in the ACT concepts at the unit level compared to the individual and/or nursing home levels.

CONCLUSIONS

The statistical results support the use of our definition of care unit in nursing home research in the Canadian prairie provinces. Beyond research convenience however, the results also support the resident unit as an important Clinical Microsystem to which future interventions designed to improve resident quality of care and staff (healthcare aide) worklife should be targeted.

Study protocol for the translating research in elder care (TREC): building context - an organizational monitoring program in long-term care project (project one)

Background

While there is a growing awareness of the importance of organizational context (or the work environment/setting) to successful knowledge translation, and successful knowledge translation to better patient, provider (staff), and system outcomes, little empirical evidence supports these assumptions. Further, little is known about the factors that enhance knowledge translation and better outcomes in residential long-term care facilities, where care has been shown to be suboptimal. The project described in this protocol is one of the two main projects of the larger five-year Translating Research in Elder Care (TREC) program.

Aims

The purpose of this project is to establish the magnitude of the effect of organizational context on knowledge translation, and subsequently on resident, staff (unregulated, regulated, and managerial) and system outcomes in long-term care facilities in the three Canadian Prairie Provinces (Alberta, Saskatchewan, Manitoba).

Methods/Design

This study protocol describes the details of a multi-level – including provinces, regions, facilities, units within facilities, and individuals who receive care (residents) or work (staff) in facilities – and longitudinal (five-year) research project. A stratified random sample of 36 residential long-term care facilities (30 urban and 6 rural) from the Canadian Prairie Provinces will comprise the sample. Caregivers and care managers within these facilities will be asked to complete the TREC survey – a suite of survey instruments designed to assess organizational context and related factors hypothesized to be important to successful knowledge translation and to achieving better resident, staff, and system outcomes. Facility and unit level data will be collected using standardized data collection forms, and resident outcomes using the Resident Assessment Instrument-Minimum Data Set version 2.0 instrument. A variety of analytic techniques will be employed including descriptive analyses, psychometric analyses, multi-level modeling, and mixed-method analyses.

Discussion

Three key challenging areas associated with conducting this project are discussed: sampling, participant recruitment, and sample retention; survey administration (with unregulated caregivers); and the provision of a stable set of study definitions to guide the project.

Study protocol for the translating research in elder care (TREC): building context through case studies in long-term care project (project two)

Background

The organizational context in which healthcare is delivered is thought to play an important role in mediating the use of knowledge in practice. Additionally, a number of potentially modifiable contextual factors have been shown to make an organizational context more amenable to change. However, understanding of how these factors operate to influence organizational context and knowledge use remains limited. In particular, research to understand knowledge translation in the long-term care setting is scarce. Further research is therefore required to provide robust explanations of the characteristics of organizational context in relation to knowledge use.

Aim

To develop a robust explanation of the way organizational context mediates the use of knowledge in practice in long-term care facilities.

Design

This is longitudinal, in-depth qualitative case study research using exploratory and interpretive methods to explore the role of organizational context in influencing knowledge translation. The study will be conducted in two phases. In phase one, comprehensive case studies will be conducted in three facilities. Following data analysis and proposition development, phase two will continue with focused case studies to elaborate emerging themes and theory. Study sites will be purposively selected. In both phases, data will be collected using a variety of approaches, including non-participant observation, key informant interviews, family perspectives, focus groups, and documentary evidence (including, but not limited to, policies, notices, and photographs of physical resources). Data analysis will comprise an iterative process of identifying convergent evidence within each case study and then examining and comparing the evidence across multiple case studies to draw conclusions from the study as a whole. Additionally, findings that emerge through this project will be compared and considered alongside those that are emerging from project one. In this way, pattern matching based on explanation building will be used to frame the analysis and develop an explanation of organizational context and knowledge use over time.

An improved understanding of the contextual factors that mediate knowledge use will inform future development and testing of interventions to enhance knowledge use, with the ultimate aim of improving the outcomes for residents in long-term care settings.