Between and within-site variation in qualitative implementation research

Health-care organization characteristics in cancer care delivery: an integrated conceptual framework with content validation

Context can influence cancer-related outcomes. For example, health-care organization characteristics, including ownership, leadership, and culture, can affect care access, communication, and patient outcomes. Health-care organization characteristics and other contextual factors can also influence whether and how clinical discoveries reduce cancer incidence, morbidity, and mortality. Importantly, policy, market, and technology changes are transforming health-care organization design, culture, and operations across the cancer continuum. Consequently, research is essential to examine when, for whom, and how organizational characteristics influence person-level, organization-level, and population-level cancer outcomes. Understanding organizational characteristics-the structures, processes, and other features of entities involved in health care delivery-and their dynamics is an important yet understudied area of care delivery research across the cancer continuum. Research incorporating organizational characteristics is critical to address health inequities, test care delivery models, adapt interventions, and strengthen implementation. The field lacks conceptual grounding, however, to help researchers identify germane organizational characteristics. We propose a framework identifying organizational characteristics relevant for cancer care delivery research based on conceptual work in health services, organizational behavior, and management science and refined using a systematic review and key informant input. The proposed framework is a tool for organizing existing research and enhancing future cancer care delivery research. Following a 2012 Journal of the National Cancer Institute monograph, this work complements National Cancer Institute efforts to stimulate research addressing the relationship between cancer outcomes and contextual factors at the patient, provider, team, delivery organization, community, and health policy levels.

Integrating Perspectives on Family Caregiving After Critical Illness: A Qualitative Content Analysis

BACKGROUND

To date, no intervention has definitively improved outcomes for families of critical illness survivors. An integrated perspective on caregivers' needs after critical illness could help identify high-priority intervention targets and improve outcomes.

OBJECTIVES

To obtain diverse perspectives on the needs, barriers and facilitators, and social determinants of health associated with family caregiving across the critical illness continuum and assess the extent to which successful caregiving interventions in other populations may be adapted to the critical illness context.

METHODS

This qualitative content analysis of 31 semistructured interviews and 10 focus groups with family caregivers, health care providers, and health care administrators explored family caregivers' needs during post- intensive care unit (ICU) transitions and the barriers and facilitators associated with addressing them. Trained coders analyzed transcripts, identified patterns and categories among the codes, and generated themes.

RESULTS

Caregivers have 3 instrumental needs: formal and informal support, involvement in care planning, and education and training. Only caregivers described their self-care and mental health needs. Social determinants of health are the key barriers and facilitators shaping the caregivers' journey, and caregiving as a social determinant of health was a prominent theme.

CONCLUSIONS

Caregivers have instrumental, self-care, and mental health needs after critical illness. Adapting hands-on and skills training interventions to the post-ICU setting, while tailoring interventions to caregivers' health-related social context, may improve caregiver outcomes.

Direct Admission Program Implementation: A Qualitative Analysis of Variation Across Health Systems

OBJECTIVES

Direct admission (DA) to the hospital has the potential to improve family satisfaction and timeliness of care by bypassing the emergency department. Using the RE-AIM implementation framework, we sought to characterize variation across health systems in the reach, effectiveness, adoption, and implementation of a DA program from the perspectives of parents and multidisciplinary clinicians.

METHODS

As part of a stepped-wedge cluster randomized trial to compare the effectiveness of DA to admission through the emergency department, we evaluated DA rates across 69 clinics and 3 health systems and conducted semi-structured interviews with parents and clinicians. We used thematic analysis to identify themes related to the reach, effectiveness, adoption, and implementation of the DA program and applied axial coding to characterize thematic differences across sites.

RESULTS

Of 2599 hospitalizations, 171 (6.6%) occurred via DA, with DA rates varying 10-fold across health systems from 0.9% to 9.3%. Through the analysis of 137 interviews, including 84 with clinicians and 53 with parents, we identified similarities across health systems in themes related to perceived program effectiveness and patient and family engagement. Thematic differences across sites in the domains of program implementation and clinician adoption included variation in transfer center efficiency, trust between referring and accepting clinicians, and the culture of change within the health system.

CONCLUSIONS

The DA program was adopted variably, highlighting unique challenges and opportunities for implementation in different hospital systems. These findings can inform future quality improvement efforts to improve transitions to the hospital.

Acceptance of and Adherence to a Four-Dose RTS,S/AS01 Schedule: Findings from a Longitudinal Qualitative Evaluation Study for the Malaria Vaccine Implementation Programme

BACKGROUND

The WHO recommended the use of the RTS,S/AS01 malaria vaccine (RTS,S) based on a pilot evaluation in routine use in Ghana, Kenya, and Malawi. A longitudinal qualitative study was conducted to examine facilitators and barriers to uptake of a 4-dose RTS,S schedule.

METHODS

A cohort of 198 caregivers of RTS,S-eligible children from communities where RTS,S was provided through the pilot were interviewed three times over a ≈22-month, 4-dose schedule. The interviews examined caregiver perceptions and behaviors. Children's vaccination history was obtained to determine dose uptake.

RESULTS

162 caregivers remained at round 3 (R3); vaccination history was available for 152/162 children. Despite early rumors/fears, the uptake of initial doses was high, driven by vaccine trust. Fears dissipated by R2, replaced with an enthusiasm for RTS,S as caregivers perceived its safety and less frequent and severe malaria. By R3, 98/152 children had received four doses; 34 three doses; 9 one or two doses; and 11 zero doses. The health system and information barriers were important across all under-dose cases. Fears about AEFIs/safety were important in zero-, one-, and two-dose cases. Competing life/livelihood demands and complacency were found in three-dose cases. Regardless of the doses received, caregivers had positive attitudes towards RTS,S by R3.

CONCLUSIONS

Findings from our study will help countries newly introducing the vaccine to anticipate and preempt reasons for delayed acceptance and missed RTS,S doses.

Barriers and facilitators to training delivery and subsequent implementation of a localised child and adolescent mental health initiative: a qualitative content analysis

BACKGROUND

Ensuring that children and young people (CYP) can obtain mental health support from a broad variety of sources is of upmost importance. This is especially true given the increasing prevalence of mental health difficulties in this population, and the associated challenges with receiving support from specialised healthcare services. Equipping professionals, from a wide range of sectors, with the skills needed to provide this support is a vital starting point. This study explored the experiences of professionals who had participated in CYP mental health training modules that related directly to the local implementation of the THRIVE Framework for System Change in Greater Manchester, UK (GM i-THRIVE) to establish the perceived barriers and facilitators behind the implementation of this training programme.

METHODS

Directed qualitative content analysis of semi-structured interview data from nine CYP-facing professionals was conducted. Both the interview schedule and initial deductive coding strategy were developed using the findings of a systematic literature review by the authors, that was conducted to explore wider CYP mental health training experiences. This methodology was used to establish the presence or absence of these findings within GM i-THRIVE, before generating tailored recommendations for their training programme.

RESULTS

When the interview data were coded and analysed, a strong level of thematic similarity with the authors' review was found. However, we deduced that the emergence of additional themes might reflect the contextual uniqueness of GM i-THRIVE, that is likely to be further compounded by the COVID-19 pandemic. Six recommendations were made for further improvement. These included the facilitation of unstructured peer interaction during training, and ensuring that jargon and key words are fully clarified.

CONCLUSIONS

Methodological limitations, guidance for usage, and potential applications of the study's findings are explored. Whilst the findings were largely akin to those of the review, subtle yet important differences were found. These are likely to reflect the nuances of the training programme discussed, however, we tentatively suggest that our findings are transferable to similar training interventions. This study provides a valuable example of how qualitative evidence syntheses can be used to aid study design and analysis: an underused approach.

Reformed child and adolescent mental health services in a devolved healthcare system: a mixed-methods case study of an implementation site

Background

Efforts are being made to reform and reconceptualise children and young people's (CYP) mental health services. This is in response to a rapid increase in mental health difficulties in this population, and the shortcomings of current service provision. The present study seeks to comprehensively evaluate the local implementation of the THRIVE Framework for System Change in Greater Manchester, UK (GM i-THRIVE) from 2018 to 2021. The framework was designed to change the way mental health is perceived, and subsequently how support is allocated. The current study focusses on the implementation of the framework's principles into CYP mental health support in the region.

Methods

The study comprised three methodological components, beginning with examination of the GM i-THRIVE implementation plan and self-assessment questionnaire measure using the Quality Implementation Tool. This was to provide a wider backdrop of implementation method adequacy to the rest of the study's findings. Subsequently, evaluation measures completed by professionals across Greater Manchester were examined to establish implementation progress, before corroborating key items from this measure with thematically analysed interview data from six CYP (13-22 years) who recently received mental health support in the region. Levels of agreement between staff and CYP were examined.

Results

GM i-THRIVE's implementation plan and self-assessment measure were respectively deemed a strong guiding foundation, and a suitable way of evaluating implementation progress. Every principle within the self-assessment measure demonstrated closer alignment with the THRIVE Framework as time progressed. Two themes were developed from the qualitative interview data, each overarching four subthemes: (1) Qualities of the service: information and decision sharing; communication and continuity; needs-based support; compassion and trust, and (2) The mental health journey: beginnings; endings; waiting; satisfaction with support. A good level of agreement between CYP testimony and staff progress reports was found.

Conclusions

Findings suggested that the experiences of the CYP in the sample, who were interviewed in the spring to summer period of 2022, were overwhelmingly positive. The rich insights into mental health support offered by the young participants lead us to recommend continued qualitative research with service-users as GM i-THRIVE's embedding period continues, with focus on representing a wide range of experiences in future research samples. Methodological limitations were explored, including the extent to which true cross-references could be made between professional and CYP accounts.

Perspectives of Parents and Teachers on the Impact of the COVID-19 Pandemic on Children's Socio-Emotional Well-Being

The negative impacts of COVID 19 on children's holistic development have been reported by researchers around the world. This qualitative study explored teachers' and parents' perspectives on the impact of physical/social distancing and school closure policies on children's socioemotional development. The study was conducted in fall 2020. The sample included four U.S. Preschools teachers (for 4-year-olds), four international preschool teachers (for 4, 5-year-olds), three U.S. Kindergarten teaches (for 5-year-olds), and 4 U.S. parents of 4 and 5-year-olds. Interviews were conducted over Zoom. Participants shared that the social deprivation experienced by children such as lack of friendships, absence of peer learning and peer communication, loss of play time, and lack of socialization impacted their children's socialization skills, higher order thinking development, mental health, and activity levels. Participants also shared that their children exhibited externalizing behaviors such as acting out, throwing tantrums, seeking negative attention, aggressiveness, lying, and showing disrespect. Participants reported children's life skills acquisition issues such as their over reliance on parents and difficulty in performing routine tasks. Participating teachers who taught 5-years-olds reported lower levels of fine motor skills among their students. The findings of the study suggest that although children have experienced severe academic learning loss during the pandemic, the post-pandemic ECE curriculum must keep a strong socio-emotional and practical life skills focus which contributes to children's overall well-being. Future studies may adopt a mixed method design in multi-country contexts to evaluate the impact of interventions implemented by early childhood programs on children's socioemotional health.

Where Rabies Is Not a Disease. Bridging Healthworlds to Improve Mutual Understanding and Prevention of Rabies

Deeply embedded in local social, cultural, and religious settings, traditional healing is part of dog bite and rabies management in many rabies endemic countries. Faith healing, which usually encompasses a more holistic approach to health including physical, mental and social dimensions, is rare in the context of rabies. In Gujarat, Western India, the Hindu goddess Hadkai Mata is worshiped by low-caste communities as the Mother of Rabies in the event of a dog bite to a person or their livestock. This belief might influence people's attitudes and behaviors toward rabies prevention but has never been investigated. Through 31 in-depth interviews with healers and staff of Hadkai Mata temples, this paper explores the system of knowledge around dog and human rabies that is built and shared in these places of worship and healing. Qualitative and quantitative data were analyzed looking for convergences and divergences with the recently launched National Action Plan for dog-mediated Rabies Elimination. Results suggest that while the etiology of human rabies as a social illness is usually explained as the goddess's wish to correct misbehaving people and restore positive interpersonal relations, there is some appreciation for the biological processes of infection that lead to rabies as a physical disease. Hadkai Mata is believed to cure rabies if her patients undergo the necessary process of moral growth. Although conventional post-exposure prophylaxis is not opposed per se, it is often delayed by patients who seek traditional treatment first. Some reluctance was expressed toward mass dog vaccination because it is seen as an interference in how the goddess controls dogs, by enraging them-hence infecting them with rabies-and sending them to bite wrongdoers. Addressing these cultural perceptions is likely to be critical in achieving effective control of dog rabies in this region. The study highlights the value of multidisciplinary approaches in the control and elimination of rabies, as well as other zoonoses. This includes the importance of understanding different culturally- and religiously- mediated ways in which humans relate to animals; and looking for points of convergence and mutual understanding, upon which context-tailored, linguistically-accurate, locally acceptable, feasible and effective strategies can be designed.

Perceptions of event notification following discharge to improve geriatric care: qualitative interviews of care team members from a 2-site cluster randomized trial

OBJECTIVE

To assess primary care teams' perceptions of a health information exchange (HIE) event notification intervention for geriatric patients in 2 Veterans Health Administration (VHA) medical centers.

MATERIALS AND METHODS

We conducted a qualitative evaluation of an event notification alerting primary care teams to non-VHA hospital admissions and emergency department visits. Data were collected through semistructured interviews (n = 23) of primary care team physicians, nurses and medical assistants. Study design and analysis were guided by the Consolidated Framework for Implementation Research (CFIR).

RESULTS

Team members found the alerts necessary, helpful for filling information gaps, and effective in supporting timely follow-up care, although some expressed concern over scheduling capacity and distinguishing alerts from other VHA notices. Participants also suggested improvements including additional data on patients' diagnosis and discharge instructions, timing alerts to patients' discharge (including clear next steps), including additional team members to ensure alerts were acted upon, and implementing a single sign-on.

DISCUSSION

Primary care team members perceived timely event notification of non-VHA emergency department visits and hospital admissions as potentially improving post-discharge follow-up and patient outcomes. However, they were sometimes unsure of next steps and suggested the alerts and platform could be streamlined for easier use.

CONCLUSIONS

Event notifications may be a valuable tool in coordinating care for high-risk older patients. Future intervention research should explore the optimal amount and types of information and delivery method across sites and test the integration of alerts into broader care coordination efforts.

End-user perceptions of a patient- and family-centred intervention to improve nutrition intake among oncology patients: a descriptive qualitative analysis

Background

People with cancer are at high risk of malnutrition. Nutrition education is an effective strategy to improve patient outcomes, however, little is known regarding the impact of family and/or carer involvement in nutrition education and requires investigation. The purpose of the study was to evaluate PIcNIC (Partnering with families to promote nutrition in cancer care) intervention acceptability from the perspective of patients, families and health care providers.

Methods

A descriptive qualitative study was undertaken at an inpatient and an outpatient hospital setting in Australia and an outpatient/home setting in Hong Kong. A patient-and-family centred intervention including nutrition education, goals setting/nutrition plans, and food diaries, was delivered to patients and/or families in the inpatient, outpatient or home setting. Semi-structured interviews were used to explore perceptions of the intervention. 64 participants were interviewed; 20 patients, 15 family members, and 29 health care professionals. Data were analysed using deductive and inductive content analysis.

Results

Two categories were identified; 1) ‘context and intervention acceptability’; and 2) ‘benefits of patient- and family-centred nutrition care’. Within each category redundant concepts were identified. For category 1 the redundant concepts were: the intervention works in outpatient settings, the food diary is easy but needs to be tailored, the information booklet is a good resource, and the intervention should be delivered by a dietitian, but could be delivered by a nurse. The redundant concepts for category 2 were: a personalised nutrition plan is required, patient and family involvement in the intervention is valued and the intervention has benefits for patients and families. Converging and diverging perceptions across participant groups and settings were identified.

Conclusions

In this paper we have described an acceptable patient- and family-centred nutrition intervention, which may be effective in increasing patient and family engagement in nutrition care and may result in improved nutrition intakes. Our study highlights important contextual considerations for nutrition education; the outpatient and home setting are optimal for engaging patients and families in learning opportunities.

Pragmatic trials and implementation science: grounds for divorce?

Background

The paper opens with a brief history of two of the major intellectual components of the recent utilitarian turn in clinical research, namely ‘pragmatic trials’ and ‘implementation science’. The two schools of thought developed independently and the paper scrutinises their mutual compatibilities and incompatibilities, asking: i) what do the leading advocates of pragmatic trials assume about the transfer of research findings to real-world practice and ii) what role pragmatic trials can and should play in the evaluation of implementation science strategies.

Methods

The paper utilises ‘explication de texte’: i) providing a close reading of the inferential logics contained in major published expositions of the two paradigms, and ii) interrogating the conclusions of a pragmatic trial of an intervention providing guidelines on retinal screening aimed at family practitioners.

Results

The paper is in two parts. Part 1 unearths some significant incommensurability – the pragmatic trial literature retains an antiquated view of knowledge transfer and is overly optimistic about the wide applicability the findings of pragmatic trials to ‘real world’ conditions. Part 2 of the paper outlines an empirical strategy to better penetrate the mechanisms of knowledge transfer and to tackle the issue of the generalisabilty of research findings in implementation science.

Conclusions

Pragmatism, classically, is about problem solving and the melding of perspectives. The core research requirement in implementation science is a fundamental shift from the narrow shoulders of pragmatic trials to a model of explanation building based upon a multi-case, multi-method body of evidence.

Explaining variation of implementation outcomes of centralized waiting lists for unattached patients

Purpose

Centralized waiting lists (CWLs) for patient attachment to a primary care provider have been implemented across Canada, including Quebec. Little is known about the implementation of CWLs and the factors that influence implementation outcomes of such primary care innovations. The purpose of this paper is to explain variations in the outcomes of implementation by analyzing the characteristics of CWLs and contextual factors that influence their implementation.

Design/methodology/approach

A multiple qualitative case study was conducted. Four contrasting CWLs were purposefully selected: two relatively high-performing and two relatively low-performing cases with regard to process indicators. Data collected between 2015 and 2016 drew on three sources: 26 semi-structured interviews with key stakeholders, 22 documents and field notes. The Consolidated Framework for Implementation Research was used to identify, through a cross-case comparison of ratings, constructs that distinguish high from low-performing cases.

Findings

Five constructs distinguished high from low-performing cases: three related to the inner setting: network and communications; leadership engagement; available resources; one from innovation characteristics: adaptability with regard to registration, evaluation of priority and attachment to a family physician; and, one associated with process domain: engaging. Other constructs exerted influence on implementation (e.g. outer setting, individual characteristics), but did not distinguish high and low-performing cases.

Originality/value

This is the first in-depth analysis of CWL implementation. Results suggest important factors that might be useful in efforts to continuously improve implementation performance of CWLs and similar innovations.

"Struggling with practices" - a qualitative study of factors influencing the implementation of clinical quality registries for cardiac rehabilitation in England and Denmark

Background

The use of clinical quality registries as means for data driven improvement in healthcare seem promising. However, their use has been shown to be challenged by a number of aspects, and we suggest some may be related to poor implementation. There is a paucity of literature regarding barriers and facilitators for registry implementation, in particular aspects related to data collection and entry. We aimed to illuminate this by exploring how staff perceive the implementation process related to the registries within the field of cardiac rehabilitation in England and Denmark.

Methods

A qualitative, interview-based study with staff involved in collecting and/or entering data into the two case registries (England N = 12, Denmark N = 12). Interviews were analysed using content analysis. The Consolidated Framework for Implementation Research was used to guide interviews and the interpretation of results.

Results

The analysis identified both similarities and differences within and between the studied registries, and resulted in clarification of staffs´ experiences in an overarching theme: ´Struggling with practices´ and five categories; the data entry process, registry quality, resources and management support, quality improvement and the wider healthcare context. Overall, implementation received little focused attention. There was a lack of active support from management, and staff may experience a struggle of fitting use of a registry into a busy and complex everyday practice.

Conclusion

The study highlights factors that may be important to consider when planning and implementing a new clinical quality registry within the field of cardiac rehabilitation, and is possibly transferrable to other fields. The results may thus be useful for policy makers, administrators and managers within the field and beyond. Targeting barriers and utilizing knowledge of facilitating factors is vital in order to improve the process of registry implementation, hence helping to achieve the intended improvement of care processes and outcomes.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-3940-5) contains supplementary material, which is available to authorized users.

Primary care networks and team effectiveness: the case of a large-scale quality improvement disparity reduction program

Documentation of primary care teams' involvement in disparity reduction efforts exists, yet little is known about how teams interact or perceive their effectiveness. We investigated how the social network and structural ties among primary-care-clinic team members relate to their perceived team effectiveness (TE), in a large-scale disparity reduction intervention in Israel's largest insurer and provider of services. A mixed-method design of Social Network Analysis and qualitative data collection was employed. 108 interviews with medical, nursing, and administrative teams of 26 clinics and their respective managerial units were performed and information on the organizational ties, analyzing density and centrality, collected. Pearson correlations examined association between network measures and perceived TE. Clinics with strong intra-clinic density and high clinic-subregional-management density were positively correlated with perceived TE. Clinic in-degree centrality was also positively associated with perceived TE. Qualitative analyses support these findings with teamwork emerging as a factor which can impede or facilitate teams' ability to design and implement disparity reduction interventions. The study demonstrates that in an organization-wide disparity reduction initiative, cohesive intra-network structure and close relations with mid-level management increase the likelihood that teams perceive themselves as possessing the skills and resources needed to lead and implement disparity reduction efforts. List of abbreviations Team Effectiveness (TE); Clalit Health Services (Clalit); Social Network Analysis (SNA); Quality Improvement (QI); National Health Care Collaborative (NHPC); Tampa Bay Community Cancer Network (TBCCN).

Shedding light on conditions for the successful passive dissemination of recommendations in primary care: a mixed methods study

BACKGROUND

Passive dissemination of information in healthcare refers to the publication or mailing of newly established guidelines or recommendations. It is one of the least costly knowledge translation activities. This approach is generally considered to be ineffective or to result in only small changes in practice. Recent research, however, suggests that passive dissemination could, under certain conditions, result in modifications of practice, similar to more active dissemination approaches. The objective of our study was to uncover the conditions associated with the change in primary care practice, namely Family Medicine Groups (FMGs) in Quebec (Canada), following the passive dissemination of recommendations for the diagnosis and management of Alzheimer's disease and related dementia (AD).

METHODS

We used a three-step, innovative, convergent mixed methods design based on a multiple case study in eight FMGs. Two studies were conducted in parallel: (1) a before and after retrospective chart review and a cluster analysis of FMGs performed on two clinical performance indicators-the rate of AD diagnosis and the quality of follow-up care; (2) a qualitative descriptive study using interviews and focus groups with FMG clinicians and healthcare managers. The results were integrated using joint displays.

RESULTS

After the passive dissemination of the recommendations, some FMGs started to implement the recommendations while other FMGs did not change their practice with respect to the AD diagnosis rate and quality of follow-up care. Three interrelated conditions were identified for the successful passive dissemination of clinical recommendations: (1) FMG clinicians with a moderate to high baseline expertise and confidence, which was linked to their existing collaboration with hospital-based specialists in dementia and their motivation; (2) the presence of a self-identified champion (individual champion or collective championship) in the FMGs taking the lead, motivating the clinical staff or organizing training; (3) the availability of sufficient clinical staff enabled these two conditions to have an impact on the implementation of recommendations through passive dissemination.

CONCLUSIONS

Passive dissemination of clinical recommendations, a low-cost knowledge translation approach, may lead to practice change under some specific conditions. More active dissemination efforts may only be needed in sites where these conditions are absent.

A Guide to Multisite Qualitative Analysis

The aims of multisite qualitative research, originally developed within the case study tradition, are to produce findings that are reflective of context, while also holding broader applicability across settings. Such knowledge is ideal for informing health and social interventions by overcoming the limitations of research developed through methodological approaches that either "strip" context, or that hold relevance for a site-specific group or population. Yet, despite the potential benefits of multisite qualitative research, there is a paucity of analytical guidance to support researchers in achieving these yields. In this article, we present an analytical approach for conducting multisite qualitative analysis (MSQA) across various methodologies to maximize the potential of qualitative research, enhance rigor, and support the development of interventions that are tailored to the populations that they are intended to serve.

An innovative model to coordinate healthcare and social services for people with serious mental illness: A mixed-methods case study of Maryland's Medicaid health home program

OBJECTIVE

We conducted a case study examining implementation of Maryland's Medicaid health home program, a unique model for integration of behavioral, somatic, and social services for people with serious mental illness (SMI) in the psychiatric rehabilitation program setting.

METHOD

We conducted interviews and surveys with health home leaders (N=72) and front-line staff (N=627) representing 46 of the 48 total health home programs active during the November 2015-December 2016 study period. We measured the structural and service characteristics of the 46 health home programs and leaders' and staff members' perceptions of program implementation.

RESULTS

Health home program structure varied across sites: for example, 15% of programs had co-located primary care providers and 76% had onsite supported employment providers. Most leaders and staff viewed the health home program as having strong organizational fit with psychiatric rehabilitation programs' organizational structures and missions, but noted implementation challenges around health IT, population health management, and coordination with external providers.

CONCLUSION

Maryland's psychiatric rehabilitation-based health home is a promising model for integration of behavioral, somatic, and social services for people with SMI but may be strengthened by additional policy and implementation supports, including incentives for external providers to engage in care coordination with health home providers.

Sowing the seeds of transformative practice to actualize women's rights to respectful maternity care: reflections from Kenya using the consolidated framework for implementation research

BACKGROUND

Despite years of growing concern about poor provider attitudes and women experiencing mistreatment during facility based childbirth, there are limited interventions that specifically focus on addressing these issues. The Heshima project is an evidence-based participatory implementation research study conducted in 13 facilities in Kenya. It engaged a range of community, facility, and policy stakeholders to address the causes of mistreatment during childbirth and promote respectful maternity care.

METHODS

We used the consolidated framework for implementation research (CFIR) as an analytical lens to describe a complex, multifaceted set of interventions through a reflexive and iterative process for triangulating qualitative data. Data from a broad range of project documents, reports, and interviews were collected at different time points during the implementation of Heshima. Assessment of in-depth interview data used NVivo (Version 10) and Atlas.ti software to inductively derive codes for themes at baseline, supplemental, and endline. Our purpose was to generate categories of themes for analysis found across the intervention design and implementation stages.

RESULTS

The implementation process, intervention characteristics, individual champions, and inner and outer settings influenced both Heshima's successes and challenges at policy, facility, and community levels. Implementation success stemmed from readiness for change at multiple levels, constant communication between stakeholders, and perceived importance to communities. The relative advantage and adequacy of implementation of the Respectful Maternity Care (RMC) resource package was meaningful within Kenyan politics and health policy, given the timing and national promise to improve the quality of maternity care.

CONCLUSION

We found the CFIR lens a promising and flexible one for understanding the complex interventions. Despite the relatively nascent stage of RMC implementation research, we feel this study is an important start to understanding a range of interventions that can begin to address issues of mistreatment in maternity care; replication of these activities is needed globally to better understand if the Heshima implementation process can be successful in different countries and regions.

Supporting the use of theory in cross-country health services research: a participatory qualitative approach using Normalisation Process Theory as an example

OBJECTIVES

To describe and reflect on the process of designing and delivering a training programme supporting the use of theory, in this case Normalisation Process Theory (NPT), in a multisite cross-country health services research study.

DESIGN

Participatory research approach using qualitative methods.

SETTING

Six European primary care settings involving research teams from Austria, England, Greece, Ireland, The Netherlands and Scotland.

PARTICIPANTS

RESTORE research team consisting of 8 project applicants, all senior primary care academics, and 10 researchers. Professional backgrounds included general practitioners/family doctors, social/cultural anthropologists, sociologists and health services/primary care researchers.

PRIMARY OUTCOME MEASURES

Views of all research team members (n=18) were assessed using qualitative evaluation methods, analysed qualitatively by the trainers after each session.

RESULTS

Most of the team had no experience of using NPT and many had not applied theory to prospective, qualitative research projects. Early training proved didactic and overloaded participants with information. Drawing on RESTORE's methodological approach of Participatory Learning and Action, workshops using role play, experiential interactive exercises and light-hearted examples not directly related to the study subject matter were developed. Evaluation showed the study team quickly grew in knowledge and confidence in applying theory to fieldwork.Recommendations applicable to other studies include: accepting that theory application is not a linear process, that time is needed to address researcher concerns with the process, and that experiential, interactive learning is a key device in building conceptual and practical knowledge. An unanticipated benefit was the smooth transition to cross-country qualitative coding of study data.

CONCLUSION

A structured programme of training enhanced and supported the prospective application of a theory, NPT, to our work but raised challenges. These were not unique to NPT but could arise with the application of any theory, especially in large multisite, international projects. The lessons learnt are applicable to other theoretically informed studies.

Implementing a Systematic Voiding Program for Patients With Urinary Incontinence After Stroke

We explored health professionals' views of implementing a systematic voiding program (SVP) in a multi-site qualitative process evaluation in stroke services recruited to the intervention arms of a cluster randomized controlled feasibility trial during 2011-2013. We conducted semi-structured group or individual interviews with 38 purposively selected nursing, managerial, and care staff involved in delivering the SVP. Content analysis of transcripts used normalization process theory (NPT) as a pre-specified organization-level exploratory framework. Barriers to implementing the SVP included perceived lack of suitability for some patient groups, patient fear of extending hospital stay, and difficulties with SVP enactment, scheduling, timing, recording, and monitoring. Enablers included the guidance provided by the SVP, patient and relative involvement, extra staff, improved nursing skill and confidence, and experience of success. Three potential mechanisms of consistency, visibility, and individualization linked the SVP process with improvements in outcome, and should be emphasized in SVP implementation.

Using the Consolidated Framework for Implementation Research to Identify Barriers and Facilitators for the Implementation of an Internet-Based Patient-Provider Communication Service in Five Settings: A Qualitative Study

Background

Although there is growing evidence of the positive effects of Internet-based patient-provider communication (IPPC) services for both patients and health care providers, their implementation into clinical practice continues to be a challenge.

Objective

The 3 aims of this study were to (1) identify and compare barriers and facilitators influencing the implementation of an IPPC service in 5 hospital units using the Consolidated Framework for Implementation Research (CFIR), (2) assess the ability of the different constructs of CFIR to distinguish between high and low implementation success, and (3) compare our findings with those from other studies that used the CFIR to discriminate between high and low implementation success.

Methods

This study was based on individual interviews with 10 nurses, 6 physicians, and 1 nutritionist who had used the IPPC to answer messages from patients.

Results

Of the 36 CFIR constructs, 28 were addressed in the interviews, of which 12 distinguished between high and low implementation units. Most of the distinguishing constructs were related to the inner setting domain of CFIR, indicating that institutional factors were particularly important for successful implementation. Health care providers’ beliefs in the intervention as useful for themselves and their patients as well as the implementation process itself were also important. A comparison of constructs across ours and 2 other studies that also used the CFIR to discriminate between high and low implementation success showed that 24 CFIR constructs distinguished between high and low implementation units in at least 1 study; 11 constructs distinguished in 2 studies. However, only 2 constructs (patient need and resources and available resources) distinguished consistently between high and low implementation units in all 3 studies.

Conclusions

The CFIR is a helpful framework for illuminating barriers and facilitators influencing IPPC implementation. However, CFIR’s strength of being broad and comprehensive also limits its usefulness as an implementation framework because it does not discriminate between the relative importance of its many constructs for implementation success. This is the first study to identify which CFIR constructs are the most promising to distinguish between high and low implementation success across settings and interventions. Findings from this study can contribute to the refinement of CFIR toward a more succinct and parsimonious framework for planning and evaluation of the implementation of clinical interventions.

ClinicalTrial

Clinicaltrials.gov NCT00971139; http://clinicaltrial.gov/ct2/show/NCT00971139 (Archived by WebCite at http://www.webcitation.org/6cWeqN1uY)

What qualitative research can contribute to a randomized controlled trial of a complex community intervention

Using the case of a large-scale, multi-site Canadian Housing First research demonstration project for homeless people with mental illness, At Home/Chez Soi, we illustrate the value of qualitative methods in a randomized controlled trial (RCT) of a complex community intervention. We argue that quantitative RCT research can neither capture the complexity nor tell the full story of a complex community intervention. We conceptualize complex community interventions as having multiple phases and dimensions that require both RCT and qualitative research components. Rather than assume that qualitative research and RCTs are incommensurate, a more pragmatic mixed methods approach was used, which included using both qualitative and quantitative methods to understand program implementation and outcomes. At the same time, qualitative research was used to examine aspects of the intervention that could not be understood through the RCT, such as its conception, planning, sustainability, and policy impacts. Through this example, we show how qualitative research can tell a more complete story about complex community interventions.

Identifying Continence OptioNs after Stroke (ICONS): an evidence synthesis, case study and exploratory cluster randomised controlled trial of the introduction of a systematic voiding programme for patients with urinary incontinence after stroke in secondary care

Background

Urinary incontinence (UI) following acute stroke is common, affecting between 40% and 60% of people in hospital, but is often poorly managed.

Aim

To develop, implement and evaluate the preliminary effectiveness and potential cost-effectiveness of a systematic voiding programme (SVP), with or without supported implementation, for the management of UI after stroke in secondary care.

Design

Structured in line with the Medical Research Council framework for the evaluation of complex interventions, the programme comprised two phases: Phase I, evidence synthesis of combined approaches to manage UI post stroke, case study of the introduction of the SVP in one stroke service; Phase II, cluster randomised controlled exploratory trial incorporating a process evaluation and testing of health economic data collection methods.

Setting

One English stroke service (case study) and 12 stroke services in England and Wales (randomised trial).

Participants

Case study, 43 patients; randomised trial, 413 patients admitted to hospital with stroke and UI.

Interventions

A SVP comprising assessment, individualised conservative interventions and weekly review. In the supported implementation trial arm, facilitation was used as an implementation strategy to support and enable people to change their practice.

Main outcome measures

Participant incontinence (presence/absence) at 12 weeks post stroke. Secondary outcomes were quality of life, frequency and severity of incontinence, urinary symptoms, activities of daily living and death, at discharge, 6, 12 and 52 weeks post stroke.

Results

There was no suggestion of a beneficial effect on outcome at 12 weeks post stroke [intervention vs. usual care: odds ratio (OR) 1.02, 95% confidence interval (CI) 0.54 to 1.93; supported implementation vs. usual care: OR 1.06, 95% CI 0.54 to 2.09]. There was weak evidence of better outcomes on the Incontinence Impact Questionnaire in supported implementation (OR 1.22, 95% CI 0.72 to 2.08) but the CI is wide and includes both clinically relevant benefit and harm. Both intervention arms had a higher estimated odds of continence for patients with urge incontinence than usual care (intervention: OR 1.58, 95% CI 0.83 to 2.99; supported implementation: OR 1.73, 95% CI 0.88 to 3.43). The process evaluation showed that the SVP increased the visibility of continence management through greater evaluation of patients’ trajectories and outcomes, and closer attention to workload. In-hospital resource use had to be based on estimates provided by staff. The response rates for the postal questionnaires were 73% and 56% of eligible patients at 12 and 52 weeks respectively. Completion of individual data items varied between 67% and 100%.

Conclusions

The trial was exploratory and did not set out to establish effectiveness; however, there are indications the intervention may be effective in patients with urge and stress incontinence. A definitive trial is now warranted.

Study registration

This study is registered as ISRCTN08609907.

Funding details

The National Institute for Health Research Programme Grants for Applied Research programme. Excess treatment costs and research support costs were funded by participating NHS trusts and health boards, Lancashire and Cumbria and East Anglia Comprehensive Local Research Networks and the Welsh National Institute for Social Care and Health Research.

Identification of promising strategies to sustain improvements in hospital practice: a qualitative case study

BACKGROUND

A quality improvement collaborative is an intensive project involving a combination of implementation strategies applied in a limited "breakthrough" time window. After an implementation project, it is generally difficult to sustain its success. In the current study, sustainability was described as maintaining an implemented innovation and its benefits over a longer period of time after the implementation project has ended. The aim of the study was to explore potentially promising strategies for sustaining the Enhanced Recovery After Surgery (ERAS) programme in colonic surgery as perceived by professionals, three to six years after the hospital had successfully finished a quality improvement collaborative.

METHODS

A qualitative case study was performed to identify promising strategies to sustain key outcome variables related to the ERAS programme in terms of adherence, time needed for functional recovery and hospital length of stay (LOS), as achieved immediately after implementation. Ten hospitals were selected which had successfully implemented the ERAS programme in colonic surgery (2006-2009), with success defined as a median LOS of 6 days or less and protocol adherence rates above 70%. Fourteen semi-structured interviews were held with eighteen key participants of the care process three to six years after implementation, starting with the project leader in every hospital. The interviews started by confronting them with the level of sustained implementation results. A direct content analysis with an inductive coding approach was used to identify promising strategies. The mean duration of the interviews was 37 minutes (min 26 minutes - max 51 minutes).

RESULTS

The current study revealed strategies targeting professionals and the organisation. They comprised internal audit and feedback on outcomes, small-scale educational booster meetings, reminders, changing the physical structure of the organisation, changing the care process, making work agreements and delegating responsibility, and involving a coordinator. A multifaceted self-driven promising strategy was applied in most hospitals, and in most hospitals promising strategies were suggested to sustain the ERAS programme.

CONCLUSIONS

Joining a quality improvement collaborative may not be enough to achieve long-term normalisation of transformed care, and additional investments may be needed. The findings suggest that certain post-implementation strategies are valuable in sustaining implementation successes achieved after joining a quality improvement collaborative.

Mapping barriers and intervention activities to behaviour change theory for Mobilization of Vulnerable Elders in Ontario (MOVE ON), a multi-site implementation intervention in acute care hospitals

BACKGROUND

As evidence-informed implementation interventions spread, they need to be tailored to address the unique needs of each setting, and this process should be well documented to facilitate replication. To facilitate the spread of the Mobilization of Vulnerable Elders in Ontario (MOVE ON) intervention, the aim of the current study is to develop a mapping guide that links identified barriers and intervention activities to behaviour change theory.

METHODS

Focus groups were conducted with front line health-care professionals to identify perceived barriers to implementation of an early mobilization intervention targeted to hospitalized older adults. Participating units then used or adapted intervention activities from an existing menu or developed new activities to facilitate early mobilization. A thematic analysis was performed on the focus group data, emphasizing concepts related to barriers to behaviour change. A behaviour change theory, the 'capability, opportunity, motivation-behaviour (COM-B) system', was used as a taxonomy to map the identified barriers to their root causes. We also mapped the behaviour constructs and intervention activities to overcome these.

RESULTS

A total of 46 focus groups were conducted across 26 hospital inpatient units in Ontario, Canada, with 261 participants. The barriers were conceptualized at three levels: health-care provider (HCP), patient, and unit. Commonly mentioned barriers were time constraints and workload (HCP), patient clinical acuity and their perceived 'sick role' (patient), and lack of proper equipment and human resources (unit level). Thirty intervention activities to facilitate early mobilization of older adults were implemented across hospitals; examples of unit-developed intervention activities include the 'mobility clock' communication tool and the use of staff champions. A mapping guide was created with barriers and intervention activities matched though the lens of the COM-B system.

CONCLUSIONS

We used a systematic approach to develop a guide, which maps barriers, intervention activities, and behaviour change constructs in order to tailor an implementation intervention to the local context. This approach allows implementers to identify potential strategies to overcome local-level barriers and to document adaptations.