How does the external context affect an implementation processes? A qualitative study investigating the impact of macro-level variables on the implementation of goal-oriented primary care

BACKGROUND

Although the importance of context in implementation science is not disputed, knowledge about the actual impact of external context variables on implementation processes remains rather fragmented. Current frameworks, models, and studies merely describe macro-level barriers and facilitators, without acknowledging their dynamic character and how they impact and steer implementation. Including organizational theories in implementation frameworks could be a way of tackling this problem. In this study, we therefore investigate how organizational theories can contribute to our understanding of the ways in which external context variables shape implementation processes. We use the implementation process of goal-oriented primary care in Belgium as a case.

METHODS

A qualitative study using in-depth semi-structured interviews was conducted with actors from a variety of primary care organizations. Data was collected and analyzed with an iterative approach. We assessed the potential of four organizational theories to enrich our understanding of the impact of external context variables on implementation processes. The organizational theories assessed are as follows: institutional theory, resource dependency theory, network theory, and contingency theory. Data analysis was based on a combination of inductive and deductive thematic analysis techniques using NVivo 12.

RESULTS

Institutional theory helps to understand mechanisms that steer and facilitate the implementation of goal-oriented care through regulatory and policy measures. For example, the Flemish government issued policy for facilitating more integrated, person-centered care by means of newly created institutions, incentives, expectations, and other regulatory factors. The three other organizational theories describe both counteracting or reinforcing mechanisms. The financial system hampers interprofessional collaboration, which is key for GOC. Networks between primary care providers and health and/or social care organizations on the one hand facilitate GOC, while on the other hand, technology to support interprofessional collaboration is lacking. Contingent variables such as the aging population and increasing workload and complexity within primary care create circumstances in which GOC is presented as a possible answer.

CONCLUSIONS

Insights and propositions that derive from organizational theories can be utilized to expand our knowledge on how external context variables affect implementation processes. These insights can be combined with or integrated into existing implementation frameworks and models to increase their explanatory power.

Will the implementation process for goal-oriented primary care succeed? A qualitative study investigating five perceived attributes of goal-oriented care

Throughout the western world, goal oriented care (GOC) is increasingly promoted as a strategy towards more person-centered, integrated care. The implementation of goal-oriented care not only takes place at the micro-level with individual primary care providers (PCPs) changing their approach, but also requires meso- and macro-level investment. In this study, we zoom in on experiences and actions of various meso- and macro-level actors that are actively engaged with implementing GOC, both within their organization or at the policy level. In-depth interviews were conducted with n = 23 actors from a variety of different organizations (governmental institutions, provider organizations, patient organizations, health/social care organizations, primary care zones/care councils, etc.), using a semi- interview guide inspired by realist interviewing. Three main drivers for implementation were identified: recognition, commitment and coordination. On top of that, results were interpreted through Rogers' Diffusion of Innovations (Dol) theory in which five attributes are discussed that contribute to or hinder implementation success. Our findings can help define actions to support and facilitate the implementation process of an innovation such as GOC.

Can systematic implementation support improve programme fidelity by improving care providers' perceptions of implementation factors? A cluster randomized trial

BACKGROUND

Investigations of implementation factors (e.g., collegial support and sense of coherence) are recommended to better understand and address inadequate implementation outcomes. Little is known about the relationship between implementation factors and outcomes, especially in later phases of an implementation effort. The aims of this study were to assess the association between implementation success (measured by programme fidelity) and care providers' perceptions of implementation factors during an implementation process and to investigate whether these perceptions are affected by systematic implementation support.

METHODS

Using a cluster-randomized design, mental health clinics were drawn to receive implementation support for one (intervention) and not for another (control) of four evidence-based practices. Programme fidelity and care providers' perceptions (Implementation Process Assessment Tool questionnaire) were scored for both intervention and control groups at baseline, 6-, 12- and 18-months. Associations and group differences were tested by means of descriptive statistics (mean, standard deviation and confidence interval) and linear mixed effect analysis.

RESULTS

Including 33 mental health centres or wards, we found care providers' perceptions of a set of implementation factors to be associated with fidelity but not at baseline. After 18 months of implementation effort, fidelity and care providers' perceptions were strongly correlated (B (95% CI) = .7 (.2, 1.1), p = .004). Care providers perceived implementation factors more positively when implementation support was provided than when it was not (t (140) = 2.22, p = .028).

CONCLUSIONS

Implementation support can facilitate positive perceptions among care providers, which is associated with higher programme fidelity. To improve implementation success, we should pay more attention to how care providers constantly perceive implementation factors during all phases of the implementation effort. Further research is needed to investigate the validity of our findings in other settings and to improve our understanding of ongoing decision-making among care providers, i.e., the mechanisms of sustaining the high fidelity of recommended practices.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03271242 (registration date: 05.09.2017).

Sugar-sweetened beverage tax implementation processes: results of a scoping review

Taxing sugar-sweetened beverages (SSB) is seen as a win–win situation for governments. It is argued that SSB taxes are relatively easy to implement from a practical perspective compared to for example other nutrition policies. However, the implementation of SSB taxation laws does not happen by itself. Therefore, this work examines implementation processes for SSB taxation in terms of (1) pre-implementation context, (2) taxation instruments used and (3) interactions in the implementation process. Ten databases and grey literature were systematically searched for studies reporting on SSB taxation implementation processes up to February 2020. All studies (N = 1248) were screened independently by two reviewers according to predefined criteria. The selection of variables to be extracted was based on the policy cycle heuristic and informed by intervention implementation research. Information on the process of implementing SSB taxation is limited. Only six cases based on three publications were identified, indicating a gap in this research area. SSB taxation implementation was accomplished by hiring a subcontractor for the implementation or using pre-existing tax collection structures. Political and public support within the implementation process seems to be supportive for the city of Berkeley and for Portugal but was not reported for the Pacific Islands. However, the existing data are very limited, and further research on SSB taxation implementation processes is needed to determine whether the aim of the policy and the envisaged outcome are linked in practice.

Registration The protocol was registered with the Open Science Framework (OSF) (osf.io/7w84q/)

Understanding implementation context and social processes through integrating Normalization Process Theory (NPT) and the Consolidated Framework for Implementation Research (CFIR)

BACKGROUND

For successful implementation of an innovation within a complex adaptive system, we need to understand the ways that implementation processes and their contexts shape each other. To do this, we need to explore the work people do to make sense of an innovation and integrate it into their workflow and the contextual elements that impact implementation. Combining Normalization Process Theory (NPT) with the Consolidated Framework for Implementation Research (CFIR) offers an approach to achieve this. NPT is an implementation process theory that explains how changes in the way people think about and use an innovation occurs, while CFIR is a framework that categorizes and describes contextual determinants across five domains that influence implementation. We demonstrate through a case example from our prior research how we integrated NPT and CFIR to inform the development of the interview guide, coding manual, and analysis of the findings.

METHODS

In collaboration with our stakeholders, we selected NPT and CFIR to study the implementation process and co-developed an interview guide to elicit responses that would illuminate concepts from both. We conducted, audio-recorded, and transcribed 28 interviews with various professionals involved with the implementation. Based on independent coding of select transcripts and team discussion comparing, clarifying, and crystallizing codes, we developed a coding manual integrating CFIR and NPT constructs. We applied the integrated codes to all interview transcripts.

RESULTS

Our findings highlight how integrating CFIR domains with NPT mechanisms adds explanatory strength to the analysis of implementation processes, with particular implications for practical strategies to facilitate implementation. Multiple coding across both theoretical frames captured the entanglement of process and context. Integrating NPT and CFIR enriched understandings of how interactions between implementation processes and contextual determinants shaped each other during implementation.

CONCLUSION

The integration of NPT and CFIR provides guidance to identify and explore complex entangled interactions between agents, processes, and contextual conditions within and beyond organizations to embed innovations into routine practices. Nuanced understandings gained through this approach moves understandings beyond descriptions of determinants to explain how change occurs or not during implementation. Mechanism-based explanations illuminate concrete practical strategies to support implementation.

Effects of relocation to activity-based workplaces on perceived productivity: Importance of change-oriented leadership

Activity-based workplaces (ABWs) are becoming popular in Western countries and were implemented at four office sites of a large Swedish government agency. A fifth office was used as a control group. The study aim was to examine the effects of relocation to ABW on perceived productivity among employees and to determine if perceived change-oriented leadership behavior prior to relocation moderates potential effects. Data were collected three months prior to relocation, and three and 12 months after. 407 respondents were included in linear mixed regression models. Perceived productivity decreased significantly after relocation compared to the control group and these effects persisted 12 months after the relocation. However, the decrease in perceived productivity was significantly smaller among employees perceiving high change-oriented leadership before relocation. Our results point out the importance of a change-oriented leadership behavior during the implementation to avoid productivity loss among employees when implementing ABWs.

Implementing an intrapartum package of interventions to improve quality of care to reduce the burden of preterm birth in Kenya and Uganda

Background

Quality of care during the intrapartum and immediate postnatal period for maternal and newborn health remains a major challenge due to the multiple health system bottlenecks in low-income countries. Reports of complex interventions that have been effective in reducing maternal and newborn mortality in these settings are usually limited in description, which inhibits learning and replication. We present a detailed account of the Preterm Birth Initiative (PTBi) implementation process, experiences and lessons learnt to inform scale-up and replication.

Methods

Using the TiDieR framework, we detail how the PTBi implemented an integrated package of interventions through a pair-matched cluster randomized control trial in 20 health facilities in Migori County, Kenya, and the Busoga region in east central Uganda from 2016 to 2019. The package aimed to improve quality of care during the intrapartum and immediate postnatal period with a focus on preterm birth. The package included data strengthening (DS) and introduction of a modified WHO Safe Childbirth Checklist (mSCC), simulation-based training and mentoring (PRONTO), and a Quality Improvement (QI) Collaborative.

Results

In 2016, DS and mSCC were introduced to improve existing data processes and increase the quality of data for measures needed to evaluate study impact. PRONTO and QI interventions were then rolled out sequentially. While package components were implemented with fidelity, some implementation processes required contextual adaptation to allow alignment with national priorities and guidelines, and flexibility to optimize uptake.

Conclusion

Lessons learned included the importance of synergy between interventions, the need for local leadership engagement, and the value of strengthening local systems and resources. Adaptations of individual elements of the package to suit the local context were important for effective implementation, and the TIDieR framework provides the guidance needed in detailed description to replicate such a complex intervention in other settings. Detailed documentation of the implementation process of a complex intervention with mutually synergistic components can help contextualize trial results and potential for scale-up. The trial is registered at ClinicalTrials.govNCT03112018, registered December 2016, posted April 2017.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00109-w.

The "State of Implementation" Progress Report (SIPREP): a pilot demonstration of a navigation system for implementation

BACKGROUND

Implementation of new clinical programs across diverse facilities in national healthcare systems like the Veterans Health Administration (VHA) can be extraordinarily complex. Implementation is a dynamic process, influenced heavily by local organizational context and the individual staff at each medical center. It is not always clear in the midst of implementation what issues are most important to whom or how to address them. In recognition of these challenges, implementation researchers within VHA developed a new systemic approach to map the implementation work required at different stages and provide ongoing, detailed, and nuanced feedback about implementation progress.

METHODS

This observational pilot demonstration project details how a novel approach to monitoring implementation progress was applied across two different national VHA initiatives. Stage-specific grids organized the implementation work into columns, rows, and cells, identifying specific implementation activities at the site level to be completed along with who was responsible for completing each implementation activity. As implementation advanced, item-level checkboxes were crossed off and cells changed colors, offering a visual representation of implementation progress within and across sites across the various stages of implementation.

RESULTS

Applied across two different national initiatives, the SIPREP provided a novel navigation system to guide and inform ongoing implementation within and across facilities. The SIPREP addressed different needs of different audiences, both described and explained how to implement the program, made ample use of visualizations, and revealed both what was happening and not happening within and across sites. The final SIPREP product spanned distinct stages of implementation.

CONCLUSIONS

The SIPREP made the work of implementation explicit at the facility level (i.e., who does what, and when) and provided a new common way for all stakeholders to monitor implementation progress and to help keep implementation moving forward. This approach could be adapted to a wide range of settings and interventions and is planned to be integrated into the national deployment of two additional VHA initiatives within the next 12 months.

Implementing collaborative care to reduce depression for rural native American/Alaska native people

BACKGROUND

The purpose of this study was to identify the effects of Collaborative Care on rural Native American and Alaska Native (AI/AN) patients.

METHODS

Collaborative Care was implemented in three AI/AN serving clinics. Clinic staff participated in training and coaching designed to facilitate practice change. We followed clinics for 2 years to observe improvements in depression treatment and to examine treatment outcomes for enrolled patients. Collaborative Care elements included universal screening for depression, evidence-based treatment to target, use of behavioral health care managers to deliver the intervention, use of psychiatric consultants to provide caseload consultation, and quality improvement tracking to improve and maintain outcomes. We used t-tests to evaluate the main effects of Collaborative Care and used multiple linear regression to better understand the predictors of success. We also collected qualitative data from members of the Collaborative Care clinical team about their experience.

RESULTS

The clinics participated in training and practice coaching to implement Collaborative Care for depressed patients. Depression response (50% or greater reduction in depression symptoms as measured by the PHQ-9) and remission (PHQ-9 score less than 5) rates were equivalent in AI/AN patients as compared with White patients in the same clinics. Significant predictors of positive treatment outcome include only one depression treatment episodes during the study and more follow-up visits per patient. Clinicians were overall positive about their experience and the effect on patient care in their clinic.

CONCLUSIONS

This project showed that it is possible to deliver Collaborative Care to AI/AN patients via primary care settings in rural areas.

The implementation of the coaching on lifestyle (CooL) intervention: lessons learnt

Background

Combined lifestyle interventions (CLIs) are designed to help people who are overweight or obese maintain a healthy new lifestyle. The CooL intervention is a CLI in the Netherlands, in which lifestyle coaches counsel adults and children (and/or their parents) who are obese or at high risk of obesity to achieve a sustained healthier lifestyle. The intervention consists of coaching on lifestyle in group and individual sessions, addressing the topics of physical activity, dietary behaviours, sleep, stress management and behavioural change. The aim of this study was to evaluate the implementation process of the Coaching on Lifestyle (CooL) intervention and its facilitating and impeding factors.

Methods

Mixed methods were used in this action-oriented study. Both quantitative (number of referrals, attendance lists of participants and questionnaires) and qualitative (group and individual interviews, observations, minutes and open questions) data were collected among participants, lifestyle coaches, project group members and other stakeholders. The Consolidated Framework for Implementation Research was used to analyse the data.

Results

CooL was evaluated by stakeholders and participants as an accessible and useful programme, because of its design and content and the lifestyle coaches’ approach. However, stakeholders indicated that the lifestyle coaches need to become more familiar in the health care network and public sectors in the Netherlands. Lifestyle coaching is a novel profession and the added value of the lifestyle coach is not always acknowledged by all health care providers. Lifestyle coaches play a crucial role in ensuring the impact of CooL by actively networking, using clear communication materials and creating stakeholders’ support and understanding.

Conclusion

The implementation process needs to be strengthened in terms of creating support for and providing clear information about lifestyle coaching. The CooL intervention was implemented in multiple regions, thanks to the efforts of many stakeholders. Lifestyle coaches should engage in networking activities and entrepreneurship to boost the implementation process. It takes considerable time for a lifestyle coach to become fully incorporated in primary care.

Trial registration

NTR6208; date registered: 13–01-2017; retrospectively registered; Netherlands Trial Register.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-4457-7) contains supplementary material, which is available to authorized users.

Building an innovative Chagas disease program for primary care units, in an urban non- endemic city

Background

On an absolute basis, Argentina is the country with the largest affected population with Chagas Disease (ChD). This constitutes a significant public health issue. As a consequence of Argentina’s migratory patterns, there has been a significant increase of affected population in urban centers. An innovative project for early diagnosis and timely treatment of ChD was designed for Municipal Primary Care Facilities of La Plata City, a non- endemic area, in line with a proposal from the Pan-American Health Organization. The project was a public –private intervention. The objectives of this study were to demonstrate the feasibility of the primary healthcare level for early diagnosis and timely treatment of ChD; to design and implement a tailor made program and to innovate in a public-private association.

Methods

The healthcare barriers for early diagnosis and timely treatment for the population with ChD of La Plata were analyzed. The four dimensions described by Peters et al. (Ann N Y Acad Sci 1136:161–71, 2008) were used. The baseline was measured during a previous pilot project and the same items were evaluated at the end of 2017. The model from Damschroder et al. (Implement Sci 4:50, 2009) was used during the implementation process.

Results

With all the information gathered during this investigation, a “patient-centered” model was designed. During the program, 17,894 people were serologically tested for ChD, 1,394 were positive and 1,035 were treated. Additionally, 3,750 children from 46 public schools were evaluated for risk factors of ChD.

Conclusions

This project showed the feasibility of the primary healthcare level for early diagnosis and timely treatment of ChD. Tailor made programs and public-private associations should be considered for vulnerable populations in emerging economies in order to enhance efforts and obtain better results. This program may be replicated in other countries of Latin America were Chagas is a main public health issue and, with the corresponding adaptations, for other neglected diseases as well.

Electronic supplementary material

The online version of this article (10.1186/s12889-019-7248-5) contains supplementary material, which is available to authorized users.

Healthcare workers' attitudes towards hand-hygiene monitoring technology

BACKGROUND

Automated radio-frequency identification (RFID)-based hand-hygiene monitoring technology was implemented in an infectious disease department to study healthcare workers' (HCWs') practices and to improve hand hygiene.

AIM

To assess HCWs' attitudes towards this innovative monitoring device in order to anticipate resistance to change and facilitate future implementation.

METHODS

In-depth interviews and an ethnographic approach.

FINDINGS

From the perspective of HCWs, while they recognize the usefulness of RFID technology to prevent the transmission of infections to patients, they expressed concerns about risks related to RFID electromagnetic waves, as well as control by their superiors. Overall, HCWs' opinions oscillated between positive feelings characterized by enthusiasm for the possibility of changing their practices using technologies and research, and negative feelings marked by strong criticisms of these technologies and research. These criticisms included blaming hand-hygiene monitoring technology for decontextualizing HCWs' practices. They perceived the technologies through the prism of the local and national contexts in which they are embedded. From their point of view, technologies are primarily in the best interests of the project team. Thus, they affirm and maintain the different interests and objectives between themselves and the project team, crystallizing a conflict of professional norms and values between these two groups. The forms of resistance taken by HCWs were practical as well as oral.

CONCLUSION

Innovative technologies should be developed to address HCWs' attitudes surrounding RFIDs. It is crucial to inform HCWs about the nature of these technologies, although some criticisms about monitoring systems are based on more structural causes.

The Safe Hands Study: Implementing aseptic techniques in the operating room: Facilitating mechanisms for contextual negotiation and collective action

BACKGROUND

Even though hand hygiene and aseptic techniques are essential to provide safe care in the operating room, several studies have found a lack of successful implementation. The aim of this study was to describe facilitative mechanisms supporting the implementation of hand hygiene and aseptic techniques.

METHODS

This study was set in a large operating room suite in a Swedish university hospital. The theory-driven implementation process was informed by the literature on organizational change and dialogue. Data were collected using interviews and participant observations and analyzed using a thematic approach. The normalization process theory served as a frame of interpretation during the analysis.

RESULTS

Three facilitating mechanisms were identified: (1) commitment through a sense of urgency, requiring extensive communication between the managers, operating room professionals, and facilitators in building commitment to change and putting the issues on the agenda; (2) dialogue for co-creation, increasing and sustaining commitment and resource mobilization; and (3) tailored management support, including helping managers to develop their leadership role, progressively involving staff, and retaining focus during the implementation process.

CONCLUSIONS

The facilitating mechanisms can be used in organizing implementation processes. Putting the emphasis on help and support to managers seems to be a crucial condition in complex implementation processes, from preparation of the change process to stabilization of the new practice.

Determinants of an integrated public health approach: the implementation process of Greenland's second public health program

Background

Greenland struggles with a high prevalence of smoking, alcohol and drug abuse. In response to the increasing need for preventive initiatives, the first public health program Inuuneritta was introduced in 2007. Internationally, frameworks focus primarily on the implementation of a single, well-described intervention or program. However, with the increasing need and emergence of more holistic, integrated approaches, a need for research investigating the process of policy implementation from launch to action arises. This paper aims to augment the empirical evidence on the implementation of integrated health promotion programs within a governmental setting using the case of Inuuneritta II. In this study, the constraining and enabling determinants of the implementation processes within and across levels and sectors were examined.

Methods

Qualitative methods with a transdisciplinary approach were applied. Data collection consisted of six phases with different qualitative methods applied to gain a comprehensive overview and understanding of Inuuneritta II’s implementation process. These methods included: observations and focus group discussions at the community health worker (CHW) conference, telephone interviews, document analysis, and a workshop on results dissemination.

Results

Enabling determinants influencing the implementation process of Inuuneritta II positively were high motivation among adopters, local prevention committees supporting community health workers, and the initiation of the central prevention committee. In contrast, constraining determinants were ambiguous program aims, high turnovers, siloed budgets and work environments, and an inconsistent and neglected central prevention committee.

Conclusion

Inuuneritta II provided a substantial framework for an integrated health policy approach. However, having a holistic and comprehensive program enabling an integrated approach is not sufficient. Inuuneritta II’s integrated approach does not harmonise with the government’s inflexible organisational structure resulting in insufficient implementation.

Electronic supplementary material

The online version of this article (10.1186/s12889-018-6253-4) contains supplementary material, which is available to authorized users.

Improving the normalization of complex interventions: part 2 - validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT)

INTRODUCTION

Successful implementation and embedding of new health care practices relies on co-ordinated, collective behaviour of individuals working within the constraints of health care settings. Normalization Process Theory (NPT) provides a theory of implementation that emphasises collective action in explaining, and shaping, the embedding of new practices. To extend the practical utility of NPT for improving implementation success, an instrument (NoMAD) was developed and validated.

METHODS

Descriptive analysis and psychometric testing of an instrument developed by the authors, through an iterative process that included item generation, consensus methods, item appraisal, and cognitive testing. A 46 item questionnaire was tested in 6 sites implementing health related interventions, using paper and online completion. Participants were staff directly involved in working with the interventions. Descriptive analysis and consensus methods were used to remove redundancy, reducing the final tool to 23 items. Data were subject to confirmatory factor analysis which sought to confirm the theoretical structure within the sample.

RESULTS

We obtained 831 completed questionnaires, an average response rate of 39% (range: 22-77%). Full completion of items was 50% (n = 413). The confirmatory factor analysis showed the model achieved acceptable fit (CFI = 0.95, TLI = 0.93, RMSEA = 0.08, SRMR = 0.03). Construct validity of the four theoretical constructs of NPT was supported, and internal consistency (Cronbach's alpha) were as follows: Coherence (4 items, α = 0.71); Collective Action (7 items, α = 0.78); Cognitive Participation (4 items, α = 0.81); Reflexive Monitoring (5 items, α = 0.65). The normalisation scale overall, was highly reliable (20 items, α = 0.89).

CONCLUSIONS

The NoMAD instrument has good face validity, construct validity and internal consistency, for assessing staff perceptions of factors relevant to embedding interventions that change their work practices. Uses in evaluating and guiding implementation are proposed.

Improving the normalization of complex interventions: part 1 - development of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT)

BACKGROUND

Understanding and measuring implementation processes is a key challenge for implementation researchers. This study draws on Normalization Process Theory (NPT) to develop an instrument that can be applied to assess, monitor or measure factors likely to affect normalization from the perspective of implementation participants.

METHODS

An iterative process of instrument development was undertaken using the following methods: theoretical elaboration, item generation and item reduction (team workshops); item appraisal (QAS-99); cognitive testing with complex intervention teams; theory re-validation with NPT experts; and pilot testing of instrument.

RESULTS

We initially generated 112 potential questionnaire items; these were then reduced to 47 through team workshops and item appraisal. No concerns about item wording and construction were raised through the item appraisal process. We undertook three rounds of cognitive interviews with professionals (n = 30) involved in the development, evaluation, delivery or reception of complex interventions. We identified minor issues around wording of some items; universal issues around how to engage with people at different time points in an intervention; and conceptual issues around the types of people for whom the instrument should be designed. We managed these by adding extra items (n = 6) and including a new set of option responses: 'not relevant at this stage', 'not relevant to my role' and 'not relevant to this intervention' and decided to design an instrument explicitly for those people either delivering or receiving an intervention. This version of the instrument had 53 items. Twenty-three people with a good working knowledge of NPT reviewed the items for theoretical drift. Items that displayed a poor alignment with NPT sub-constructs were removed (n = 8) and others revised or combined (n = 6). The final instrument, with 43 items, was successfully piloted with five people, with a 100% completion rate of items.

CONCLUSION

The process of moving through cycles of theoretical translation, item generation, cognitive testing, and theoretical (re)validation was essential for maintaining a balance between the theoretical integrity of the NPT concepts and the ease with which intended respondents could answer the questions. The final instrument could be easily understood and completed, while retaining theoretical validity. NoMAD represents a measure that can be used to understand implementation participants' experiences. It is intended as a measure that can be used alongside instruments that measure other dimensions of implementation activity, such as implementation fidelity, adoption, and readiness.

Implementation of an interprofessional medication adherence program for HIV patients: description of the process using the framework for the implementation of services in pharmacy

BACKGROUND

The community pharmacy center of the Department of Ambulatory Care and Community Medicine of the Policlinique Médicale Universitaire (PMU), Lausanne, Switzerland developed and implemented an interprofessional medication adherence program for chronic patients (IMAP). In 2014, a project was launched to implement the IMAP for HIV patients in a public non-academic hospital with the collaboration of community pharmacists in the Neuchâtel area (Switzerland). This article aims to describe the different implementation stages and strategies of the project.

METHODS

A posteriori description of the implementation process, including the conceptualization strategies and stages (exploration, preparation, operation, sustainability) using the Framework for the Implementation of Services in Pharmacy (FISpH).

RESULTS

In 2014, an attending infectious disease physician and a nurse at a public hospital (Neuchâtel, Switzerland) contacted the PMU to implement the IMAP in their setting in collaboration with community pharmacies. Five volunteer community pharmacies in Neuchâtel were trained to deliver the program. Three factors were found to be essential to the successful launch and progress of the implementation project: the experience of the community pharmacy center of the PMU with the IMAP, the involvement of the PMU research team, and collaboration with an external start up (SISPha) to train and support pharmacists. During the operation stage, the most important strategy developed was that of regular meetings between all stakeholders. These allowed healthcare professionals to discuss the implementation progress, to address each stakeholder's expectations, and to exchange experiences to facilitate interprofessional collaboration and program delivery. Structural changes allowed the formalization of the activities at the hospital and in a community pharmacy. This formalization was identified as the transition step between the operation and the sustainability stages.

CONCLUSIONS

The transfer of the IMAP for HIV patients to a non-academic setting and its implementation are feasible. However, implementation of a new model of pharmacy service such as IMAP implies a deep change in practice. A transitional external support and the allocation of sufficient resources to carry out the IMAP are essential for its long-term sustainability.

Performance-based financing in three humanitarian settings: principles and pragmatism

BACKGROUND

Performance based financing (PBF) has been increasingly implemented across low and middle-income countries, including in fragile and humanitarian settings, which present specific features likely to require adaptation and to influence implementation of any health financing programme. However, the literature has been surprisingly thin in the discussion of how PBF has been adapted to different contexts, and in turn how different contexts may influence PBF. With case studies from three humanitarian settings (northern Nigeria, Central African Republic and South Kivu in the Democratic Republic of Congo), we examine why and how PBF has emerged and has been adapted to those unsettled and dynamic contexts, what the opportunities and challenges have been, and what lessons can be drawn.

METHODS

Our comparative case study is based on data collected from a document review, 35 key informant interviews and 16 focus group discussions with stakeholders at national and subnational level in the three settings. Data were analysed in order to describe and compare each setting in terms of underlying fragility features and their implications for the health system, and to look at how PBF has been adopted, implemented and iteratively adapted to respond to acute crisis, deal with other humanitarian actors and involve local communities.

RESULTS

Our analysis reveals that the challenging environments required a high degree of PBF adaptation and innovation, at times contravening the so-called 'PBF principles' that have become codified. We develop an analytical framework to highlight the key nodes where adaptations happen, the contextual drivers of adaptation, and the organisational elements that facilitate adaptation and may sustain PBF programmes.

CONCLUSIONS

Our study points to the importance of pragmatic adaptation in PBF design and implementation to reflect the contextual specificities, and identifies elements (such as, organisational flexibility, local staff and knowledge, and embedded long-term partners) that could facilitate adaptations and innovations. These findings and framework are useful to spark a reflection among PBF donors and implementers on the relevance of incorporating, reinforcing and building on those elements when designing and implementing PBF programmes.

Exposure to a multi-level multi-component childhood obesity prevention community-randomized controlled trial: patterns, determinants, and implications

BACKGROUND

For community interventions to be effective in real-world conditions, participants need to have sufficient exposure to the intervention. It is unclear how the dose and intensity of the intervention differ among study participants in low-income areas. We aimed to understand patterns of exposure to different components of a multi-level multi-component obesity prevention program to inform our future impact analyses.

METHODS

B'more Healthy Communities for Kids (BHCK) was a community-randomized controlled trial implemented in 28 low-income zones in Baltimore in two rounds (waves). Exposure to three different intervention components (corner store/carryout restaurants, social media/text messaging, and youth-led nutrition education) was assessed via post-intervention interviews with 385 low-income urban youths and their caregivers. Exposure scores were generated based on self-reported viewing of BHCK materials (posters, handouts, educational displays, and social media posts) and participating in activities, including taste tests during the intervention. For each intervention component, points were assigned for exposure to study materials and activities, then scaled (0-1 range), yielding an overall BHCK exposure score [youths: mean 1.1 (range 0-7.6 points); caregivers: 1.1 (0-6.7), possible highest score: 13]. Ordered logit regression analyses were used to investigate correlates of youths' and caregivers' exposure level (quartile of exposure).

RESULTS

Mean intervention exposure scores were significantly higher for intervention than comparison youths (mean 1.6 vs 0.5, p < 0.001) and caregivers (mean 1.6 vs 0.6, p < 0.001). However, exposure scores were low in both groups and 10% of the comparison group was moderately exposed to the intervention. For each 1-year increase in age, there was a 33% lower odds of being highly exposed to the intervention (odds ratio 0.77, 95% confidence interval 0.69; 0.88) in the unadjusted and adjusted model controlling for youths' sex and household income.

CONCLUSION

Treatment effects may be attenuated in community-based trials, as participants may be differentially exposed to intervention components and the comparison group may also be exposed. Exposure should be measured to provide context to impact evaluations in multi-level trials. Future analyses linking exposure scores to the outcome should control for potential confounders in the treatment-on-the-treated approach, while recognizing that confounding and selection bias may exist affecting causal inference.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02181010 . Retrospectively registered on 2 July 2014.

Factors associated with the use of cognitive aids in operating room crises: a cross-sectional study of US hospitals and ambulatory surgical centers

Background

Operating room (OR) crises are high-acuity events requiring rapid, coordinated management. Medical judgment and decision-making can be compromised in stressful situations, and clinicians may not experience a crisis for many years. A cognitive aid (e.g., checklist) for the most common types of crises in the OR may improve management during unexpected and rare events. While implementation strategies for innovations such as cognitive aids for routine use are becoming better understood, cognitive aids that are rarely used are not yet well understood. We examined organizational context and implementation process factors influencing the use of cognitive aids for OR crises.

Methods

We conducted a cross-sectional study using a Web-based survey of individuals who had downloaded OR cognitive aids from the websites of Ariadne Labs or Stanford University between January 2013 and January 2016. In this paper, we report on the experience of 368 respondents from US hospitals and ambulatory surgical centers. We analyzed the relationship of more successful implementation (measured as reported regular cognitive aid use during applicable clinical events) with organizational context and with participation in a multi-step implementation process. We used multivariable logistic regression to identify significant predictors of reported, regular OR cognitive aid use during OR crises.

Results

In the multivariable logistic regression, small facility size was associated with a fourfold increase in the odds of a facility reporting more successful implementation (p = 0.0092). Completing more implementation steps was also significantly associated with more successful implementation; each implementation step completed was associated with just over 50% higher odds of more successful implementation (p ≤ 0.0001). More successful implementation was associated with leadership support (p < 0.0001) and dedicated time to train staff (p = 0.0189). Less successful implementation was associated with resistance among clinical providers to using cognitive aids (p < 0.0001), absence of an implementation champion (p = 0.0126), and unsatisfactory content or design of the cognitive aid (p = 0.0112).

Conclusions

Successful implementation of cognitive aids in ORs was associated with a supportive organizational context and following a multi-step implementation process. Building strong organizational support and following a well-planned multi-step implementation process will likely increase the use of OR cognitive aids during intraoperative crises, which may improve patient outcomes.

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0739-4) contains supplementary material, which is available to authorized users.

Implementation of an electronic routine outcome monitoring at an inpatient unit for psychosomatic medicine

BACKGROUND

Patient-reported outcomes (PROs) can be part of an electronic routine outcome monitoring (eROM). eROM can improve patient involvement, treatment outcomes and simplify scientific data assessment. Available studies on eROM focus on its evaluation only and lack a detailed description of the prior implementation procedure.

OBJECTIVE

The aim was to implement an eROM assessment at a division of Psychosomatic Medicine and provide a detailed description of the implementation procedure.

METHODS

According to the Replicating Effective Program concept the project consisted of 4 phases: pre-condition (1), pre-implementation (2), implementation (3) and maintenance and evolution (4) mainly focusing the description of the implementation procedure and a short evaluation.

RESULTS

We describe the actions taken during the implementation procedure and steps which were taken to overcome identified barriers. All decisions were carried out based on the Participatory Action Research process. A core set consisting of sociodemographic and clinical data and a comprehensive questionnaire battery covering symptoms, functioning parameters and psychological constructs was implemented. In total 164 patients, took part in the eROM assessment from June 2015 to December 2016. The evaluation showed that eROM was appreciated by health-care professionals (85.2%) and patients (70.2%) alike. The majority of patients (89.4%) and health-care professionals (85.7%) experienced no delays in daily clinical routine due to eROM.

CONCLUSION

The detailed description of the implementation process can guide institutions planning to implement eROM into their daily clinical routine. Focusing scientific efforts on the implementation process is essential since this influences all further steps such as evaluation and acceptance.

An ethnographic observation study of the facilitator role in an implementation process

Background

Even though the importance of a facilitator during an implementation process is well described, the facilitator’s role is rarely problematized in relation to the organizational context in terms of power and legitimacy; themes which have recently been brought to the fore when studying change in health care organizations. Therefore, in this article, we present a qualitative study with the aim of identifying key aspects of the experience of being in a facilitator role. The data collection involved ethnographic fieldwork encompassing observations and field notes, as well as two qualitative interviews with the facilitator. The data were analysed using a phenomenological hermeneutical method in order to formulate thematic aspects of the implementation process. The study was conducted in southern Sweden between January 2013 and August 2014.

Results

One main theme, “walking a tightrope”, and four sub-themes, all of which involved balancing acts of different levels and different ways, were identified. These included: being in control, but needing to adjust; pushing for change, but forced to stand back; being accepted, but dependent; and being reasonable, but culturally sensitive.

Conclusion

Instead of listing the desirable qualities and conditions of a facilitator, this study shows that being a facilitator can be described more completely by applying the concept of role, thus allowing a more holistic process of reflection and analysis. This in turn makes it possible to move from the reactive stance of balancing to a more proactive stance of negotiating.

Comparison of the adaptive implementation and evaluation of the Meeting Centers Support Program for people with dementia and their family carers in Europe; study protocol of the MEETINGDEM project

Background

The MEETINGDEM study aims to implement and evaluate an innovative, inclusive, approach to supporting community dwelling people with mild to moderate dementia and their family carers, called the Meeting Centers Support Program (MCSP), in three countries in the European Union (EU): Italy, Poland and United Kingdom. Demonstrated benefits of this person-centered approach, developed in The Netherlands, include high user satisfaction, reduced behavioral and mood problems, delayed admission to residential care, lower levels of caregiving-related stress, higher carer competence, and improved collaboration between care and welfare organizations.

Methods

The project will be carried out over a 36 month period. Project partners in the three countries will utilize, and adapt, strategies and tools developed in the Netherlands. In Phase One (month 1-18) activities will focus on establishing an initiative group of relevant organizations and user representatives in each country, exploring pathways to care and potential facilitators and barriers to implementing the program, and developing country specific implementation plans and materials. In Phase Two (month 19‑36) training will be provided to organizations and staff, after which the meeting centers will be established and evaluated for impact on behavior, mood and quality of life of people with dementia and carers, cost-effectiveness, changes in service use, user satisfaction and implementation process.

Discussion

An overall evaluation will draw together findings from the three countries to develop recommendations for successful implementation of MCSP across the EU. If the Meeting Centers approach can be widely implemented, this could lead to major improvements in dementia care across Europe and beyond.

Trial registration

The trial was retrospectively registered in May 2016: trial number: NTR5936.

Experiences from implementing value-based healthcare at a Swedish University Hospital - an longitudinal interview study

Background

Implementing the value-based healthcare concept (VBHC) is a growing management trend in Swedish healthcare organizations. The aim of this study is to explore how representatives of four pilot project teams experienced implementing VBHC in a large Swedish University Hospital over a period of 2 years. The project teams started their work in October 2013.

Methods

An explorative and qualitative design was used, with interviews as the data collection method. All the participants in the four pilot project teams were individually interviewed three times, with interviews starting in March 2014 and ending in November 2015. All the interviews were transcribed and analyzed using qualitative analysis.

Results

Value for the patients was experienced as the fundamental drive for implementing VBHC. However, multiple understandings of what value for patients’ means existed in parallel. The teams received guidance from consultants during the first 3 months. There were pros and cons to the consultant’s guidance. This period included intensive work identifying outcome measurements based on patients’ and professionals’ perspectives, with less interest devoted to measuring costs. The implementation process, which both gave and took energy, developed over time and included interventions. In due course it provided insights to the teams about the complexity of healthcare. The necessity of coordination, cooperation and working together inter-departmentally was critical.

Conclusions

Healthcare organizations implementing VBHC will benefit from emphasizing value for patients, in line with the intrinsic drive in healthcare, as well as managing the process of implementation on the basis of understanding the complexities of healthcare. Paying attention to the patients’ voice is a most important concern and is also a key towards increased engagement from physicians and care providers for improvement work.

Use of electronic medical records and quality of patient data: different reaction patterns of doctors and nurses to the hospital organization

BACKGROUND

As the implementation of Electronic Medical Records (EMRs) in hospitals may be challenged by different responses of different user groups, this paper examines the differences between doctors and nurses in their response to the implementation and use of EMRs in their hospital and how this affects the perceived quality of the data in EMRs.

METHODS

Questionnaire data of 402 doctors and 512 nurses who had experience with the implementation and the use of EMRs in hospitals was analysed with Multi group Structural equation modelling (SEM). The models included measures of organisational factors, results of the implementation (ease of use and alignment of EMR with daily routine), perceived added value, timeliness of use and perceived quality of patient data.

RESULTS

Doctors and nurses differ in their response to the organisational factors (support of IT, HR and administrative departments) considering the success of the implementation. Nurses respond to culture while doctors do not. Doctors and nurses agree that an EMR that is easier to work with and better aligned with their work has more added value, but for the doctors this is more pronounced. The doctors and nurses perceive that the quality of the patient data is better when EMRs are easier to use and better aligned with their daily routine.

CONCLUSIONS

The result of the implementation, in terms of ease of use and alignment with work, seems to affect the perceived quality of patient data more strongly than timeliness of entering patient data. Doctors and nurses value bottom-up communication and support of the IT department for the result of the implementation, and nurses respond to an open and innovative organisational culture.

The complexity in the implementation process of empowerment-based chronic kidney care: a case study

Background

This study is part of an interactive improvement intervention aimed to facilitate empowerment-based chronic kidney care using data from persons with CKD and their family members. There are many challenges to implementing empowerment-based care, and it is therefore necessary to study the implementation process. The aim of this study was to generate knowledge regarding the implementation process of an improvement intervention of empowerment for those who require chronic kidney care.

Methods

A prospective single qualitative case study was chosen to follow the process of the implementation over a two year period. Twelve health care professionals were selected based on their various role(s) in the implementation of the improvement intervention. Data collection comprised of digitally recorded project group meetings, field notes of the meetings, and individual interviews before and after the improvement project. These multiple data were analyzed using qualitative latent content analysis.

Results

Two facilitator themes emerged: Moving spirit and Encouragement. The healthcare professionals described a willingness to individualize care and to increase their professional development in the field of chronic kidney care. The implementation process was strongly reinforced by both the researchers working interactively with the staff, and the project group. One theme emerged as a barrier: the Limitations of the organization. Changes in the organization hindered the implementation of the intervention throughout the study period, and the lack of interplay in the organization most impeded the process.

Conclusions

The findings indicated the complexity of maintaining a sustainable and lasting implementation over a period of two years. Implementing empowerment-based care was found to be facilitated by the cooperation between all involved healthcare professionals. Furthermore, long-term improvement interventions need strong encouragement from all levels of the organization to maintain engagement, even when it is initiated by the health care professionals themselves.

The role of advocacy coalitions in a project implementation process: the example of the planning phase of the At Home/Chez Soi project dealing with homelessness in Montreal

This study analyzed the planning process (summer 2008 to fall 2009) of a Montreal project that offers housing and community follow-up to homeless people with mental disorders, with or without substance abuse disorders. With the help of the Advocacy Coalition Framework (ACF), advocacy groups that were able to navigate a complex intervention implementation process were identified. In all, 25 people involved in the Montreal At Home/Chez Soi project were surveyed through interviews (n=18) and a discussion group (n=7). Participant observations and documentation (minutes and correspondence) were also used for the analysis. The start-up phase of the At Home/Chez may be broken down into three separate periods qualified respectively as "honeymoon;" "clash of cultures;" and "acceptance & commitment". In each of the planning phases of the At Home/Chez Soi project in Montreal, at least two advocacy coalitions were in confrontation about their specific belief systems concerning solutions to address the recurring homelessness social problem, while a third, more moderate one contributed in rallying most key actors under specified secondary aspects. The study confirms the importance of policy brokers in achieving compromises acceptable to all advocacy coalitions.