Comparing theory and non-theory based implementation approaches to improving referral practices in cancer genetics: a cluster randomised trial protocol

In person and virtual process mapping experiences to capture and explore variability in clinical practice: application to genetic referral pathways across seven Australian hospital networks

Genetic referral for Lynch syndrome (LS) exemplifies complex clinical pathways. Identifying target behaviours (TBs) for change and associated barriers requires structured group consultation activities with busy clinicians - consolidating implementation activities whilst retaining rigour is crucial. This study aimed to: i) use process mapping to gain in-depth understandings of site-specific LS testing and referral practices in Australian hospitals and support identification of TBs for change, ii) explore if barriers to identified TBs could be identified through process mapping focus-group data, and iii) demonstrate pandemic-induced transition from in-person to virtual group interactive process mapping methods. LS clinical stakeholders attended interactive in-person or virtual focus groups to develop site-specific "process maps" visually representing referral pathways. Content analysis of transcriptions informed site-specific process maps, then clinical audit data was compared to highlight TBs for change. TBs were reviewed in follow-up focus groups. Secondary thematic analysis explored barriers to identified TBs, coded against the Theoretical Domains Framework (TDF). The transition from in-person to pandemic-induced virtual group interactive process mapping methods was documented. Process mapping highlighted six key areas of clinical practice variation across sites and site-specific TBs for change were identified. Key barriers to identified TBs emerged, categorised to seven TDF domains. Process mapping revealed variations in clinical practices surrounding LS referral between sites. Incorporating qualitative perspectives enhances process mapping by facilitating identification of TBs for change and barriers, providing a pathway to developing targeted interventions. Virtual process mapping activities produced detailed data and enabled comprehensive map development.

Aligning intuition and theory: a novel approach to identifying the determinants of behaviours necessary to support implementation of evidence into practice

BACKGROUND

Disentangling the interplay between experience-based intuition and theory-informed implementation is crucial for identifying the direct contribution theory can make for generating behaviour changes needed for successful evidence translation. In the context of 'clinicogenomics', a complex and rapidly evolving field demanding swift practice change, we aimed to (a) describe a combined clinician intuition- and theory-driven method for identifying determinants of and strategies for implementing clinicogenomics, and (b) articulate a structured approach to standardise hypothesised behavioural pathways and make potential underlying theory explicit.

METHODS

Interview data from 16 non-genetic medical specialists using genomics in practice identified three target behaviour areas across the testing process: (1) identifying patients, (2) test ordering and reporting, (3) communicating results. The Theoretical Domains Framework (TDF) was used to group barriers and facilitators to performing these actions. Barriers were grouped by distinct TDF domains, with 'overarching' TDF themes identified for overlapping barriers. Clinician intuitively-derived implementation strategies were matched with corresponding barriers, and retrospectively coded against behaviour change techniques (BCTs). Where no intuitive strategies were provided, theory-driven strategies were generated. An algorithm was developed and applied to articulate how implementation strategies address barriers to influence behaviour change.

RESULTS

Across all target behaviour areas, 32 identified barriers were coded across seven distinct TDF domains and eight overarching TDF themes. Within the 29 intuitive strategies, 21 BCTs were represented and used on 49 occasions to address 23 barriers. On 10 (20%) of these occasions, existing empirical links were found between BCTs and corresponding distinct TDF-coded barriers. Twenty additional theory-driven implementation strategies (using 19 BCTs on 31 occasions) were developed to address nine remaining barriers.

CONCLUSION

Clinicians naturally generate their own solutions when implementing clinical interventions, and in this clinicogenomics example these intuitive strategies aligned with theoretical recommendations 20% of the time. We have matched intuitive strategies with theory-driven BCTs to make potential underlying theory explicit through proposed structured hypothesised causal pathways. Transparency and efficiency are enhanced, providing a novel method to identify determinants of implementation. Operationalising this approach to support the design of implementation strategies may optimise practice change in response to rapidly evolving scientific advances requiring swift translation into healthcare.

Standardizing variation: Scaling up clinical genomics in Australia

PURPOSE

Clinical genomics demands close interaction of physicians, laboratory scientists, and genetic professionals. Taking genomics to scale requires an understanding of the underlying processes from the perspective of nongenetic physicians who are new to the field. We identified components of the processes amenable to adaptation when scaling up clinical genomics.

METHODS

Semistructured interviews informed by the Theoretical Domains Framework with nongenetic physicians, who were using clinical genomics in practice, were guided by an annotated process map with 7 steps following the patient's journey. Findings from the individual maps were synthesized into an overview process map and a series of individual maps by common location and specialty. Interviews were analyzed using the Theoretical Domains Framework.

RESULTS

In total, 16 nongenetic physicians (eg, nephrologists, immunologists) participated, generating 1 overview and 10 individual process maps. Sixteen common steps were identified across clinical specialties and locations, with variations over 9 steps. We report the potential for standardization across these 9 steps.

CONCLUSION

When scaling up complex interventions, it is essential to identify steps where variation can be accommodated. With these results we show how process mapping can be used to identify steps where variation is acceptable during scale up to accommodate adaptation to local context, allowing for the inevitable evolution of factors influencing ongoing implementation and sustainability.

Lynch syndrome testing of colorectal cancer patients in a high-income country with universal healthcare: a retrospective study of current practice and gaps in seven australian hospitals

BACKGROUND

To inform effective genomic medicine strategies, it is important to examine current approaches and gaps in well-established applications. Lynch syndrome (LS) causes 3-5% of colorectal cancers (CRCs). While guidelines commonly recommend LS tumour testing of all CRC patients, implementation in health systems is known to be highly variable. To provide insights on the heterogeneity in practice and current bottlenecks in a high-income country with universal healthcare, we characterise the approaches and gaps in LS testing and referral in seven Australian hospitals across three states.

METHODS

We obtained surgery, pathology, and genetics services data for 1,624 patients who underwent CRC resections from 01/01/2017 to 31/12/2018 in the included hospitals.

RESULTS

Tumour testing approaches differed between hospitals, with 0-19% of patients missing mismatch repair deficiency test results (total 211/1,624 patients). Tumour tests to exclude somatic MLH1 loss were incomplete at five hospitals (42/187 patients). Of 74 patients with tumour tests completed appropriately and indicating high risk of LS, 36 (49%) were missing a record of referral to genetics services for diagnostic testing, with higher missingness for older patients (0% of patients aged ≤ 40 years, 76% of patients aged > 70 years). Of 38 patients with high-risk tumour test results and genetics services referral, diagnostic testing was carried out for 25 (89%) and identified a LS pathogenic/likely pathogenic variant for 11 patients (44% of 25; 0.7% of 1,624 patients).

CONCLUSIONS

Given the LS testing and referral gaps, further work is needed to identify strategies for successful integration of LS testing into clinical care, and provide a model for hereditary cancers and broader genomic medicine. Standardised reporting may help clinicians interpret tumour test results and initiate further actions.

Building capacity from within: qualitative evaluation of a training program aimed at upskilling healthcare workers in delivering an evidence-based implementation approach

Translating evidence into complex health systems is an ongoing challenge. Building the capacity of healthcare workers in behavioral and implementation science methods may facilitate the use of evidence-based implementation approaches, leading to sustainable and effective translation. The aim was to describe the development, contents and evaluation of a training workshop aimed at upskilling hospital-embedded staff to deliver an evidence-based implementation approach. The Hide and Seek Project (HaSP) is a cluster randomized controlled trial testing two implementation approaches for improving hereditary cancer referral at eight Australian hospitals. Healthcare workers were recruited as “Implementation Leads” and trained via a one-day workshop—TRAining in evideNce-baSed ImpLementATion for hEalth (TRANSLATE). The purpose of TRANSLATE was to upskill Implementation Leads in the delivery of HaSP, as well as implementation science methods more broadly. Implementation Leads participated in semi-structured evaluation interviews, which were analyzed using inductive thematic analysis. Nine Implementation Leads from various professional backgrounds completed the training. Four key themes were identified: (i) training day reactions, (ii) learning, (iii) implementation barriers and facilitators, and (iv) building health system capacity for implementation. Participants reported high levels of satisfaction, and anticipated that the knowledge and skills may be useful in the future. We describe a novel training program focused on the delivery of evidence-based implementation within health systems. Guided by insights from this study, methods to deliver the training on a larger scale and across different contexts are being explored. The prolonged impact of TRANSLATE will be further evaluated at trial completion.

Trial registration: ANZCTR, ACTRN12618001072202. Registered on June 27, 2018

Aligning intuition and theory: enhancing the replicability of behaviour change interventions in cancer genetics

Background

Despite considerable encouragement for healthcare professionals to use or be clear about the theory used in their improvement programmes, the uptake of these approaches to design interventions or report their content is lacking. Recommendations suggest healthcare practitioners work with social and/or behavioural scientists to gain expertise in programme theory, ideally before, but even during or after the work is done. We aim to demonstrate the extent to which intuitive intervention strategies designed by healthcare professionals to overcome patient barriers to communicating genetic cancer risk information to family members align with a theoretical framework of behaviour change.

Methods

As part of a pre-post intervention study, a team of genetic counsellors aimed to understand, and design interventions to overcome, the major barriers a group of familial cancer patients face around communicating hereditary cancer risk information to their relatives. A behavioural change specialist worked with the team to review and recode barriers and interventions according to the Theoretical Domains Framework (TDF) and 93 behaviour change techniques (BCTs). Resulting BCTs were cross-referenced against the Theory and Techniques Tool to examine whether evidence-based mechanistic links have been established to date.

Results

Five themes emerged from the genetic counsellor coded barriers, which when recoded according to the TDF represented seven domains of behaviour change. Forty-five experiential and intuitive interventions were used to tackle key barriers. These were represented by 21 BCTs, which were found to be used on 131 occasions. The full mapping exercise is presented, resulting in a suite of intervention strategies explicitly linked to a theoretical framework. Structured, written reflections were provided retrospectively by the core clinical team.

Conclusions

Although the ideal is to use theory prospectively, or even whilst a project is underway, making links between theory and interventions explicit, even retrospectively, can contribute towards standardising intervention strategies, furthering understanding of intervention effects, and enhancing the opportunities for accurate replicability and generalisability across other settings. Demonstrating to healthcare professionals how their intuition aligns with theory may highlight the additional benefits that theory has to offer and serve to promote its use in improvement.

Pathways to a cancer-free future: a protocol for modelled evaluations to minimise the future burden of colorectal cancer in Australia

INTRODUCTION

With almost 50% of cases preventable and the Australian National Bowel Cancer Screening Program in place, colorectal cancer (CRC) is a prime candidate for investment to reduce the cancer burden. The challenge is determining effective ways to reduce morbidity and mortality and their implementation through policy and practice. Pathways-Bowel is a multistage programme that aims to identify best-value investment in CRC control by integrating expert and end-user engagement; relevant evidence; modelled interventions to guide future investment; and policy-driven implementation of interventions using evidence-based methods. METHODS AND ANALYSIS: Pathways-Bowel is an iterative work programme incorporating a calibrated and validated CRC natural history model for Australia (Policy1-Bowel) and assessing the health and cost outcomes and resource use of targeted interventions. Experts help identify and prioritise modelled evaluations of changing trends and interventions and critically assess results to advise on their real-world applicability. Where appropriate the results are used to support public policy change and make the case for optimal investment in specific CRC control interventions. Fourteen high-priority evaluations have been modelled or planned, including evaluations of CRC outcomes from the changing prevalence of modifiable exposures, including smoking and body fatness; potential benefits of daily aspirin intake as chemoprevention; increasing CRC incidence in people aged <50 years; increasing screening participation in the general and Aboriginal and Torres Strait Islander populations; alternative screening technologies and modalities; and changes to follow-up surveillance protocols. Pathways-Bowel is a unique, comprehensive approach to evaluating CRC control; no prior body of work has assessed the relative benefits of a variety of interventions across CRC development and progression to produce a list of best-value investments.

ETHICS AND DISSEMINATION

Ethics approval was not required as human participants were not involved. Findings are reported in a series of papers in peer-reviewed journals and presented at fora to engage the community and policymakers.

Understanding implementation success: protocol for an in-depth, mixed-methods process evaluation of a cluster randomised controlled trial testing methods to improve detection of Lynch syndrome in Australian hospitals

INTRODUCTION

In multisite intervention trials, implementation success often varies widely across settings. Process evaluations are crucial to interpreting trial outcomes and understanding contextual factors and causal chains necessary for successful implementation. Lynch syndrome is a hereditary cancer predisposition conferring an increased risk of colorectal, endometrial and other cancer types. Despite systematic screening protocols to identify Lynch syndrome, the condition remains largely underdiagnosed. The Hide and Seek Project ('HaSP') is a cluster randomised controlled trial determining the effectiveness of two approaches to improving Lynch syndrome detection at eight Australian hospital networks. To enhance widespread implementation of optimal Lynch syndrome identification, there is a need to understand not only what works, but also why, in what contexts, and at what costs. Here we describe an in-depth investigation of factors influencing successful implementation of procedures evaluated in the HaSP trial.

METHODS AND ANALYSIS

A mixed-methods, theory-driven process evaluation will be undertaken in parallel to the HaSP trial. Data will include: interviews of Implementation Leads and Lynch syndrome stakeholders, pre-post implementation questionnaires, audio analysis of meetings and focus groups, observation of multidisciplinary team meetings, fidelity checklists and project log analysis. Results will be triangulated and coded, drawing on the Theoretical Domains Framework, Consolidated Framework for Implementation Research and Proctor's implementation outcomes.

ETHICS AND DISSEMINATION

Use of a theory-based process evaluation will enhance interpretation and generalisability of HaSP trial findings, and contribute to the implementation research field by furthering understanding of the conditions necessary for implementation success. Ethical approval has been granted and results will be disseminated via publications in peer-reviewed journals and conference presentations. At trial completion, key findings will be fed back to sites to enable refinement of intervention strategies, both in the context of Lynch syndrome and for the possible generalisability of intervention components in other genetic and broader clinical specialties.

HASP TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry (Identifier: ACTRN12618001072202). Registered 27 June 2018. http://www.ANZCTR.org.au/ACTRN12618001072202.aspx.