Impact of an organization-wide knowledge translation strategy to support evidence-informed public health decision making

Exploring evidence use and capacity for health services management and planning in Swiss health administrations: A mixed-method interview study

BACKGROUND

Health administrations require evidence, meaning robust information, data, and research, on health services and systems. Little is known about the resources and processes available within administrations to support evidence-informed policymaking. This study assessed Swiss health administrations' capacity for evidence use and investigated civil servants' needs and perspectives regarding the role and use of evidence in health services management and planning.

METHODS

In this mixed-method study, we interviewed civil servants from Swiss German-speaking cantonal health administrations. We quantitatively assessed administrations' organization-level capacity by applying six structured interviews using an existing measurement tool (ORACLe). Individual-level needs and perspectives regarding evidence use and capacity were qualitatively explored with twelve in-depth interviews that were analyzed using the framework method.

FINDINGS

Respondents indicated moderate evidence-use capacity in all administrations. Administrations displayed a similar pattern of high and low capacity in specific capacity areas, generally with considerable variation within administrations. Most administrations indicated high capacity for producing or commissioning evidence and close relationships with research. They showed limited capacity in the documentation of processes and availability of tools, programs, or training opportunities. Administrations place the responsibility for engagement with evidence at the level of individual civil servants rather than at the organizational level. Although administrations highly value evidence-informed policymaking and consider it vital to effective health services management and planning, they face significant constraints in accessing evidence-specific resources and receive little organizational support. Administrations rely on external capacity to compensate for these limitations and engage with evidence pragmatically.

CONCLUSION

Our findings indicate moderate and improvable capacity for evidence use in Swiss health administrations that place limited value on organizational support. Besides strengthening organizational support, leadership buy-in, particular staff needs, and balancing the implementation of specific measures with the provision of more general resources should be considered to unlock the potential of strengthened engagement with evidence.

Strategies to implement evidence-informed decision making at the organizational level: a rapid systematic review

BACKGROUND

Achievement of evidence-informed decision making (EIDM) requires the integration of evidence into all practice decisions by identifying and synthesizing evidence, then developing and executing plans to implement and evaluate changes to practice. This rapid systematic review synthesizes evidence for strategies for the implementation of EIDM across organizations, mapping facilitators and barriers to the COM-B (capability, opportunity, motivation, behaviour) model for behaviour change. The review was conducted to support leadership at organizations delivering public health services (health promotion, communicable disease prevention) to drive change toward evidence-informed public health.

METHODS

A systematic search was conducted in multiple databases and by reviewing publications of key authors. Articles that describe interventions to drive EIDM within teams, departments, or organizations were eligible for inclusion. For each included article, quality was assessed, and details of the intervention, setting, outcomes, facilitators and barriers were extracted. A convergent integrated approach was undertaken to analyze both quantitative and qualitative findings.

RESULTS

Thirty-seven articles are included. Studies were conducted in primary care, public health, social services, and occupational health settings. Strategies to implement EIDM included the establishment of Knowledge Broker-type roles, building the EIDM capacity of staff, and research or academic partnerships. Facilitators and barriers align with the COM-B model for behaviour change. Facilitators for capability include the development of staff knowledge and skill, establishing specialized roles, and knowledge sharing across the organization, though staff turnover and subsequent knowledge loss was a barrier to capability. For opportunity, facilitators include the development of processes or mechanisms to support new practices, forums for learning and skill development, and protected time, and barriers include competing priorities. Facilitators identified for motivation include supportive organizational culture, expectations for new practices to occur, recognition and positive reinforcement, and strong leadership support. Barriers include negative attitudes toward new practices, and lack of understanding and support from management.

CONCLUSION

This review provides a comprehensive analysis of facilitators and barriers for the implementation of EIDM in organizations for public health, mapped to the COM-B model for behaviour change. The existing literature for strategies to support EIDM in public health illustrates several facilitators and barriers linked to realizing EIDM. Knowledge of these factors will help senior leadership develop and implement EIDM strategies tailored to their organization, leading to increased likelihood of implementation success.

REVIEW REGISTRATION

PROSPERO CRD42022318994.

Models and approaches for building knowledge translation capacity and capability in health services: a scoping review

BACKGROUND

Building healthcare service and health professionals' capacity and capability to rapidly translate research evidence into health practice is critical to the effectiveness and sustainability of healthcare systems. This review scoped the literature describing programmes to build knowledge translation capacity and capability in health professionals and healthcare services, and the evidence supporting these.

METHODS

This scoping review was undertaken using the Joanna Briggs Institute scoping review methodology. Four research databases (Ovid MEDLINE, CINAHL, Embase, and PsycInfo) were searched using a pre-determined strategy. Eligible studies described a programme implemented in healthcare settings to build health professional or healthcare service knowledge translation capacity and capability. Abstracts and full texts considered for inclusion were screened by two researchers. Data from included papers were extracted using a bespoke tool informed by the scoping review questions.

RESULTS

Database searches yielded 10,509 unique citations, of which 136 full texts were reviewed. Thirty-four papers were included, with three additional papers identified on citation searching, resulting in 37 papers describing 34 knowledge translation capability building programmes. Programmes were often multifaceted, comprising a combination of two or more strategies including education, dedicated implementation support roles, strategic research-practice partnerships and collaborations, co-designed knowledge translation capability building programmes, and dedicated funding for knowledge translation. Many programmes utilised experiential and collaborative learning, and targeted either individual, team, organisational, or system levels of impact. Twenty-seven programmes were evaluated formally using one or more data collection methods. Outcomes measured varied significantly and included participant self-reported outcomes, perceived barriers and enablers of knowledge translation, milestone achievement and behaviour change. All papers reported that programme objectives were achieved to varying degrees.

CONCLUSIONS

Knowledge translation capacity and capability building programmes in healthcare settings are multifaceted, often include education to facilitate experiential and collaborative learning, and target individual, team, organisational, or supra-organisational levels of impact. Although measured differently across the programmes, the outcomes were positive. The sustainability of programmes and outcomes may be undermined by the lack of long-term funding and inconsistent evaluation. Future research is required to develop evidence-informed frameworks to guide methods and outcome measures for short-, medium- and longer-term programme evaluation at the different structural levels.

Challenges of using evidence in managerial decision-making of the primary health care system

BACKGROUND

Managerial Evidence-Based Decision-Making [EBDM] in the primary is a systematic approach that directs the decision-maker in a conscientious, explicit, and judicious utilization of reliable and best evidence based on the professional experiences and preferences of stakeholders and patients from various sources. This study aimed to investigate the challenges primary healthcare managers encounter while undertaking decision-making processes.

METHOD

A systematic review was conducted in 2022 with the aim of identifying and collecting all qualitative articles pertaining to evidence-based decision-making in the primary healthcare system. To achieve this, a meticulous search was conducted using the relevant keywords, including primary health care and evidence-based decision making, as well as their corresponding synonyms, across the databases Web of Science, Scopus, and Pubmed. Importantly, there were no limitations imposed on the timeframe for the search. To carefully analyze and consolidate the findings of this systematic review, the meta-synthesis approach was employed.

RESULTS

A total of 22 articles were assessed in this systematic review study. The results revealed the main categories including evidence nature, EBDM barriers, utilizing evidence, decision-makers ability, organizational structure, evidence-based, EBDM support, communication for EBDM, evidence sides, EBDM skill development, public health promotion, and health system performance improvement.

CONCLUSION

The primary healthcare system is crucial in improving health outcomes and ensuring access to healthcare services for all individuals. This study explored the utilization of evidence-based EBDM within the primary healthcare system. We identified five key dimensions: causal, contextual, and intervening conditions, strategies, and consequences of EBDM as a core phenomenon. The findings will help policymakers and administrators comprehend the importance of evidence-based decision-making, ultimately leading to enhanced decision quality, community well-being, and efficiency within the healthcare system. EBDM entails considering the best reliable evidence, and incorporating community preferences while also exploiting the professional expertise and experiences of decision-makers. This systematic review has the potential to provide guidance for future reforms and enhance the quality of decision-making at the managerial level in primary healthcare.

Examining the influences on the use of behavioural science within UK local authority public health: Qualitative thematic analysis and deductive mapping to the COM-B model and Theoretical Domains Framework

Background

Behavioural science and its contribution towards improving public health is receiving increased recognition. Yet, the translation of these insights into public health practice is under-researched. This study explored the factors influencing the use of behavioural science within public health at a local authority level.

Methods

Fourteen local authority staff (n = 13 female) in the south of England participated in semi-structured interviews, which were analysed inductively to identify key themes. These were later mapped deductively to the COM-B model and Theoretical Domains Framework.

Findings

Nine themes were identified as factors that influence the use of behavioural science in local authority public health: (1) "Limited past experience," (2) "Narrow understanding," (3) "Perceived value of behavioural science," (4) "Translational gap from theory-to-practice," (5) "No protected time," (6) "Old ways of working," (7) "Political influence and organisational culture," (8) "Relationships with key stakeholders," (9) "Access to behavioural science resources". Deductive mapping of these themes revealed that five of the COM constructs (excluding Physical Capability) and eleven of the TDF domains influenced behavioural science use, with "Social influences" and "Knowledge" being the most prominent.

Discussion

Use of behavioural science within local authority public health practice is limited and inconsistent. For it to be successfully implemented, there must be an understanding of its role and value, alongside strategies to overcome a translational gap from theory to practice. Public health teams would benefit from protected time to enable application and strategies to break old habits of using a common-sense approach. System-wide buy-in, particularly related to senior leadership and system partners is needed, which would benefit from organisational and political culture change. Training opportunities, practical resources and expert in-house support should be considered a priority across public health teams.

Validity, reliability, and acceptability of the Evidence-Informed Decision-Making (EIDM) competence measure

Valid, reliable, and acceptable tools for assessing self-reported competence in evidence-informed decision-making (EIDM) are required to provide insight into the current status of EIDM knowledge, skills, attitudes/beliefs, and behaviours for registered nurses working in public health. The purpose of this study was to assess the validity, reliability, and acceptability of the EIDM Competence Measure. A psychometric study design was employed guided by the Standards for Educational and Psychological Testing and general measurement development principles. All registered nurses working across 16 public health units in Ontario, Canada were invited to complete the newly developed EIDM Competence Measure via an online survey. The EIDM Competence Measure is a self-reported tool consisting of four EIDM subscales: 1) knowledge; 2) skills; 3) attitudes/beliefs; and 4) behaviours. Acceptability was measured by completion time and percentage of missing data of the original 40-item tool. The internal structure of the tool was first assessed through item-subscale total and item-item correlations within subscales for potential item reduction of the original 40-item tool. Following item reduction which resulted in a revised 27-item EIDM Competence Measure, a principal component analysis using an oblique rotation was performed to confirm the four subscale structure. Validity based on relationships to other variables was assessed by exploring associations between EIDM competence attributes and individual factors (e.g., years of nursing experience, education) and organizational factors (e.g., resource allocation). Internal reliability within each subscale was analyzed using Cronbach’s alphas. Across 16 participating public health units, 201 nurses (mean years as a registered nurse = 18.1, predominantly female n = 197; 98%) completed the EIDM Competence Measure. Overall missing data were minimal as 93% of participants completed the entire original 40-item tool (i.e., no missing data), with 7% of participants having one or more items with missing data. Only one participant (0.5%) had >10% of missing data (i.e., more than 4 out of 40 items with data missing). Mean completion time was 7 minutes and 20 seconds for the 40-item tool. Extraction of a four-factor model based on the 27-item version of the scale showed substantial factor loadings (>0.4) that aligned with the four EIDM subscales of knowledge, skills, attitudes/beliefs, and behaviours. Significant relationships between EIDM competence subscale scores and education, EIDM training, EIDM project involvement, and supportive organizational culture were observed. Cronbach’s alphas exceeded minimum standards for all subscales: knowledge (α = 0.96); skills (α = 0.93); attitudes/beliefs (α = 0.80); and behaviours (α = 0.94).

The role of life skills in developing an authentic leadership attitude in public health students: a multicenter cross-sectional study in Poland

Background

Decision-making skills are considered crucial life skills that condition proper social functioning within groups (i.e., support authentic leadership skills and increasing one’s chances of success and wellbeing in life). Nonetheless, the number of scientific papers addressing the role of life skills in developing authentic leadership skills in public health students is limited. The aim of the present study was to develop a theoretical model to determine the role of selected life skills in developing authentic leadership skills in public health students.

Methods

The study was conducted from January 16 through February 28, 2018. In total, 653 students undertaking in-service training in Master’s degree programs qualified for the study, and complete data sets were obtained from 329 students (response rate 50.38%). The data were collected by means of a paper questionnaire. Four research tools were used in the study: The Authentic Leadership Self-Assessment Questionnaire, The Moral Foundations Questionnaire, The General Self-Efficacy Scale, and The Youth Leadership Life Skills Development Scale.

Results

Two subgroups were identified among the public health students in the study: 1) the extra life skills training group (N = 113) and 2) the no extra life skills training group (N = 216). Both groups of study participants did not differ significantly in terms of age (M (SD): 25.0 (3.89) vs. 25.0 (3.66); t = 0.068, P = 0.946). On the other hand, clear differences were observed in the case of the respondents’ participation in voluntary service. The respondents from the extra life skills training group declared participation in voluntary activities less frequently than the respondents from the second identified group (48.7 vs. 31.9%).

Conclusions

A verified theoretical model showed that course aimed at strengthening authentic leadership competences should be modular, should focus on self-improvement and critical reflection, and should be spread over time to enable and encourage each participant to grow and flourish at their own pace.

Knowledge and attitudes of Implementation Support Practitioners-Findings from a systematic integrative review

BACKGROUND

It requires thoughtful planning and work to successfully apply and sustain research-supported interventions like healthcare treatments, social support, or preventive programs in practice. Implementation support practitioners (ISPs) such as facilitators, technical assistance providers, knowledge brokers, coaches or consultants may be involved to actively support the implementation process. This article presents knowledge and attitudes ISPs bring to their work.

METHODS

Building on a previously developed program logic, a systematic integrative review was conducted. Literature was sourced by searching nine electronic data bases, organizational websites, and by launching a call for publications among selected experts and social media. Article screening was performed independently by two researchers, and data from included studies were extracted by members of the research team and quality-assured by the lead researcher. The quality of included RCTs was assessed based on a framework by Hodder and colleagues. Thematic Analysis was used to capture information on knowledge and attitudes of ISPs across the included studies. Euler diagrams and heatmaps were used to present the results.

RESULTS

Results are based on 79 included studies. ISPs reportedly displayed knowledge about the clinical practice they work with, implementation / improvement practice, the local context, supporting change processes, and facilitating evidence-based practice in general. In particular, knowledge about the intervention to be implemented and its target population, specific improvement / implementation methods and approaches, organizational structures and sensitivities, training, and characteristics of (good) research was described in the literature. Seven themes describing ISPs' attitudes were identified: 1) professional, 2) motivated / motivating / encouraging / empowering, 3) empathetic / respectful / sensitive, 4) collaborative / inclusive, 5) authentic, 6) creative / flexible / innovative / adaptive, and 7) frank / direct / honest. Pertaining to a professional attitude, being responsive and focused were the most prevalent indicators across included publications.

CONCLUSION

The wide range and complexity of knowledge and attitudes found in the literature calls for a comprehensive and systematic approach to collaboratively develop a professional role for ISPs across disciplines. Embedding the ISP role in different health and social welfare settings will enhance implementation capacities considerably.

A comprehensive monitoring and evaluation framework for evidence to policy networks

OBJECTIVE

To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks.

METHOD

The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting.

RESULTS

A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture.

CONCLUSION

The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.

A pragmatic evaluation of a public health knowledge broker mentoring education program: a convergent mixed methods study

BACKGROUND

Public health professionals are expected to use the best available research and contextual evidence to inform decision-making. The National Collaborating Centre for Methods and Tools developed, implemented, and evaluated a Knowledge Broker mentoring program aimed at facilitating organization-wide evidence-informed decision-making in ten public health units in Ontario, Canada. The purpose of this study was to pragmatically assess the impact of the program.

METHODS

A convergent mixed methods design was used to interpret quantitative results in the context of the qualitative findings. A goal-setting exercise was conducted with senior leadership in each organization prior to implementing the program. Achievement of goals was quantified through deductive coding of post-program interviews with participants and management. Interviews analyzed inductively to qualitatively explain progress toward identified goals and identify key factors related to implementation of EIDM within the organization.

RESULTS

Organizations met their goals for evidence use to varying degrees. The key themes identified that support an organizational shift to EIDM include definitive plans for participants to share knowledge during and after program completion, embedding evidence into decision-making processes, and supportive leadership with organizational investment of time and resources. The location, setting, or size of health units was not associated with attainment of EIDM goals; small, rural health units were not at a disadvantage compared to larger, urban health units.

CONCLUSIONS

The Knowledge Broker mentoring program allowed participants to share their learning and support change at their health units. When paired with organizational supports such as supportive leadership and resource investment, this program holds promise as an innovative knowledge translation strategy for organization wide EIDM among public health organizations.

The roles, activities and impacts of middle managers who function as knowledge brokers to improve care delivery and outcomes in healthcare organizations: a critical interpretive synthesis

Background

Middle Managers (MMs) are thought to play a pivotal role as knowledge brokers (KBs) in healthcare organizations. However, the role of MMs who function as KBs (MM KBs) in health care is under-studied. Research is needed that contributes to our understanding of how MMs broker knowledge in health care and what factors influence their KB efforts.

Methods

We used a critical interpretive synthesis (CIS) approach to review both qualitative and quantitative studies to develop an organizing framework of how MMs enact the KB role in health care. We used compass questions to create a search strategy and electronic searches were conducted in MEDLINE, CINAHL, Social Sciences Abstracts, ABI/INFORM, EMBASE, PubMed, PsycINFO, ERIC and the Cochrane Library. Searching, sampling, and data analysis was an iterative process, using constant comparison, to synthesize the results.

Results

We included 41 articles (38 empirical studies and 3 conceptual papers) that met the eligibility criteria. No existing review was found on this topic. A synthesis of the studies revealed 12 MM KB roles and 63 associated activities beyond existing roles hypothesized by extant theory, and we elaborate on two MM KB roles: 1) convincing others of the need for, and benefit of an innovation or evidence-based practice; and 2) functioning as a strategic influencer. We identified organizational and individual factors that may influence the efforts of MM KBs in healthcare organizations. Additionally, we found that the MM KB role was associated with enhanced provider knowledge, and skills, as well as improved organizational outcomes.

Conclusion

Our findings suggest that MMs do enact KB roles in healthcare settings to implement innovations and practice change. Our organizing framework offers a novel conceptualization of MM KBs that advances understanding of the emerging KB role that MMs play in healthcare organizations. In addition to roles, this study contributes to the extant literature by revealing factors that may influence the efforts and impacts of MM KBs in healthcare organizations. Future studies are required to refine and strengthen this framework.

Trial registration

A protocol for this review was not registered.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-07387-z.

Knowledge translation strategies for sharing evidence-based health information with older adults and their caregivers: findings from a persona-scenario method

Background

By understanding the information seeking behaviors of older adults, we can better develop or iterate effective information technologies, such as the McMaster Optimal Aging Portal, that provide evidence-based health information to the public. This paper reports health-related information seeking and searching behaviours and provides strategies for effective knowledge translation (KT) to increase awareness and use of reliable health information.

Methods

We conducted a qualitative study with eighteen older adults using the persona-scenario method, whereby participants created personas and scenarios describing older adults seeking health information. Scenarios were analyzed using a two-phase inductive qualitative approach, with the personas as context. From the findings related to pathways of engaging with health information, we identified targeted KT strategies to raise awareness and uptake of evidence-based information resources.

Results

Twelve women and six men, 60 to 81 years of age, participated. In pairs, they created twelve personas that captured rural and urban, male and female, and immigrant perspectives. Some scenarios described older adults who did not engage directly with technology, but rather accessed information indirectly through other sources or preferred nondigital modes of delivery. Two major themes regarding KT considerations were identified: connecting to information via other people and personal venues (people included healthcare professionals, librarians, and personal networks; personal venues included clinics, libraries, pharmacies, and community gatherings); and health information delivery formats, (e.g., printed and multimedia formats for web-based resources). For each theme, and any identified subthemes, corresponding sets of suggested KT strategies are presented.

Conclusions

Our findings underline the importance of people, venues, and formats in the actions of older adults seeking trusted health information and highlight the need for enhanced KT strategies to share information across personal and professional networks of older adults. KT strategies that could be employed by organizations or communities sharing evidence-based, reliable health information include combinations of educational outreach and materials, decision support tools, small group sessions, publicity campaigns, champions/opinion leaders, and conferences.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12877-021-02588-x.

Effectiveness of knowledge brokering and recommendation dissemination for influencing healthcare resource allocation decisions: A cluster randomised controlled implementation trial

BACKGROUND

Implementing evidence into clinical practice is a key focus of healthcare improvements to reduce unwarranted variation. Dissemination of evidence-based recommendations and knowledge brokering have emerged as potential strategies to achieve evidence implementation by influencing resource allocation decisions. The aim of this study was to determine the effectiveness of these two research implementation strategies to facilitate evidence-informed healthcare management decisions for the provision of inpatient weekend allied health services.

METHODS AND FINDINGS

This multicentre, single-blinded (data collection and analysis), three-group parallel cluster randomised controlled trial with concealed allocation was conducted in Australian and New Zealand hospitals between February 2018 and January 2020. Clustering and randomisation took place at the organisation level where weekend allied health staffing decisions were made (e.g., network of hospitals or single hospital). Hospital wards were nested within these decision-making structures. Three conditions were compared over a 12-month period: (1) usual practice waitlist control; (2) dissemination of written evidence-based practice recommendations; and (3) access to a webinar-based knowledge broker in addition to the recommendations. The primary outcome was the alignment of weekend allied health provision with practice recommendations at the cluster and ward levels, addressing the adoption, penetration, and fidelity to the recommendations. The secondary outcome was mean hospital length of stay at the ward level. Outcomes were collected at baseline and 12 months later. A total of 45 clusters (n = 833 wards) were randomised to either control (n = 15), recommendation (n = 16), or knowledge broker (n = 14) conditions. Four (9%) did not provide follow-up data, and no adverse events were recorded. No significant effect was found with either implementation strategy for the primary outcome at the cluster level (recommendation versus control β 18.11 [95% CI -8,721.81 to 8,758.02] p = 0.997; knowledge broker versus control β 1.24 [95% CI -6,992.60 to 6,995.07] p = 1.000; recommendation versus knowledge broker β -9.12 [95% CI -3,878.39 to 3,860.16] p = 0.996) or ward level (recommendation versus control β 0.01 [95% CI 0.74 to 0.75] p = 0.983; knowledge broker versus control β -0.12 [95% CI -0.54 to 0.30] p = 0.581; recommendation versus knowledge broker β -0.19 [-1.04 to 0.65] p = 0.651). There was no significant effect between strategies for the secondary outcome at ward level (recommendation versus control β 2.19 [95% CI -1.36 to 5.74] p = 0.219; knowledge broker versus control β -0.55 [95% CI -1.16 to 0.06] p = 0.075; recommendation versus knowledge broker β -3.75 [95% CI -8.33 to 0.82] p = 0.102). None of the control or knowledge broker clusters transitioned to partial or full alignment with the recommendations. Three (20%) of the clusters who only received the written recommendations transitioned from nonalignment to partial alignment. Limitations include underpowering at the cluster level sample due to the grouping of multiple geographically distinct hospitals to avoid contamination.

CONCLUSIONS

Owing to a lack of power at the cluster level, this trial was unable to identify a difference between the knowledge broker strategy and dissemination of recommendations compared with usual practice for the promotion of evidence-informed resource allocation to inpatient weekend allied health services. Future research is needed to determine the interactions between different implementation strategies and healthcare contexts when translating evidence into healthcare practice.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12618000029291.

Assessing the Electronic Evidence System Needs of Canadian Public Health Professionals: Cross-sectional Study

BACKGROUND

True evidence-informed decision-making in public health relies on incorporating evidence from a number of sources in addition to traditional scientific evidence. Lack of access to these types of data as well as ease of use and interpretability of scientific evidence contribute to limited uptake of evidence-informed decision-making in practice. An electronic evidence system that includes multiple sources of evidence and potentially novel computational processing approaches or artificial intelligence holds promise as a solution to overcoming barriers to evidence-informed decision-making in public health.

OBJECTIVE

This study aims to understand the needs and preferences for an electronic evidence system among public health professionals in Canada.

METHODS

An invitation to participate in an anonymous web-based survey was distributed via listservs of 2 Canadian public health organizations in February 2019. Eligible participants were English- or French-speaking individuals currently working in public health. The survey contained both multiple-choice and open-ended questions about the needs and preferences relevant to an electronic evidence system. Quantitative responses were analyzed to explore differences by public health role. Inductive and deductive analysis methods were used to code and interpret the qualitative data. Ethics review was not required by the host institution.

RESULTS

Respondents (N=371) were heterogeneous, spanning organizations, positions, and areas of practice within public health. Nearly all (364/371, 98.1%) respondents indicated that an electronic evidence system would support their work. Respondents had high preferences for local contextual data, research and intervention evidence, and information about human and financial resources. Qualitative analyses identified several concerns, needs, and suggestions for the development of such a system. Concerns ranged from the personal use of such a system to the ability of their organization to use such a system. Recognized needs spanned the different sources of evidence, including local context, research and intervention evidence, and resources and tools. Additional suggestions were identified to improve system usability.

CONCLUSIONS

Canadian public health professionals have positive perceptions toward an electronic evidence system that would bring together evidence from the local context, scientific research, and resources. Elements were also identified to increase the usability of an electronic evidence system.

Knowledge Translation Improvement Strategies in Universities of Medical Sciences in Iran: A Qualitative Study

Background

Recently, one of the challenges in the health system of the country is the need for research contributing to policy-making. Therefore, it is crucial to develop activities in the field of knowledge Translation (KT). This study aimed to propose KT improvement strategies in universities of medical sciences in Iran.

Methods

In this qualitative study, 18 semi-structured interviews were conducted with key informants from the medical universities in Iran during January-July 2018. The transcribed documents were analyzed using the Gale framework analysis approach. Data organization was carried out using MAXQDA version 10 software.

Results

According to framework analysis, six KT improvement strategies were identified including improving the abilities and skills of researchers, improving the processes and quality of knowledge production, revising policies and laws, improving the prerequisites, culture-building, and promoting the use of evidence.

Conclusion

Given the challenges and strategies outlined in this study, it seems that the mechanism of KT and its effects on improving health plans for policymakers and researchers has not been elucidated yet. Therefore, considerable changes in prerequisites, knowledge production processes, academic procedures, policies and laws are necessary for implementing KT in universities of medical sciences in Iran.

Evaluating an 'incident control' approach to non-communicable disease

OBJECTIVES

This article evaluates the application of 'incident control' methodology usually applied in communicable disease control to an 'incident' of unexplained deaths, specifically to resolve a significant difference in 1-year survival after a lung cancer diagnosis observed between two Clinical Commissioning Groups and the England national average, 2011-14. The purpose of the evaluation was to assess whether a formalised incident control approach is feasible and effective in improving outcomes for non-communicable diseases.

STUDY DESIGN

Descriptive, qualitative, process evaluation.

METHODS

There were two components to the evaluation: a document review against identified phases of a non-communicable disease incident control framework and a qualitative analysis of semi-structured interviews with stakeholders who had been involved in implementation.

RESULTS

The findings indicate feasibility of the incident control model, with some limitations. Identified strengths of the model included the articulation of a clear case and incident definition. The structure and stepped phased approach facilitated partner engagement, robust data analysis, action planning and communication strategies. Delays in data publication and the lack of comparable data across different non-communicable diseases present challenges in timely response and prioritisation of 'incidents'.

CONCLUSIONS

The evaluation indicates value in applying defined incident control methodology to management of non-communicable diseases, especially where there is identification of a potential outlier or a measurable variation, i.e. there is a definable 'incident' and 'case'.

The usability and applicability of knowledge translation theories, models, and frameworks for research in the context of a national health service

BACKGROUND

Translating research findings into service improvements for patients and/or policy changes is a key challenge for health service organizations. The Health Service Executive (HSE) in Ireland launched the Action Plan for Health Research 2019-2029, as reported by Terrés (HSE, Dublin, 2019), one of the goals of which is to maximize the impact of the research that takes place within the service to achieve improvements in patient care, services, or policy change. The purpose of this research is to review the literature on knowledge translation theories, models, and frameworks (TMFs) and to assess the suitability of the TMFs for HSE use, selecting one or more for this purpose. The aim is to produce guidance for HSE researchers and other health services staff, validate the usability of the framework(s) with researchers, and review and implement the guidance. It was hoped that identifying a suitable methodology would provide the means to increase the uptake and application of research findings, and reduce research wastage. This paper reports on the first part of the study: the review, assessment, and selection of knowledge translation TMFs for a national health service.

METHODS

An interdisciplinary working group of academic experts in implementation science, research wastage, and knowledge translation, along with key representatives from research funders (Health Research Board) and HSE personnel with expertise in quality improvement and research management, undertook a three-stage review and selection process to identify a knowledge translation TMF that would be suitable and usable for HSE purposes. The process included a literature review, consensus exercise, and a final consensus workshop. The review group adopted the Theory Comparison and Selection Tool (T-CaST) developed by Birken et al. (Implement Sci 13: 143, 2018) to review knowledge translation theories, models, and frameworks.

RESULTS

From 247 knowledge translation TMFs initially identified, the first stage of the review identified 18 that met the criteria of validity, applicability, relevance, usability, and ability to be operationalized in the local context. A further review by a subgroup of the working group reduced this number to 11. A whole-group review selected six of these to be reviewed at a facilitated consensus workshop, which identified three that were suitable and applicable for HSE use. These were able to be mapped onto the four components of the HSE knowledge translation process: knowledge creation, knowledge into action, transfer and exchange of knowledge, and implementation and sustainability.

CONCLUSION

The multiplicity of knowledge translation TMFs presents a challenge for health service researchers in making decisions about the appropriate methods for disseminating their research. Building a culture that uses research knowledge and evidence is important for organizations seeking to maximize the benefits from research. Supporting researchers with guidance on how to disseminate and translate their research can increase the uptake and application of research findings. The use of robust selection criteria enabled the HSE to select relevant TMFs and develop a process for increasing the dissemination and translation of research knowledge. The guidance developed to inform and educate researchers and knowledge users is expected to increase organizational capacity to promote a culture of research knowledge and evidence use within the HSE.

Key considerations for designing capacity-building interventions to support evidence-based programming in underserved communities: a qualitative exploration

Increasing the use of evidence-based programs (EBPs) in community settings is critical for improving health and reducing disparities. Community-based organizations (CBOs) and faith-based organizations (FBOs) have tremendous reach and trust within underserved communities, but their impact is constrained by limited staff capacity to use EBPs. This exploratory study sought to identify design and delivery considerations that could increase the impact of capacity-building interventions for CBOs and FBOs working with underserved communities. Data come from a community-based participatory research project addressing cancer disparities in Black, Latino, and Brazilian communities from Greater Boston and Greater Lawrence, Massachusetts. We conducted four focus group discussions with program coordinators in CBOs and FBOs (n = 27) and key informant interviews with CBO and FBO leaders (n = 15). Three researchers analyzed the data using a multi-stage coding process that included both prefigured and emergent codes. Key design considerations included embedding customized capacity-building interventions into community networks with local experts, supporting ongoing engagement with the intervention via a range of resources and communication channels, and addressing resource constraints. Regarding the contextual factors that should influence capacity-building intervention content, participants highlighted resource constraints, environments in which EBP use is not the norm, and challenges linking available programs with the multi-level barriers to good health faced by community members. Overall, the study highlights the need for integrated, long-term capacity-building efforts developed in partnership with, and ultimately sustained by, local organizations.

Evaluation of the performance and achievements of the WHO Evidence-informed Policy Network (EVIPNet) Europe

Background

The Evidence-informed Policy Network (EVIPNet) is one of the key mechanisms introduced by WHO to reduce the research-to-policy gap. EVIPNet Europe was launched in 2012. We evaluated the performance and achievements of EVIPNet Europe with the overall aims (1) to inform future developments and strategic planning of EVIPNet Europe and (2) to contribute to the evidence base for organisational knowledge translation activities by sharing the lessons learnt.

Methods

The evaluation covered the WHO Secretariat of EVIPNet Europe and its 21 member countries, from its inception to mid-2018. A mixed methods design was used to assess changes in three domains, including triangulation of quantitative and qualitative methods, based on the EVIPNet Europe Monitoring & Evaluation framework and theory of change. Data were collected between August and October 2018. Data collection comprised documentary review, social media analysis, online country evaluation, key informant interviews and validated tools. Two case studies were also developed.

Results

The evaluation showed promising results as well as lessons to guide the future development of EVIPNet in the WHO European Region and other regions of the world. EVIPNet Europe appears to be filling a niche in promoting the capacity of Network member countries for evidence-informed policy-making. There is evidence that EVIPNet Europe’s capacity-building programme of work is improving knowledge and skills at the individual level. There has been an increase in activity and outputs since its establishment and evidence has been used to inform new policies in some member countries. However, the speed at which member countries are developing or publishing products varies greatly and no formalised knowledge translation platforms have yet been created. Financial and human resources are limited and staff turnover is a cause for concern, both at the WHO Secretariat and country team levels.

Conclusions

Six years since the launch of EVIPNet Europe, the Network has grown quickly, is clearly valued and has had some successes. However, more work and support are needed if it is to achieve its vision of a Europe in which high-quality, context-sensitive evidence routinely informs health decision-making processes that ultimately serve to strengthen health outcomes across the Region.

Practitioner perspectives on building capacity for evidence-based public health in state health departments in the United States: a qualitative case study

BACKGROUND

Public health agencies are responsible for implementing effective, evidence-based public health programs and policies to reduce the burden of chronic diseases. Evidence-based public health can be facilitated by modifiable administrative evidence-based practices (A-EBPs) (e.g., workforce development, organizational climate), yet little is known about how practitioners view A-EBPs. Thus, the purpose of this qualitative study was to understand state health department practitioners' perceptions about how A-EBPs are implemented and what facilitators and barriers exist to using A-EBPs.

METHODS

Chronic disease prevention and health promotion program staff who were members of the National Association of Chronic Disease Directors were recruited to participate in telephone interviews using a snowball sampling technique. Interviews were transcribed verbatim, and transcripts were analyzed using a common codebook and the a priori method in NVivo.

RESULTS

Twenty seven interviews were conducted with practitioners in four states (5-8 interviews per state). All practitioners felt that their work unit culture is positive and that leadership encouraged and expected staff to use evidence-based processes. Participants discussed the provision of trainings and technical assistance as key to workforce development and how leaders communicate their expectations. Access to evidence, partnerships, and funding restrictions were the most commonly discussed barriers to the use of A-EBPs and EBDM.

CONCLUSIONS

Results of this study highlight practitioners' perspectives on promoting evidence-based public health in their departments. Findings can inform the development and refinement of resources to improve A-EBP use and organizational and leadership capacity of state health departments.

Barriers and enablers to the use of venous leg ulcer clinical practice guidelines in Australian primary care: A qualitative study using the theoretical domains framework

BACKGROUND

Venous leg ulcers represent the most common chronic wound problem managed in Australian primary care. Despite the prevalence of the condition, there is an evidence-practice gap in both diagnosis and management of venous leg ulcers.

OBJECTIVE

We used the Theoretical Domains Framework to identify barriers and enablers perceived by primary care practitioners in implementing venous leg ulcer guidelines in clinical practice.

DESIGN

We collected data to explore the experiences of practice nurses and general practitioners related to their use of clinical practice guidelines in management of venous leg ulcers.

SETTING(S)

We recruited participants from primary care settings located in metropolitan and rural areas across Victoria, Australia.

PARTICIPANTS

We recruited general practitioners (15) and practice nurses (20).

METHODS

We conducted 35 semi-structured face-to-face and telephone interviews. Content analysis of health practitioners' statements was performed and barriers to implementing clinical practice guidelines were mapped across the Theoretical Domains Framework theoretical domains.

RESULTS

Six main domains from the Theoretical Domains Framework (Environmental context and resources, Knowledge, Skills, Social influences, Social/Professional Role and Identity and Belief about Capabilities) best explained these barriers and enablers. Many participants were not aware of venous leg ulcer clinical practice guidelines. Those that were aware, stated that finding and accessing guidelines was challenging and most participants relied on other sources of information. Venous leg ulcer management was greatly influenced by professional experience and suggestions from colleagues. Other barriers included busy clinical practice, absence of handheld Doppler ultrasonography, insufficient skills and a lack of confidence related to the use of technology to rule out arterial involvement prior to compression application, a particular skill related to venous leg ulcer management that will impact on healing outcomes.

CONCLUSIONS

We identified a number of barriers and the lack of enablers that influence the uptake of venous leg ulcer clinical practice guidelines in primary care. This paper adds a theoretically sound, systematic approach for understanding and addressing the behaviour change required to improve translation of venous leg ulcer clinical practice guidelines in clinical practice. Tweetable abstract: The need to optimise venous leg ulcer clinical practice guidelines (CPG) has never been greater as the current estimate of health cost is AUD3billion and increasing due to rising epidemics of diabetes and obesity. We found most primary care health practitioners are unaware of CPG and this will impact on health and healing outcomes in Australian primary care.

Specifying clinical assessment schedules for the European framework of rehabilitation service types: the perspective of the physical and rehabilitation medicine Section and Board of the European Union of Medical Specialists

INTRODUCTION

In light of global mandates and in recognition of the value of data collection and reporting based on the International Classification of Functioning, Disability and Health (ICF), the UEMS PRM Section and Board established an action plan to implement the ICF in Physical and Rehabilitation Medicine, rehabilitation and health care at large. This includes, among other steps, the development of a framework of rehabilitation service types for Europe (European Framework) and corresponding clinical assessment schedules (CLASs) for each service type. A CLAS encompasses the recommendation for what aspects of functioning to document, for whom and when, and the data collection tools to use. The objective of this paper is to report on the development of the CLASs for the European Framework developed in Stockholm in 2018, with focus on what to document.

METHODS

Involving UEMS PRM delegates across European regions, a multistage Delphi process comprised the development of an initial proposal of the CLASs (i.e. default and optional ICF Sets to document), two feedback (pre- and post-Stockholm) rounds via e-mail, and a deliberation by the UEMS PRM during its March 2019 meeting in Budapest. In both Delphi rounds, participants were asked whether the initially proposed default and optional ICF Sets represent what is currently documented at an exemplary service provider in the country or in consideration of their own expertise. The European Framework was revised between the two Delphi rounds, requiring a revision of the CLAS proposal accordingly. Participants were additionally asked whether they support the suggested ICF Sets as the specification of the CLAS. Level of support (strong = ≥80%, moderate = between 80-60%, weak =≤59%) was calculated as the percentage of countries supporting the suggested CLAS over the number of responding countries. The results of the post-Stockholm round were presented for discussion, revision and approval at the Budapest meeting.

RESULTS

Pre-Stockholm Delphi round: due to low response rate only a summary of comments made by the responding countries was provided as reference information for the post-Stockholm round. Post-Stockholm Delphi round: results indicated moderate to strong support for the proposed CLASs. Deliberation Budapest Meeting - Motions for specific revisions to the CLASs based on the results of the Post-Stockholm round were predominately accepted. With additional minor revisions, the UEMS PRM General Assembly approved a version of the CLASs for the European Framework.

CONCLUSIONS

To kick-off the implementation of these CLASs, UEMS PRM plans demonstration projects in at least one rehabilitation facility in each delegate country that exemplifies the rehabilitation service types of the European Framework which exist in the respective country. The demonstration projects are intended to orient service providers and clinicians to the CLASs and illustrate how the CLASs can be implemented.

A description of a tailored knowledge translation intervention delivered by knowledge brokers within public health departments in Canada

Background

While there is an expectation to demonstrate evidence-informed public health there is an ongoing need for capacity development. The purpose of this paper is to provide a description of a tailored knowledge translation intervention implemented by knowledge brokers (KBs), and reflections on the factors that facilitated or hindered its implementation.

Methods

The 22-month knowledge translation intervention, implemented by two KBs, sought to facilitate evidence-informed public health decision-making. Data on outcomes were collected using a knowledge, skills and behavioural assessment survey. In addition, the KBs maintained reflective journals noting which activities appeared successful or not, as well as factors related to the individual or the organisation that facilitated or hindered evidence-informed decision-making.

Results

Tailoring of the knowledge translation intervention to address the needs, preferences and structure of each organisation resulted in three unique interventions being implemented. A consistent finding across organisations was that each site needed to determine where evidence-informed decision-making ‘fit’ within pre-existing organisational processes. Components of the intervention consistent across the three organisations included one-to-one mentoring of teams through rapid evidence reviews, large group workshops and regular meetings with senior management. Components that varied included the frequency of the KB being physically onsite, the amount of time staff spent with the KB and proportion of time spent one-to-one with a KB versus in workshops. Key facilitating factors for implementation included strong leadership, influential power of champions, supportive infrastructure, committed resources and staff enthusiasm.

Conclusions

The results of this study illustrate the importance of working collaboratively with organisations to tailor knowledge translation interventions to best meet unique needs, preferences, organisational structures and contexts. Organisational factors such as leadership, champions and supportive infrastructure play a key role in determining the impact of the knowledge translation interventions. Future studies should explore how these factors can be fostered and/or developed within organisations. While KBs implemented the knowledge translation intervention in this study, more research is needed to understand the impact of all change agent roles including KBs, as well as how these roles can be maintained in the long-term if proven effective.