"Layers of translation" - evidence literacy in public health practice: a qualitative secondary analysis

Strategies to implement evidence-informed decision making at the organizational level: a rapid systematic review

BACKGROUND

Achievement of evidence-informed decision making (EIDM) requires the integration of evidence into all practice decisions by identifying and synthesizing evidence, then developing and executing plans to implement and evaluate changes to practice. This rapid systematic review synthesizes evidence for strategies for the implementation of EIDM across organizations, mapping facilitators and barriers to the COM-B (capability, opportunity, motivation, behaviour) model for behaviour change. The review was conducted to support leadership at organizations delivering public health services (health promotion, communicable disease prevention) to drive change toward evidence-informed public health.

METHODS

A systematic search was conducted in multiple databases and by reviewing publications of key authors. Articles that describe interventions to drive EIDM within teams, departments, or organizations were eligible for inclusion. For each included article, quality was assessed, and details of the intervention, setting, outcomes, facilitators and barriers were extracted. A convergent integrated approach was undertaken to analyze both quantitative and qualitative findings.

RESULTS

Thirty-seven articles are included. Studies were conducted in primary care, public health, social services, and occupational health settings. Strategies to implement EIDM included the establishment of Knowledge Broker-type roles, building the EIDM capacity of staff, and research or academic partnerships. Facilitators and barriers align with the COM-B model for behaviour change. Facilitators for capability include the development of staff knowledge and skill, establishing specialized roles, and knowledge sharing across the organization, though staff turnover and subsequent knowledge loss was a barrier to capability. For opportunity, facilitators include the development of processes or mechanisms to support new practices, forums for learning and skill development, and protected time, and barriers include competing priorities. Facilitators identified for motivation include supportive organizational culture, expectations for new practices to occur, recognition and positive reinforcement, and strong leadership support. Barriers include negative attitudes toward new practices, and lack of understanding and support from management.

CONCLUSION

This review provides a comprehensive analysis of facilitators and barriers for the implementation of EIDM in organizations for public health, mapped to the COM-B model for behaviour change. The existing literature for strategies to support EIDM in public health illustrates several facilitators and barriers linked to realizing EIDM. Knowledge of these factors will help senior leadership develop and implement EIDM strategies tailored to their organization, leading to increased likelihood of implementation success.

REVIEW REGISTRATION

PROSPERO CRD42022318994.

Welcome to the era of vague news: a study of the demands of statistical and mathematical products in the COVID-19 pandemic media

In this article, we report on a typology of the demands of statistical and mathematical products (StaMPs) embedded in media items related to the COVID-19 (coronavirus) pandemic. The typology emerged from a content analysis of a large purposive sample of diverse media items selected from digital news sources based in four countries. The findings encompass nine categories of StaMPs: (1) descriptive quantitative information, (2) models, predictions, causality and risk, (3) representations and displays, (4) data quality and strength of evidence, (5) demographics and comparative thinking, (6) heterogeneity and contextual factors, (7) literacy and language demands, (8) multiple information sources, and (9) critical demands. We illustrate these categories via selected media items, substantiate them through relevant research literature, and point to categories that encompass new or enhanced types of demands. Our findings offer insights into the rich set of capabilities that citizens (including both young people and adults) must possess in order to engage these mass media demands, critically analyze statistical and mathematical information in the media, evaluate the meaning and credibility of news reports, understand public policies, and make evidenced-informed judgments. Our conclusions point to the need to revise current curricular frameworks and conceptual models (e.g., regarding statistical and probability literacy, adult numeracy), to better incorporate notions such as blended knowledge, vagueness, risk, strength of evidence, and criticality. Furthermore, more attention is needed to the literacy and language demands of media items involving statistical and mathematical information. Implications for further research and educational practice are discussed.

A pragmatic evaluation of a public health knowledge broker mentoring education program: a convergent mixed methods study

BACKGROUND

Public health professionals are expected to use the best available research and contextual evidence to inform decision-making. The National Collaborating Centre for Methods and Tools developed, implemented, and evaluated a Knowledge Broker mentoring program aimed at facilitating organization-wide evidence-informed decision-making in ten public health units in Ontario, Canada. The purpose of this study was to pragmatically assess the impact of the program.

METHODS

A convergent mixed methods design was used to interpret quantitative results in the context of the qualitative findings. A goal-setting exercise was conducted with senior leadership in each organization prior to implementing the program. Achievement of goals was quantified through deductive coding of post-program interviews with participants and management. Interviews analyzed inductively to qualitatively explain progress toward identified goals and identify key factors related to implementation of EIDM within the organization.

RESULTS

Organizations met their goals for evidence use to varying degrees. The key themes identified that support an organizational shift to EIDM include definitive plans for participants to share knowledge during and after program completion, embedding evidence into decision-making processes, and supportive leadership with organizational investment of time and resources. The location, setting, or size of health units was not associated with attainment of EIDM goals; small, rural health units were not at a disadvantage compared to larger, urban health units.

CONCLUSIONS

The Knowledge Broker mentoring program allowed participants to share their learning and support change at their health units. When paired with organizational supports such as supportive leadership and resource investment, this program holds promise as an innovative knowledge translation strategy for organization wide EIDM among public health organizations.

Assessing the Electronic Evidence System Needs of Canadian Public Health Professionals: Cross-sectional Study

BACKGROUND

True evidence-informed decision-making in public health relies on incorporating evidence from a number of sources in addition to traditional scientific evidence. Lack of access to these types of data as well as ease of use and interpretability of scientific evidence contribute to limited uptake of evidence-informed decision-making in practice. An electronic evidence system that includes multiple sources of evidence and potentially novel computational processing approaches or artificial intelligence holds promise as a solution to overcoming barriers to evidence-informed decision-making in public health.

OBJECTIVE

This study aims to understand the needs and preferences for an electronic evidence system among public health professionals in Canada.

METHODS

An invitation to participate in an anonymous web-based survey was distributed via listservs of 2 Canadian public health organizations in February 2019. Eligible participants were English- or French-speaking individuals currently working in public health. The survey contained both multiple-choice and open-ended questions about the needs and preferences relevant to an electronic evidence system. Quantitative responses were analyzed to explore differences by public health role. Inductive and deductive analysis methods were used to code and interpret the qualitative data. Ethics review was not required by the host institution.

RESULTS

Respondents (N=371) were heterogeneous, spanning organizations, positions, and areas of practice within public health. Nearly all (364/371, 98.1%) respondents indicated that an electronic evidence system would support their work. Respondents had high preferences for local contextual data, research and intervention evidence, and information about human and financial resources. Qualitative analyses identified several concerns, needs, and suggestions for the development of such a system. Concerns ranged from the personal use of such a system to the ability of their organization to use such a system. Recognized needs spanned the different sources of evidence, including local context, research and intervention evidence, and resources and tools. Additional suggestions were identified to improve system usability.

CONCLUSIONS

Canadian public health professionals have positive perceptions toward an electronic evidence system that would bring together evidence from the local context, scientific research, and resources. Elements were also identified to increase the usability of an electronic evidence system.

Practitioner perspectives on building capacity for evidence-based public health in state health departments in the United States: a qualitative case study

BACKGROUND

Public health agencies are responsible for implementing effective, evidence-based public health programs and policies to reduce the burden of chronic diseases. Evidence-based public health can be facilitated by modifiable administrative evidence-based practices (A-EBPs) (e.g., workforce development, organizational climate), yet little is known about how practitioners view A-EBPs. Thus, the purpose of this qualitative study was to understand state health department practitioners' perceptions about how A-EBPs are implemented and what facilitators and barriers exist to using A-EBPs.

METHODS

Chronic disease prevention and health promotion program staff who were members of the National Association of Chronic Disease Directors were recruited to participate in telephone interviews using a snowball sampling technique. Interviews were transcribed verbatim, and transcripts were analyzed using a common codebook and the a priori method in NVivo.

RESULTS

Twenty seven interviews were conducted with practitioners in four states (5-8 interviews per state). All practitioners felt that their work unit culture is positive and that leadership encouraged and expected staff to use evidence-based processes. Participants discussed the provision of trainings and technical assistance as key to workforce development and how leaders communicate their expectations. Access to evidence, partnerships, and funding restrictions were the most commonly discussed barriers to the use of A-EBPs and EBDM.

CONCLUSIONS

Results of this study highlight practitioners' perspectives on promoting evidence-based public health in their departments. Findings can inform the development and refinement of resources to improve A-EBP use and organizational and leadership capacity of state health departments.

Evidence use in equity focused health impact assessment: a realist evaluation

BACKGROUND

Equity-focused health impact assessment (EFHIA) can function as a framework and tool that supports users to collate data, information, and evidence related to health equity in order to identify and mitigate the impact of a current or proposed initiative on health inequities. Despite education efforts in both the clinical and public health settings, practitioners have found implementation and the use of evidence in completing equity focussed assessment tools to be challenging.

METHODS

We conducted a realist evaluation of evidence use in EFHIA in three phases: 1) developing propositions informed by a literature scan, existing theoretical frameworks, and stakeholder engagement; 2) data collection at four case study sites using online surveys, semi-structured interviews, document analysis, and observation; and 3) a realist analysis and identification of context-mechanism-outcome patterns and demi-regularities.

RESULTS

We identified limited use of academic evidence in EFHIA with two explanatory demi-regularities: 1) participants were unable to "identify with" academic sources, acknowledging that evidence based practice and use of academic literature was valued in their organization, but seen as less likely to provide answers needed for practice and 2) use of academic evidence was not associated with a perceived "positive return on investment" of participant energy and time. However, we found that knowledge brokering at the local site can facilitate evidence familiarity and manageability, increase user confidence in using evidence, and increase the likelihood of evidence use in future work.

CONCLUSIONS

The findings of this study provide a realist perspective on evidence use in practice, specifically for EFHIA. These findings can inform ongoing development and refinement of various knowledge translation interventions, particularly for practitioners delivering front-line public health services.