Comparing the usability of the World Health Organization's conventional tuberculosis guidelines to the eTB recommendations map: A two-arm superiority randomised controlled trial

Barriers and opportunities faced by public health practitioners in using public health guidance on COVID-19: a knowledge translation exercise for the eCOVID-19 RecMap

BACKGROUND AND OBJECTIVES

The COVID-19 pandemic prompted the scientific community to collaborate in an unprecedented way, with the rapid and urgent generation and translation of new knowledge about the disease and its causative agent. Iteratively, and at different levels of government and globally, population-level guidance was created and updated, resulting in the need for a living catalog of guidelines, the eCOVID-19 Recommendations Map and Gateway to Contextualization (RecMap). This article focuses on the approach that was used to analyze barriers and opportunities associated with using the RecMap in public health in Canada.

STUDY DESIGN AND SETTING

A mixed qualitative and quantitative approach data were used to inform this knowledge mobilization project and inform feedback on implementation of the eCOVID-19 RecMap. This approach involved surveying 110 attendees from a public health webinar. Following this webinar, an evidence brief and series of case studies were created and disseminated to 24 Canadian public health practitioners who attended a virtual workshop. This workshop identified barriers and opportunities to improve RecMap use.

RESULTS

This study helped to shed light on the needs that public health practitioners have when finding, using, and disseminating public health guidelines. Through the workshop that was conducted, opportunities for public health guidelines can be categorized into 4 categories: 1) information access, 2) awareness, 3) public health development, and 4) usability. Barriers that were identified can also be categorized into 4 categories: 1) usability, 2) information maintenance, 3) public health guidance, 4) awareness.

CONCLUSION

This work will help to inform the development and organization of future public health guidelines, and the needs that public health practitioners have when engaging with them.

Parents' User Experience Accessing and Using a Web-Based Map of COVID-19 Recommendations for Health Decision-Making: Qualitative Descriptive Study

BACKGROUND

The eCOVID19 Recommendations Map & Gateway to Contextualization (RecMap) website was developed to identify all COVID-19 guidelines, assess the credibility and trustworthiness of the guidelines, and make recommendations understandable to various stakeholder groups. To date, little has been done to understand and explore parents' experiences when accessing and using the RecMap website for COVID-19 health decision-making.

OBJECTIVE

To explore (1) where parents look for COVID-19 health information and why, (2) parents' user experience when accessing and using the RecMap website to make health decisions, and (3) what knowledge mobilization activities are needed to increase parents' awareness, use, and engagement with the RecMap website.

METHODS

We conducted a qualitative descriptive study using semistructured interviews and a think-aloud activity with parents of children aged 18 years or younger living in Canada. Participants were asked to provide feedback on the RecMap website and to "think aloud" as they navigated the website to find relevant COVID-19 health recommendations. Demographic information was collected using a web-based questionnaire. A hybrid deductive and inductive thematic approach guided analysis and data synthesis.

RESULTS

A total of 21 participants (13/21, 62% mothers) were interviewed and participated in a think-aloud activity. The data were categorized into four sections, representative of key elements that deductively and inductively emerged from the data: (1) parent information seeking behaviors and preferences for COVID-19, (2) RecMap website usability, (3) perceived usefulness of the RecMap website, and (4) knowledge mobilization strategies to increase awareness, use, and engagement of the RecMap website. Parents primarily used the internet to find COVID-19 information and focused on sources that they determined to be credible, trustworthy, simple, and engaging. As the pandemic evolved, participants' information-seeking behaviors changed, specifically their topics of interest and search frequency. Most parents were not aware of the RecMap website before this study but found satisfaction with its concept and layout and expressed intentions to use and share it with others. Parents experienced some barriers to using the RecMap website and suggested key areas for improvement to facilitate its usability and perceived usefulness. Recommendations included a more user-friendly home page for lay audiences (separate public-facing user interface), improving the search and filter options, quicker navigation, clearer titles, more family-friendly graphics, and improving mobile-friendly access. Several strategies to disseminate the RecMap website were also expressed, including a mix of traditional and nontraditional methods (handouts and social media) in credible and high-traffic locations that parents frequent often.

CONCLUSIONS

Overall, parents liked the concept of the RecMap website but had some suggestions to improve its usability (language, navigation, and website interface). These findings can be used to improve the RecMap website for parents and offer insight for the development and dissemination of effective web-based health information tools and resources for the general public.

A multimethods randomized trial found that plain language versions improved adults understanding of health recommendations

OBJECTIVES

To make informed decisions, the general population should have access to accessible and understandable health recommendations. To compare understanding, accessibility, usability, satisfaction, intention to implement, and preference of adults provided with a digital "Plain Language Recommendation" (PLR) format vs. the original "Standard Language Version" (SLV).

STUDY DESIGN AND SETTING

An allocation-concealed, blinded, controlled superiority trial and a qualitative study to understand participant preferences. An international on-line survey. 488 adults with some English proficiency. 67.8% of participants identified as female, 62.3% were from the Americas, 70.1% identified as white, 32.2% had a bachelor's degree as their highest completed education, and 42% said they were very comfortable reading health information. In collaboration with patient partners, advisors, and the Cochrane Consumer Network, we developed a plain language format of guideline recommendations (PLRs) to compare their effectiveness vs. the original standard language versions (SLVs) as published in the source guideline. We selected two recommendations about COVID-19 vaccine, similar in their content, to compare our versions, one from the World Health Organization (WHO) and one from Centers for Disease Control and Prevention (CDC). The primary outcome was understanding, measured as the proportion of correct responses to seven comprehension questions. Secondary outcomes were accessibility, usability, satisfaction, preference, and intended behavior, measured on a 1-7 scale.

RESULTS

Participants randomized to the PLR group had a higher proportion of correct responses to the understanding questions for the WHO recommendation (mean difference [MD] of 19.8%, 95% confidence interval [CI] 14.7-24.9%; P < 0.001) but this difference was smaller and not statistically significant for the CDC recommendation (MD of 3.9%, 95% CI -0.7% to 8.3%; P = 0.096). However, regardless of the recommendation, participants found the PLRs more accessible, (MD of 1.2 on the seven-point scale, 95% CI 0.9-1.4%; P < 0.001) and more satisfying (MD of 1.2, 95% CI 0.9-1.4%; P < 0.001). They were also more likely to follow the recommendation if they had not already followed it (MD of 1.2, 95% CI 0.7-1.8%; P < 0.001) and share it with other people they know (MD of 1.9, 95% CI 0.5-1.2%; P < 0.001). There was no significant difference in the preference between the two formats (MD of -0.3, 95% CI -0.5% to 0.03%; P = 0.078). The qualitative interviews supported and contextualized these findings.

CONCLUSION

Health information provided in a PLR format improved understanding, accessibility, usability, and satisfaction and thereby has the potential to shape public decision-making behavior.

A multimethods randomized trial found that plain language versions improved parents' understanding of health recommendations

OBJECTIVES

To assess the effectiveness of plain language compared with standard language versions of COVID-19 recommendations specific to child health.

STUDY DESIGN AND SETTING

Pragmatic, allocation-concealed, blinded, superiority randomized controlled trial with nested qualitative component. Trial was conducted online, internationally. Parents or legal guardians (≥18 years) of a child (<18 years) were eligible. Participants were randomized to receive a plain language recommendation (PLR) or standard (SLV) verison of a COVID-19 recommendation specific to child health. Primary outcome was understanding. Secondary outcomes included: preference, accessibility, usability, satisfaction, and intended behavior. Interviews explored perceptions and preferences for each format.

RESULTS

Between July and August 2022, 295 parents were randomized; 241 (81.7%) completed the study (intervention n = 121, control n = 120). Mean understanding scores were significantly different between groups (PLR 3.96 [standard deviation (SD) 2.02], SLV 3.33 [SD 1.88], P = 0.014). Overall participants preferred the PLR version: mean rating 5.05/7.00 (95% CI 4.81, 5.29). Interviews (n = 12 parents) highlighted their preference for the PLR and provided insight on elements to enhance future knowledge mobilization of health recommendations.

CONCLUSION

Compared to SLVs, parents preferred PLRs and better understood the recommendation. Guideline developers should strive to use plain language to increase understanding, uptake, and implementation of evidence by the public.

Plain Language vs Standard Format for Youth Understanding of COVID-19 Recommendations: A Randomized Clinical Trial

Importance

To ensure that youths can make informed decisions about their health, it is important that health recommendations be presented for understanding by youths.

Objective

To compare understanding, accessibility, usability, satisfaction, intention to implement, and preference of youths provided with a digital plain language recommendation (PLR) format vs the original standard language version (SLV) of a health recommendation.

Design, Setting, and Participants

This pragmatic, allocation-concealed, blinded, superiority randomized clinical trial included individuals from any country who were 15 to 24 years of age, had internet access, and could read and understand English. The trial was conducted from May 27 to July 6, 2022, and included a qualitative component.

Interventions

An online platform was used to randomize youths in a 1:1 ratio to an optimized digital PLR or SLV format of 1 of 2 health recommendations related to the COVID-19 vaccine; youth-friendly PLRs were developed in collaboration with youth partners and advisors.

Main Outcomes and Measures

The primary outcome was understanding, measured as the proportion of correct responses to 7 comprehension questions. Secondary outcomes were accessibility, usability, satisfaction, preference, and intended behavior. After completion of the survey, participants indicated their interest in completing a 1-on-1 semistructured interview to reflect on their preferred digital format (PLR or SLV) and their outcome assessment survey response.

Results

Of the 268 participants included in the final analysis, 137 were in the PLR group (48.4% female) and 131 were in the SLV group (53.4% female). Most participants (233 [86.9%]) were from North and South America. No significant difference was found in understanding scores between the PLR and SLV groups (mean difference, 5.2%; 95% CI, -1.2% to 11.6%; P = .11). Participants found the PLR to be more accessible and usable (mean difference, 0.34; 95% CI, 0.05-0.63) and satisfying (mean difference, 0.39; 95% CI, 0.06-0.73) and had a stronger preference toward the PLR (mean difference, 4.8; 95% CI, 4.5-5.1 [4.0 indicated a neutral response]) compared with the SLV. No significant difference was found in intended behavior (mean difference, 0.22 (95% CI, -0.20 to 0.74). Interviewees (n = 14) agreed that the PLR was easier to understand and generated constructive feedback to further improve the digital PLR.

Conclusions and Relevance

In this randomized clinical trial, compared with the SLV, the PLR did not produce statistically significant findings in terms of understanding scores. Youths ranked it higher in terms of accessibility, usability, and satisfaction, suggesting that the PLR may be preferred for communicating health recommendations to youths. The interviews provided suggestions for further improving PLR formats.

Trial Registration

ClinicalTrials.gov Identifier: NCT05358990.

The BIGG-REC database makes available all WHO/PAHO evidence informed recommendations

OBJECTIVES

To build and maintain a living database of the Pan American Health Organization/World Health Organization (PAHO/WHO) recommendations developed using Grading of Recommendations Assessment, Development, and Evaluation (GRADE).

STUDY DESIGN AND SETTING

Guidelines are identified from WHO and PAHO databases. We periodically extract recommendations, according to the health and well-being targets of sustainable development goal 3 (SDG-3).

RESULTS

As of March 2022, the International database of GRADE guidelines (https://bigg-rec.bvsalud.org/en) database hosted 2,682 recommendations contained in 285 WHO/PAHO guidelines. Recommendations were classified as follows: communicable diseases (1,581), children's health (1,182), universal health (1,171), sexual and reproductive health (910), noncommunicable diseases (677), maternal health (654), COVID-19 (224), use of psychoactive substances (99), tobacco (14) and road and traffic accidents (16). International database of GRADE guidelines allows searching by SDG-3, condition or disease, type of intervention, institution, year of publication, and age.

CONCLUSION

Recommendation maps provide an important resource for health professionals, organizations and member states that use evidence-informed guidance to make better decisions, providing a source for the adoption or adaptation of recommendations to meet their needs. This one-stop shop database of evidence-informed recommendations built with intuitive functionalities undoubtedly represents a long-needed tool for decision-makers, guideline developers, and the public at large.