Effects of the Informed Health Choices primary school intervention on the ability of children in Uganda to assess the reliability of claims about treatment effects: a cluster-randomised controlled trial

Prioritising Key Concepts for informed health choices in cancer: An evidence-based online educational programme

Objective

The overabundance of health misinformation has undermined people's capacity to make evidence-based, informed choices about their health. Using the Informed Health Choices (IHC) Key Concepts (KCs), we are developing a two-stage education programme, Informed Health Choices-Cancer (IHC-C), to provide those impacted by cancer with the knowledge and skills necessary to think critically about the reliability of health information and claims and make well-informed choices. Stage 1 seeks to prioritise the most relevant Key Concepts.

Methods

A project group and a patient and carer participation group completed a two-round prioritisation process. The process involved disseminating pre-reading materials, training sessions, and a structured judgement form to evaluate concepts for inclusion. Data from each round were analysed to reach a consensus on the concepts to include.

Results

Fourteen participants were recruited and completed the first-round prioritisation. Fifteen participants undertook the second-round prioritisation. Nine Key Concepts were selected for the programme across five training sessions and two consensus meetings.

Conclusion

The prioritised concepts identified represent the most pertinent aspects of cancer-related information for those impacted by the disease. By incorporating these concepts into educational materials and communication strategies, healthcare providers and organisations can potentially help cancer patients, survivors, and their loved ones to recognise and combat cancer-related misinformation more effectively.

Innovation

This study introduces a participatory prioritisation process, which integrates the expertise of healthcare professionals with the insights of patients and carers, thereby enhancing the programme's relevance and applicability.

Teaching critical thinking about health information and choices in secondary schools: human-centred design of digital resources

Background

Learning to thinking critically about health information and choices can protect people from unnecessary suffering, harm, and resource waste. Earlier work revealed that children can learn these skills, but printing costs and curricula compatibility remain important barriers to school implementation. We aimed to develop a set of digital learning resources for students to think critically about health that were suitable for use in Kenyan, Rwandan, and Ugandan secondary schools.

Methods

We conducted work in two phases collaborating with teachers, students, schools, and national curriculum development offices using a human-centred design approach. First, we conducted context analyses and an overview of teaching strategies, prioritised content and collected examples. Next, we developed lessons and guidance iteratively, informed by data from user-testing, individual and group interviews, and school pilots.

Results

Final resources include online lesson plans, teachers' guide, and extra resources, with lesson plans in two modes, for use in a classroom equipped with a blackboard/flip-chart and a projector. The resources are accessible offline for use when electricity or Internet is lacking. Teachers preferred the projector mode, as it provided structure and a focal point for class attention. Feedback was largely positive, with teachers and students appreciating the learning and experiencing it as relevant. Four main challenges included time to teach lessons; incorrect comprehension; identifying suitable examples; and technical, logistical, and behavioural challenges with a student-computer mode that we piloted. We resolved challenges by simplifying and combining lessons; increasing opportunities for review and assessment; developing teacher training materials, creating a searchable set of examples; and deactivating the student-computer mode.

Conclusion

Using a human-centred design approach, we created digital resources for teaching secondary school students to think critically about health actions and for training teachers. Be smart about your health resources are open access and can be translated or adapted to other settings.

Key concepts for informed health choices: Where's the evidence?

Background

The Informed Health Choices (IHC) Key Concepts is a framework that provides a basis for developing educational resources and evaluating people's ability to think critically about health actions. We developed the original Key Concepts framework by reviewing texts and checklists for the public, journalists, and health professionals and collecting structured feedback from an international advisory group. We revised the original 2015 framework yearly from 2016 to 2018 based on feedback and experience using the framework. The objectives of this paper are to describe the development of the framework since 2018 and summarise their basis.

Methods

For the 2019 version, we responded to feedback on the 2018 version. For the current 2022 version, in addition to responding to feedback on the 2019 version, we reviewed the evidence base for each of the concepts. Whenever possible, we referenced systematic reviews that provide a basis for a concept. We screened all Cochrane methodology reviews and searched Epistemonikos, PubMed, and Google Scholar for methodology reviews and meta-epidemiological studies.

Results

The original framework included 32 concepts in six groups. The 2019 version and the current 2022 version include 49 concepts in the same three main groups that we have used since 2016. There are now 10 subgroups or higher-level concepts. For each concept, there is an explanation including one or more examples, the basis for the concept, and implications. Over 600 references are cited that support the concepts, and over half of the references are systematic reviews.

Conclusions

There is a large body of evidence that supports the IHC key concepts and we have received few suggestions for changes since 2019.

Teaching Australian high school students to think critically about health claims: a cluster randomized trial

Making informed health decisions requires knowledge and skills in appraising health claims, and teaching adolescents these skills may prepare them for future decision-making. This cluster randomized trial evaluated the effectiveness of an educational intervention on students' ability to identify and appraise health claims. Nine Australian high schools (4 control and 5 intervention) were recruited, comprising 974 students (382 control and 592 intervention) in Grades 7-10. Intervention impact was evaluated through baseline and follow-up evaluation. Follow-up mean scores on questions (maximum score of 25) from the Claim Evaluation Tools database (primary outcome) showed minimal between-group difference (intervention versus control: 14.4 versus 13.6; difference 0.8, 95% confidence interval [CI] -1.6 to 3.1; P = 0.52). Change scores were only slightly higher in the intervention group (difference 1.2 [95% CI -0.7 to 3.1; P = 0.21]). Between-group differences for secondary outcomes were also minimal. Most intervention group students 'trusted' and 'liked' the programme and found the content 'easy' and 'helpful'. Most teacher feedback was positive, some noting challenges of covering content in allocated time and maintaining student engagement. It is unlikely that the assessed educational intervention had a large effect. Future research priorities are suggested.

Effects of the Informed Health Choices secondary school intervention on the ability of students in Rwanda to think critically about health choices: A cluster-randomized trial

AIM

The aim of this trial was to evaluate the effects of the Informed Health Choices intervention on the ability of students in Rwandan to think critically and make Informed Health Choices.

METHODS

We conducted a two-arm cluster-randomized trial in 84 lower secondary schools from 10 districts representing five provinces of Rwanda. We used stratified randomization to allocate schools to the intervention or control. One class in each intervention school had ten 40-min lessons taught by a trained teacher in addition to the usual curriculum. Control schools followed the usual curriculum. The primary outcome was a passing score (≥ 9 out of 18 questions answered correctly) for students on the Critical Thinking about Health Test completed within 2 weeks after the intervention. We conducted an intention-to-treat analysis using generalized linear mixed models, accounting for the cluster design using random intercepts.

RESULTS

Between February 25 and March 29, 2022, we recruited 3,212 participants. We assigned 1,572 students and 42 teachers to the intervention arm and 1,556 students and 42 teachers to the control arm. The proportion of students who passed the test in the intervention arm was 915/1,572 (58.2%) compared to 302/1,556 (19.4%) in the control arm, adjusted odds ratio 10.6 (95% CI: 6.3-17.8), p < 0.0001, adjusted difference 37.2% (95% CI: 29.5%-45.0%).

CONCLUSIONS

The intervention is effective in helping students think critically about health choices. It was possible to improve students' ability to think critically about health in the context of a competence-based curriculum in Rwanda, despite challenging postpandemic conditions.

Use of the informed health choices educational intervention to improve secondary students' ability to think critically about health interventions in Uganda: A cluster-randomized trial

AIM

The aim was to evaluate the effect of the Informed Health Choices (IHC) educational intervention on secondary students' ability to assess health-related claims and make informed choices.

METHODS

In a cluster-randomized trial, we randomized 80 secondary schools (students aged 13-17 years) in Uganda to the intervention or control (usual curriculum). The intervention included a 2-day teacher training workshop, 10 lessons accessed online by teachers and delivered in one school term. The lesson plans were developed for classrooms equipped with a blackboard or a blackboard and projector. The lessons addressed nine prioritized concepts. We used two multiple-choice questions for each concept to evaluate the students' ability to assess claims and make informed choices. The primary outcome was the proportion of students with a passing score (≥9 of 18 questions answered correctly).

RESULTS

Eighty schools consented and were randomly allocated. A total of 2477 students in the 40 intervention schools and 2376 students in the 40 control schools participated in this trial. In the intervention schools, 1364 (55%) of students that completed the test had a passing score compared with 586 (25%) of students in the control schools (adjusted difference 33%, 95% CI 26%-39%).

CONCLUSIONS

The IHC secondary school intervention improved students' ability to think critically and make informed choices. Well-designed digital resources may improve access to educational material, even in schools without computers or other information and communication technology (ICT). This could facilitate scaling-up use of the resources and help to address inequities associated with limited ICT access.

Effects of the Informed Health Choices secondary school intervention: A prospective meta-analysis

AIM

The aim of this prospective meta-analysis was to synthesize the results of three cluster-randomized trials of an intervention designed to teach lower-secondary school students (age 14-16) to think critically about health choices.

METHODS

We conducted the trials in Kenya, Rwanda, and Uganda. The intervention included a 2- to 3-day teacher training workshop, digital resources, and ten 40-min lessons. The lessons focused on nine key concepts. We did not intervene in control schools. The primary outcome was a passing score on a test (≥9 of 18 multiple-choice questions answered correctly). We performed random effects meta-analyses to estimate the overall adjusted odds ratios. Secondary outcomes included effects of the intervention on teachers.

RESULTS

Altogether, 244 schools (11,344 students) took part in the three trials. The overall adjusted odds ratio was 5.5 (95% CI: 3.0-10.2; p < 0.0001) in favor of the intervention (high certainty evidence). This corresponds to 33% (95% CI: 25-40%) more students in the intervention schools passing the test. Overall, 3397 (58%) of 5846 students in intervention schools had a passing score. The overall adjusted odds ratio for teachers was 13.7(95% CI: 4.6-40.4; p < 0.0001), corresponding to 32% (95% CI: 6%-57%) more teachers in the intervention schools passing the test (moderate certainty evidence). Overall, 118 (97%) of 122 teachers in intervention schools had a passing score.

CONCLUSIONS

The intervention led to a large improvement in the ability of students and teachers to think critically about health choices, but 42% of students in the intervention schools did not achieve a passing score.

Effects of the informed health choices secondary school intervention on the ability of students in Kenya to think critically about health choices: A cluster-randomized trial

AIM

There is an overabundance of claims about the advantages and disadvantages of health interventions. People need to be able to appraise the reliability of these claims. The aim of this two-arm cluster-randomized trial was to evaluate the Informed Health Choices secondary school intervention designed to teach students to assess claims about the effects of health actions and make informed decisions.

METHODS

We conducted the trial among students from 80 secondary schools in five subcounties in Kenya. We used stratified randomization to allocate schools to the intervention or control arm. The intervention included a 2-day teacher training workshop and 10 lessons that addressed nine prioritized key concepts for assessing claims about treatment effects. We did not intervene in the control schools. The primary outcome was the proportion of students with a passing score (≥ 9/18 correct answers) on the Critical Thinking about Health test, which included two multiple-choice questions for each concept.

RESULTS

Between May 11, 2022, and July 8, 2022, we recruited 3362 students and 80 teachers. We allocated 1863 students and 40 teachers to the intervention and 1499 students and 40 teachers to the control arm. In the intervention schools, 1149/1863 (61.7%) of students achieved a passing score compared to 511/1499 (34.1%) in the control schools (odds ratio 3.6 (95% CI 2.5-5.2), p < 0.0001).

CONCLUSIONS

The intervention had a large effect on students' ability to think critically about health interventions. It is possible to integrate the learning of critical thinking about health within Kenya secondary school curriculum.

Strategies for communicating scientific evidence on healthcare to managers and the population: a scoping review

BACKGROUND

Health evidence needs to be communicated and disseminated in a manner that is clearly understood by decision-makers. As an inherent component of health knowledge translation, communicating results of scientific studies, effects of interventions and health risk estimates, in addition to understanding key concepts of clinical epidemiology and interpreting evidence, represent a set of essential instruments to reduce the gap between science and practice. The advancement of digital and social media has reshaped the concept of health communication, introducing new, direct and powerful communication platforms and gateways between researchers and the public. The objective of this scoping review was to identify strategies for communicating scientific evidence in healthcare to managers and/or population.

METHODS

We searched Cochrane Library, Embase®, MEDLINE® and other six electronic databases, in addition to grey literature, relevant websites from related organizations for studies, documents or reports published from 2000, addressing any strategy for communicating scientific evidence on healthcare to managers and/or population.

RESULTS

Our search identified 24 598 unique records, of which 80 met the inclusion criteria and addressed 78 strategies. Most strategies focused on risk and benefit communication in health, were presented by textual format and had been implemented and somehow evaluated. Among the strategies evaluated and appearing to yield some benefit are (i) risk/benefit communication: natural frequencies instead of percentages, absolute risk instead relative risk and number needed to treat, numerical instead nominal communication, mortality instead survival; negative or loss content appear to be more effective than positive or gain content; (ii) evidence synthesis: plain languages summaries to communicate the results of Cochrane reviews to the community were perceived as more reliable, easier to find and understand, and better to support decisions than the original summaries; (iii) teaching/learning: the Informed Health Choices resources seem to be effective for improving critical thinking skills.

CONCLUSION

Our findings contribute to both the knowledge translation process by identifying communication strategies with potential for immediate implementation and to future research by recognizing the need to evaluate the clinical and social impact of other strategies to support evidence-informed policies. Trial registration protocol is prospectively available in MedArxiv (doi.org/10.1101/2021.11.04.21265922).

Piloting the informed health choices resources in Barcelona primary schools: A mixed methods study

INTRODUCTION

The main objective of the Informed Health Choices (IHC) project is to teach people to assess treatment claims and make informed health choices. For this purpose, the IHC learning resources were developed for primary school children. The aim of this study is to explore students' and teachers' experience when using the IHC resources in primary schools in Barcelona (Spain).

METHODS

We conducted a mixed methods study for piloting the IHC resources in a convenience sample of primary schools in Barcelona. The intervention included a workshop with teachers, and nine lessons with students. We collected data using multiple approaches. We performed quantitative and qualitative analyses, and integrated the findings in a joint display. Finally, we formulated recommendations for using the IHC resources in this setting.

RESULTS

Two schools, with a total of 143 students in 4th and 5th grade and six teachers, participated in the study. One school followed the suggested IHC teaching plan and competed all the lessons; the other school modified the plan substantially and did not complete all the lessons. Overall, students and teachers from both schools understood, were interested in, and were able to apply the content of the lessons. During the lessons, the textbook was useful for students; nevertheless, for the teachers, the usefulness of the IHC resources was variable. Teachers adapted the IHC resources to increase student participation and used Information and Communications Technologies tools. We observed more facilitators than barriers to teach the lessons. The teachers suggested some ideas to improve the lessons based on activities they developed and implemented. The integration analysis showed great convergence of the quantitative and qualitative findings. We propose seven recommendations for using the IHC resources in this setting.

CONCLUSIONS

Students and teachers from primary schools in Barcelona showed a positive experience when using IHC resources; however, these resources should be adapted to promote classroom participation.

Prioritisation of Informed Health Choices (IHC) key concepts to be included in lower secondary school resources: A consensus study

BACKGROUND

The Informed Health Choices Key Concepts are principles for thinking critically about healthcare claims and deciding what to do. The Key Concepts provide a framework for designing curricula, learning resources, and evaluation tools.

OBJECTIVES

To prioritise which of the 49 Key Concepts to include in resources for lower secondary schools in East Africa.

METHODS

Twelve judges used an iterative process to reach a consensus. The judges were curriculum specialists, teachers, and researchers from Kenya, Uganda, and Rwanda. After familiarising themselves with the concepts, they pilot-tested draft criteria for selecting and ordering the concepts. After agreeing on the criteria, nine judges independently assessed all 49 concepts and reached an initial consensus. We sought feedback on the draft consensus from other stakeholders, including teachers. After considering the feedback, nine judges independently reassessed the prioritised concepts and reached a consensus. The final set of concepts was determined after user-testing prototypes and pilot-testing the resources.

RESULTS

The first panel of judges prioritised 29 concepts. Based on feedback from teachers, students, curriculum specialists, and members of the research team, two concepts were dropped. A second panel of nine judges prioritised 17 of the 27 concepts that emerged from the initial prioritisation and feedback. Based on feedback on prototypes of lessons and pilot-testing a set of 10 lessons, we determined that it was possible to introduce nine concepts in 10 single-period (40-minute) lessons. We included eight of the 17 prioritised concepts and one additional concept.

CONCLUSION

Using an iterative process with explicit criteria, we prioritised nine concepts as a starting point for students to learn to think critically about healthcare claims and choices.

What should the standard be for passing and mastery on the Critical Thinking about Health Test? A consensus study

OBJECTIVE

Most health literacy measures rely on subjective self-assessment. The Critical Thinking about Health Test is an objective measure that includes two multiple-choice questions (MCQs) for each of the nine Informed Health Choices Key Concepts included in the educational resources for secondary schools. The objective of this study was to determine cut-off scores for passing (the border between having and not having a basic understanding and the ability to apply the nine concepts) and mastery (the border between having mastered and not having mastered them).

DESIGN

Using a combination of two widely used methods: Angoff's and Nedelsky's, a panel judged the likelihood that an individual on the border of passing and another on the border of having mastered the concepts would answer each MCQ correctly. The cut-off scores were determined by summing up the probability of answering each MCQ correctly. Their independent assessments were summarised and discussed. A nominal group technique was used to reach a consensus.

SETTING

The study was conducted in secondary schools in East Africa.

PARTICIPANTS

The panel included eight individuals with 5 or more years' experience in the following areas: evaluation of critical thinking interventions, curriculum development, teaching of lower secondary school and evidence-informed decision-making.

RESULTS

The panel agreed that for a passing score, students had to answer 9 of the 18 questions and for a mastery score, 14 out of 18 questions correctly.

CONCLUSION

There was wide variation in the judgements made by individual panel members for many of the questions, but they quickly reached a consensus on the cut-off scores after discussions.

Evaluating student's ability to assess treatment claims: validating a German version of the Claim Evaluation Tools

BACKGROUND

The Claim Evaluation Tools measure the ability to assess claims about treatment effects. The aim of this study was to adapt the German item sets to the target group of secondary school students (aged 11 to 16 years, grade 6 to 10) and to validate them accordingly. The scale's reliability and validity using Rasch's probabilistic test theory should be determined.

METHODS

We conducted a sequential mixed-method study comprising three stages: contextualisation and adaption of the items (stage 1), piloting of the item sets using qualitative interviews (stage 2) and a construct validation by testing the unidimensional Rasch scalability for each item set after data collection in one secondary school in Germany and two secondary schools in Austria. We explored summary and individual fit statistics and performed a distractor analysis (stage 3).

RESULTS

Secondary school students (n = 6) and their teachers (n = 5) participated in qualitative interviews in Germany. The qualitative interviews identified the need for minor modifications (e.g. reducing thematic repetitions, changing the order of the items). The data of 598 German and Austrian secondary school students were included to test for Rasch scalability. Rasch analyses showed acceptable overall model fit. Distractor analyses suggested that model fit could be improved by simplifying the text in the scenarios, removing and editing response options of some items.

CONCLUSION

After the revision of some items, the questionnaires are suitable to evaluate secondary school students' ability to assess health claims. A future goal is to increase the pool of items being translated and tested.

Development of a video-based evidence synthesis knowledge translation resource: Drawing on a user-centred design approach

Objectives

We aimed to develop a video animation knowledge translation (KT) resource to explain the purpose, use and importance of evidence synthesis to the public regarding healthcare decision-making.

Methods

We drew on a user-centred design approach to develop a spoken animated video (SAV) by conducting two cycles of idea generation, prototyping, user testing, analysis, and refinement. Six researchers identified the initial key messages of the SAV and informed the first draft of the storyboard and script. Seven members of the public provided input on this draft and the key messages through think-aloud interviews, which we used to develop an SAV prototype. Seven additional members of the public participated in think-aloud interviews while watching the video prototype. All members of the public also completed a questionnaire on perceived usefulness, desirability, clarity and credibility. We subsequently synthesised all data to develop the final SAV.

Results

Researchers identified the initial key messages as 1) the importance of evidence synthesis, 2) what an evidence synthesis is and 3) how evidence synthesis can impact healthcare decision-making. Members of the public rated the initial video prototype as 9/10 for usefulness, 8/10 for desirability, 8/10 for clarity and 9/10 for credibility. Using their guidance and feedback, we produced a three-and-a-half-minute video animation. The video was uploaded on YouTube, has since been translated into two languages, and viewed over 12,000 times to date.

Conclusions

Drawing on user-centred design methods provided a structured and transparent approach to the development of our SAV. Involving members of the public enhanced the credibility and usefulness of the resource. Future work could explore involving the public from the outset to identify key messages in developing KT resources explaining methodological topics. This study describes the systematic development of a KT resource with limited resources and provides transferrable learnings for others wishing to do similar.

Amplifying consumers as partners in dissemination and implementation science and practice

Background

This Viewpoint argues for consumers (people with lived experience and their families) to be amplified as key partners in dissemination and implementation science and practice.

Method

We contend that consumer opinion and consumer demand can be harnessed to influence practitioners and policymakers.

Results

Amplifying consumers' voices can improve the fit of evidence-based interventions to the intended end user. We offer recommendations of frameworks to engage consumers in the dissemination and implementation of health interventions. We discuss the primary types of evidence consumers may rely upon, including testimonials and lived experience.

Conclusions

Our intention is for this Viewpoint to continue the momentum in dissemination and implementation science and practice of engaging consumers in our work.

Involving Children in Health Literacy Research

Despite the volume and breadth of health literacy research related to children, children's involvement in that research is rare. Research with children is challenging, but the principles of involvement and engagement underpin all health promotion work, including health literacy. This commentary reflects on the process of setting up a Children's Advisory Group to consult on an institutional ethnography study of health literacy work from children's standpoint. The Children's Advisory Group contributed feedback on the study ethics and design and piloted methods for rapport-building and data collection, including livestreamed draw-and-describe and modified Interview to the Double. Consulting with the Children's Advisory Group highlighted the importance of listening to children and recognizing and valuing children's imaginative contributions to methods for involving children in health literacy research. Insights from this commentary can be used to foreground equity-focused approaches to future research and practice with children in the field of health literacy.

Feasibility of contextualizing the Informed Health Choices learning resources in Italy: A pilot study in a primary school in Florence

Background The Informed Health Choices (IHC) project team developed learning resources for primary school children to teach critical thinking about treatments claims and health choices and evaluated their effect in a randomized controlled trial of 120 schools in Uganda. Children taught with these resources showed a better ability to think critically about treatments claims and health choices than children not taught with these resources. Teams in multiple countries are contextualising the IHC resources for use in other languages and settings; in this pilot we describe contextualization for use in Italian primary school.  Methods After translating the IHC resources to Italian and holding an introductory workshop with participating schoolteachers, we piloted the resources with two classes of a primary school in Florence over nine lessons. Our aims were: 1) to assess the feasibility of introducing the IHC curriculum in Italian primary school; 2) to evaluate students' ability to assess health claims and make informed health choices; to explore 3) students' and 4) teachers' experiences with the IHC learning resources; 5) to identify barriers and facilitators to implementation of IHC learning resources in Italian primary school. To assess these objectives, we used qualitative and quantitative methods. Results Both qualitative and quantitative analyses consistently showed that the IHC learning resources had a positive impact on the objectives examined. The resources integrated well into the Italian primary school curriculum. Both students and teachers considered these resources comprehensible, appealing in design and content, and stimulating for the development of a critical attitude. The only barrier teachers and students expressed was using the resources in a remote learning context.  Conclusions Findings from our contextualisation of IHC learning resources in Italian primary school indicate that these resources are well-suited for Italian teachers and students in a primary school context and compatible with the Italian primary school curriculum.

Contextualizing critical thinking about health using digital technology in secondary schools in Kenya: a qualitative analysis

BACKGROUND

Good health decisions depend on one's ability to think critically about health claims and make informed health choices. Young people can learn these skills through school-based interventions, but learning resources need to be low-cost and built around lessons that can fit into existing curricula. As a first step to developing and evaluating digital learning resources that are feasible to use in Kenyan secondary schools, we conducted a context analysis to explore interest in critical thinking for health, map where critical thinking about health best fits in the curriculum, explore conditions for introducing new learning resources, and describe the information and communication technology (ICT) infrastructure available for teaching and learning.

METHODS

We employed a qualitative descriptive approach. We interviewed 15 key informants, carried out two focus group discussions, observed ICT conditions in five secondary schools, reviewed seven documents, and conducted an online catalog of ICT infrastructure in all schools (n=250) in Kisumu County. Participants included national curriculum developers, national ICT officers, teachers, and national examiners. We used a framework analysis approach to analyze data and report findings.

FINDINGS

Although critical thinking is a core competence in the curriculum, critical thinking about health is not currently taught in Kenyan secondary schools. Teachers, health officials, and curriculum developers recognized the importance of teaching critical thinking about health in secondary schools. Stakeholders agreed that Informed Health Choices learning resources could be embedded in nine subjects. The National Institute of Curriculum Development regulates resources for learning; the development of new resources requires collaboration and approval from this body. Most schools do not use ICT for teaching, and for those few that do, the use is limited. Implementation of Kenya's ICT policy framework for schools faces several challenges which include inadequate ICT infrastructure, poor internet connectivity, and teachers' lack of training and experience.

CONCLUSION

Teaching critical thinking about health is possible within the current Kenyan lower secondary school curriculum, but the learning resources will need to be designed for inclusion in and across existing subjects. The National ICT Plan and Vision for 2030 provides an opportunity for scale-up and integration of technology in teaching and learning environments, which can enable future use of digital resources in schools. However, given the current ICT condition in schools in the country, digital learning resources should be designed to function with limited ICT infrastructure, unstable Internet access, and for use by teachers with low levels of experience using digital technology.

Vergleich unterschiedlicher Instrumente zur Messung von Gesundheitskompetenz im Zusammenhang mit Lesekompetenz und kognitiven Fähigkeiten von Jugendlichen

Zusammenfassung. Instrumente zur Messung von Gesundheitskompetenz bei Jugendlichen basieren auf sehr heterogenen Definitionen und Konzepten. Zudem können sie grundsätzlich in subjektive (Selbsteinschätzungs–) und objektive (die Performanz messende) Verfahren unterteilt werden. In der vorliegenden Studie wurden 2 subjektive (eHEALS; Kurzform des HLS-EU-Q16) und ein objektives Messinstrument (Claim) von 471 Jugendlichen der 6. und 7. Klassenstufe (Durchschnittsalter 13.04 Jahre; 49 % Mädchen; 63 % Familiensprache Deutsch) bearbeitet und auf ihren wechselseitigen Zusammenhang, den Zusammenhang mit kognitiven und Lesefähigkeiten, sowie Unterschiede in Bezug auf Geschlecht und Familiensprache untersucht. Das objektive Verfahren korrelierte nicht mit den subjektiven Verfahren. Dies bestätigt die Annahme, dass sie aufgrund der Messperspektive unterschiedliche Indikatorenausprägungen von Gesundheitskompetenz erfassen. Korrelationen mit Lese- und kognitiven Fähigkeiten zeigten sich nur beim objektiven Instrument, wohingegen die Selbsteinschätzungsinstrumente diese Aspekte der Gesundheitskompetenz nicht abbilden. Unterschiede hinsichtlich des Geschlechts und der Familiensprache zeigten sich insbesondere beim objektiven Instrument, allerdings sind Antwortverzerrungen bei Selbsteinschätzungen möglich. Die spezifischen Vor- und Nachteile von subjektiven und objektiven Verfahren sollten bei der Instrumentenauswahl berücksichtigt werden.

Public Libraries as Supportive Environments for Children's Development of Critical Health Literacy

Critical health literacy enables individuals to use cognitive and social resources for informed action on the wider determinants of health. Promoting critical health literacy early in the life-course may contribute to improved health outcomes in the long term, but children's opportunities to develop critical health literacy are limited and tend to be school-based. This study applies a settings-based approach to analyse the potential of public libraries in England to be supportive environments for children's development of critical health literacy. The study adopted institutional ethnography as a framework to explore the public library as an everyday setting for children. A children's advisory group informed the study design. Thirteen children and 19 public library staff and community stakeholders were interviewed. The study results indicated that the public library was not seen by children, staff, or community stakeholders as a setting for health. Its policies and structure purport to develop health literacy, but the political nature of critical health literacy was seen as outside its remit. A supersetting approach in which children's everyday settings work together is proposed and a conceptual model of the public library role is presented.

A Health Equity Implementation Approach to Child Health Literacy Interventions

Health and behavioural inequalities exist in all populations, including children. As a social determinant of health, health literacy is a crucial driver of equitable health outcomes in children. With the increasing calls for more actions on addressing low health literacy and inequalities, health literacy interventions to improve children's healthy behaviours have emerged as a key strategy to reduce health inequities. However, health literacy interventions face implementation challenges impacting upon potential outcomes, and disparities in the implementation of health literacy interventions also occur. Variation exists in child health literacy intervention target groups, timing, content and formats, and there is a lack of implementation specificity, resulting in a lack of clarity about which intervention strategies are the most effective in improving health literacy, related health behaviours, and associated health outcomes. While actions to facilitate child health intervention implementation exist, to minimise further perpetuation of child health inequities, this perspective calls for a health equity implementation approach to child health literacy interventions.

Standardised data on initiatives-STARDIT: Beta version

BACKGROUND AND OBJECTIVE

There is currently no standardised way to share information across disciplines about initiatives, including fields such as health, environment, basic science, manufacturing, media and international development. All problems, including complex global problems such as air pollution and pandemics require reliable data sharing between disciplines in order to respond effectively. Current reporting methods also lack information about the ways in which different people and organisations are involved in initiatives, making it difficult to collate and appraise data about the most effective ways to involve different people. The objective of STARDIT (Standardised Data on Initiatives) is to address current limitations and inconsistencies in sharing data about initiatives. The STARDIT system features standardised data reporting about initiatives, including who has been involved, what tasks they did, and any impacts observed. STARDIT was created to help everyone in the world find and understand information about collective human actions, which are referred to as 'initiatives'. STARDIT enables multiple categories of data to be reported in a standardised way across disciplines, facilitating appraisal of initiatives and aiding synthesis of evidence for the most effective ways for people to be involved in initiatives. This article outlines progress to date on STARDIT; current usage; information about submitting reports; planned next steps and how anyone can become involved.

METHOD

STARDIT development is guided by participatory action research paradigms, and has been co-created with people from multiple disciplines and countries. Co-authors include cancer patients, people affected by rare diseases, health researchers, environmental researchers, economists, librarians and academic publishers. The co-authors also worked with Indigenous peoples from multiple countries and in partnership with an organisation working with Indigenous Australians.

RESULTS AND DISCUSSION

Over 100 people from multiple disciplines and countries have been involved in co-designing STARDIT since 2019. STARDIT is the first open access web-based data-sharing system which standardises the way that information about initiatives is reported across diverse fields and disciplines, including information about which tasks were done by which stakeholders. STARDIT is designed to work with existing data standards. STARDIT data will be released into the public domain (CC0) and integrated into Wikidata; it works across multiple languages and is both human and machine readable. Reports can be updated throughout the lifetime of an initiative, from planning to evaluation, allowing anyone to be involved in reporting impacts and outcomes. STARDIT is the first system that enables sharing of standardised data about initiatives across disciplines. A working Beta version was publicly released in February 2021 (ScienceforAll.World/STARDIT). Subsequently, STARDIT reports have been created for peer-reviewed research in multiple journals and multiple research projects, demonstrating the usability. In addition, organisations including Cochrane and Australian Genomics have created prospective reports outlining planned initiatives.

CONCLUSIONS

STARDIT can help create high-quality standardised information on initiatives trying to solve complex multidisciplinary global problems.

Broad Medical Uncertainty and the ethical obligation for openness

This paper argues that there exists a collective epistemic state of 'Broad Medical Uncertainty' (BMU) regarding the effectiveness of many medical interventions. We outline the features of BMU, and describe some of the main contributing factors. These include flaws in medical research methodologies, bias in publication practices, financial and other conflicts of interest, and features of how evidence is translated into practice. These result in a significant degree of uncertainty regarding the effectiveness of many medical treatments and unduly optimistic beliefs about the benefit/harm profiles of such treatments. We argue for an ethical presumption in favour of openness regarding BMU as part of a 'Corrective Response'. We then consider some objections to this position (the 'Anti-Corrective Response'), including concerns that public honesty about flaws in medical research could undermine trust in healthcare institutions. We suggest that, as it stands, the Anti-Corrective Response is unconvincing.

Learning to think critically about health using digital technology in Ugandan lower secondary schools: A contextual analysis

INTRODUCTION

The world is awash with claims about the effects of health interventions. Many of these claims are untrustworthy because the bases are unreliable. Acting on unreliable claims can lead to waste of resources and poor health outcomes. Yet, most people lack the necessary skills to appraise the reliability of health claims. The Informed Health Choices (IHC) project aims to equip young people in Ugandan lower secondary schools with skills to think critically about health claims and to make good health choices by developing and evaluating digital learning resources. To ensure that we create resources that are suitable for use in Uganda's secondary schools and can be scaled up if found effective, we conducted a context analysis. We aimed to better understand opportunities and barriers related to demand for the resources, how the learning content overlaps with existing curriculum and conditions in secondary schools for accessing and using digital resources, in order to inform resource development.

METHODS

We used a mixed methods approach and collected both qualitative and quantitative data. We conducted document analyses, key informant interviews, focus group discussions, school visits, and a telephone survey regarding information communication and technology (ICT). We used a nominal group technique to obtain consensus on the appropriate number and length of IHC lessons that should be planned in a school term. We developed and used a framework from the objectives to code the transcripts and generated summaries of query reports in Atlas.ti version 7.

FINDINGS

Critical thinking is a key competency in the lower secondary school curriculum. However, the curriculum does not explicitly make provision to teach critical thinking about health, despite a need acknowledged by curriculum developers, teachers and students. Exam oriented teaching and a lack of learning resources are additional important barriers to teaching critical thinking about health. School closures and the subsequent introduction of online learning during the COVID-19 pandemic has accelerated teachers' use of digital equipment and learning resources for teaching. Although the government is committed to improving access to ICT in schools and teachers are open to using ICT, access to digital equipment, unreliable power and internet connections remain important hinderances to use of digital learning resources.

CONCLUSIONS

There is a recognized need for learning resources to teach critical thinking about health in Ugandan lower secondary schools. Digital learning resources should be designed to be usable even in schools with limited access and equipment. Teacher training on use of ICT for teaching is needed.

The READ-IT study protocol for a feasibility randomised controlled trial of using a support worker/family carer mediated online reading programme to teach early reading skills to adults with intellectual disabilities

Background

Many individuals with intellectual disability (ID) have not learnt basic reading skills by the time that they reach adulthood, potentially limiting their access to critical information. READ-IT is an online reading programme developed from the Headsprout® Early Reading (HER®) intervention and supplemented by support strategies tailored for adults with ID. HER® has been successfully used to teach adults with ID to read in a forensic setting by trained staff. The aim of this study is to assess the feasibility of delivering READ-IT to adults with ID by family carers/support workers and will assess whether it would be feasible to conduct a later definitive randomised controlled trial (RCT) of the effectiveness of the programme. The study will aim to contribute to the evidence base on improving outcomes for adults with ID and their caregivers.

Methods

This study is a feasibility RCT, with embedded process evaluation. Forty-eight adults with ID will be recruited and allocated to intervention: control on a 1:1 basis. Intervention families will be offered the READ-IT programme immediately, continuing to receive usual practice and control participants will be offered the opportunity to receive READ-IT at the end of the trial follow-up period and will continue to receive usual practice. Data will be collected at baseline and 6 months post-randomisation.

Discussion

The results of this study will inform a potential future definitive trial, to evaluate the effectiveness of READ-IT to improve reading skills. Such a trial would have significant scientific impact internationally in the intellectual disability field.

Trial registration

ISRCTN11409097

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-022-00972-x.

School-Based Health Literacy Programs for Children (2-16 Years): An International Review

BACKGROUND

Health literacy impacts children's health and educational attainment. Therefore, determining the most appropriate pedagogical design is critical. The long-term health benefits of health literacy for each child's life course further justify this imperative. School-based health literacy programs are of interest internationally.

METHODS

We brainstormed the search terms and established inclusion/exclusion criteria for this systematic review. We searched 2 databases (CINAHL, ERIC) following PRISMA guidelines. Three authors screened and sorted the findings.

RESULTS

We identified 21 relevant studies from 629 retrieved. Few (6/21) studies were situated in the primary school setting.

CONCLUSIONS

This review found a variety of project designs, evaluation methods, and conceptual models. Descriptive analysis of the final 21 papers highlighted the importance of multicomponent design (whole-of-school and curriculum), cross-curricula integration, professional development for teachers, age of children, role of parents, and role of community. The results of this analysis may inform primary school program design in the future. Schools provide a logical setting for health literacy development. Despite the evidence that adolescence is too late, few studies have been situated in primary schools. Teachers lack confidence to teach health and need ongoing professional development. Parent, child, and community voices are essential for sustained engagement and program success.

The Norwegian public's ability to assess treatment claims: results of a cross-sectional study of critical health literacy

Background: Few studies have evaluated the ability of the general public to assess the trustworthiness of claims about the effects of healthcare. For the most part, those studies have used self-reported measures of critical health literacy. Methods: We mailed 4500 invitations to Norwegian adults. Respondents were randomly assigned to one of four online questionnaires that included multiple-choice questions that test understanding of Key Concepts people need to understand to assess healthcare claims. They also included questions about intended behaviours and self-efficacy. One of the four questionnaires was identical to one previously used in two randomised trials of educational interventions in Uganda, facilitating comparisons to Ugandan children, parents, and teachers. We adjusted the results using demographic data to reflect the population. Results: A total of 771 people responded. The adjusted proportion of Norwegian adults who answered correctly was < 50% for 17 of the 30 Key Concepts. On the other hand, less than half answered correctly for 13 concepts. The results for Norwegian adults were better than the results for Ugandan children in the intervention arm of the trial and parents, and similar to those of Ugandan teachers in the intervention arm of the trial. Based on self-report, most Norwegians are likely to find out the basis of treatment claims, but few consider it easy to assess whether claims are based on research and to assess the trustworthiness of research. Conclusions: Norwegian adults do not understand many concepts that are essential for assessing healthcare claims and making informed choices. Future interventions should be tailored to address Key Concepts for which there appears to be a lack of understanding.

Dahaan: a framework for delivering evidence-informed dentistry recommendations and dental public health advocacy in Iran

Although health is mostly determined by socio-political factors, the need for providing reliable health recommendations to the public should not be neglected. There has been a considerable void in delivering evidence-informed oral health recommendations in Iran; whilst there is a significant gap in oral health knowledge among socioeconomic classes, recommendations are neither fully compatible with each other nor up-to-date. To fill in this void, we started Dahaan (meaning "mouth" in Persian) with the aim of providing the latest easily accessed evidence-informed dentistry recommendations and advocating dental public health in the Iranian community. In this paper, we as the authors present the performance and achievements of this group, which is a member of the NCD Alliance and the Informed Health Choices project with a reasonable number of readers across the country, and illustrate the way ahead towards our goals.

Teaching and learning how to make informed health choices: Protocol for a context analysis in Spanish primary schools

Introduction The Informed Health Choices (IHC) project developed learning resources to teach primary school children (10 to 12-year-olds) to assess treatment claims and make informed health choices. The aim of our study is to explore the educational context for teaching and learning critical thinking about health in Spanish primary schools. Methods During the 2020-2021 school year, we will conduct 1) a systematic assessment of educational documents and resources, and 2) semi-structured interviews with key education and health stakeholders. In the systematic assessment of educational documents and resources, we will include state and autonomous communities' curriculums, school educational projects, and commonly used textbooks and other health teaching materials. In the semi-structured interviews, we will involve education and health policy makers, developers of learning resources, developers of health promotion and educational interventions, head teachers, teachers, families, and paediatric primary care providers. We will design and pilot a data extraction form and a semi-structured interview guide to collect the data. We will perform a quantitative and a qualitative analysis of the data to explore how critical thinking about health is being taught and learned in Spanish primary schools. Conclusion We will identify opportunities for and barriers to teaching and learning critical thinking about health in Spanish primary schools. We will formulate recommendations-for both practice and research purposes-on how to use, adapt (if needed), and implement the IHC resources in this context.

Teaching and learning how to make informed health choices: Protocol for a context analysis in Spanish primary schools

Introduction The Informed Health Choices (IHC) project developed learning resources to teach primary school children (10 to 12-year-olds) to assess treatment claims and make informed health choices. The aim of our study is to explore the educational context for teaching and learning critical thinking about health in Spanish primary schools. Methods During the 2020-2021 school year, we will conduct 1) a systematic assessment of educational documents and resources, and 2) semi-structured interviews with key education and health stakeholders. In the systematic assessment of educational documents and resources, we will include state and autonomous communities' curriculums, school educational projects, and commonly used textbooks and other health teaching materials. In the semi-structured interviews, we will involve education and health policy makers, developers of learning resources, developers of health promotion and educational interventions, head teachers, teachers, families, and paediatric primary care providers. We will design and pilot a data extraction form and a semi-structured interview guide to collect the data. We will perform a quantitative and a qualitative analysis of the data to explore how critical thinking about health is being taught and learned in Spanish primary schools. Conclusion We will identify opportunities for and barriers to teaching and learning critical thinking about health in Spanish primary schools. We will formulate recommendations-for both practice and research purposes-on how to use, adapt (if needed), and implement the IHC resources in this context.

Teaching critical thinking about health using digital technology in lower secondary schools in Rwanda: A qualitative context analysis

Introduction

Adolescents encounter misleading claims about health interventions that can affect their health. Young people need to develop critical thinking skills to enable them to verify health claims and make informed choices. Schools could teach these important life skills, but educators need access to suitable learning resources that are aligned with their curriculum. The overall objective of this context analysis was to explore conditions for teaching critical thinking about health interventions using digital technology to lower secondary school students in Rwanda.

Methods

We undertook a qualitative descriptive study using four methods: document review, key informant interviews, focus group discussions, and observations. We reviewed 29 documents related to the national curriculum and ICT conditions in secondary schools. We conducted 8 interviews and 5 focus group discussions with students, teachers, and policy makers. We observed ICT conditions and use in five schools. We analysed the data using a framework analysis approach.

Results

Two major themes found. The first was demand for teaching critical thinking about health. The current curriculum explicitly aims to develop critical thinking competences in students. Critical thinking and health topics are taught across subjects. But understanding and teaching of critical thinking varies among teachers, and critical thinking about health is not being taught. The second theme was the current and expected ICT conditions. Most public schools have computers, projectors, and internet connectivity. However, use of ICT in teaching is limited, due in part to low computer to student ratios.

Conclusions

There is a need for learning resources to develop critical thinking skills generally and critical thinking about health specifically. Such skills could be taught within the existing curriculum using available ICT technologies. Digital resources for teaching critical thinking about health should be designed so that they can be used flexibly across subjects and easily by teachers and students.

Health Literacy and Shared Decision-making: Exploring the Relationship to Enable Meaningful Patient Engagement in Healthcare

Research into health literacy and shared decision-making has largely developed along parallel, but distinct lines over the past two decades. There is little evidence that the concepts and related practice have intersected except in the most functional way, for example, to simplify shared decision-making tools by improving readability scores of decision aids. This paper presents an integrated model to strengthen and sustain patient engagement in health care by drawing on the strengths of both concepts. This includes addressing patients' skills and capacities, alongside modifications to written and verbal information. We propose an expanded model of shared decision-making which incorporates health literacy concepts and promotes two-tiered intervention methods to improve the targeting and personalization of communication and support the development of transferable health literacy skills among patients.

Protocol for assessing stakeholder engagement in the development and evaluation of the Informed Health Choices resources teaching secondary school students to think critically about health claims and choices

BACKGROUND

As part of a five year plan (2019-2023), the Informed Health Choices Project, is developing and evaluating resources for helping secondary school students learn to think critically about health claims and choices. We will bring together key stakeholders; such as secondary school teachers and students, our main target for the IHC secondary school resources, school administrators, policy makers, curriculum development specialists and parents, to enable us gain insight about the context.

OBJECTIVES

To ensure that stakeholders are effectively and appropriately engaged in the design, evaluation and dissemination of the learning resources.To evaluate the extent to which stakeholders were successfully engaged.

METHODS

Using a multi-stage stratified sampling method, we will identify a representative sample of secondary schools with varied characteristics that might modify the effects of the learning resources such as, the school location (rural, semi-urban or urban), ownership (private, public) and ICT facilities (under resourced, highly resourced). A sample of schools will be randomly selected from the schools in each stratum. We will aim to recruit a diverse sample of students and secondary school teachers from those schools. Other stakeholders will be purposively selected to ensure a diverse range of experience and expertise.

RESULTS

Together with the teacher and student networks and the advisory panels, we will establish measurable success criteria that reflect the objectives of engaging stakeholders at the start of the project and evaluate the extent to which those criteria were met at the end of the project.

CONCLUSION

We aim for an increase in research uptake, improve quality and appropriateness of research results, accountability and social justice.

Validation of an Australian parenting health literacy skills instrument: The parenting plus skills index

OBJECTIVE

Existing instruments for assessing health literacy skills in parents have limited scope to inform the design and evaluation of health literacy interventions. In this study we aimed to develop and validate a new performance-based measure of health literacy for Australian parents, the Parenting Plus Skills Index (PPSI). The instrument aimed to assess functional, communicative and critical health literacy skills.

METHODS

The PPSI was developed in three phases: 1) Modified Delphi Expert Panel to provide feedback on 34 initial items; 2) Evaluation of psychometric properties of each item using a multidimensional item response theory model in a sample of Australian adults of parenting age (20-44 years) (N = 500); 3) Assessment of subset of items in an independent sample (N = 500).

RESULTS

Following the three phases, 13 items were included in the final instrument. Participants scored on average 8.9/13 (69 %). The instrument demonstrated acceptable reliability (r = 0.70) and was significantly correlated with other performance-based health literacy instruments.

CONCLUSIONS

The PPSI is a validated 13-item performance-based instrument that assesses health literacy skills for parents in an Australian setting.

PRACTICE IMPLICATIONS

The PPSI fills an important gap in available health literacy instruments that may be useful for facilitating development and evaluation of health literacy interventions.

Comparison of blogshots with plain language summaries of Cochrane systematic reviews: a qualitative study and randomized trial

Background

Cochrane, an organization dedicated to the production and dissemination of high-quality evidence on health, endeavors to reach consumers by developing appropriate summary formats of its systematic reviews. However, the optimal type of presentation of evidence to consumers is still unknown.

Objective

The aim of this study was to investigate consumer preferences for different summary formats of Cochrane systematic reviews (CSRs), using both qualitative and quantitative approaches.

Methods

Initially, we conducted three focus groups with medical students (n = 7), doctors (n = 4), and patients (n = 9) in 2017 to explore their health information search habits and preferences for CSR summary formats. Based on those findings, we conducted a randomized trial with medical students at the University of Split School of Medicine, Croatia, and with patients from three Dalmatian family practices to determine whether they prefer CSR blogshots (n = 115) or CSR plain language summaries (PLSs; n = 123).

Results

Participants in the focus groups favored brief and explicit CSR summary formats with fewer numbers. Although we found no difference in participants’ preferences for a specific summary format in the overall sample, subgroup analysis showed that patients preferred blogshots over PLSs in comparison to medical students (P = 0.003, eta squared effect size η² = 0.04).

Conclusion

CSR summaries should be produced in a format that meets the expectations and needs of consumers. Use of blogshots as a summary format could enhance the dissemination of CSRs among patients.

Trial registration

The trial was registered in ClinicalTrials.gov, NCT03542201. Registered on May 31st 2018.

Development of the informed health choices resources in four countries to teach primary school children to assess claims about treatment effects: a qualitative study employing a user-centred approach

Background

People of all ages are flooded with health claims about treatment effects (benefits and harms of treatments). Many of these are not reliable, and many people lack skills to assess their reliability. Primary school is the ideal time to begin to teach these skills, to lay a foundation for continued learning and enable children to make well-informed health choices, as they grow older. However, these skills are rarely being taught and yet there are no rigorously developed and evaluated resources for teaching these skills.

Objectives

To develop the Informed Health Choices (IHC) resources (for learning and teaching people to assess claims about the effects of treatments) for primary school children and teachers.

Methods

We prototyped, piloted, and user-tested resources in four settings that included Uganda, Kenya, Rwanda, and Norway. We employed a user-centred approach to designing IHC resources which entailed multiple iterative cycles of development (determining content scope, generating ideas, prototyping, testing, analysing and refining) based on continuous close collaboration with teachers and children.

Results

We identified 24 Key Concepts that are important for children to learn. We developed a comic book and a separate exercise book to introduce and explain the Key Concepts to the children, combining lessons with exercises and classroom activities. We developed a teachers' guide to supplement the resources for children.

Conclusion

By employing a user-centred approach to designing resources to teach primary children to think critically about treatment claims and choices, we developed learning resources that end users experienced as useful, easy to use and well-suited to use in diverse classroom settings.

Effects of the Informed Health Choices podcast on the ability of parents of primary school children in Uganda to assess the trustworthiness of claims about treatment effects: one-year follow up of a randomised trial

INTRODUCTION

Earlier, we designed and evaluated an educational mass media intervention for improving people's ability to think more critically and to assess the trustworthiness of claims (assertions) about the benefits and harms (effects) of treatments. The overall aims of this follow-up study were to evaluate the impact of our intervention 1 year after it was administered, and to assess retention of learning and behaviour regarding claims about treatments.

METHODS

We randomly allocated consenting parents to listen to either the Informed Health Choices podcast (intervention) or typical public service announcements about health issues (control) over 7-10 weeks. Each intervention episode explained how the trustworthiness of treatment claims can be assessed by using relevant key concepts of evidence-informed decision-making. Participants listened to two episodes per week, delivered by research assistants. We evaluated outcomes immediately, and a year after the intervention. Primary outcomes were mean score and the proportion with a score indicating a basic ability to apply the key concepts (> 11 out of 18 correct answers) on a tool measuring people's ability to critically appraise the trustworthiness of treatment claims. Skills decay/retention was estimated by calculating the relative difference between the follow-up and initial results in the intervention group, adjusting for chance. Statistical analyses were performed using R (R Core Team, Vienna, Austria; version 3.4.3).

RESULTS

After 1 year, the mean score for parents in the intervention group was 58.9% correct answers, compared to 52.6% in the control (adjusted mean difference of 6.7% (95% CI 3.3% to 10.1%)). In the intervention group, 47.2% of 267 parents had a score indicating a basic ability to assess treatment claims compared to 39.5% of 256 parents in the control (adjusted difference of 9.8% more parents (95% CI 0.9% to 18.9%). These represent relative reductions of 29% in the mean scores and 33% in the proportion of parents with a score indicating a basic ability to assess the trustworthiness of claims about treatment effects.

CONCLUSIONS

Although listening to the Informed Health Choices podcast initially led to a large improvement in the ability of parents to assess claims about the effects of treatments, our findings show that these skills decreased substantially over 1 year. More active practice could address the substantial skills decay observed over 1 year.

TRIAL REGISTRATION

Pan African Clinical Trial Registry (www.pactr.org), PACTR201606001676150. Registered on 12 June 2016.

Effects of the Informed Health Choices primary school intervention on the ability of children in Uganda to assess the reliability of claims about treatment effects, 1-year follow-up: a cluster-randomised trial

INTRODUCTION

We evaluated an intervention designed to teach 10- to 12-year-old primary school children to assess claims about the effects of treatments (any action intended to maintain or improve health). We report outcomes measured 1 year after the intervention.

METHODS

In this cluster-randomised trial, we included primary schools in the central region of Uganda that taught year 5 children (aged 10 to 12 years). We randomly allocated a representative sample of eligible schools to either an intervention or control group. Intervention schools received the Informed Health Choices primary school resources (textbooks, exercise books and a teachers' guide). The primary outcomes, measured at the end of the school term and again after 1 year, were the mean score on a test with two multiple-choice questions for each of the 12 concepts and the proportion of children with passing scores.

RESULTS

We assessed 2960 schools for eligibility; 2029 were eligible, and a random sample of 170 were invited to recruitment meetings. After recruitment meetings, 120 eligible schools consented and were randomly assigned to either the intervention group (n = 60 schools; 76 teachers and 6383 children) or the control group (n = 60 schools; 67 teachers and 4430 children). After 1 year, the mean score in the multiple-choice test for the intervention schools was 68.7% compared with 53.0% for the control schools (adjusted mean difference 16.7%; 95% CI, 13.9 to 19.5; P < 0.00001). In the intervention schools, 3160 (80.1%) of 3943 children who completed the test after 1 year achieved a predetermined passing score (≥ 13 of 24 correct answers) compared with 1464 (51.5%) of 2844 children in the control schools (adjusted difference, 39.5%; 95% CI, 29.9 to 47.5).

CONCLUSION

Use of the learning resources led to a large improvement in the ability of children to assess claims, which was sustained for at least 1 year.

TRIAL REGISTRATION

Pan African Clinical Trial Registry (www.pactr.org), PACTR201606001679337. Registered on 13 June 2016.

Informed Health Choices media intervention for improving people's ability to critically appraise the trustworthiness of claims about treatment effects: a mixed-methods process evaluation of a randomised trial in Uganda

We developed the Informed Health Choices podcast to improve people's ability to assess claims about the effects of treatments. We evaluated the effects of the podcast in a randomised trial.

OBJECTIVES

We conducted this process evaluation to assess the fidelity of the intervention, identify factors that affected the implementation and impact of the intervention and could affect scaling up, and identify potential adverse and beneficial effects.

SETTING

The study was conducted in central Uganda in rural, periurban and urban settings.

PARTICIPANTS

We collected data on parents who were in the intervention arm of the Informed Health Choices study that evaluated an intervention to improve parents' ability to assess treatment effects.

PROCEDURES

We conducted 84 semistructured interviews during the intervention, 19 in-depth interviews shortly after, two focus group discussions with parents, one focus group discussion with research assistants and two in-depth interviews with the principal investigators. We used framework analysis to manage qualitative data, assessed the certainty of the findings using the GRADE-CERQual (Grading of Recommendations, Assessment, Development and Evaluations-Confidence in the Evidence from Reviews of Qualitative Research) approach, and organised findings in a logic model.

OUTCOMES

Proportion of participants listening to all episodes; factors influencing the implementation of the podcast; ways to scale up and any adverse and beneficial effects.

RESULTS

All participants who completed the study listened to the podcast as intended, perhaps because of the explanatory design and recruitment of parents with a positive attitude. This was also likely facilitated by the podcast being delivered by research assistants, and providing the participants with MP3 players. The podcast was reportedly clear, understandable, credible and entertaining, which motivated them to listen and eased implementation. No additional adverse effects were reported.

CONCLUSIONS

Participants experienced the podcast positively and were motivated to engage with it. These findings help to explain the short-term effectiveness of the intervention, but not the decrease in effectiveness over the following year.

Learning to make informed health choices: Protocol for a pilot study in schools in Barcelona

Introduction: The Informed Health Choices (IHC) project has developed learning resources to teach primary school children (10 to 12-year-olds) to assess treatment claims and make informed health choices. The aim of our study is to explore both the students' and teachers' experience when using these resources in the context of Barcelona (Spain). Methods: During the 2019-2020 school year, we will conduct a pilot study with 4 th and 5 th-year primary school students (9 to 11-year-olds) from three schools in Barcelona. The intervention in the schools will include: 1) a workshop with the teachers, and 2) lessons to the students. The data collection will include: 1) initial assessment of the resources by the teachers, 2) non-participatory observations during the lessons, 3) semi-structured interviews with the students after a lesson, 4) assessment of the lessons by the teachers, 5) treatment claim assessment by the students, and 6) final assessment of the resources by the teachers. We will use ad hoc questionnaires and guides to register the data. We will perform a quantitative and qualitative analysis of the data to explore understandability, desirability, suitability, usefulness, facilitators and barriers of the resources. The most relevant results will be discussed and some recommendations on how to use, how to adapt (if needed), and how to implement the IHC resources to this context will be agreed. We will publish the study results in a peer-reviewed journal and in several Internet resources (web pages, electronic bulletins, and social media), and we will present them to the different users of interest in conferences, workshops, and meetings. Ethical considerations: The study protocol has obtained an approval exemption from the Ethics Committee of the Hospital de la Santa Creu i Sant Pau (Barcelona, Spain).

Learning to make informed health choices: Protocol for a pilot study in schools in Barcelona

Introduction: The Informed Health Choices (IHC) project has developed learning resources to teach primary school children (10 to 12-year-olds) to assess treatment claims and make informed health choices. The aim of our study is to explore both the students' and teachers' experience when using these resources in the context of Barcelona (Spain). Methods: During the 2019-2020 school year, we will conduct a pilot study with 4 th and 5 th-year primary school students (9 to 11-year-olds) from three schools in Barcelona. The intervention in the schools will include: 1) assessment of the IHC resources by the teachers before the lessons, 2) non-participatory observations during the lessons, 3) semi-structured interviews with the students after a lesson, 4) assessment of the lessons by the teachers after a lesson, 5) treatment claim assessment by the students at the end of the lessons, and 6) assessment of the IHC resources by the teachers at the end of the lessons. We will use ad hoc questionnaires and guides to register the data. We will perform a quantitative and qualitative analysis of the data to explore understandability, desirability, suitability, usefulness, facilitators and barriers of the resources. The most relevant results will be discussed and some recommendations on how to use, how to adapt (if needed), and how to implement the IHC resources to this context will be agreed. The findings of the contextualization activities could inform the design of a cluster-randomised trial, to determine the effectiveness of the IHC resources in this context prior to scaling-up its use. Ethical considerations: The study protocol has obtained an approval exemption from the Ethics Committee of the Hospital de la Santa Creu i Sant Pau (Barcelona, Spain).

Learning to make informed health choices: Protocol for a pilot study in schools in Barcelona

Introduction: The Informed Health Choices (IHC) project has developed learning resources to teach primary school children (10 to 12-year-olds) to assess treatment claims and make informed health choices. The aim of our study is to explore both the students' and teachers' experience when using these resources in the context of Barcelona (Spain). Methods: During the 2019-2020 school year, we will conduct a pilot study with 4 th and 5 th-year primary school students (9 to 11-year-olds) from three schools in Barcelona. The intervention in the schools will include: 1) a workshop with the teachers, and 2) lessons to the students. The data collection will include: 1) assessment of the IHC resources by the teachers before the lessons, 2) non-participatory observations during the lessons, 3) semi-structured interviews with the students after a lesson, 4) assessment of the lessons by the teachers after a lesson, 5) treatment claim assessment by the students at the end of the lessons, and 6) assessment of the IHC resources by the teachers at the end of the lessons. We will use ad hoc questionnaires and guides to register the data. We will perform a quantitative and qualitative analysis of the data to explore understandability, desirability, suitability, usefulness, facilitators and barriers of the resources. The most relevant results will be discussed and some recommendations on how to use, how to adapt (if needed), and how to implement the IHC resources to this context will be agreed. The findings of the contextualization activities could inform the design of a cluster-randomised trial, to determine the effectiveness of the IHC resources in this context prior to scaling-up its use. Ethical considerations: The study protocol has obtained an approval exemption from the Ethics Committee of the Hospital de la Santa Creu i Sant Pau (Barcelona, Spain).

Reducing research waste by promoting informed responses to invitations to participate in clinical trials

Poor recruitment to, and retention in, clinical trials is a source of research waste that could be reduced by more informed choices about participation. Barriers to effective recruitment and retention can be wide-ranging but relevance of the questions being addressed by trials and the outcomes that they are assessing are key for potential participants. Decisions about trial participation should be informed by general and trial-specific information and by considering broader assessments of 'informedness' and how they impact on both recruitment and retention. We suggest that more informed decisions about trial participation should encourage personally appropriate decisions, increase recruitment and retention, and reduce research waste and increase its value.

Lower secondary school students' scientific literacy and their proficiency in identifying and appraising health claims in news media: a secondary analysis using large-scale survey data

OBJECTIVES

Scientific literacy is assumed necessary for appraising the reliability of health claims. Using a national science achievement test, we explored whether students located at the lower quartile on the latent trait (scientific literacy) scale were likely to identify a health claim in a fictitious brief news report, and whether students located at or above the upper quartile were likely to additionally request information relevant for appraising that claim.

DESIGN

Secondary analysis of cross-sectional survey data.

SETTING AND PARTICIPANTS

2229 Norwegian 10th grade students (50% females) from 97 randomly sampled lower secondary schools who performed the test during April-May 2013.

OUTCOME MEASURES

Using Rasch modelling, we linked item difficulty and student proficiency in science to locate the proficiencies associated with different percentiles on the latent trait scale. Estimates of students' proficiency, the difficulty of identifying the claim and the difficulty of making at least one request for information to appraise that claim, were reported in logits.

RESULTS

Students who reached the lower quartile (located at -0.5 logits) on the scale were not likely to identify the health claim as their proficiency was below the difficulty estimate of that task (0.0 logits). Students who reached the upper quartile (located at 1.4 logits) were likely to identify the health claim but barely proficient at making one request for information (task difficulty located at 1.5 logits). Even those who performed at or above the 90th percentile typically made only one request for information, predominantly methodological aspects.

CONCLUSIONS

When interpreting the skill to request relevant information as expressing students' proficiency in critical appraisal of health claims, we found that only students with very high proficiency in science possessed that skill. There is a need for teachers, healthcare professionals and researchers to collaborate to create learning resources for developing these lifelong learning skills.

Informed health choices intervention to teach primary school children in low-income countries to assess claims about treatment effects: process evaluation

BACKGROUND

We developed the informed health choices (IHC) primary school resources to teach children how to assess the trustworthiness of claims about the effects of treatments. We evaluated these resources in a randomised trial in Uganda. This paper describes the process evaluation that we conducted alongside this trial.

OBJECTIVES

To identify factors affecting the implementation, impact and scaling up of the intervention; and potential adverse and beneficial effects of the intervention.

METHODS

All 85 teachers in the 60 schools in the intervention arm of the trial completed a questionnaire after each lesson and at the end of the term. We conducted structured classroom observations at all 60 schools. For interviews and focus groups, we purposively selected six schools. We interviewed district education officers, teachers, head teachers, children and their parents. We used a framework analysis approach to analyse the data.

RESULTS

Most of the participants liked the IHC resources and felt that the content was important. This motivated the teachers and contributed to positive attitudes. Although some teachers started out lacking confidence, many found that the children's enthusiasm for the lessons made them more confident. Nearly everyone interviewed thought that the children learnt something important and many thought that it improved their decision-making. The main barrier to scaling up use of the IHC resources that participants identified was the need to incorporate the lessons into the national curriculum.

CONCLUSION

The mostly positive findings reflect the trial results, which showed large effects on the children's and the teachers' critical appraisal skills. The main limitations of this evaluation are that the investigators were responsible for both developing and evaluating the intervention.