User testing digital, multimedia information to inform children, adolescents and their parents about healthcare trials

Engaging children, young people, parents and health professionals in interviews: Using an interactive ranking exercise within the co-design of multimedia websites

When planning paediatric trials, it is important to consider how best to communicate with children and young people (CYP) so they understand what they are taking part in. It is also important to consider what information they need. Involving CYP as research participants leads to research that is more relevant although it can be difficult to engage CYP in qualitative research to improve trial materials due to the topic area. This paper describes how a visual ranking exercise within qualitative interviews acted as a helpful conduit to engaging discussions to inform a co-designed website with information for trial participants. 40 people participated in interviews during which the ranking exercise was used (11 CYP aged 9-18 years, 14 parents, 15 professionals). We found the ranking exercise supported participant engagement and prevented them feeling that particular responses were expected. It also enabled participants to discuss their ranking (and decisions behind this) with other participants and the researcher. Co-design interviews with CYP that use interactive exercises such as ranking are likely to elicit richer data than those relying on traditional questioning techniques.

The effectiveness and acceptability of multimedia information when recruiting children and young people to trials: the TRECA meta-analysis of SWATs

Background

The information provided to potential trial participants plays a crucial role in their decision-making. Printed participant information sheets for trials have received recurrent criticism as being too long and technical, unappealing and hard to navigate. An alternative is to provide information through multimedia (text, animations, video, audio, diagrams and photos). However, there is limited evidence on the effects of multimedia participant information on research recruitment rates, particularly in children and young people.

Objectives

The study objectives were as follows: 1. to develop template multimedia information resources through participatory design, for use when recruiting children and young people to trials 2. to evaluate the multimedia information resources in a series of Studies Within A Trial, to test their effects on recruitment and retention rates, and participant decision-making, by comparing the provision of multimedia information resources instead of printed participant information sheets, and comparing the provision of multimedia information resources in addition to printed participant information sheets.

Design

Two-phase study: 1. multimedia information resources development including qualitative study; user testing study; readability metrics; enhanced patient and public involvement 2. multimedia information resources' evaluation comprising Studies Within A Trial undertaken within host trials recruiting children and young people.

Setting

United Kingdom trials involving patients aged under 18.

Participants

Development phase: n = 120 (children and young people, parents, clinicians, trial personnel). Evaluation phase: n = 1906 (children and young people being asked to take part in trials).

Interventions

Multimedia information resources (comprising text, audio, 'talking heads' video, trial-specific and trial-generic animations). Printed participant information sheets.

Main outcome measures

Primary outcome: trial recruitment rate comparing multimedia information resource-only with printed participant information sheet-only provision. Secondary outcomes: trial recruitment rate comparing combined multimedia information resource and printed participant information sheet with printed participant information sheet-only provision; trial retention rate; quality of participant decision-making. Results for each trial were calculated and combined in a two-stage random-effects meta-analysis.

Results

Phase 1 generated two multimedia information resource templates: (1) for children aged 6-11 years; (2) for children aged 12-18 years and parents. In the Phase 2 Studies Within A Trial the multimedia information resources improved trial recruitment, when compared to printed information alone [odds ratio (OR) = 1.54; 95% confidence interval (CI) 1.05 to 2.28; p = 0.03; I2 = 0%]. When printed participant information sheet-only provision was compared to combined multimedia information resource and printed participant information sheet provision, there was no effect on trial recruitment (OR = 0.89; 95% CI 0.53 to 1.50; I2 = 0%). There were no differences between multimedia information resource and printed participant information sheet on trial retention or participant decision-making quality. In a study within a hypothetical trial setting, multimedia information resource-only provision produced higher ratings of 'information was easy to understand' (Z = 3.03; p = 0.003) and 'I had confidence in decision-making' (Z = 2.00; p = 0.044) than printed participant information sheet-only provision.

Limitations

It was not possible to include data from three Studies Within A Trial in the meta-analysis due to limited sample size, and questionnaire return rates were low, which reduced the strength of the findings.

Conclusions

Use of multimedia information increased the rate of recruitment to trials involving children and young people compared to standard patient information sheets.

Future work

There should be further evaluation of the effects of multimedia information on recruitment to trials involving children and young people. It would be valuable to assess any impacts of multimedia information resources on communication between trial recruiters, children and young people, and parents.

Study registration

This trial is registered as TRECA ISRCTN 73136092 and Northern Ireland Hub for Trials Methodology Research SWAT Repository (SWAT 97).

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: 14/21/21) and is published in full in Health and Social Care Delivery Research; Vol. 11, No. 24. See the NIHR Funding and Awards website for further award information.

Providing multimedia information to children and young people increases recruitment to trials: pre-planned meta-analysis of SWATs

BACKGROUND

Randomised controlled trials are often beset by problems with poor recruitment and retention. Information to support decisions on trial participation is usually provided as printed participant information sheets (PIS), which are often long, technical, and unappealing. Multimedia information (MMI), including animations and videos, may be a valuable alternative or complement to a PIS. The Trials Engagement in Children and Adolescents (TRECA) study compared MMI to PIS to investigate the effects on participant recruitment, retention, and quality of decision-making.

METHODS

We undertook six SWATs (Study Within A Trial) within a series of host trials recruiting children and young people. Potential participants in the host trials were randomly allocated to receive MMI-only, PIS-only, or combined MMI + PIS. We recorded the rates of recruitment and retention (varying between 6 and 26 weeks post-randomisation) in each host trial. Potential participants approached about each host trial were asked to complete a nine-item Decision-Making Questionnaire (DMQ) to indicate their evaluation of the information and their reasons for participation/non-participation. Odds ratios were calculated and combined in a meta-analysis.

RESULTS

Data from 3/6 SWATs for which it was possible were combined in a meta-analysis (n = 1758). Potential participants allocated to MMI-only were more likely to be recruited to the host trial than those allocated to PIS-only (OR 1.54; 95% CI 1.05, 2.28; p = 0.03). Those allocated to combined MMI + PIS compared to PIS-only were no more likely to be recruited to the host trial (OR = 0.89; 95% CI 0.53, 1.50; p = 0.67). Providing MMI rather than PIS did not impact on DMQ scores. Once children and young people had been recruited to host trials, their trial retention rates did not differ according to intervention allocation.

CONCLUSIONS

Providing MMI-only increased the trial recruitment rate compared to PIS-only but did not affect DMQ scores. Combined MMI + PIS instead of PIS had no effect on recruitment or retention. MMIs are a useful tool for trial recruitment in children and young people, and they could reduce trial recruitment periods.

Efficacy of DigiKnowItNews: Teen, a multimedia educational website for adolescents about pediatric clinical trials: study protocol for a randomized controlled trial

BACKGROUND

Pediatric research is crucial for the development of new scientific advancements, treatments, and therapies for adolescents. Yet relatively few pediatric clinical trials are conducted due to barriers to successful recruitment and retention, including knowledge and attitudes about clinical trials. Adolescents tend to experience greater autonomy to make decisions and have expressed interest in being part of the decision to participate in clinical trials. Increasing knowledge, positive attitudes, and self-efficacy related to clinical trials could positively impact the decision to participate in a pediatric clinical trial. However, there are currently few interactive, developmentally appropriate, web-based resources available to educate adolescents about clinical trials. DigiKnowItNews: Teen was created as a multimedia educational website to address the relatively low levels of enrollment in pediatric clinical trials and need for information to empower adolescents to make decisions about participating in clinical trials.

METHODS

This is a parallel group randomized controlled superiority trial to test the effectiveness of DigiKnowItNews: Teen, for improving factors related to clinical trial participation among adolescent and parents. Eligible parent-adolescent (ages 12 to 17 years) pairs will be randomly assigned to one of two conditions: intervention or wait-list control. All participants will complete pre- and post-test questionnaires and participants assigned to the intervention will receive access to review the DigiKnowItNews: Teen content for 1 week. Wait-list control participants will have the option to review DigiKnowItNews: Teen after study completion. The primary outcomes are knowledge about clinical research, attitudes, and beliefs toward pediatric clinical trials, self-efficacy for making decisions related to clinical trial participation, willingness to participate in a future clinical trial, procedural fears, and parent-adolescent communication quality. Overall feedback and satisfaction related to DigiKnowItNews: Teen will also be collected.

DISCUSSION

The trial will evaluate the effectiveness of DigiKnowIt News: Teen, an educational website about pediatric clinical trials for adolescents. If found effective in promoting factors related to future pediatric clinical trial participation, DigiKnowIt News: Teen could be used by adolescents, along with their parents, as they make the decision to participate in a clinical trial. Clinical trial researchers can also use DigiKnowIt News: Teen to aid their participant recruitment efforts.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05714943. Registered on 02/03/2023.

Does digital, multimedia information increase recruitment and retention in a children's wrist fracture treatment trial, and what do people think of it? A randomised controlled Study Within A Trial (SWAT)

OBJECTIVES

To evaluate digital, multimedia information (MMI) for its effects on trial recruitment, retention, decisions about participation and acceptability by patients, compared with printed information.

DESIGN

Study Within A Trial using random cluster allocation within the Forearm Fracture Recovery in Children Evaluation (FORCE) study.

SETTING

Emergency departments in 23 UK hospitals.

PARTICIPANTS

1409 children aged 4-16 years attending with a torus (buckle) fracture, and their parents/guardian. Children's mean age was 9.2 years, 41.0% were female, 77.4% were ethnically White and 90.0% spoke English as a first language.

INTERVENTIONS

Participants and their parents/guardian received trial information either via multimedia, including animated videos, talking head videos and text (revised for readability and age appropriateness when needed) on tablet computer (MMI group; n=681), or printed participant information sheet (PIS group; n=728).

OUTCOME MEASURES

Primary outcome was recruitment rate to FORCE. Secondary outcomes were Decision-Making Questionnaire (nine Likert items, analysed summatively and individually), three 'free text' questions (deriving subjective evaluations) and trial retention.

RESULTS

MMI produced a small, not statistically significant increase in recruitment: 475 (69.8%) participants were recruited from the MMI group; 484 (66.5%) from the PIS group (OR=1.35; 95% CI 0.76 to 2.40, p=0.31). A total of 324 (23.0%) questionnaires were returned and analysed. There was no difference in total Decision-Making Questionnaire scores: adjusted mean difference 0.05 (95% CI -1.23 to 1.32, p=0.94). The MMI group was more likely to report the information 'very easy' to understand (89; 57.8% vs 67; 39.4%; Z=2.60, p=0.01) and identify information that was explained well (96; 62.3% vs 71; 41.8%). Almost all FORCE recruits were retained at the 6 weeks' timepoint and there was no difference in retention rate between the information groups: MMI (473; 99.6%); PIS (481; 99.4%).

CONCLUSIONS

MMI did not increase recruitment or retention in the FORCE trial, but participants rated multimedia as easier to understand and were more likely to evaluate it positively.

TRIAL REGISTRATION NUMBER

ISRCTN73136092 and ISRCTN13955395.

DigiKnowIt News: Educating youth about pediatric clinical trials using an interactive, multimedia educational website

Pediatric clinical trials allow for the testing of appropriate and effective treatments for children. However, some challenges exist with recruitment. This study examined the effectiveness of DigiKnowIt News, an interactive, multimedia website (which includes activities, videos, and comic books) designed to educate children about clinical trials. A randomized controlled trial was conducted in 2018 with 91 participants (M age = 10.92 years; SD = 2.06). Participants were randomly assigned to intervention or wait-list control groups and completed questionnaires at pretest and posttest (1 week later) about their knowledge, attitudes, beliefs about clinical trials, and self-efficacy for participating in clinical trials. Participants in the intervention group received access to DigiKnowIt News between pretest and posttest and completed a satisfaction questionnaire at posttest. At the end of the study, participants in the wait-list control group were offered the option to use the website and complete a satisfaction questionnaire. At posttest, participants in the intervention group, compared to participants in the wait-list control group, had more knowledge about clinical trials and more reported confidence for participating in clinical trials. Participants reported high levels of satisfaction with DigiKnowIt News. The findings suggest that an educational website can improve factors related to increasing rates of participation in clinical trials.

What do parents think of using informational videos to support recruitment for parenting trials? A qualitative study

Background

Lower than expected recruitment and retention rates are common challenges in parenting trials—particularly for community-based trials targeting parents of young children that rely on face-to-face recruitment by frontline workers. Recruitment requires parental informed consent, yet information sheets have been criticized for being lengthy and complex, and particularly challenging for parents with low literacy. Recent innovations include ‘talking head’ information videos. This paper aims to explore parent perceptions of using a ‘talking head’ video to support informed consent, recruitment, and retention procedures in parenting trials.

Methods

We conducted semi-structured interviews with a sample of 24 mothers recruited after their final follow-ups in two different parenting trials in Denmark. Before consenting to participate in the trials, parents were invited to view a video of a member of the study team giving information about the study, and again before the interviews for the current study. The audio data was transcribed and thematic analysis was conducted.

Results

We identified three overarching themes: (1) general impression of the video, (2) thoughts on participation in research, and (3) recruitment and retention. Participants were generally positive in their appraisal of the two talking head informational videos. We found that participants felt that a mix of paper-based and video-based sources of information would enable them to make an informed choice about whether to participate in a research study. We also found that a professionally produced video featuring a key member of the study team produced a feeling of commitment to the study that could impact retention rates.

Conclusions

Informational videos are acceptable to parents; however, co-production or participant/patient involvement in the development of such videos is recommended. Informational videos may not increase recruitment but have the potential for improving retention. Key design recommendations are to ensure a ‘professional’ look to the video, to supplement videos with paper-based information, to keep the length to < 3 min, and for the ‘talking head’ part to feature a key member of the study team.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05826-0.

Evaluating the use of multimedia information when recruiting adolescents to orthodontics research: A randomised controlled trial

Objective:

To compare two methods of providing information about the Bone Anchored Maxillary Protraction (BAMP) trial: standard printed information and multimedia websites, for their quality and ease of understanding, and impact on decision-making.

Design:

Randomised controlled trial.

Setting:

Orthodontic outpatient clinic in the UK.

Methods:

Participants were 109 adolescents (aged 11–14 years) attending for orthodontic treatment. While awaiting treatment they were asked to imagine being recruited to the BAMP clinical trial. They were individually randomised to receive the printed or the multimedia website information (comprising text, animations and ‘talking head’ videos). After reading or viewing the information, they completed a 9-item Likert scale Decision-Making Questionnaire (DMQ) (score range 0–36) plus three free-text questions on their evaluation of the information.

Results:

A total of 104 participants completed the questionnaire. Mean total DMQ scores were higher (more positive) in the website group (28.1 vs. 27.0), although the difference was small and not statistically significant (P = 0.20). Analysis of individual questionnaire items showed two statistically significant differences: the website information had higher ratings on ‘easy to understand’ (Z = 3.03; P = 0.003) and ‘confidence in decision-making’ (Z = 2.00; P = 0.044). On the three free-text questions, more positive and fewer negative comments were made about the websites than the printed information.

Conclusion:

In this hypothetical trial setting, adolescent patients found that trial information conveyed on a multimedia website was easier to understand and made them more confident in their decision about trial participation. Their subjective evaluations of the website were also more positive and less negative than about the printed information. Multimedia information has the potential to increase the quality of engagement and information exchange when seeking consent for research.

Does a video clip enhance recruitment into a parenting trial? Learnings from a study within a trial

Background

Reaching recruitment targets in randomised controlled trials is a challenge. Media tools are increasingly used to engage participants, yet there is a paucity of research into the use of video to optimise recruitment. We therefore tested whether adding a participant information video clip to a standard participant information sheet improved recruitment into a parenting trial.

Methods

One hundred seven participants were randomised to receive either a participant information sheet (n = 51) or an informational video clip (n = 56) as part of an email contact following a screening phase. All participants went on to receive the information sheet as part of the existing consent procedure.

Results

The video condition did not increase the odds of recruitment into the trial, such that those in the video condition were significantly less likely to participate in the main trial (OR = 0.253, CI = 0.104–0.618, p = 0.003).

Conclusion

The introduction of a video clip into the recruitment stages of a parenting trial did not lead to an improvement in recruitment; however, the small sample size precludes definitive inferences. We offer reflections on challenges encountered in implementing the SWAT and suggestions for other researchers seeking to embed recruitment SWATs into similar trials.

Trial registration

Current controlled trials ISRCTN 58327365. Registered on 19 March 2015.

SWAT registration

SWAT 106; Effects of a video clip on recruitment into a randomised trial. Registered on 20 December 2016.

Different corticosteroid induction regimens in children and young people with juvenile idiopathic arthritis: the SIRJIA mixed-methods feasibility study

BACKGROUND

In the UK, juvenile idiopathic arthritis is the most common inflammatory disorder in childhood, affecting 10 : 100,000 children and young people aged < 16 years each year, with a population prevalence of around 1 : 1000. Corticosteroids are commonly used to treat juvenile idiopathic arthritis; however, there is currently a lack of consensus as to which corticosteroid induction regimen should be used with various disease subtypes and severities of juvenile idiopathic arthritis.

OBJECTIVE

The main study objective was to determine the feasibility of conducting a randomised controlled trial to compare the different corticosteroid induction regimens in children and young people with juvenile idiopathic arthritis.

DESIGN

This was a mixed-methods study. Work packages included a literature review; qualitative interviews with children and young people with juvenile idiopathic arthritis and their families; a questionnaire survey and screening log to establish current UK practice; a consensus meeting with health-care professionals, children and young people with juvenile idiopathic arthritis, and their families to establish the primary outcome; a feasibility study to pilot data capture and to collect data for future sample size calculations; and a final consensus meeting to establish the final protocol.

SETTING

The setting was rheumatology clinics across the UK.

PARTICIPANTS

Children, young people and their families who attended clinics and health-care professionals took part in this mixed-methods study.

INTERVENTIONS

This study observed methods of prescribing corticosteroids across the UK.

MAIN OUTCOME MEASURES

The main study outcomes were the acceptability of a future trial for children, young people, their families and health-care professionals, and the feasibility of delivering such a trial.

RESULTS

Qualitative interviews identified differences in the views of children, young people and their families on a randomised controlled trial and potential barriers to recruitment. A total of 297 participants were screened from 13 centres in just less than 6 months. In practice, all routes of corticosteroid administration were used, and in all subtypes of juvenile idiopathic arthritis. Intra-articular corticosteroid injection was the most common treatment. The questionnaire surveys showed the varying clinical practice across the UK, but established intra-articular corticosteroids as the treatment control for a future trial. The primary outcome of choice for children, young people, their families and health-care professionals was the Juvenile Arthritis Disease Activity Score, 71-joint count. However, results from the feasibility study showed that, owing to missing blood test data, the clinical Juvenile Arthritis Disease Activity Score should be used. The Juvenile Arthritis Disease Activity Score, 71-joint count, and the clinical Juvenile Arthritis Disease Activity Score are composite disease activity scoring systems for juvenile arthritis. Two final trial protocols were established for a future randomised controlled trial.

LIMITATIONS

Fewer clinics were included in this feasibility study than originally planned, limiting the ability to draw strong conclusions about these units to take part in future research.

CONCLUSIONS

A definitive randomised controlled trial is likely to be feasible based on the findings from this study; however, important recommendations should be taken into account when planning such a trial.

FUTURE WORK

This mixed-methods study has laid down the foundations to develop the evidence base in this area and conducting a randomised control trial to compare different corticosteroid induction regimens in children and young people with juvenile idiopathic arthritis is likely to be feasible.

STUDY REGISTRATION

Current Controlled Trials ISRCTN16649996.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 36. See the NIHR Journals Library website for further project information.

Impact of Videotaped Information on the Experience of Parents of Children with Acute Lymphoblastic Leukemia

Videotaped information has been shown to be effective in reducing parental anxiety and facilitating knowledge transfer in various clinical settings. There is lack of literature on the use of videotaped information during the pediatric oncology initial family disclosure meeting. The purpose of this study was to deliver an informative DVD, highlighting information on childhood acute lymphoblastic leukemia (ALL), to parents of children with newly diagnosed ALL and to assess if the DVD provided increased levels of satisfaction and decreased levels of anxiety in parents around the time of diagnosis. We surveyed 24 parents of children on active treatment for ALL, diagnosed between the ages of 1 and 18 years from 2008 to 2016 at The Hospital for Sick Children, Toronto, Canada. Parents were provided a survey questionnaire assessing levels of satisfaction with information communicated by the healthcare team and anxiety following verbal disclosure and were asked to report satisfaction and anxiety levels immediately following viewing the DVD intervention. Twenty-three/24 (95.8%) parents surveyed reported seeking information from additional resources after disclosure. Of the 24 parents who watched the DVD, 12 (50.0%) watched it once, while 12 (50.0%) watched it twice or more. All parents were satisfied with DVD information, and there was a significant decrease in anxiety after viewing (P = 0.03). All 24 parents felt that the DVD was a useful educational tool. Videotaped information after verbal disclosure is an effective educational resource and is associated with reduced anxiety among parents of children with ALL.

Why do patients take part in research? An overview of systematic reviews of psychosocial barriers and facilitators

BACKGROUND

Understanding why people take part in health research is critical to improve research efficiency and generalisability. The aim of this overview of systematic reviews was to identify psychosocial determinants of research participation and map them to psychological theory and empirical recruitment research, to identify effective strategies to increase research participation.

METHODS

Qualitative and quantitative systematic reviews were systematically identified. No date or language limits were applied. Two reviewers independently selected reviews. Methodological quality was rated using AMSTAR, and poor-quality reviews (scoring 0-3) were excluded. Barriers and facilitators were coded to psychological theory (Theoretical Domains Framework) and empirical recruitment research (recruitment interventions that had been subjected to randomised controlled trial evaluation).

RESULTS

We included 26 systematic reviews (429 unique primary studies), covering a wide range of patient populations and health settings. We identified five groups of facilitators, of which three were dominant (potential for personal benefit, altruism, trust) and appear to be relevant across research setting and design. We identified nine groups of barriers, which were more dependent on the particular study (context, population, design). Two determinants (participant information, social influences) were found to be both barriers and facilitators. Barriers and facilitators could be coded to the Motivation and Opportunity components of the Theoretical Domains Framework; only one was coded to a Capability component. There was some overlap between psychosocial determinants and empirical recruitment research, but some barriers and facilitators had not been tested at all.

CONCLUSIONS

Identifying effective recruitment strategies could increase the efficiency and generalisability of primary research. We identified a number of barriers and facilitators that could be addressed by researchers. There is a need for more research to identify effective recruitment strategies that draw on the psychosocial facilitators and barriers identified in this overview.

SWATted away: the challenging experience of setting up a programme of SWATs in paediatric trials

BACKGROUND

Randomised controlled trials are considered the best method for determining the effectiveness and safety of health interventions. Trials involving children are essential to ensure that treatments are safe and effective. However, many trials, in both adult and paediatric populations, do not achieve recruitment targets and/or maintain retention of participants, which can lead to a reduction in the internal and external validity of the results. Identifying ways of improving trial efficiency are important in order to increase the successful completion of trials.

MAIN BODY

A 'Study Within A Trial' (SWAT) is a self-contained study embedded within an ongoing trial, which aims to establish evidence to improve the management and delivery of trials in healthcare. Increasing numbers of SWATs have been undertaken in recent years yet very few within paediatric trials. Herein, we describe some of the challenges with undertaking a programme of SWATs within paediatric clinical trials in the UK. The TRECA (TRials Engagement in Children and Adolescents) study involves developing multimedia websites for use within paediatric trials to provide recruitment information to children, young people and their families about the clinical trial. Challenges encountered included governance issues such as host trial approval processes and sharing of anonymised data, funding issues for host trials, internet quality and accessibility within the healthcare setting, and ethical concerns associated with SWAT methodology. We believe the ethical concerns are more pronounced in the paediatric setting, perhaps because of the fewer SWATs undertaken in these settings or that a more cautious, risk-averse approach to undertaking research with children is taken.

CONCLUSION

SWATs are becoming increasingly common to provide an evidence base for methods to improve trial efficiency. However, we encountered a number of unanticipated challenges to embedding TRECA that have not been previously reported within the scientific literature. We believe that, if these issues were addressed through wider promotion and explanation of undertaking SWATs involving all key stakeholders, as well as by exploration of alternative funding models for SWATs, this would enable more streamlined, appropriate and timely processes for SWATs and a stronger evidence base for what works to increase trial efficiency.

TRIAL REGISTRATION

The TRECA study is registered on ISRCTN, ID 73136092 . Registered on 24 August 2016.