Improving recruitment to a study of telehealth management for COPD: a cluster randomised controlled 'study within a trial' (SWAT) of a multimedia information resource

Describing the content of trial recruitment interventions using the TIDieR reporting checklist: a systematic methodology review

BACKGROUND

Recruiting participants to clinical trials is an ongoing challenge, and relatively little is known about what recruitment strategies lead to better recruitment. Recruitment interventions can be considered complex interventions, often involving multiple components, targeting a variety of groups, and tailoring to different groups. We used the Template for Intervention Description and Replication (TIDieR) reporting checklist (which comprises 12 items recommended for reporting complex interventions) to guide the assessment of how recruitment interventions are described. We aimed to (1) examine to what extent we could identify information about each TIDieR item within recruitment intervention studies, and (2) observe additional detail for each item to describe useful variation among these studies.

METHODS

We identified randomized, nested recruitment intervention studies providing recruitment or willingness to participate rates from two sources: a Cochrane review of trials evaluating strategies to improve recruitment to randomized trials, and the Online Resource for Research in Clinical triAls database. First, we assessed to what extent authors reported information about each TIDieR item. Second, we developed descriptive categorical variables for 7 TIDieR items and extracting relevant quotes for the other 5 items.

RESULTS

We assessed 122 recruitment intervention studies. We were able to extract information relevant to most TIDieR items (e.g., brief rationale, materials, procedure) with the exception of a few items that were only rarely reported (e.g., tailoring, modifications, planned/actual fidelity). The descriptive variables provided a useful overview of study characteristics, with most studies using various forms of informational interventions (55%) delivered at a single time point (90%), often by a member of the research team (59%) in a clinical care setting (41%).

CONCLUSIONS

Our TIDieR-based variables provide a useful description of the core elements of complex trial recruitment interventions. Recruitment intervention studies report core elements of complex interventions variably; some process elements (e.g., mode of delivery, location) are almost always described, while others (e.g., duration, fidelity) are reported infrequently, with little indication of a reason for their absence. Future research should explore whether these TIDieR-based variables can form the basis of an approach to better reporting of elements of successful recruitment interventions.

Do recruitment SWAT interventions have an impact on participant retention in randomised controlled trials? A systematic review

BACKGROUND

Evidence-based methods for randomised controlled trial recruitment and retention are extremely valuable. Despite increased testing of these through studies within a trial, there remains limited high-certainty evidence for effective strategies. In addition, there has been little consideration as to whether recruitment interventions also have an impact on participant retention.

METHODS

A systematic review was conducted. Studies were eligible if they were randomised controlled trials using a recruitment intervention and which also assessed the impact of this on retention at any time point. Searches were conducted through MEDLINE, EMBASE, Cochrane Library, and the Northern Ireland Hub for Trials Methodology Research SWAT Repository. Two independent reviewers screened the search results and extracted data for eligible studies using a piloted extraction form.

RESULTS

A total of 7815 records were identified, resulting in 10 studies being included in the review. Most studies (n = 6, 60%) focussed on the information given to participants (n = 6, 60%), with two (20%) focussing on incentives, and two focussing on trial design and recruiter interventions. Due to intervention heterogeneity, none of the interventions could be meta-analysed. Only one study found any statistically significant effect of letters including a photograph (odds ratio: 5.40, 95% CI 1.12-26.15, p = 0.04).

CONCLUSION

Assessment of the impacts of recruitment strategies, evaluated in a SWAT, on retention of participants in the host trial remains limited. Assessment of the impact of recruitment interventions on retention is recommended to minimise future research costs and waste.

Content, Mechanism, and Outcome of Effective Telehealth Solutions for Management of Chronic Obstructive Pulmonary Diseases: A Narrative Review

Telehealth (TH) solutions for Chronic Obstructive Pulmonary Disease (COPD) are promising behavioral therapeutic interventions and can help individuals living with COPD to improve their health status. The linking content, mechanism, and outcome of TH interventions reported in the literature related to COPD care are unknown. This paper aims to summarize the existing literature about structured TH solutions in COPD care. We conducted an electronic search of the literature related to TH solutions for COPD management up to October 2023. Thirty papers presented TH solutions as an innovative treatment to manage COPD. TH and digital health solutions are used interchangeably in the literature, but both have the potential to improve care, accessibility, and quality of life. To date, current TH solutions in COPD care have a variety of content, mechanisms, and outcomes. TH solutions can enhance education as well as provide remote monitoring. The content of TH solutions can be summarized as symptom management, prompt physical activity, and psychological support. The mechanism of TH solutions is manipulated by factors such as content, mode of delivery, strategy, and intensity. The most common outcome measures with TH solutions were adherence to treatment, health status, and quality of life. Implementing effective TH with a COPD care bundle must consider important determinants such as patient's needs, familiarity with the technology, healthcare professional support, and data privacy. The development of effective TH solutions for COPD management also must consider patient engagement as a positive approach to optimizing implementation and effectiveness.

Can we achieve better trial recruitment by presenting patient information through multimedia? Meta-analysis of 'studies within a trial' (SWATs)

BACKGROUND

People need high-quality information to make decisions about research participation. Providing information in written format alone is conventional but may not be the most effective and acceptable approach. We developed a structure for the presentation of information using multimedia which included generic and trial-specific content. Our aim was to embed 'Studies Within A Trial' (SWATs) across multiple ongoing trials to test whether multimedia presentation of patient information led to better rates of recruitment.

METHODS

Five trials included a SWAT and randomised their participants to receive a multimedia presentation alongside standard information, or standard written information alone. We collected data on trial recruitment, acceptance and retention and analysed the pooled results using random effects meta-analysis, with the primary outcome defined as the proportion of participants randomised following an invitation to take part.

RESULTS

Five SWATs provided data on the primary outcome of proportion of participants randomised. Multimedia alongside written information results in little or no difference in recruitment rates (pooled odds ratio = 0.96, 95% CI: 0.79 to 1.17, p-value = 0.671, I2 = 0%). There was no effect on any other outcomes.

CONCLUSIONS

Multimedia alongside written information did not improve trial recruitment rates.

TRIAL REGISTRATION

ISRCTN71952900, ISRCTN 06710391, ISRCTN 17160087, ISRCTN05926847, ISRCTN62869767.

The effectiveness and acceptability of multimedia information when recruiting children and young people to trials: the TRECA meta-analysis of SWATs

Background

The information provided to potential trial participants plays a crucial role in their decision-making. Printed participant information sheets for trials have received recurrent criticism as being too long and technical, unappealing and hard to navigate. An alternative is to provide information through multimedia (text, animations, video, audio, diagrams and photos). However, there is limited evidence on the effects of multimedia participant information on research recruitment rates, particularly in children and young people.

Objectives

The study objectives were as follows: 1. to develop template multimedia information resources through participatory design, for use when recruiting children and young people to trials 2. to evaluate the multimedia information resources in a series of Studies Within A Trial, to test their effects on recruitment and retention rates, and participant decision-making, by comparing the provision of multimedia information resources instead of printed participant information sheets, and comparing the provision of multimedia information resources in addition to printed participant information sheets.

Design

Two-phase study: 1. multimedia information resources development including qualitative study; user testing study; readability metrics; enhanced patient and public involvement 2. multimedia information resources' evaluation comprising Studies Within A Trial undertaken within host trials recruiting children and young people.

Setting

United Kingdom trials involving patients aged under 18.

Participants

Development phase: n = 120 (children and young people, parents, clinicians, trial personnel). Evaluation phase: n = 1906 (children and young people being asked to take part in trials).

Interventions

Multimedia information resources (comprising text, audio, 'talking heads' video, trial-specific and trial-generic animations). Printed participant information sheets.

Main outcome measures

Primary outcome: trial recruitment rate comparing multimedia information resource-only with printed participant information sheet-only provision. Secondary outcomes: trial recruitment rate comparing combined multimedia information resource and printed participant information sheet with printed participant information sheet-only provision; trial retention rate; quality of participant decision-making. Results for each trial were calculated and combined in a two-stage random-effects meta-analysis.

Results

Phase 1 generated two multimedia information resource templates: (1) for children aged 6-11 years; (2) for children aged 12-18 years and parents. In the Phase 2 Studies Within A Trial the multimedia information resources improved trial recruitment, when compared to printed information alone [odds ratio (OR) = 1.54; 95% confidence interval (CI) 1.05 to 2.28; p = 0.03; I2 = 0%]. When printed participant information sheet-only provision was compared to combined multimedia information resource and printed participant information sheet provision, there was no effect on trial recruitment (OR = 0.89; 95% CI 0.53 to 1.50; I2 = 0%). There were no differences between multimedia information resource and printed participant information sheet on trial retention or participant decision-making quality. In a study within a hypothetical trial setting, multimedia information resource-only provision produced higher ratings of 'information was easy to understand' (Z = 3.03; p = 0.003) and 'I had confidence in decision-making' (Z = 2.00; p = 0.044) than printed participant information sheet-only provision.

Limitations

It was not possible to include data from three Studies Within A Trial in the meta-analysis due to limited sample size, and questionnaire return rates were low, which reduced the strength of the findings.

Conclusions

Use of multimedia information increased the rate of recruitment to trials involving children and young people compared to standard patient information sheets.

Future work

There should be further evaluation of the effects of multimedia information on recruitment to trials involving children and young people. It would be valuable to assess any impacts of multimedia information resources on communication between trial recruiters, children and young people, and parents.

Study registration

This trial is registered as TRECA ISRCTN 73136092 and Northern Ireland Hub for Trials Methodology Research SWAT Repository (SWAT 97).

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: 14/21/21) and is published in full in Health and Social Care Delivery Research; Vol. 11, No. 24. See the NIHR Funding and Awards website for further award information.

Impact of Mobile Apps in Conjunction With Percutaneous Endoscopic Gastrostomy on Patients' Complications, Quality of Life, and Health-Related Self-Care Behaviors: Randomized Clinical Trial

BACKGROUND

Percutaneous endoscopic gastrostomy (PEG) is commonly chosen for long-term enteral nutrition support. However, common complications of PEG include wound infection, leakage, obstruction, bleeding, dislodgement, pneumonia, peritonitis, and more. The anticipation of these complications by both patients and their family caregivers underscores the essential requirement of ongoing technical guidance for the daily care of PEG and the adoption of preventative strategies.

OBJECTIVE

This study aimed to establish and compare a health education program utilizing a tracking system for PEG using a mobile app (PEG app) and instant messaging software versus a paper-based health education program with instant messaging software. Their effectiveness in preventing complications, avoiding hospital readmissions, improving self-care practices, and enhancing quality of life outcomes was assessed.

METHODS

A randomized controlled trial design was used, and the study sample consisted of patients from a medical center in central Taiwan who underwent thoracic surgery or gastroenterology procedures. Inclusion criteria were being a new case undergoing his or her first gastric tube insertion and having the ability to operate a smartphone. Exclusion criteria were cases requiring tube replacement or nasogastric tubes. A total of 74 participants were enrolled, with 37 participants in the experimental group and 37 participants in the control group. Data collection took place from hospitalization until 1 month after discharge. The experimental group received care using the gastric tube tracking system (PEG app) and the Line app that included phone, text, and photo capture capabilities, while the control group received routine nursing care and used the Line app.

RESULTS

The experimental group demonstrated a significant reduction in the occurrence of complications compared with the control group (χ21=12.087, P=.001). Specifically, the occurrence of leakage events was significantly lower in the experimental group than in the control group (χ21=12.906, P=.001). However, the experimental group exhibited superior self-care ability compared with the control group (t72=2.203, P=.03). There was no significant difference in overall quality of life scores between the experimental and control groups (t72=1.603, P=.11). However, the experimental group showed better social aspects of quality of life than the control group (t72=2.164, P=.03).

CONCLUSIONS

Integration of the PEG app with instant messaging can enhance self-care ability, improve social aspects of quality of life, and reduce complications. The study results suggest that the PEG app could be used as an adjunct tool to promote patients' self-directed management of their gastric tube at home, particularly for patients who have undergone their first PEG placement and are being discharged from the hospital.

TRIAL REGISTRATION

Chinese Clinical Trial Registry ChiCTR2300071271; https://tinyurl.com/4vvy584e.

Providing multimedia information to children and young people increases recruitment to trials: pre-planned meta-analysis of SWATs

BACKGROUND

Randomised controlled trials are often beset by problems with poor recruitment and retention. Information to support decisions on trial participation is usually provided as printed participant information sheets (PIS), which are often long, technical, and unappealing. Multimedia information (MMI), including animations and videos, may be a valuable alternative or complement to a PIS. The Trials Engagement in Children and Adolescents (TRECA) study compared MMI to PIS to investigate the effects on participant recruitment, retention, and quality of decision-making.

METHODS

We undertook six SWATs (Study Within A Trial) within a series of host trials recruiting children and young people. Potential participants in the host trials were randomly allocated to receive MMI-only, PIS-only, or combined MMI + PIS. We recorded the rates of recruitment and retention (varying between 6 and 26 weeks post-randomisation) in each host trial. Potential participants approached about each host trial were asked to complete a nine-item Decision-Making Questionnaire (DMQ) to indicate their evaluation of the information and their reasons for participation/non-participation. Odds ratios were calculated and combined in a meta-analysis.

RESULTS

Data from 3/6 SWATs for which it was possible were combined in a meta-analysis (n = 1758). Potential participants allocated to MMI-only were more likely to be recruited to the host trial than those allocated to PIS-only (OR 1.54; 95% CI 1.05, 2.28; p = 0.03). Those allocated to combined MMI + PIS compared to PIS-only were no more likely to be recruited to the host trial (OR = 0.89; 95% CI 0.53, 1.50; p = 0.67). Providing MMI rather than PIS did not impact on DMQ scores. Once children and young people had been recruited to host trials, their trial retention rates did not differ according to intervention allocation.

CONCLUSIONS

Providing MMI-only increased the trial recruitment rate compared to PIS-only but did not affect DMQ scores. Combined MMI + PIS instead of PIS had no effect on recruitment or retention. MMIs are a useful tool for trial recruitment in children and young people, and they could reduce trial recruitment periods.

Electronic informed consent: effects on enrolment, practical and economic benefits, challenges, and drawbacks-a systematic review of studies within randomized controlled trials

BACKGROUND

Enrolment is one of the most challenging aspects of conducting clinical trials, preceded by the process of informed consent (IC). Different strategies to improve recruitment in clinical trials have been used, including electronic IC. During COVID-19 pandemic, barriers to enrolment have been evident. Although digital technologies were acknowledged as the future of clinical research and potential advantages were shown for recruitment, electronic informed consent (e-IC) has not yet been globally adopted. The purpose of this review is to investigate the effect of using e-IC on enrolment, practical and economic benefits, challenges, and drawbacks when compared to traditional informed consent, through a systematic review.

METHODS

Embase, Global Health Library, Medline, and The Cochrane Library databases were searched. No limit was set for publication date, age, sex, or study design. We included all studies within a randomized controlled trial (RCT), published in English, Chinese or Spanish, evaluating the electronic consent process used in the parent RCT. Studies were included if any of the three components ((i) information provision, (ii) participant's comprehension, (iii) signature) of the IC process was designed as electronic, whether administered remotely or face-to-face. The primary outcome was the rate of enrolment to the parent trial. Secondary outcomes were summarized according to the various findings reported on the use of electronic consent.

RESULTS

From a total of 9069 titles, 12 studies were included in the final analysis with a total of 8864 participants. Five studies of high heterogeneity and risk of bias showed mixed results on the efficacy of e-IC on enrolment. Data of included studies suggested e-IC could improve comprehension and recall of study-related information. Meta-analysis could not be conducted due to different study designs and outcome measures and the predominantly qualitative findings.

CONCLUSION

Few published studies have investigated the impact of e-IC on enrolment and findings were mixed. e-IC may improve participant's comprehension and recall of information. High-quality studies are needed to evaluate the potential benefit of e-IC to increase clinical trial enrolment.

TRIAL REGISTRATION

PROSPERO CRD42021231035 . Registration date: 19-Feb-2021.

The effect of personalised versus non-personalised study invitations on recruitment within the ENGAGE feasibility trial: an embedded randomised controlled recruitment trial

BACKGROUND

Recruitment into clinical trials is challenging and there is a lack of evidence on effective recruitment strategies. Personalisation of invitation letters is a potentially pragmatic and feasible way of increasing recruitment rates at a low-cost. However, there is a lack of evidence concerning the effect of personalising of study invitation letters on recruitment rates.

METHODS

We undertook a Study Within A Trial (SWAT) to investigate the effect of personalised versus non-personalised study invitation letters on recruitment rates into the host feasibility trial ENGAGE, a feasibility study of an internet-administered, guided, Low Intensity Cognitive-Behavioural Therapy based self-help intervention for parents of children previously treated for cancer. An intervention group (n = 254) received a personalised study invitation letter and the control group (n = 255) received a non-personalised study invitation letter. The primary outcome was the proportion of participants in the intervention group and the control group enrolled into the ENGAGE host feasibility trial. Secondary outcomes relating to the recruitment and screening process, and retention were examined. Differences in proportions between groups for the primary and secondary outcomes were estimated using logistic regression.

RESULTS

Of the 509 potential participants, 56 (11.0%) were enrolled into the ENGAGE host feasibility trial: personalised: 30/254 (11.8%) and non-personalised: 26/255 (10.2%). No statistically significant effect on personalisation of enrolment was found (OR 1.18, 95% CI 0.68-2.06). No statistically significant differences were found for any secondary outcome.

CONCLUSIONS

Personalisation of study invitations had no effect on recruitment. However, given the small study sample size in the present SWAT, and lack of similar embedded recruitment RCTs to enable a meta-analysis, additional SWATs to examine the personalisation of study invitation letters are warranted.

TRIAL REGISTRATION

ISRCTN57233429 ; ISRCTN18404129 ; SWAT 112, Northern Ireland Hub for Trials Methodology Research SWAT repository (2018 OCT 1 1231) ( https://www.qub.ac.uk/sites/TheNorthernIrelandNetworkforTrialsMethodologyResearch/FileStore/Filetoupload,939618,en.pdf ).

Experiences of trial participants and site staff of participating in and running a large randomised trial within fertility (the endometrial scratch trial): a qualitative interview study

OBJECTIVES

To explore the experiences of endometrial scratch (ES) trial participants and site staff of trial recruitment and participation, in order to improve the experience of participants in future trials.

DESIGN

Qualitative study of a subset of participants in the ES randomised controlled trial and a subset of trial site staff.

SETTING

A purposeful sample of 9 of the 16 UK Fertility Units that participated in the trial.

PARTICIPANTS

A purposeful sample of 27 trial participants and 7 site staff.

RESULTS

Participants were largely happy with the recruitment practices, however, some were overwhelmed with the amount of information received. Interviewees had positive preconceptions regarding the possible effect of the ES on the outcome of their in vitro fertilisation (IVF) cycle, which often originated from their own internet research and seemed to be exacerbated by how site staff described the intervention. Some participants appeared to not understand that receiving the ES could potentially reduce their chances of a successful IVF outcome. Those randomised to the control arm discussed feeling discontent; site staff developed mechanisms of dealing with this.

CONCLUSIONS

A lack of equipoise in both study participants and the recruiting site staff led to trial participants having positive preconceptions of the potential impact of the ES on their upcoming IVF cycle. Trial participants may not have understood the potential harms of participating in a randomised trial. The trial information sheet did not clearly state this; further research should assess how such information should be presented to potential participants, to proportionately present the level of risk, but to not unduly discourage participation. The amount of information fertility patients require about a research study should also be investigated, in order to avoid participants feeling overwhelmed by the amount of information they receive prior to starting IVF.

TRIAL REGISTRATION NUMBER

ISRCTN23800982.

Does a video clip enhance recruitment into a parenting trial? Learnings from a study within a trial

Background

Reaching recruitment targets in randomised controlled trials is a challenge. Media tools are increasingly used to engage participants, yet there is a paucity of research into the use of video to optimise recruitment. We therefore tested whether adding a participant information video clip to a standard participant information sheet improved recruitment into a parenting trial.

Methods

One hundred seven participants were randomised to receive either a participant information sheet (n = 51) or an informational video clip (n = 56) as part of an email contact following a screening phase. All participants went on to receive the information sheet as part of the existing consent procedure.

Results

The video condition did not increase the odds of recruitment into the trial, such that those in the video condition were significantly less likely to participate in the main trial (OR = 0.253, CI = 0.104–0.618, p = 0.003).

Conclusion

The introduction of a video clip into the recruitment stages of a parenting trial did not lead to an improvement in recruitment; however, the small sample size precludes definitive inferences. We offer reflections on challenges encountered in implementing the SWAT and suggestions for other researchers seeking to embed recruitment SWATs into similar trials.

Trial registration

Current controlled trials ISRCTN 58327365. Registered on 19 March 2015.

SWAT registration

SWAT 106; Effects of a video clip on recruitment into a randomised trial. Registered on 20 December 2016.

Study within a trial (SWAT) protocol. Investigating the effect of personalised versus non-personalised study invitations on recruitment: An embedded randomised controlled recruitment trial

Introduction

Recruitment into clinical trials is a common challenge experienced by healthcare researchers. Currently, there is little evidence regarding strategies to improve recruitment into clinical trials. However, preliminary research suggests the personalisation of study invitation letters may increase recruitment rates. As such, there is a need to investigate the effectiveness of personalisation strategies on trial recruitment rates. This study within a trial (SWAT) will investigate the effect of personalised versus non-personalised study invitation letters on recruitment rates into the host trial ENGAGE, a feasibility study of an internet-administered, guided, Cognitive-Behavioural Therapy (CBT) based self-help intervention for parents of children previously treated for cancer.

Methods

An embedded randomised controlled trial (RCT) will investigate the effectiveness of a personalised study invitation letter including the potential participant’s name and address compared with a standard, non-personalised letter without name or address, on participant recruitment rates into the ENGAGE study. The primary outcome is differences in the proportion of participants recruited, examined using logistic regression. Results will be reported as adjusted odds ratios with 95% confidence intervals.

Discussion

Even moderate effects of the personalisation of study invitation letters on recruitment rates could be of significant value by shortening study length, saving resources, and providing a faster answer to the clinical question posed by the study. This protocol can be used as a template for other researchers who wish to contribute to the evidence base for trial decision-making, by embedding a similar SWAT into their trial.

Trial registration

ISRCTN 57233429; ISRCTN 18404129; SWAT 112, Northern Ireland Hub for Trials Methodology Research SWAT repository (2018 OCT 1 1231).