1
|
Hudek N, Carroll K, Semchishen S, Vanderhout S, Presseau J, Grimshaw J, Fergusson DA, Gillies K, Graham ID, Taljaard M, Brehaut JC. Describing the content of trial recruitment interventions using the TIDieR reporting checklist: a systematic methodology review. BMC Med Res Methodol 2024; 24:85. [PMID: 38589803 PMCID: PMC11000410 DOI: 10.1186/s12874-024-02195-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 03/03/2024] [Indexed: 04/10/2024] Open
Abstract
BACKGROUND Recruiting participants to clinical trials is an ongoing challenge, and relatively little is known about what recruitment strategies lead to better recruitment. Recruitment interventions can be considered complex interventions, often involving multiple components, targeting a variety of groups, and tailoring to different groups. We used the Template for Intervention Description and Replication (TIDieR) reporting checklist (which comprises 12 items recommended for reporting complex interventions) to guide the assessment of how recruitment interventions are described. We aimed to (1) examine to what extent we could identify information about each TIDieR item within recruitment intervention studies, and (2) observe additional detail for each item to describe useful variation among these studies. METHODS We identified randomized, nested recruitment intervention studies providing recruitment or willingness to participate rates from two sources: a Cochrane review of trials evaluating strategies to improve recruitment to randomized trials, and the Online Resource for Research in Clinical triAls database. First, we assessed to what extent authors reported information about each TIDieR item. Second, we developed descriptive categorical variables for 7 TIDieR items and extracting relevant quotes for the other 5 items. RESULTS We assessed 122 recruitment intervention studies. We were able to extract information relevant to most TIDieR items (e.g., brief rationale, materials, procedure) with the exception of a few items that were only rarely reported (e.g., tailoring, modifications, planned/actual fidelity). The descriptive variables provided a useful overview of study characteristics, with most studies using various forms of informational interventions (55%) delivered at a single time point (90%), often by a member of the research team (59%) in a clinical care setting (41%). CONCLUSIONS Our TIDieR-based variables provide a useful description of the core elements of complex trial recruitment interventions. Recruitment intervention studies report core elements of complex interventions variably; some process elements (e.g., mode of delivery, location) are almost always described, while others (e.g., duration, fidelity) are reported infrequently, with little indication of a reason for their absence. Future research should explore whether these TIDieR-based variables can form the basis of an approach to better reporting of elements of successful recruitment interventions.
Collapse
Affiliation(s)
- Natasha Hudek
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Kelly Carroll
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Seana Semchishen
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Shelley Vanderhout
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Justin Presseau
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada
| | - Jeremy Grimshaw
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Dean A Fergusson
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Katie Gillies
- Health Services Research Unit, University of Aberdeen, Foresterhill, Aberdeen, UK
| | - Ian D Graham
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Monica Taljaard
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada
| | - Jamie C Brehaut
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Box 201B, Ottawa, ON, K1H 8L6, Canada.
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada.
| |
Collapse
|
2
|
Arundel CE, Clark L. Do recruitment SWAT interventions have an impact on participant retention in randomised controlled trials? A systematic review. Clin Trials 2024; 21:233-241. [PMID: 37877371 PMCID: PMC11005310 DOI: 10.1177/17407745231206283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2023]
Abstract
BACKGROUND Evidence-based methods for randomised controlled trial recruitment and retention are extremely valuable. Despite increased testing of these through studies within a trial, there remains limited high-certainty evidence for effective strategies. In addition, there has been little consideration as to whether recruitment interventions also have an impact on participant retention. METHODS A systematic review was conducted. Studies were eligible if they were randomised controlled trials using a recruitment intervention and which also assessed the impact of this on retention at any time point. Searches were conducted through MEDLINE, EMBASE, Cochrane Library, and the Northern Ireland Hub for Trials Methodology Research SWAT Repository. Two independent reviewers screened the search results and extracted data for eligible studies using a piloted extraction form. RESULTS A total of 7815 records were identified, resulting in 10 studies being included in the review. Most studies (n = 6, 60%) focussed on the information given to participants (n = 6, 60%), with two (20%) focussing on incentives, and two focussing on trial design and recruiter interventions. Due to intervention heterogeneity, none of the interventions could be meta-analysed. Only one study found any statistically significant effect of letters including a photograph (odds ratio: 5.40, 95% CI 1.12-26.15, p = 0.04). CONCLUSION Assessment of the impacts of recruitment strategies, evaluated in a SWAT, on retention of participants in the host trial remains limited. Assessment of the impact of recruitment interventions on retention is recommended to minimise future research costs and waste.
Collapse
Affiliation(s)
- Catherine E Arundel
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Laura Clark
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| |
Collapse
|
3
|
Barber VS, Calvert C, Appelbe D, Sprange K, Nollett C, Tanner S, Richards DB. Current usage of explainer animations in trials: a survey of the UKCRC registered clinical trial units in the UK. Trials 2024; 25:224. [PMID: 38549126 PMCID: PMC10976673 DOI: 10.1186/s13063-024-08060-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Accepted: 03/15/2024] [Indexed: 04/02/2024] Open
Abstract
BACKGROUND Explainer animations are a means to communicate aspects of clinical trials to participants in a more engaging and accessible way. Delivered well these have the potential to enhance recruitment and retention. The range of media technology used to deliver this material is expanding rapidly but is highly fragmented. Usage of explainer animations across the UK is unknown, the aim of this research was to determine current usage across the 52 registered UK Clinical Research Collaboration (UKCRC) Clinical Trials Units (CTUs) to understand the current landscape and any barriers that could be preventing wider uptake of this functionality. METHODS A survey link was emailed to all UKCRC CTU Directors and Trial Management Leads to ascertain current usage of explainer animations within their CTU. The survey ran between 01 February 2023 and 07 March 2023. RESULTS Responses were received from 35 CTUs-representing a response rate of 67%. 24 CTUs (69%) reported that they had created/used at least one explainer animation within their unit, although the usage, cost, length and production activities varied among the units. CONCLUSIONS The survey showed that a high proportion of the UKCRC CTUs have used explainer animations to provide information to participants about clinical studies. For those not using the technology yet, the most common reasons cited were a lack of expertise, lack of resources and costs to produce them. One of the desired outcomes of this project is the creation of a free-to-use library of animations to encourage wider uptake and avoid duplication.
Collapse
Affiliation(s)
- Vicki S Barber
- Oxford Clinical Trials Research Unit (OCTRU), University of Oxford, Oxford, UK.
| | - Clare Calvert
- Oxford Clinical Trials Research Unit (OCTRU), University of Oxford, Oxford, UK
| | - Duncan Appelbe
- Oxford Clinical Trials Research Unit (OCTRU), University of Oxford, Oxford, UK
| | - Kirsty Sprange
- Nottingham Clinical Trials Unit, University of Nottingham, Nottingham, UK
| | - Claire Nollett
- Centre for Trials Research, Cardiff University, Cardiff, UK
| | - Samantha Tanner
- Oxford Clinical Trials Research Unit (OCTRU), University of Oxford, Oxford, UK
| | - Duncan B Richards
- Oxford Clinical Trials Research Unit (OCTRU), University of Oxford, Oxford, UK
| |
Collapse
|
4
|
Corneli A, Starling S, Choi Y, Vosylius J, Madre L, Mackinnon A, Tenaerts P. Participant comprehension and acceptability of enhanced versus text-only electronic informed consent: an innovative qualitative pilot study. Pilot Feasibility Stud 2024; 10:10. [PMID: 38233932 DOI: 10.1186/s40814-023-01432-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 12/19/2023] [Indexed: 01/19/2024] Open
Abstract
BACKGROUND The use of electronic informed consent (eIC) in decentralized trials offers a pragmatic approach to enrolling participants across multiple geographic areas. METHODS Using a randomized, cross-over study design, we conducted a qualitative descriptive evaluation of two eIC approaches-text-only eIC and enhanced eIC-in a mock hypertension Phase III clinical trial. We assessed participant comprehension and acceptability (usability, satisfaction, and eIC preference). RESULTS A total of 24 individuals with hypertension participated in the study: 12 reviewed the text-only eIC first, followed by the enhanced eIC, and 12 reviewed the enhanced eIC first, followed by the text-only eIC. The study population was diverse in gender, age, race, and geographic location. We found no descriptive differences in participant comprehension and satisfaction between the two eIC approaches. However, more participants preferred the enhanced eIC, and participants indicated that the digital elements were personable and made them feel more informed, engaged, comfortable, and prepared to participate in clinical research. CONCLUSIONS Our findings suggest that enhancing the eIC process with digital elements may have beneficial outcomes among potential participants beyond comprehension and satisfaction.
Collapse
Affiliation(s)
- Amy Corneli
- Department of Population Health Sciences, Duke University School of Medicine, 215 Morris St, Durham, NC, 27701, USA.
- Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, USA.
| | - Summer Starling
- Department of Population Health Sciences, Duke University School of Medicine, 215 Morris St, Durham, NC, 27701, USA
| | - Yujung Choi
- Department of Population Health Sciences, Duke University School of Medicine, 215 Morris St, Durham, NC, 27701, USA
| | | | | | | | | |
Collapse
|
5
|
Arundel C, Mott A. Recruitment and retention interventions in surgical and wound care trials: A systematic review. PLoS One 2023; 18:e0288028. [PMID: 37471398 PMCID: PMC10358880 DOI: 10.1371/journal.pone.0288028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 06/16/2023] [Indexed: 07/22/2023] Open
Abstract
BACKGROUND Recruitment and retention to surgical trials has previously been reported to be problematic, resulting in research waste. Surgery often results in wounds, meaning these trials are likely to have similar populations. There is currently no systematic assessment of effective strategies for these populations and hence, systematic assessment of these was deemed to be of importance. METHODS A systematic review was conducted. Studies were eligible if they were randomised controlled trials undertaken to test an intervention to improve recruitment or retention within a surgical or wound based host randomised controlled trial. MEDLINE, EMBASE, Cochrane Library, ORRCA Database and the Northern Ireland Hub for Trials Methodology Research SWAT Repository Store were searched. Two independent reviewers screened the search results and extracted data for eligible studies using a piloted extraction form. A narrative synthesis was used due to a lack of heterogeneity between strategies which prevented meta-analysis. RESULTS A total of 2133 records were identified which resulted in 13 ultimately being included in the review; seven on recruitment and six on retention. All included studies were based within surgical host trials. Four of the seven recruitment studies focussed on the provision of consent information to participants, one focussed on study set up and one on staff training, with only one relating to consent information finding any significant effect. A range of retention strategies were assessed by the included studies, however only two found (pen vs no pen, mailing strategies) found any significant effect. CONCLUSION The included studies within a trial were all conducted within surgical trials. There was significant variation in strategies used, and limited replications and therefore further assessment may be warranted. Given the lack of studies embedded within wound care trials, further studies in this area are recommended. TRIAL REGISTRATION PROSPERO (CRD42020205475).
Collapse
Affiliation(s)
- Catherine Arundel
- York Trials Unit, Department of Health Sciences, University of York, Heslington, York, United Kingdom
| | - Andrew Mott
- York Trials Unit, Department of Health Sciences, University of York, Heslington, York, United Kingdom
| |
Collapse
|
6
|
López JE, Kyle A, Hosseini AJ, Wilson M, Soares S. Educational video while "waiting-to-be-seen" in a cardiology outpatient clinic promotes opt-in self-consent for biobanking of remnant clinical biospecimens: A randomized-controlled trial. J Clin Transl Sci 2023; 7:e103. [PMID: 37250987 PMCID: PMC10225258 DOI: 10.1017/cts.2023.518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Revised: 03/12/2023] [Accepted: 03/26/2023] [Indexed: 05/31/2023] Open
Abstract
Objectives Consenting donors for remnant clinical biospecimen donation is critical for scaling research biorepositories. Opt-in, low-cost, self-consenting for donations that solely relied on clinical staff and printed materials was recently shown to yield ∼30% consent rate. We hypothesized that adding an educational video to this process would improve consent rates. Methods Randomized patients (by clinic day) in a Cardiology clinic received either printed materials (control) or the same materials plus an educational video on donations (intervention) while waiting to be seen. Engaged patients were surveyed at the clinic checkout for an "opt-in" or "opt-out" response. The decision was documented digitally in the electronic medical record. The primary outcome of this study was the consent rate. Results Thirty-five clinic days were randomized to intervention (18) or control (17). Three hundred and fifty-five patients were engaged, 217 in the intervention and 158 in the control. No significant demographic differences were noted between treatment groups. Following an intention-to-treat analysis, the rate of opt-in for remnant biospecimen donation was 53% for the intervention and 41% for the control group (p-value = 0.03). This represents a 62% increase in the odds of consenting (OR = 1.62, 95% CI = 1.05-2.5). Conclusion This is the first randomized trial showing that an educational video is superior to printed materials alone when patients are self-consenting for remnant biospecimen donation. This result adds to the evidence that efficient and effective consenting processes can be integrated into clinical workflows to advance universal consenting in medical research.
Collapse
Affiliation(s)
| | - Andrew Kyle
- Division of Internal Medicine at UC Davis, CA, USA
| | | | - Machelle Wilson
- Clinical Translational Science Center, University of California Davis Medical Center, Sacramento, CA, USA
| | - Stephanie Soares
- Clinical Translational Science Center, University of California Davis Medical Center, Sacramento, CA, USA
| |
Collapse
|
7
|
A Randomized Controlled Trial of a Multimedia Patient Education Tool for Stress Versus Urgency Urinary Incontinence. Female Pelvic Med Reconstr Surg 2021; 27:403-408. [PMID: 32925421 DOI: 10.1097/spv.0000000000000946] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
OBJECTIVE The aim of this study was to determine whether there was a difference in patient education when comparing traditional conversation-based patient counseling with multimedia-based patient counseling about stress and urgency urinary incontinence. METHODS Patients seeking treatment for urinary incontinence were randomized to traditional, conversation-based counseling from a physician regarding stress and urgency urinary incontinence (control group) or view a video (multimedia) as their counseling (treatment group). A vignette-based assessment of the patient's knowledge of stress and urgency urinary incontinence was administered as a pretest, immediate posttest, and 6- to 8-week delayed posttest. The Incontinence Impact Questionnaire, short form, was used to assess quality of life and was administered at the initial visit and at the 6- to 8-week follow-up call. Patient satisfaction was recorded at the end of the initial visit using a continuous visual analog scale, and health literacy was evaluated using the Rapid Estimate of Adult Literacy in Medicine-Short Form or Short Assessment of Health Literacy-Spanish. RESULTS In the 98 participants, immediate posttest scores trended toward significance between the control and treatment groups (P = 0.086). This trend was lost at the delayed posttest (P = 0.122). Both methods of education showed a significant difference between pretest, immediate posttest, and delayed posttest (P < 0.001). There were no demographic differences between groups. CONCLUSIONS Multimedia-based patient education represents an effective method of providing patient education regarding urinary incontinence because those who received video education showed comparable comprehension of this topic when compared with standard physician counseling. Video education can feasibly be used as an alternative to, or in conjunction with, current patient education practices in a urogynecology setting.
Collapse
|
8
|
Gillies K, Kearney A, Keenan C, Treweek S, Hudson J, Brueton VC, Conway T, Hunter A, Murphy L, Carr PJ, Rait G, Manson P, Aceves-Martins M. Strategies to improve retention in randomised trials. Cochrane Database Syst Rev 2021; 3:MR000032. [PMID: 33675536 PMCID: PMC8092429 DOI: 10.1002/14651858.mr000032.pub3] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
BACKGROUND Poor retention of participants in randomised trials can lead to missing outcome data which can introduce bias and reduce study power, affecting the generalisability, validity and reliability of results. Many strategies are used to improve retention but few have been formally evaluated. OBJECTIVES To quantify the effect of strategies to improve retention of participants in randomised trials and to investigate if the effect varied by trial setting. SEARCH METHODS We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Scopus, PsycINFO, CINAHL, Web of Science Core Collection (SCI-expanded, SSCI, CPSI-S, CPCI-SSH and ESCI) either directly with a specified search strategy or indirectly through the ORRCA database. We also searched the SWAT repository to identify ongoing or recently completed retention trials. We did our most recent searches in January 2020. SELECTION CRITERIA We included eligible randomised or quasi-randomised trials of evaluations of strategies to increase retention that were embedded in 'host' randomised trials from all disease areas and healthcare settings. We excluded studies aiming to increase treatment compliance. DATA COLLECTION AND ANALYSIS We extracted data on: the retention strategy being evaluated; location of study; host trial setting; method of randomisation; numbers and proportions in each intervention and comparator group. We used a risk difference (RD) and 95% confidence interval (CI) to estimate the effectiveness of the strategies to improve retention. We assessed heterogeneity between trials. We applied GRADE to determine the certainty of the evidence within each comparison. MAIN RESULTS We identified 70 eligible papers that reported data from 81 retention trials. We included 69 studies with more than 100,000 participants in the final meta-analyses, of which 67 studies evaluated interventions aimed at trial participants and two evaluated interventions aimed at trial staff involved in retention. All studies were in health care and most aimed to improve postal questionnaire response. Interventions were categorised into broad comparison groups: Data collection; Participants; Sites and site staff; Central study management; and Study design. These intervention groups consisted of 52 comparisons, none of which were supported by high-certainty evidence as determined by GRADE assessment. There were four comparisons presenting moderate-certainty evidence, three supporting retention (self-sampling kits, monetary reward together with reminder or prenotification and giving a pen at recruitment) and one reducing retention (inclusion of a diary with usual follow-up compared to usual follow-up alone). Of the remaining studies, 20 presented GRADE low-certainty evidence and 28 presented very low-certainty evidence. Our findings do provide a priority list for future replication studies, especially with regard to comparisons that currently rely on a single study. AUTHORS' CONCLUSIONS Most of the interventions we identified aimed to improve retention in the form of postal questionnaire response. There were few evaluations of ways to improve participants returning to trial sites for trial follow-up. None of the comparisons are supported by high-certainty evidence. Comparisons in the review where the evidence certainty could be improved with the addition of well-done studies should be the focus for future evaluations.
Collapse
Affiliation(s)
- Katie Gillies
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| | - Anna Kearney
- Dept. of Health Data Science, University of Liverpool, Liverpool, UK
| | - Ciara Keenan
- Campbell UK & Ireland, Centre for Evidence and Social Innovation, Queen's University, Belfast, UK
| | - Shaun Treweek
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| | - Jemma Hudson
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| | - Valerie C Brueton
- Department of Adult Nursing, Florence Nightingale Faculty of Nursing Midwifery and Palliative Care, King's College, London, UK
| | - Thomas Conway
- Clinical Research Facility Galway, National University of Ireland Galway, Galway, Ireland
| | - Andrew Hunter
- School of Nursing and Midwifery, National University of Ireland Galway, Galway, Ireland
| | - Louise Murphy
- School of Nursing and Midwifery, National University of Ireland Galway, Galway, Ireland
| | - Peter J Carr
- School of Nursing and Midwifery, National University of Ireland Galway, Galway, Ireland
| | - Greta Rait
- Research Department of Primary Care and Population Health, University College London, London, UK
| | - Paul Manson
- Health Services Research Unit (HSRU), University of Aberdeen, Aberdeen, UK
| | | |
Collapse
|