Involving patients and the public In sTatistIcal Analysis pLans (INITIAL): A delphi survey

BACKGROUND

Patient and public involvement (PPI) in trials aims to enhance research by improving its relevance and transparency. Planning for statistical analysis begins at the design stage of a trial within the protocol and is refined and detailed in a Statistical Analysis Plan (SAP). While PPI is common in design and protocol development it is less common within SAPs. This study aimed to reach consensus on the most important and relevant statistical analysis items within an SAP to involve patients and the public.

METHODS

We developed a UK-based, two-round Delphi survey through an iterative consultation with public partners, statisticians, and trialists. The consultation process started with 55 items from international guidance for statistical analysis plans. We aimed to recruit at least 20 participants per key stakeholder group for inclusion in the final analysis of the Delphi survey. Participants were asked to vote on each item using a Likert scale from 1 to 9, where a rating of 1 to 3 was labelled as having 'limited importance'; 4 to 6 as 'important but not critical' and 7 to 9 as 'critical' to involve patients and the public. Results from the second round determined consensus on critical items for PPI.

RESULTS

The consultation exercise led to the inclusion of 15 statistical items in the Delphi survey. We recruited 179 participants, of whom 72% (129: 36 statisticians, 29 patients or public partners, 25 clinical researchers or methodologists, 27 trial managers, and 12 PPI coordinators) completed both rounds. Participants were on average 48 years old, 60% were female, 84% were White, 64% were based in England and 84% had at least five years' experience in trials. Four items reached consensus regarding critical importance for patient and public involvement: presentation of results to trial participants; summary and presentation of harms; interpretation and presentation of findings in an academic setting; factors impacting how well a treatment works. No consensus was reached for the remaining 11 items. In general, the results were consistent across stakeholder groups.

DISCUSSION

We identified four critical items to involve patients and the public in statistical analysis plans. The remaining 11 items did not reach consensus and need to be considered in a case-by-case basis with most responders considering patient and public involvement important (but not critical). Our research provides a platform to enable focused future efforts to improve patient and public involvement in trials and enhance the relevance of statistical analyses to patients and the public.

Cost-effectiveness of Spironolactone for Adult Female Acne (SAFA): economic evaluation alongside a randomised controlled trial

OBJECTIVE

This study aims to estimate the cost-effectiveness of oral spironolactone plus routine topical treatment compared with routine topical treatment alone for persistent acne in adult women from a British NHS perspective over 24 weeks.

DESIGN

Economic evaluation undertaken alongside a pragmatic, parallel, double-blind, randomised trial.

SETTING

Primary and secondary healthcare, community and social media advertising.

PARTICIPANTS

Women ≥18 years with persistent facial acne judged to warrant oral antibiotic treatment.

INTERVENTIONS

Participants were randomised 1:1 to 50 mg/day spironolactone (increasing to 100 mg/day after 6 weeks) or matched placebo until week 24. Participants in both groups could continue topical treatment.

MAIN OUTCOME MEASURES

Cost-utility analysis assessed incremental cost per quality-adjusted life year (QALY) using the EQ-5D-5L. Cost-effectiveness analysis estimated incremental cost per unit change on the Acne-QoL symptom subscale. Adjusted analysis included randomisation stratification variables (centre, baseline severity (investigator's global assessment, IGA <3 vs ≥3)) and baseline variables (Acne-QoL symptom subscale score, resource use costs, EQ-5D score and use of topical treatments).

RESULTS

Spironolactone did not appear cost-effective in the complete case analysis (n=126 spironolactone, n=109 control), compared with no active systemic treatment (adjusted incremental cost per QALY £67 191; unadjusted £34 770). Incremental cost per QALY was £27 879 (adjusted), just below the upper National Institute for Health and Care Excellence's threshold value of £30 000, where multiple imputation took account of missing data. Incremental cost per QALY for other sensitivity analyses varied around the base-case, highlighting the degree of uncertainty. The adjusted incremental cost per point change on the Acne-QoL symptom subscale for spironolactone compared with no active systemic treatment was £38.21 (complete case analysis).

CONCLUSIONS

The results demonstrate a high level of uncertainty, particularly with respect to estimates of incremental QALYs. Compared with no active systemic treatment, spironolactone was estimated to be marginally cost-effective where multiple imputation was performed but was not cost-effective in complete case analysis.

TRIAL REGISTRATION NUMBER

ISRCTN registry (ISRCTN12892056).

Citizen science to improve patient and public involvement in GUideline Implementation in oral health and DEntistry (the GUIDE platform)

BACKGROUND

Citizen science is a way to democratise science by involving groups of citizens in the research process. Clinical guidelines are used to improve practice, but their implementation can be limited. Involving patients and the public can enhance guideline implementation, but there is uncertainty about the best approaches to achieve this. Citizen science is a potential way to involve patients and the public in improving clinical guideline implementation. We aimed to explore the application of citizen science methods to involve patients and the public in the dissemination and implementation of clinical guidelines in oral health and dentistry.

METHODS

We developed GUIDE (GUideline Implementation in oral health and DEntistry), a citizen science online platform, using a participatory approach with researchers, oral health professionals, guideline developers and citizens. Recruitment was conducted exclusively online. The platform focused on prespecified challenges related to oral health assessment guidelines, and asked citizens to generate ideas, as well as vote and comment on other citizens' ideas to improve those challenges. Citizens also shared their views via surveys and two online synchronous group meetings. Data were collected on participant's demographics, platform engagement and experience of taking part. The most promising idea category was identified by an advisory group based on engagement, feasibility and relevance. We presented quantitative data using descriptive statistics and analysed qualitative data using inductive and deductive thematic analysis.

RESULTS

The platform was open for 6 months and we recruited 189 citizens, from which over 90 citizens actively engaged with the platform. Most citizens were over 34 years (64%), female (58%) and had a university degree (50%). They generated 128 ideas, 146 comments and 248 votes. The challenge that led to most engagement was related to prevention and oral health self-care. To take this challenge forward, citizens generated a further 36 ideas to improve a pre-existing National Health Service oral care prevention leaflet. Citizens discussed motivations to take part in the platform (understanding, values, self-care), reasons to stay engaged (communication and feedback, outputs and impact, and relevance of topics discussed) and suggestions to improve future platforms.

CONCLUSION

Citizen science is an effective approach to generate and prioritise ideas from a group of citizens to improve oral health and dental services. Prevention and oral health self-care were of particular interest to citizens. More research is needed to ensure recruitment of a diverse group of citizens and to improve retention in citizen science projects.

PATIENT OR PUBLIC CONTRIBUTION

This project was inherently conducted with the input of public partners (citizen scientists) in all key aspects of its conduct and interpretation. In addition, two public partners were part of the research team and contributed to the design of the project, as well as key decisions related to its conduct, analysis, interpretation and dissemination and are co-authors of this manuscript.

Factors that influence women's enrolment and ongoing participation in a partially decentralised randomised controlled dermatology trial: a qualitative interview study with participants in the SAFA (Spironolactone for Adult Female Acne) trial

BACKGROUND

The use of decentralised clinical trials (which bring trials to patients through remote processes and technology versus central on-site visits) has been thought to be a potential solution to common recruitment and retention barriers. However, there is a lack of evidence to understand the experiences, needs and preferences of the public to inform trial methodologies that appeal to different populations. We report participant experiences of SAFA, a partially decentralised randomised clinical trial, to inform the methodology used in future dermatology trials that aim to appeal to women aged 18 and over.

METHODS

Participants of the SAFA (Spironolactone for Adult Female Acne) trial were invited to take part in a qualitative semi-structured interview to explore their experience and perspectives of taking part in the trial. Questions focused on their experience of using decentralised methods to access and enrol in the trial (e.g. social media advertising), in addition to the decentralised trial visit and data collection methods used throughout. Interviews were conducted remotely, recorded, and transcribed. Data were analysed using reflexive thematic analysis.

RESULTS

Twelve SAFA participants (all women, age range 22-36 years) were interviewed. Initially, participants were influenced to enrol by trusted online information, the feeling of validation the trial provided, and the convenience and flexibility offered by the decentralised methods and research staff made participants feel valued and enabled them to engage in the trial with minimal interference to existing commitments. SAFA participants were generally accepting of trial demands, such as the text-heavy paperwork and on-site visits for blood collection and highlighted several areas relevant for trial conduct going forwards including where decentralised methods may (and may not) be accepted and how trial accessibility and understanding could be improved.

CONCLUSIONS

The study has shown that decentralised methods used by responsive and approachable staff were widely accepted in the SAFA trial. Interviewees found the methods adopted in the SAFA trial helped the trial to fit with their needs and promoted a sense of feeling valued that encouraged ongoing trial engagement. Decentralised methods should be considered favourably when designing a dermatology trial as they can potentially enhance both recruitment and retention.

TRIAL REGISTRATION NUMBER

ISRCTN 12892056. Registered on October 15, 2018.

Exploring views of members of the public and policymakers on the acceptability of population level dietary and active-travel policies: a qualitative study

BACKGROUND

There is limited evidence on what shapes the acceptability of population level dietary and active-travel policies in England. This information would be useful in the decision-making process about which policies should be implemented and how to increase their effectiveness and sustainability. To fill this gap, we explored public and policymakers' views about factors that influence public acceptability of dietary and active-travel policies and how to increase public acceptability for these policies.

METHODS

We conducted online, semi-structured interviews with 20 members of the public and 20 policymakers in England. A purposive sampling frame was used to recruit members of the public via a recruitment agency, based on age, sex, socioeconomic status and ethnicity. Policymakers were recruited from existing contacts within our research collaborations and via snowball sampling. We explored different dietary and active-travel policies that varied in their scope and focus. Interviews were transcribed verbatim and analysed using thematic reflexive analysis with both inductive and deductive coding.

RESULTS

We identified four themes that informed public acceptability of dietary and active-travel policies: (1) perceived policy effectiveness, i.e., policies that included believable mechanisms of action, addressed valued co-benefits and barriers to engage in the behaviour; (2) perceived policy fairness, i.e., policies that provided everyone with an opportunity to benefit (mentioned only by the public), equally considered the needs of various population subgroups and rewarded 'healthy' behaviours rather than only penalising 'unhealthy' behaviours; (3) communication of policies, i.e., policies that were visible and had consistent and positive messages from the media (mentioned only by policymakers) and (4) how to improve policy support, with the main suggestion being an integrated strategy addressing multiple aspects of these behaviours, inclusive policies that consider everyone's needs and use of appropriate channels and messages in policy communication.

CONCLUSIONS

Our findings highlight that members' of the public and policymakers' support for dietary and active-travel policies can be shaped by the perceived effectiveness, fairness and communication of policies and provide suggestions on how to improve policy support. This information can inform the design of acceptable policies but can also be used to help communicate existing and future policies to maximise their adoption and sustainability.

Effectiveness of spironolactone for women with acne vulgaris (SAFA) in England and Wales: pragmatic, multicentre, phase 3, double blind, randomised controlled trial

OBJECTIVE

To assess the effectiveness of oral spironolactone for acne vulgaris in adult women.

DESIGN

Pragmatic, multicentre, phase 3, double blind, randomised controlled trial.

SETTING

Primary and secondary healthcare, and advertising in the community and on social media in England and Wales.

PARTICIPANTS

Women (≥18 years) with facial acne for at least six months, judged to warrant oral antibiotics.

INTERVENTIONS

Participants were randomly assigned (1:1) to either 50 mg/day spironolactone or matched placebo until week six, increasing to 100 mg/day spironolactone or placebo until week 24. Participants could continue using topical treatment.

MAIN OUTCOME MEASURES

Primary outcome was Acne-Specific Quality of Life (Acne-QoL) symptom subscale score at week 12 (range 0-30, where higher scores reflect improved QoL). Secondary outcomes were Acne-QoL at week 24, participant self-assessed improvement; investigator's global assessment (IGA) for treatment success; and adverse reactions.

RESULTS

From 5 June 2019 to 31 August 2021, 1267 women were assessed for eligibility, 410 were randomly assigned to the intervention (n=201) or control group (n=209) and 342 were included in the primary analysis (n=176 in the intervention group and n=166 in the control group). Baseline mean age was 29.2 years (standard deviation 7.2), 28 (7%) of 389 were from ethnicities other than white, with 46% mild, 40% moderate, and 13% severe acne. Mean Acne-QoL symptom scores at baseline were 13.2 (standard deviation 4.9) and at week 12 were 19.2 (6.1) for spironolactone and 12.9 (4.5) and 17.8 (5.6) for placebo (difference favouring spironolactone 1.27 (95% confidence interval 0.07 to 2.46), adjusted for baseline variables). Scores at week 24 were 21.2 (5.9) for spironolactone and 17.4 (5.8) for placebo (difference 3.45 (95% confidence interval 2.16 to 4.75), adjusted). More participants in the spironolactone group reported acne improvement than in the placebo group: no significant difference was reported at week 12 (72% v 68%, odds ratio 1.16 (95% confidence interval 0.70 to 1.91)) but significant difference was noted at week 24 (82% v 63%, 2.72 (1.50 to 4.93)). Treatment success (IGA classified) at week 12 was 31 (19%) of 168 given spironolactone and nine (6%) of 160 given placebo (5.18 (2.18 to 12.28)). Adverse reactions were slightly more common in the spironolactone group with more headaches reported (20% v 12%; p=0.02). No serious adverse reactions were reported.

CONCLUSIONS

Spironolactone improved outcomes compared with placebo, with greater differences at week 24 than week 12. Spironolactone is a useful alternative to oral antibiotics for women with acne.

TRIAL REGISTRATION

ISRCTN12892056.

Then there were seven: a commentary on creating a public involvement strategy group for a policy research unit in behavioural science

The National Institute for Health and Care Research (NIHR) Policy Research Unit in Behavioural Science (PRU-BS) was funded to inform government on the application of behavioural science in health and social care policy. What makes this unit different to other topic specific ones, was the wide range of its brief. Because of this, the PPI group would need to include a wide range of experience and expertise and be prepared to learn. We were a different type of public group for a different type of task. This paper deals with how we approached this. In this paper we outline how the PPI plan in the funding proposal for the PRU-BS was adapted to real world challenges. We describe the stages in the formation of the PPI Strategy Group and how a virtual platform was created to ensure good communication. We discuss our pragmatic approach of developing Terms of Reference and a PPI strategy document. Given the restrictions imposed by the Covid-19 pandemic we explain how we tackled PPI SG member induction sessions, meetings and training sessions. To illustrate how the group operates we provide an example of our involvement in a PRU-BS project. Central to our paper is the lessons we learned. We hope the challenges we met in forming the unique PPI SG, how these were overcome, and our recommendations will help others faced with a similar task.

Supporting care home residents in the last year of life through 'Needs Rounds': Development of a pre-implementation programme theory through a rapid collaborative online approach

Background

Realist evaluation aims to address the knowledge to practice gap by explaining how an intervention is expected to work, as well as what is likely to impact upon the success of its implementation, by developing programme theories that link contexts, mechanisms and outcomes. Co-production approaches to the development of programme theories offer substantial benefits in addressing power relations, including and valuing different types of knowledge, and promoting buy-in from stakeholders while navigating the complex social systems in which innovations are embedded. This paper describes the co-production of an initial programme theory of how an evidence based intervention developed in Australia - called 'Palliative Care Needs Rounds' - might work in England and Scotland to support care home residents approaching their end of life.

Methods

Using realist evaluation and iPARIHS (integrated Promoting Action on Research Implementation in Health Services) we sought to determine how contexts and mechanisms of change might shape implementation outcomes. Pre-intervention online interviews (n = 28) were conducted (February-April 2021), followed by four co-design online workshops with 43 participants (April-June 2021). The online interviews and workshops included a range of stakeholders, including care home staff, specialist palliative care staff, paramedics, general practitioners, and relatives of people living in care homes.

Results

This methodology paper reports developments in realist evaluation and co-production methodologies, and how they were used to develop context, mechanisms, outcomes (CMOs) configurations, and chains of inference. The initial (pre-intervention) programme theory is used to illustrate this process. Two developments to iPARIHS are described. First, involving stakeholders in the collaborative co-design workshops created opportunities to commence facilitation. Second, we describe developing iPARIHS' innovation component, to include novel stakeholder interpretations, perceptions and anticipated use of the intervention as they participated in workshop discussions.

Conclusions

This rapid and robust co-production methodology draws on interactive collaborative research practices (interviews, workshop discussions of data, illustrative vignettes and visual methods). These innovative and engaging methods can be packaged for online processes to develop, describe and interrogate the CMOs in order to co-produce a programme theory. These approaches also commence facilitation and innovation, and can be adopted in other implementation science and realist studies.

Spironolactone for adult female acne (SAFA): protocol for a double-blind, placebo-controlled, phase III randomised study of spironolactone as systemic therapy for acne in adult women

INTRODUCTION

Acne is one of the most common inflammatory skin diseases worldwide and can have significant psychosocial impact and cause permanent scarring. Spironolactone, a potassium-sparing diuretic, has antiandrogenic properties, potentially reducing sebum production and hyperkeratinisation in acne-prone follicles. Dermatologists have prescribed spironolactone for acne in women for over 30 years, but robust clinical study data are lacking. This study seeks to evaluate whether spironolactone is clinically effective and cost-effective in treating acne in women.

METHODS AND ANALYSIS

Women (≥18 years) with persistent facial acne requiring systemic therapy are randomised to receive one tablet per day of 50 mg spironolactone or a matched placebo until week 6, increasing to up to two tablets per day (total of 100 mg spironolactone or matched placebo) until week 24, along with usual topical therapy if desired. Study treatment stops at week 24; participants are informed of their treatment allocation and enter an unblinded observational follow-up period for up to 6 months (up to week 52 after baseline). Primary outcome is the Acne-specific Quality of Life (Acne-QoL) symptom subscale score at week 12. Secondary outcomes include Acne-QoL total and subscales; participant acne self-assessment recorded on a 6-point Likert scale at 6, 12, 24 weeks and up to 52 weeks; Investigator's Global Assessment at weeks 6 and 12; cost and cost effectiveness are assessed over 24 weeks. Aiming to detect a group difference of 2 points on the Acne-QoL symptom subscale (SD 5.8, effect size 0.35), allowing for 20% loss to follow-up, gives a sample size of 398 participants.

ETHICS AND DISSEMINATION

This protocol was approved by Wales Research Ethics Committee (18/WA/0420). Follow-up to be completed in early 2022. Findings will be disseminated to participants, peer-reviewed journals, networks and patient groups, on social media, on the study website and the Southampton Clinical Trials Unit website to maximise impact.

TRIAL REGISTRATION NUMBER

ISRCTN12892056;Pre-results.

Topical preparations for the treatment of mild-to-moderate acne vulgaris: systematic review and network meta-analysis

BACKGROUND

Acne is very common and can have a substantial impact on wellbeing. Guidelines suggest first-line management with topical treatments, but there is little evidence regarding which treatments are most effective.

OBJECTIVES

To identify the most effective and best tolerated topical treatments for acne using network meta-analysis.

METHODS

CENTRAL, MEDLINE, Embase and World Health Organization Trials Registry were searched from inception to June 2020 for randomized trials that included participants with mild/moderate acne. Primary outcomes were self-reported improvement in acne, and trial withdrawal. Secondary outcomes included change in lesion counts, Investigator's Global Assessment, change in quality of life and total number of adverse events. Network meta-analysis was undertaken using a frequentist approach. Risk of bias was assessed using the Cochrane Risk of Bias Tool and confidence in evidence was assessed using CINeMA.

RESULTS

A total of 81 papers were included, reporting 40 trials with a total of 18 089 participants. Patient Global Assessment of Improvement was reported in 11 trials. Based on the pooled network estimates, compared with vehicle, benzoyl peroxide (BPO) was effective (35% vs. 26%) for improving self-reported acne. The combinations of BPO with adapalene (54% vs. 35%) or with clindamycin (49% vs. 35%) were ranked more effective than BPO alone. The withdrawal of participants from the trial was reported in 35 trials. The number of patients withdrawing owing to adverse events was low for all treatments. Rates of withdrawal were slightly higher for BPO with adapalene (2·5%) or clindamycin (2·7%) than BPO (1·6%) or adapalene alone (1·0%). Overall confidence in the evidence was low.

CONCLUSIONS

Adapalene in combination with BPO may be the most effective treatment for acne but with a slightly higher incidence of withdrawal than monotherapy. Inconsistent reporting of trial results precluded firmer conclusions.

Developing the INCLUDE Ethnicity Framework-a tool to help trialists design trials that better reflect the communities they serve

Background

Ensuring that a trial is designed so that its participants reflect those who might benefit from the results, or be spared harms, is key to the potential benefits of the trial reaching all they should. This paper describes the process, facilitated by Trial Forge, that was used between July 2019 and October 2020 to develop the INCLUDE Ethnicity Framework, part of the wider INCLUDE initiative from the National Institute for Health Research to improve inclusion of under-served groups in clinical research studies.

Methods

Development of the Framework was done in seven phases: (1) outline, (2) initial draft, (3) stakeholder meeting, (4) modify draft, (5) Stakeholder feedback, (6) applying the Framework and (7) packaging. Phases 2 and 3 were face-to-face meetings. Consultation with stakeholders was iterative, especially phases 4 to 6. Movement to the next phase was done once all or most stakeholders were comfortable with the results of the current phase. When there was a version of the Framework that could be considered final, the Framework was applied to six trials to create a set of examples (phase 6). Finally, the Framework, guidance and examples were packaged ready for dissemination (phase 7).

Results

A total of 40 people from stakeholder groups including patient and public partners, clinicians, funders, academics working with various ethnic groups, trial managers and methodologists contributed to the seven phases of development. The Framework comprises two parts. The first part is a list of four key questions:

Who should my trial apply to?

Are the groups identified likely to respond in different ways?

Will my study intervention make it harder for some groups to engage?

Will the way I have designed the study make it harder for some groups to engage?

The second part is a set of worksheets to help trial teams address these questions. The Framework can be used for any stage of trial, for a healthcare intervention in any disease area. The Framework was launched on 1st October 2020 and is available open access at the Trial Forge website: https://www.trialforge.org/trial-forge-centre/include/.

Conclusion

Thinking about the number of people in our trials is not enough: we need to start thinking more carefully about who our participants are.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05276-8.

Palliative and end-of-life care in care homes: protocol for codesigning and implementing an appropriate scalable model of Needs Rounds in the UK

INTRODUCTION

Palliative and end-of-life care in care homes is often inadequate, despite high morbidity and mortality. Residents can experience uncontrolled symptoms, poor quality deaths and avoidable hospitalisations. Care home staff can feel unsupported to look after residents at the end of life. Approaches for improving end-of-life care are often education-focused, do not triage residents and rarely integrate clinical care. This study will adapt an evidence-based approach from Australia for the UK context called 'Palliative Care Needs Rounds' (Needs Rounds). Needs Rounds combine triaging, anticipatory person-centred planning, case-based education and case-conferencing; the Australian studies found that Needs Rounds reduce length of stay in hospital, and improve dying in preferred place of care, and symptoms at the end of life.

METHODS AND ANALYSIS

This implementation science study will codesign and implement a scalable UK model of Needs Rounds. The Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework will be used to identify contextual barriers and use facilitation to enable successful implementation. Six palliative care teams, working with 4-6 care homes each, will engage in two phases. In phase 1 (February 2021), stakeholder interviews (n=40) will be used to develop a programme theory to meet the primary outcome of identifying what works, for whom in what circumstances for UK Needs Rounds. Subsequently a workshop to codesign UK Needs Rounds will be run. Phase 2 (July 2021) will implement the UK model for a year. Prospective data collection will focus on secondary outcomes regarding hospitalisations, residents' quality of death and care home staff capability of adopting a palliative approach.

ETHICS AND DISSEMINATION

Frenchay Research Ethics Committee (287447) approved the study. Findings will be disseminated to policy-makers, care home/palliative care practitioners, residents/relatives and academic audiences. An implementation package will be developed for practitioners to provide the tools and resources required to adopt UK Needs Rounds.

REGISTRATION DETAILS

Registration details: ISRCTN15863801.

What are the most important unanswered research questions in trial retention? A James Lind Alliance Priority Setting Partnership: the PRioRiTy II (Prioritising Retention in Randomised Trials) study

BACKGROUND

One of the top three research priorities for the UK clinical trial community is to address the gap in evidence-based approaches to improving participant retention in randomised trials. Despite this, there is little evidence supporting methods to improve retention. This paper reports the PRioRiTy II project, a Priority Setting Partnership (PSP) that identified and prioritised unanswered questions and uncertainties around trial retention in collaboration with key stakeholders.

METHODS

This PSP was conducted in collaboration with the James Lind Alliance, a non-profit making initiative, to support key stakeholders (researchers, patients, and the public) in jointly identifying and agreeing on priority research questions. There were three stages. (1) First an initial online survey was conducted consisting of six open-ended questions about retention in randomised trials. Responses were coded into thematic groups to create a longlist of questions. The longlist of questions was checked against existing evidence to ensure that they had not been answered by existing research. (2) An interim stage involved a further online survey where stakeholders were asked to select questions of key importance from the longlist. (3) A face-to-face consensus meeting was held, where key stakeholder representatives agreed on an ordered list of 21 unanswered research questions for methods of improving retention in randomised trials.

RESULTS

A total of 456 respondents yielded 2431 answers to six open-ended questions, from which 372 questions specifically about retention were identified. Further analysis included thematically grouping all data items within answers and merging questions in consultation with the Steering Group. This produced 27 questions for further rating during the interim survey. The top 21 questions from the interim online survey were brought to a face-to-face consensus meeting in which key stakeholder representatives prioritised the order. The 'Top 10' of these are reported in this paper. The number one ranked question was 'What motivates a participant's decision to complete a clinical trial?' The entire list will be available at www.priorityresearch.ie .

CONCLUSION

The Top 10 list can inform the direction of future research on trial methods and be used by funders to guide projects aiming to address and improve retention in randomised trials.