1
|
Sherratt FC, Swaby L, Walker K, Jayasuriya R, Campbell L, Mills AJ, Gardner AC, Perry DC, Cole A, Young B. Patient and parent perspectives on being invited to join a trial of night-time only versus full-time bracing for adolescent idiopathic scoliosis : a qualitative study. Bone Jt Open 2025; 6:135-146. [PMID: 39909052 PMCID: PMC11798614 DOI: 10.1302/2633-1462.62.bjo-2024-0078.r1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2025] Open
Abstract
Aims The Bracing Adolescent Idiopathic Scoliosis (BASIS) study is a randomized controlled non-inferiority pragmatic trial of 'full-time bracing' (FTB) compared to 'night-time bracing' (NTB) for the treatment of adolescent idiopathic scoliosis (AIS). We anticipated that recruiting patients to BASIS would be challenging, as it is a paediatric trial comparing two markedly different bracing pathways. No previous studies have compared the experiences of AIS patients treated with FTB to those treated with NTB. This qualitative study was embedded in BASIS to explore families' perspectives of BASIS, to inform trial communication, and to identify strategies to support patients treated in a brace. Methods Semi-structured interviews were conducted with parents (n = 26) and young people (n = 21) who had been invited to participate in BASIS at ten of the 22 UK paediatric spine services in hospitals recruiting to BASIS. Audio-recorded interviews were transcribed and analyzed thematically. Results Families viewed their interactions with BASIS recruiters positively, but were often confused about core aspects of BASIS, such as the aims, expectations of bracing, and the process of randomization. Participants typically expressed a preference for NTB, but recruiters may have framed NTB more favourably. Patients and parents reported challenges wearing a brace, such as physical discomfort, feelings of self-consciousness, difficulty participating in physical activities, and strain on financial resources to support brace use. Patients in FTB reported more pronounced challenges. While families valued health professional support, they felt there was a lack of social, emotional, and school support, and relied on online resources, as well private counselling services to address this need. Conclusion The findings informed the development of resources and strategies, including guidance for schools and the recommendations in this paper, to support patients to wear NTB and FTB as prescribed. The results indicated opportunities for recruiters to enhance trial communication in ways that could improve informed consent and recruitment to BASIS, and inform future trials of bracing.
Collapse
Affiliation(s)
- Frances C. Sherratt
- Department of Public Health, Policy & Systems, University of Liverpool, Liverpool, UK
| | - Lizzie Swaby
- Sheffield Centre for Health and Related Research, The University of Sheffield, Sheffield, UK
| | - Kerry Walker
- Sheffield Centre for Health and Related Research, The University of Sheffield, Sheffield, UK
| | | | | | | | - Adrian C. Gardner
- Royal Orthopaedic Hospital & Birmingham Women’s Children's Hospital, Birmingham, UK
- Aston University, Birmingham, UK
| | - Daniel C. Perry
- School of Medicine, Institute of Life Course and Medical Sciences, University of Liverpool, Liverpool, UK
- Alder Hey Children's Hospital, Liverpool, UK
| | - Ashley Cole
- Sheffield Children’s Hospital, Sheffield, UK
| | - Bridget Young
- Department of Public Health, Policy & Systems, University of Liverpool, Liverpool, UK
| |
Collapse
|
2
|
Farrar N, Elliott D, Jepson M, Young B, Donovan JL, Conefrey C, Realpe AX, Mills N, Wade J, Lim E, Stein RC, Caskey FJ, Rooshenas L. The role of healthcare professionals' communication in trial participation decisions: a qualitative investigation of recruitment consultations and patient interviews across three RCTs. Trials 2024; 25:829. [PMID: 39695876 DOI: 10.1186/s13063-024-08656-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Accepted: 11/25/2024] [Indexed: 12/20/2024] Open
Abstract
BACKGROUND Although the challenges of recruiting to randomised controlled trials (RCTs) are well documented, few studies have focused on the impact that the communication between recruiters and patients has on patients' participation decisions. Recruiters are thought to influence patient decision-making, but the mechanisms by which this occurs are unclear. The aim of this research was to investigate how patients interpret and use the information conveyed to them by healthcare professionals (HCPs) in trial participation decisions. METHODS Three pragmatic UK-based multicentre RCTs were purposively sampled to provide contrasting clinical specialities. Data collection was integrated into each RCT, including audio-recordings of patient recruitment consultations and interviews with patients. Where possible, consultation audio-recordings were linked to interviews to explore how information communicated by recruiters was interpreted and used by patients during their decision-making. Data were analysed thematically, using the constant comparison approach. RESULTS Twenty audio-recorded recruitment consultations were obtained across the 3 RCTs, combined with 42 interviews with patients who had consented to or declined RCT participation. Consultation and interview data were 'linked' for 17 individual patients. Throughout the patient's clinical pathway, HCPs (both those involved in the RCT and not) influenced patients' perceptions of treatment need and benefit by indicating that they preferred a particular treatment option for the patient as an individual. Whilst patients valued and were influenced by information conveyed by HCPs, they also drew on support from other sources and ultimately framed RCT participation decisions as their own. Patients' willingness to be randomised hinged on perceptions of whether they stood to benefit from a particular treatment and the availability of those treatments outside of the trial. CONCLUSION This study supports the need for training and support for healthcare professionals involved throughout the clinical pathway of patients eligible for RCTs, as all healthcare professionals who interact with patients have the potential to influence their perceptions of treatments being compared in the trial. TRIAL REGISTRATION OPTIMA ISRCTN42400492. Prospectively registered on 26 June 2012. Prepare for Kidney Care ISRCTN17133653. Prospectively registered on 31 May 2017. MARS 2 ISRCTN44351742. Retrospectively registered on 5 September 2018.
Collapse
Affiliation(s)
- Nicola Farrar
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK.
| | - Daisy Elliott
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
- NIHR Bristol Biomedical Research Centre, University Hospitals Bristol and Weston NHS Foundation Trust and University of Bristol, Bristol, UK
| | - Marcus Jepson
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Bridget Young
- Department of Public Health, Policy and Systems, Institute of Population Health, University of Liverpool, Liverpool, L69 3GB, UK
| | - Jenny L Donovan
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Carmel Conefrey
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Alba X Realpe
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
- NIHR Bristol Biomedical Research Centre, University Hospitals Bristol and Weston NHS Foundation Trust and University of Bristol, Bristol, UK
| | - Nicola Mills
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Julia Wade
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Eric Lim
- The Royal Brompton and Harefield NHS Foundation Trust, Sydney Street, London, UK
| | - Robert C Stein
- National Institute for Health Research University College London Hospitals Biomedical Research Centre, London, UK
| | - Fergus J Caskey
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Leila Rooshenas
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
- NIHR Bristol Biomedical Research Centre, University Hospitals Bristol and Weston NHS Foundation Trust and University of Bristol, Bristol, UK
| |
Collapse
|
3
|
Shiely F, Murphy E, Gilles K, Hood K, O'Sullivan L, Harman N, Isaacs T, Treweek S. Trial participants' self-reported understanding of randomisation phrases in participation information leaflets can be high, but acceptability of some descriptions is low, especially those linked to gambling and luck. Trials 2024; 25:391. [PMID: 38890748 PMCID: PMC11186130 DOI: 10.1186/s13063-024-08217-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Accepted: 06/03/2024] [Indexed: 06/20/2024] Open
Abstract
BACKGROUND Evidence indicates that trial participants often struggle to understand participant information leaflets (PILs) for clinical trials, including the concept of randomisation. We analysed the language used to describe randomisation in PILs and determine the most understandable and acceptable description through public and participant feedback. METHODS We collected 280 PILs/informed consent forms and one video animation from clinical research facilities/clinical trial units in Ireland and the UK. We extracted text on how randomisation was described, plus trial characteristics. We conducted content analysis to group the randomisation phrases inductively. We then excluded phrases that appeared more than once or were very similar to others. The final list of randomisation phrases was then presented to an online panel of participants and the public. Panel members were asked to rate each phrase on a 5-point Likert scale in terms of their understanding of the phrase, confidence in their understanding and acceptability of the phrase. RESULTS Two hundred and eighty PILs and the transcribed text from one video animation represented 229 ongoing or concluded trials. The pragmatic content analysis generated five inductive categories: (1) explanation of why randomisation is required in trials; (2) synonyms for randomisation; (3) comparative randomisation phrases; (4) elaborative phrases for randomisation (5) and phrases that describe the process of randomisation. We had 48 unique phrases, which were shared with 73 participants and members of the public. Phrases that were well understood were not necessarily acceptable. Participants understood, but disliked, comparative phrases that referenced gambling, e.g. toss of a coin, like a lottery, roll of a die. They also disliked phrases that attributed decision-making to computers or automated systems. Participants liked plain language descriptions of what randomisation is and those that did not use comparative phrases. CONCLUSIONS Potential trial participants are clear on their likes and dislikes when it comes to describing randomisation in PILs. We make five recommendations for practice.
Collapse
Affiliation(s)
- Frances Shiely
- TRAMS (Trials Research and Methodologies Unit), HRB Clinical Research Facility, University College Cork, Cork, Ireland.
- Health Research Board Trial Methodology Research Network (HRB TMRN), University College Cork, Cork, Ireland.
- School of Public Health, University College Cork, Cork, Ireland.
| | - Ellen Murphy
- TRAMS (Trials Research and Methodologies Unit), HRB Clinical Research Facility, University College Cork, Cork, Ireland
- Health Research Board Trial Methodology Research Network (HRB TMRN), University College Cork, Cork, Ireland
- School of Public Health, University College Cork, Cork, Ireland
| | - Katie Gilles
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| | - Kerry Hood
- Centre for Trials Research, Cardiff University, Cardiff, UK
| | - Lydia O'Sullivan
- Health Research Board Trial Methodology Research Network (HRB TMRN), University College Cork, Cork, Ireland
| | - Nicola Harman
- Department of Health Data Science, University of Liverpool, Liverpool, UK
| | - Talia Isaacs
- IOE, Faculty of Education and Society, University College London, London, UK
| | - Shaun Treweek
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| |
Collapse
|
4
|
Popa M, Young B, Rousseau N, Cherry MG, Jenkins I, Cloke J, Pettitt A, Jenkinson MD, Ahmed S, Pemberton AR, Sherratt FC. Consultations about randomised controlled trials are shorter and less in-depth for socioeconomically disadvantaged patients compared to socioeconomically advantaged patients: qualitative analysis across three trials. Trials 2024; 25:382. [PMID: 38872208 DOI: 10.1186/s13063-024-08216-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Accepted: 05/31/2024] [Indexed: 06/15/2024] Open
Abstract
BACKGROUND Patients from socioeconomically disadvantaged backgrounds are underserved in randomised controlled trials, yet they experience a much greater burden of disease compared with patients from socioeconomically advantaged areas. It is crucial to make trials more inclusive to ensure that treatments and interventions are safe and effective in real-world contexts. Improving how information about trials is verbally communicated is an unexplored strategy to make trials more inclusive. This study examined how trials are communicated verbally, comparing consultations involving patients from the most and least socioeconomically disadvantaged areas. METHODS Secondary qualitative analysis of 55 trial consultation transcripts from 41 patients, sampled from 3 qualitative studies embedded in their respective UK multi-site, cancer-related randomised controlled trials. Patients living in the most and least socioeconomically disadvantaged areas, defined using English Indices of Multiple Deprivation decile scores, were purposively sampled. Analysis was largely thematic and drew on the constant comparison method. RESULTS Recruiters communicated clinical uncertainty in a similar way for patients living in different socioeconomic areas. Consultations with disadvantaged patients were, on average, half the duration of those with advantaged patients, and tended to involve recruiters providing less in-depth explanations of trial concepts, used phrasing that softened trial arm risks, and described trial processes (e.g. randomisation) using informal or metaphorical phrasing. Disadvantaged and advantaged patients differed in the concerns they expressed; disadvantaged patients voiced fewer concerns and asked fewer questions but were also less likely to be invited to do so by recruiters. CONCLUSION Interactions about trials unfolded in different ways between patients living in different socioeconomic areas, likely due to both patient- and recruiter-related factors. We present considerations for recruiters when discussing trials with patients from socioeconomically disadvantaged backgrounds, aimed at enhancing trial communication. Future research should examine disadvantaged patients' and recruiters' experiences of verbal trial communication to inform guidance that addresses the needs and preferences of underserved groups.
Collapse
Affiliation(s)
- Mariana Popa
- Department of Public Health, Policy and Systems, University of Liverpool, Liverpool, UK
| | - Bridget Young
- Department of Public Health, Policy and Systems, University of Liverpool, Liverpool, UK
| | - Nikki Rousseau
- School of Medicine, Faculty of Medicine and Health, University of Leeds, Leeds, UK
| | - Mary G Cherry
- Department of Primary Care and Mental Health, University of Liverpool, Liverpool, UK
| | - Isobel Jenkins
- School of Medicine, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK
| | - Jane Cloke
- NIHR Applied Research Collaboration North West Coast, University of Liverpool, Liverpool, UK
| | - Andrew Pettitt
- Department of Molecular and Clinical Cancer Medicine, University of Liverpool, Liverpool, UK
- The Clatterbridge Cancer Centre NHS Foundation Trust, Liverpool, UK
| | - Michael D Jenkinson
- Institute of Systems, Molecular and Integrative Biology, The University of Liverpool, Liverpool, UK
- The Walton Centre NHS Foundation Trust, Liverpool, UK
| | - Saiqa Ahmed
- NIHR Applied Research Collaboration North West Coast, University of Liverpool, Liverpool, UK
| | - Allan R Pemberton
- NIHR Applied Research Collaboration North West Coast, University of Liverpool, Liverpool, UK
| | - Frances C Sherratt
- Department of Public Health, Policy and Systems, University of Liverpool, Liverpool, UK.
| |
Collapse
|
5
|
Mills N, Farrar N, Warnes B, Ashton KE, Harris R, Rogers CA, Lim E, Elliott D. Strategies to address recruitment to a randomised trial of surgical and non-surgical treatment for cancer: results from a complex recruitment intervention within the Mesothelioma and Radical Surgery 2 (MARS 2) study. BMJ Open 2024; 14:e079108. [PMID: 38760029 PMCID: PMC11103236 DOI: 10.1136/bmjopen-2023-079108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Accepted: 11/29/2023] [Indexed: 05/19/2024] Open
Abstract
OBJECTIVES Recruiting to randomised trials is often challenging particularly when the intervention arms are markedly different. The Mesothelioma and Radical Surgery 2 randomised controlled trial (RCT) compared standard chemotherapy with or without (extended) pleurectomy decortication surgery for malignant pleural mesothelioma. Anticipating recruitment difficulties, a QuinteT Recruitment Intervention was embedded in the main trial phase to unearth and address barriers. The trial achieved recruitment to target with a 4-month COVID-19 pandemic-related extension. This paper presents the key recruitment challenges, and the strategies delivered to optimise recruitment and informed consent. DESIGN A multifaceted, flexible, mixed-method approach to investigate recruitment obstacles drawing on data from staff/patient interviews, audio recorded study recruitment consultations and screening logs. Key findings were translated into strategies targeting identified issues. Data collection, analysis, feedback and strategy implementation continued cyclically throughout the recruitment period. SETTING Secondary thoracic cancer care. RESULTS Respiratory physicians, oncologists, surgeons and nursing specialists supported the trial, but recruitment challenges were evident. The study had to fit within a framework of a thoracic cancer service considered overstretched where patients encountered multiple healthcare professionals and treatment views, all of which challenged recruitment. Clinician treatment biases, shaped in part by the wider clinical and research context alongside experience, adversely impacted several aspects of the recruitment process by restricting referrals for study consideration, impacting eligibility decisions, affecting the neutrality in which the study and treatment was presented and shaping patient treatment expectations and preferences. Individual and group recruiter feedback and training raised awareness of key equipoise issues, offered support and shared good practice to safeguard informed consent and optimise recruitment. CONCLUSIONS With bespoke support to overcome identified issues, recruitment to a challenging RCT of surgery versus no surgery in a thoracic cancer setting with a complex recruitment pathway and multiple health professional involvement is possible. TRIAL REGISTRATION NUMBER ISRCTN ISRCTN44351742, Clinical Trials.gov NCT02040272.
Collapse
Affiliation(s)
- Nicola Mills
- Bristol Medical School, University of Bristol Faculty of Health Sciences, Bristol, UK
| | - Nicola Farrar
- Bristol Medical School, University of Bristol Faculty of Health Sciences, Bristol, UK
| | - Barbara Warnes
- Bristol Medical School, University of Bristol Faculty of Health Sciences, Bristol, UK
| | - Kate E Ashton
- Bristol Medical School, University of Bristol Faculty of Health Sciences, Bristol, UK
| | - Rosie Harris
- Bristol Medical School, University of Bristol Faculty of Health Sciences, Bristol, UK
| | - Chris A Rogers
- Bristol Medical School, University of Bristol Faculty of Health Sciences, Bristol, UK
| | - Eric Lim
- Academic Division of Thoracic Surgery, The Royal Brompton Hospital, London, UK
- National Heart and Lung Institute, Imperial College London Faculty of Medicine, London, UK
| | - Daisy Elliott
- Bristol Medical School, University of Bristol Faculty of Health Sciences, Bristol, UK
| |
Collapse
|
6
|
Carrie S, Fouweather T, Homer T, O'Hara J, Rousseau N, Rooshenas L, Bray A, Stocken DD, Ternent L, Rennie K, Clark E, Waugh N, Steel AJ, Dooley J, Drinnan M, Hamilton D, Lloyd K, Oluboyede Y, Wilson C, Gardiner Q, Kara N, Khwaja S, Leong SC, Maini S, Morrison J, Nix P, Wilson JA, Teare MD. Effectiveness of septoplasty compared to medical management in adults with obstruction associated with a deviated nasal septum: the NAIROS RCT. Health Technol Assess 2024; 28:1-213. [PMID: 38477237 PMCID: PMC11017631 DOI: 10.3310/mvfr4028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/14/2024] Open
Abstract
Background The indications for septoplasty are practice-based, rather than evidence-based. In addition, internationally accepted guidelines for the management of nasal obstruction associated with nasal septal deviation are lacking. Objective The objective was to determine the clinical effectiveness and cost-effectiveness of septoplasty, with or without turbinate reduction, compared with medical management, in the management of nasal obstruction associated with a deviated nasal septum. Design This was a multicentre randomised controlled trial comparing septoplasty, with or without turbinate reduction, with defined medical management; it incorporated a mixed-methods process evaluation and an economic evaluation. Setting The trial was set in 17 NHS secondary care hospitals in the UK. Participants A total of 378 eligible participants aged > 18 years were recruited. Interventions Participants were randomised on a 1: 1 basis and stratified by baseline severity and gender to either (1) septoplasty, with or without turbinate surgery (n = 188) or (2) medical management with intranasal steroid spray and saline spray (n = 190). Main outcome measures The primary outcome was the Sino-nasal Outcome Test-22 items score at 6 months (patient-reported outcome). The secondary outcomes were as follows: patient-reported outcomes - Nasal Obstruction Symptom Evaluation score at 6 and 12 months, Sino-nasal Outcome Test-22 items subscales at 12 months, Double Ordinal Airway Subjective Scale at 6 and 12 months, the Short Form questionnaire-36 items and costs; objective measurements - peak nasal inspiratory flow and rhinospirometry. The number of adverse events experienced was also recorded. A within-trial economic evaluation from an NHS and Personal Social Services perspective estimated the incremental cost per (1) improvement (of ≥ 9 points) in Sino-nasal Outcome Test-22 items score, (2) adverse event avoided and (3) quality-adjusted life-year gained at 12 months. An economic model estimated the incremental cost per quality-adjusted life-year gained at 24 and 36 months. A mixed-methods process evaluation was undertaken to understand/address recruitment issues and examine the acceptability of trial processes and treatment arms. Results At the 6-month time point, 307 participants provided primary outcome data (septoplasty, n = 152; medical management, n = 155). An intention-to-treat analysis revealed a greater and more sustained improvement in the primary outcome measure in the surgical arm. The 6-month mean Sino-nasal Outcome Test-22 items scores were -20.0 points lower (better) for participants randomised to septoplasty than for those randomised to medical management [the score for the septoplasty arm was 19.9 and the score for the medical management arm was 39.5 (95% confidence interval -23.6 to -16.4; p < 0.0001)]. This was confirmed by sensitivity analyses and through the analysis of secondary outcomes. Outcomes were statistically significantly related to baseline severity, but not to gender or turbinate reduction. In the surgical and medical management arms, 132 and 95 adverse events occurred, respectively; 14 serious adverse events occurred in the surgical arm and nine in the medical management arm. On average, septoplasty was more costly and more effective in improving Sino-nasal Outcome Test-22 items scores and quality-adjusted life-years than medical management, but incurred a larger number of adverse events. Septoplasty had a 15% probability of being considered cost-effective at 12 months at a £20,000 willingness-to-pay threshold for an additional quality-adjusted life-year. This probability increased to 99% and 100% at 24 and 36 months, respectively. Limitations COVID-19 had an impact on participant-facing data collection from March 2020. Conclusions Septoplasty, with or without turbinate reduction, is more effective than medical management with a nasal steroid and saline spray. Baseline severity predicts the degree of improvement in symptoms. Septoplasty has a low probability of cost-effectiveness at 12 months, but may be considered cost-effective at 24 months. Future work should focus on developing a septoplasty patient decision aid. Trial registration This trial is registered as ISRCTN16168569 and EudraCT 2017-000893-12. Funding This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 14/226/07) and is published in full in Health Technology Assessment; Vol. 28, No. 10. See the NIHR Funding and Awards website for further award information.
Collapse
Affiliation(s)
- Sean Carrie
- Ear, Nose and Throat Department, Freeman Hospital, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
- Honorary affiliation with Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Tony Fouweather
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Tara Homer
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - James O'Hara
- Ear, Nose and Throat Department, Freeman Hospital, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Nikki Rousseau
- Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, UK
| | - Leila Rooshenas
- Bristol Population Health Science Institute, University of Bristol, Bristol, UK
| | - Alison Bray
- Honorary affiliation with Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- Northern Medical Physics and Clinical Engineering, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Deborah D Stocken
- Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, UK
| | - Laura Ternent
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Katherine Rennie
- Newcastle Clinical Trials Unit, Newcastle University, Newcastle upon Tyne, UK
| | - Emma Clark
- Newcastle Clinical Trials Unit, Newcastle University, Newcastle upon Tyne, UK
| | - Nichola Waugh
- Newcastle Clinical Trials Unit, Newcastle University, Newcastle upon Tyne, UK
| | - Alison J Steel
- Newcastle Clinical Trials Unit, Newcastle University, Newcastle upon Tyne, UK
| | - Jemima Dooley
- Centre for Academic Primary Care, University of Bristol, Bristol, UK
| | - Michael Drinnan
- Honorary affiliation with Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- Northern Medical Physics and Clinical Engineering, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - David Hamilton
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Kelly Lloyd
- Leeds Institute of Clinical Trials Research, University of Leeds, Leeds, UK
| | - Yemi Oluboyede
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Caroline Wilson
- Bristol Population Health Science Institute, University of Bristol, Bristol, UK
| | - Quentin Gardiner
- Ear, Nose and Throat Department, Ninewells Hospital, NHS Tayside, Dundee, UK
| | - Naveed Kara
- Ear, Nose and Throat Department, Darlington Memorial Hospital, County Durham and Darlington NHS Foundation Trust, Durham, UK
| | - Sadie Khwaja
- Ear, Nose and Throat Department, Manchester Royal Infirmary, Manchester University Foundation NHS Trust, Manchester, UK
| | - Samuel Chee Leong
- Ear, Nose and Throat Department, Aintree Hospital, Aintree University Hospitals NHS Foundation Trust, Liverpool, UK
| | - Sangeeta Maini
- Ear, Nose and Throat Department, Aberdeen Royal Infirmary, NHS Grampian, Aberdeen, UK
| | | | - Paul Nix
- Ear, Nose and Throat Department, Leeds General Infirmary, Leeds Teaching Hospitals NHS Trust, Leeds, UK
| | - Janet A Wilson
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - M Dawn Teare
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| |
Collapse
|
7
|
Lorenc A, Rooshenas L, Conefrey C, Wade J, Farrar N, Mills N, Paramasivan S, Realpe A, Jepson M. Non-COVID-19 UK clinical trials and the COVID-19 pandemic: impact, challenges and possible solutions. Trials 2023; 24:424. [PMID: 37349850 PMCID: PMC10286467 DOI: 10.1186/s13063-023-07414-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Accepted: 05/25/2023] [Indexed: 06/24/2023] Open
Abstract
INTRODUCTION The COVID-19 pandemic impacted the operationalisation of non-COVID-19 clinical trials globally, particularly site and participant recruitment and trial success/stoppage. Trials which anticipate recruitment challenges may embed methods such as the QuinteT Recruitment Intervention (QRI) to help identify and understand the sources of challenges. Such interventions can help shed light on pandemic-related challenges. This paper reports our experience of the impact of the COVID-19 pandemic on conducting clinical trials with an embedded QRI, highlighting how the QRI aided in identifying challenges and potential solutions, particularly related to the site set-up and participant recruitment. MAIN BODY We report on 13 UK clinical trials which included a QRI. Information is from QRI data and researchers' experience and reflections. In most trials, recruitment was lower than even the lowest anticipated rates. The flexibility of the QRI facilitated rapid data collection to understand and document, and in some instances respond to, operational challenges. Challenges were mostly logistical, pandemic-related and beyond the control of the site or central trial teams. Specifically: disrupted and variable site opening timelines -often due to local research and development (R&D) delays- shortages of staff to recruit patients; fewer eligible patients or limited access to patients; and intervention-related factors. Almost all trials were affected by pandemic-related staffing issues including redeployment, prioritisation of COVID-19 care and research, and COVID-19-related staff illness and absence. Trials of elective procedures were particularly impacted by the pandemic, which caused changes to care/recruitment pathways, deprioritisation of services, reduced clinical and surgical capacity and longer waiting lists. Attempted solutions included extra engagement with staff and R&D departments, trial protocol changes (primarily moving online) and seeking additional resourcing. CONCLUSION We have highlighted wide-ranging, extensive and consistent pandemic-related challenges faced by UK clinical trials, which the QRI helped to identify and, in some cases, address. Many challenges were insurmountable at individual trials or trials unit level. This overview highlights the need to streamline trial regulatory processes, address staffing crises, improve recognition of NHS research staff and for clearer, more nuanced central guidance on the prioritisation of studies and how to deal with the backlog. Pre-emptively embedding qualitative work and stakeholder consultation into trials with anticipated difficulties, moving some processes online, and flexible trial protocols may improve the resilience of trials in the current challenging context.
Collapse
Affiliation(s)
- Ava Lorenc
- QuinteT Group, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK.
| | - Leila Rooshenas
- QuinteT Group, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Carmel Conefrey
- QuinteT Group, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Julia Wade
- QuinteT Group, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Nicola Farrar
- QuinteT Group, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Nicola Mills
- QuinteT Group, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Sangeetha Paramasivan
- QuinteT Group, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Alba Realpe
- QuinteT Group, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Marcus Jepson
- QuinteT Group, Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| |
Collapse
|
8
|
Wade J, Humphrys E, Realpe AX, Gaunt DM, Burt J. Informed consent in randomised controlled trials: further development and evaluation of the participatory and informed consent (PIC) measure. Trials 2023; 24:305. [PMID: 37131255 PMCID: PMC10155434 DOI: 10.1186/s13063-023-07296-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Accepted: 04/05/2023] [Indexed: 05/04/2023] Open
Abstract
BACKGROUND Informed consent is an accepted ethical and legal prerequisite for trial participation, yet there is no standardised method of assessing patient understanding for informed consent. The participatory and informed consent (PIC) measure was developed for application to recruitment discussions to evaluate recruiter information provision and evidence of patient understanding. Preliminary evaluation of the PIC indicated the need to improve inter-rater and intra-rater reliability ratings and conduct further psychometric evaluation. This paper describes the assessment, revision and evaluation of the PIC within the context of OPTiMISE, a pragmatic primary care-based trial. METHODS This study used multiple methods across two phases. In phase one, one researcher applied the existing PIC measure to 18 audio-recorded recruitment discussions from the OPTiMISE study and made detailed observational notes about any uncertainties in application. Appointments were sampled to be maximally diverse for patient gender, study centre, recruiter and before and after an intervention to optimise information provision. Application uncertainties were reviewed by the study team, revisions made and a coding manual developed and agreed. In phase two, the coding manual was used to develop tailored guidelines for applying the PIC to appointments within the OPTiMISE trial. Two researchers then assessed 27 further appointments, purposively sampled as above, to evaluate inter-rater and intra-rater reliability, content validity and feasibility. RESULTS Application of the PIC to 18 audio-recorded OPTiMISE recruitment discussions resulted in harmonisation of the scales rating recruiter information provision and evidence of patient understanding, minor amendments to clarify wording and the development of detailed generic coding guidelines for applying the measure within any trial. Application of the revised measure using these guidelines to 27 further recruitment discussions showed good feasibility (time to complete), content validity (completion rate) and reliability (inter- and intra-rater) of the measure. CONCLUSION The PIC provides a means to evaluate the content of information provided by recruiters, patient participation in recruitment discussions and, to some extent, evidence of patient understanding. Future work will use the measure to evaluate recruiter information provision and evidence of patient understanding both across and within trials.
Collapse
Affiliation(s)
- Julia Wade
- Bristol Medical School, University of Bristol, 39 Whatley Road, Clifton, Bristol BS8 2PS, UK.
| | - Elka Humphrys
- THIS Institute (The Healthcare Improvement Studies Institute), University of Cambridge, Strangeways Research Laboratory, Cambridge, CB1 8RN, UK
| | - Alba X Realpe
- Bristol Medical School, University of Bristol, 39 Whatley Road, Clifton, Bristol BS8 2PS, UK
- NIHR Bristol Biomedical Research Centre, University Hospitals Bristol and Weston NHS Foundation Trust and University of Bristol, Bristol, UK
| | - Daisy M Gaunt
- Bristol Medical School, University of Bristol, 39 Whatley Road, Clifton, Bristol BS8 2PS, UK
| | - Jenni Burt
- THIS Institute (The Healthcare Improvement Studies Institute), University of Cambridge, Strangeways Research Laboratory, Cambridge, CB1 8RN, UK
| |
Collapse
|
9
|
Carter B, Bray L, al-Najjar N, Piella AT, Tudur-Smith C, Spowart C, Collingwood A, Crudgington H, Currier J, Hughes DA, Wood E, Martin R, Morris C, Roberts D, Rouncefield-Swales A, Sutherland H, Watson V, Cook G, Wiggs L, Gringras P, Pal D. The impact of parent treatment preference and other factors on recruitment: lessons learned from a paediatric epilepsy randomised controlled trial. Trials 2023; 24:83. [PMID: 36747248 PMCID: PMC9900533 DOI: 10.1186/s13063-023-07091-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Accepted: 12/30/2022] [Indexed: 02/08/2023] Open
Abstract
BACKGROUND In paediatric epilepsy, the evidence of effectiveness of antiseizure treatment is inconclusive for some types of epilepsy. As with other paediatric clinical trials, researchers undertaking paediatric epilepsy clinical trials face a range of challenges that may compromise external validity MAIN BODY: In this paper, we critically reflect upon the factors which impacted recruitment to the pilot phase of a phase IV unblinded, randomised controlled 3×2 factorial trial examining the effectiveness of two antiseizure medications (ASMs) and a sleep behaviour intervention in children with Rolandic epilepsy. We consider the processes established to support recruitment, public and patient involvement and engagement (PPIE), site induction, our oversight of recruitment targets and figures, and the actions we took to help us understand why we failed to recruit sufficient children to continue to the substantive trial phase. The key lessons learned were about parent preference, children's involvement and collaboration in decision-making, potential and alternative trial designs, and elicitation of stated preferences pre-trial design. Despite pre-funding PPIE during the trial design phase, we failed to anticipate the scale of parental treatment preference for or against antiseizure medication (ASMs) and consequent unwillingness to be randomised. Future studies should ensure more detailed and in-depth consultation to ascertain parent and/or patient preferences. More intense engagement with parents and children exploring their ideas about treatment preferences could, perhaps, have helped predict some recruitment issues. Infrequent seizures or screening children close to natural remission were possible explanations for non-consent. It is possible some clinicians were unintentionally unable to convey clinical equipoise influencing parental decision against participation. We wanted children to be involved in decisions about trial participation. However, despite having tailored written and video information to explain the trial to children we do not know whether these materials were viewed in each consent conversation or how much input children had towards parents' decisions to participate. Novel methods such as parent/patient preference trials and/or discrete choice experiments may be the way forward. CONCLUSION The importance of diligent consultation, the consideration of novel methods such as parent/patient preference trials and/or discrete choice experiments in studies examining the effectiveness of ASMs versus no-ASMs cannot be overemphasised even in the presence of widespread clinician equipoise.
Collapse
Affiliation(s)
- Bernie Carter
- Faculty of Health, Social Care and Medicine, Edge Hill University, Ormskirk, UK.
| | - Lucy Bray
- grid.255434.10000 0000 8794 7109Faculty of Health, Social Care and Medicine, Edge Hill University, Ormskirk, UK
| | - Nadia al-Najjar
- grid.10025.360000 0004 1936 8470Liverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK
| | - Agnès Tort Piella
- grid.10025.360000 0004 1936 8470Liverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK
| | - Catrin Tudur-Smith
- grid.10025.360000 0004 1936 8470Liverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK
| | - Catherine Spowart
- grid.10025.360000 0004 1936 8470Liverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK
| | - Amber Collingwood
- grid.13097.3c0000 0001 2322 6764Department of Basic and Clinical Neurosciences, Institute of Psychiatry, Psychology & Neuroscience, Kings College London, London, UK
| | - Holly Crudgington
- grid.13097.3c0000 0001 2322 6764Department of Basic and Clinical Neurosciences, Institute of Psychiatry, Psychology & Neuroscience, Kings College London, London, UK
| | | | - Dyfrig A. Hughes
- grid.7362.00000000118820937Centre for Health Economics & Medicines Evaluation, Bangor University, Bangor, UK
| | - Eifiona Wood
- grid.7362.00000000118820937Centre for Health Economics & Medicines Evaluation, Bangor University, Bangor, UK
| | - Rachael Martin
- grid.255434.10000 0000 8794 7109Faculty of Health, Social Care and Medicine, Edge Hill University, Ormskirk, UK
| | - Christopher Morris
- grid.8391.30000 0004 1936 8024University of Exeter Medical School, University of Exeter, Exeter, UK
| | | | - Alison Rouncefield-Swales
- grid.255434.10000 0000 8794 7109Faculty of Health, Social Care and Medicine, Edge Hill University, Ormskirk, UK
| | - Heather Sutherland
- grid.255434.10000 0000 8794 7109Faculty of Health, Social Care and Medicine, Edge Hill University, Ormskirk, UK
| | - Victoria Watson
- grid.10025.360000 0004 1936 8470Liverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK
| | - Georgia Cook
- grid.7628.b0000 0001 0726 8331Centre for Psychological Research, Oxford Brookes University, Oxford, UK
| | - Luci Wiggs
- grid.7628.b0000 0001 0726 8331Centre for Psychological Research, Oxford Brookes University, Oxford, UK
| | - Paul Gringras
- Newcomen Children's Neurosciences Centre, Evelina London Children's Hospital, London, UK. .,Department of Women and Children's Health, Faculty of Life Sciences and Medicine, King's College London, London, UK.
| | - Deb Pal
- Department of Basic and Clinical Neurosciences, Institute of Psychiatry, Psychology & Neuroscience, Kings College London, London, UK. .,MRC Centre for Neurodevelopmental Disorders, King's College London, London, UK. .,King's College Hospital, London, UK.
| |
Collapse
|
10
|
Lim E, Harris RA, McKeon HE, Batchelor TJ, Dunning J, Shackcloth M, Anikin V, Naidu B, Belcher E, Loubani M, Zamvar V, Dabner L, Brush T, Stokes EA, Wordsworth S, Paramasivan S, Realpe A, Elliott D, Blazeby J, Rogers CA. Impact of video-assisted thoracoscopic lobectomy versus open lobectomy for lung cancer on recovery assessed using self-reported physical function: VIOLET RCT. Health Technol Assess 2022; 26:1-162. [PMID: 36524582 PMCID: PMC9791462 DOI: 10.3310/thbq1793] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND Lung cancer is the leading cause of cancer death. Surgery remains the main method of managing early-stage disease. Minimal-access video-assisted thoracoscopic surgery results in less tissue trauma than open surgery; however, it is not known if it improves patient outcomes. OBJECTIVE To compare the clinical effectiveness and cost-effectiveness of video-assisted thoracoscopic surgery lobectomy with open surgery for the treatment of lung cancer. DESIGN, SETTING AND PARTICIPANTS A multicentre, superiority, parallel-group, randomised controlled trial with blinding of participants (until hospital discharge) and outcome assessors conducted in nine NHS hospitals. Adults referred for lung resection for known or suspected lung cancer, with disease suitable for both surgeries, were eligible. Participants were followed up for 1 year. INTERVENTIONS Participants were randomised 1 : 1 to video-assisted thoracoscopic surgery lobectomy or open surgery. Video-assisted thoracoscopic surgery used one to four keyhole incisions without rib spreading. Open surgery used a single incision with rib spreading, with or without rib resection. MAIN OUTCOME MEASURES The primary outcome was self-reported physical function (using the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire Core 30) at 5 weeks. Secondary outcomes included upstaging to pathologic node stage 2 disease, time from surgery to hospital discharge, pain in the first 2 days, prolonged pain requiring analgesia at > 5 weeks, adverse health events, uptake of adjuvant treatment, overall and disease-free survival, quality of life (Quality of Life Questionnaire Core 30, Quality of Life Questionnaire Lung Cancer 13 and EQ-5D) at 2 and 5 weeks and 3, 6 and 12 months, and cost-effectiveness. RESULTS A total of 503 patients were randomised between July 2015 and February 2019 (video-assisted thoracoscopic surgery, n = 247; open surgery, n = 256). One participant withdrew before surgery. The mean age of patients was 69 years; 249 (49.5%) patients were men and 242 (48.1%) did not have a confirmed diagnosis. Lobectomy was performed in 453 of 502 (90.2%) participants and complete resection was achieved in 429 of 439 (97.7%) participants. Quality of Life Questionnaire Core 30 physical function was better in the video-assisted thoracoscopic surgery group than in the open-surgery group at 5 weeks (video-assisted thoracoscopic surgery, n = 247; open surgery, n = 255; mean difference 4.65, 95% confidence interval 1.69 to 7.61; p = 0.0089). Upstaging from clinical node stage 0 to pathologic node stage 1 and from clinical node stage 0 or 1 to pathologic node stage 2 was similar (p ≥ 0.50). Pain scores were similar on day 1, but lower in the video-assisted thoracoscopic surgery group on day 2 (mean difference -0.54, 95% confidence interval -0.99 to -0.09; p = 0.018). Analgesic consumption was 10% lower (95% CI -20% to 1%) and the median hospital stay was less (4 vs. 5 days, hazard ratio 1.34, 95% confidence interval 1.09, 1.65; p = 0.006) in the video-assisted thoracoscopic surgery group than in the open-surgery group. Prolonged pain was also less (relative risk 0.82, 95% confidence interval 0.72 to 0.94; p = 0.003). Time to uptake of adjuvant treatment, overall survival and progression-free survival were similar (p ≥ 0.28). Fewer participants in the video-assisted thoracoscopic surgery group than in the open-surgery group experienced complications before and after discharge from hospital (relative risk 0.74, 95% confidence interval 0.66 to 0.84; p < 0.001 and relative risk 0.81, 95% confidence interval 0.66 to 1.00; p = 0.053, respectively). Quality of life to 1 year was better across several domains in the video-assisted thoracoscopic surgery group than in the open-surgery group. The probability that video-assisted thoracoscopic surgery is cost-effective at a willingness-to-pay threshold of £20,000 per quality-adjusted life-year is 1. LIMITATIONS Ethnic minorities were under-represented compared with the UK population (< 5%), but the cohort reflected the lung cancer population. CONCLUSIONS Video-assisted thoracoscopic surgery lobectomy was associated with less pain, fewer complications and better quality of life without any compromise to oncologic outcome. Use of video-assisted thoracoscopic surgery is highly likely to be cost-effective for the NHS. FUTURE WORK Evaluation of the efficacy of video-assisted thoracoscopic surgery with robotic assistance, which is being offered in many hospitals. TRIAL REGISTRATION This trial is registered as ISRCTN13472721. FUNDING This project was funded by the National Institute for Health and Care Research ( NIHR ) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 48. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Eric Lim
- Academic Division of Thoracic Surgery, The Royal Brompton and Harefield Hospitals, London, UK
| | - Rosie A Harris
- Clinical Trials and Evaluation Unit, Bristol Trials Centre, Bristol Medical School, University of Bristol, Bristol, UK
| | - Holly E McKeon
- Clinical Trials and Evaluation Unit, Bristol Trials Centre, Bristol Medical School, University of Bristol, Bristol, UK
| | - Timothy Jp Batchelor
- Thoracic Surgery, Bristol Royal Infirmary, University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
| | - Joel Dunning
- Department of Cardiothoracic Surgery, The James Cook University Hospital, South Tees Hospitals NHS Foundation Trust, Middlesbrough, UK
| | - Michael Shackcloth
- Department of Thoracic Surgery, Liverpool Heart and Chest Hospital, Liverpool, UK
| | - Vladimir Anikin
- Academic Division of Thoracic Surgery, The Royal Brompton and Harefield Hospitals, London, UK
| | - Babu Naidu
- Department of Thoracic Surgery, Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK
| | - Elizabeth Belcher
- Cardiothoracic Surgery, John Radcliffe Hospital, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | - Mahmoud Loubani
- Department of Cardiothoracic Surgery, Castle Hill Hospital, Cottingham, UK
| | - Vipin Zamvar
- Department of Cardiothoracic Surgery, Edinburgh Royal Infirmary, Edinburgh, UK
| | - Lucy Dabner
- Clinical Trials and Evaluation Unit, Bristol Trials Centre, Bristol Medical School, University of Bristol, Bristol, UK
| | - Timothy Brush
- Clinical Trials and Evaluation Unit, Bristol Trials Centre, Bristol Medical School, University of Bristol, Bristol, UK
| | - Elizabeth A Stokes
- Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK
- National Institute for Health and Care Research Oxford Biomedical Research Centre, Oxford, UK
| | - Sarah Wordsworth
- Health Economics Research Centre, Nuffield Department of Population Health, University of Oxford, Oxford, UK
- National Institute for Health and Care Research Oxford Biomedical Research Centre, Oxford, UK
| | - Sangeetha Paramasivan
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Alba Realpe
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Daisy Elliott
- National Institute for Health and Care Research Bristol and Weston Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, Bristol Medical School, University of Bristol, Bristol, UK
| | - Jane Blazeby
- National Institute for Health and Care Research Bristol and Weston Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, Bristol Medical School, University of Bristol, Bristol, UK
| | - Chris A Rogers
- Clinical Trials and Evaluation Unit, Bristol Trials Centre, Bristol Medical School, University of Bristol, Bristol, UK
| |
Collapse
|
11
|
Abstract
It was in the 1990s, that the possibility of increased transmission of HIV with the use of injectable contraceptive Depo-Provera®, was first flagged in medical literature. This has posed a challenge for its use in countries, particularly in the African region, where the prevalence and transmission rate of HIV is high. In 2015, a randomised 'clinical' trial, the Evidence for Contraceptive Options and HIV Outcomes (ECHO) was launched in four African countries to resolve the question whether the increased risk was causal. Contrary to expectations, the ECHO trial successfully recruited and randomised the specified number of girls/women participants. This paper argues that this was made possible by exercising undue influence, by using incentives, coercive language, and by concealing the real nature of the clinical trial during recruitment. The ECHO trial is unique in subjecting a group of healthy girls/women knowingly to a contraceptive drug with an intention not of finding out whether it is efficacious as a contraceptive, but to find out how risky or life-threatening its use could be. Thus, the ECHO trial has violated one of the central tenets of the Helsinki Declaration by privileging pursuit of knowledge over the interests of the girl/women trial participants from Africa.
Collapse
Affiliation(s)
- C Sathyamala
- International Institute of Social Studies, Erasmus University Rotterdam, The Hague, The Netherlands
| |
Collapse
|
12
|
Rodriguez L, Murray-Krezan C, Regino L, Tellez M, Vasquez C, Sandoval V, Perez Rodriguez D, Pedigo B, Page-Reeves J. A Study of a Culturally and Contextually Situated Multimedia Approach to Recruit a Hard-to-Reach Spanish-Speaking Population for a Randomized Control Trial (RCT). J Empir Res Hum Res Ethics 2022; 17:461-470. [PMID: 35585705 PMCID: PMC11307171 DOI: 10.1177/15562646221102682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Study designs involving randomization can be difficult to communicate to participants, especially those with low literacy. The literature on strategies to explain research concepts is limited, especially for non-English speakers. We measured the effectiveness of a culturally and contextually situated multimedia approach to recruit a cohort of 60 female Mexican immigrants (FMI) to a randomized control trial (RCT) to reduce social isolation and depression. This strategy was designed to explain the concept of randomization, explain what participating in the research study entailed, and ensure informed consent. Potential participants viewed a presentation explaining the study and a video including animation with voice-over explaining the concept of randomization. We administered a pre/post survey. Respondents (N = 59) reported an increase in their understanding of randomization, intention to enroll, and attitude towards participating in research. We conclude that a culturally and contextually situated multimedia approach is an effective model when recruiting underrepresented populations with low literacy for RCTs.
Collapse
Affiliation(s)
| | | | - Lidia Regino
- Office for Community Health, University of New Mexico, Albuquerque, NM, USA
| | - Maria Tellez
- One Hope Centro de Vida Health Center, East Central Ministries, Albuquerque, NM, USA
| | | | - Virginia Sandoval
- One Hope Centro de Vida Health Center, East Central Ministries, Albuquerque, NM, USA
| | | | - Blanca Pedigo
- One Hope Centro de Vida Health Center, East Central Ministries, Albuquerque, NM, USA
| | - Janet Page-Reeves
- Office for Community Health, University of New Mexico, Albuquerque, NM, USA
- Department of Family and Community Medicine, University of New Mexico, Albuquerque, NM, USA
| |
Collapse
|
13
|
Donovan JL, Jepson M, Rooshenas L, Paramasivan S, Mills N, Elliott D, Wade J, Reda D, Blazeby JM, Moghanaki D, Hwang ES, Davies L. Development of a new adapted QuinteT Recruitment Intervention (QRI-Two) for rapid application to RCTs underway with enrolment shortfalls—to identify previously hidden barriers and improve recruitment. Trials 2022; 23:258. [PMID: 35379301 PMCID: PMC8978173 DOI: 10.1186/s13063-022-06187-y] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Accepted: 03/19/2022] [Indexed: 11/30/2022] Open
Abstract
Background Many randomised controlled trials (RCTs) struggle to recruit, despite valiant efforts. The QRI (QuinteT Recruitment Intervention) uses innovative research methods to optimise recruitment by revealing previously hidden barriers related to the perceptions and experiences of recruiters and patients, and targeting remedial actions. It was designed to be integrated with RCTs anticipating difficulties at the outset. A new version of the intervention (QRI-Two) was developed for RCTs already underway with enrolment shortfalls. Methods QRIs in 12 RCTs with enrolment shortfalls during 2007–2017 were reviewed to document which of the research methods used could be rapidly applied to successfully identify recruitment barriers. These methods were then included in the new streamlined QRI-Two intervention which was applied in 20 RCTs in the USA and Europe during 2018–2019. The feasibility of the QRI-Two was investigated, recruitment barriers and proposed remedial actions were documented, and the QRI-Two protocol was finalised. Results The review of QRIs from 2007 to 2017 showed that previously unrecognised recruitment barriers could be identified but data collection for the full QRI required time and resources usually unavailable to ongoing RCTs. The streamlined QRI-Two focussed on analysis of screening/accrual data and RCT documents (protocol, patient-information), with discussion of newly diagnosed barriers and potential remedial actions in a workshop with the RCT team. Four RCTs confirmed the feasibility of the rapid application of the QRI-Two. When the QRI-Two was applied to 14 RCTs underway with enrolment shortfalls, an array of previously unknown/underestimated recruitment barriers related to issues such as equipoise, intervention preferences, or study presentation was identified, with new insights into losses of eligible patients along the recruitment pathway. The QRI-Two workshop enabled discussion of the newly diagnosed barriers and potential remedial actions to improve recruitment in collaboration with the RCT team. As expected, the QRI-Two performed less well in six RCTs at the start-up stage before commencing enrolment. Conclusions The QRI-Two can be applied rapidly, diagnose previously unrecognised recruitment barriers, and suggest remedial actions in RCTs underway with enrolment shortfalls, providing opportunities for RCT teams to develop targeted actions to improve recruitment. The effectiveness of the QRI-Two in improving recruitment requires further evaluation. Supplementary Information The online version contains supplementary material available at 10.1186/s13063-022-06187-y.
Collapse
|
14
|
Niyibizi NK, Speight CD, Najarro G, Mitchell AR, Sadan O, Ko YA, Dickert NW. Experimenting with modifications to consent forms in comparative effectiveness research: understanding the impact of language about financial implications and key information. BMC Med Ethics 2022; 23:34. [PMID: 35346171 PMCID: PMC8962560 DOI: 10.1186/s12910-021-00736-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Accepted: 11/29/2021] [Indexed: 12/04/2022] Open
Abstract
Background Informed consent forms are intended to facilitate research enrollment decisions. However, the technical language in institutional templates can be unfamiliar and confusing for decision-makers. Standardized language describing financial implications of participation, namely compensation for injury and costs of care associated with participating, can be complex and could be a deterrent for potential participants. This standardized language may also be misleading in the context of comparative effectiveness trials of standard care interventions, in which costs and risk of injury associated with participating may not differ from regular medical care. In addition, the revised U.S. Common Rule contains a new requirement to present key information upfront; the impact of how this requirement is operationalized on comprehension and likelihood of enrollment for a given study is unknown. Methods Two online surveys assessed the impact of (1) changes to compensation for injury language (standard vs. tailored language form) and (2) changes to the key information page (using the tailored compensation language form with standard key information vs. modified key information vs. modified key information plus financial information) on both likelihood of enrollment in and understanding of a hypothetical comparative effectiveness trial. Results Likelihood of enrolling was not observed to be different between the standard and tailored language forms in Study 1 (73 vs. 75%; p = 0.6); however, the tailored language group had a higher frequency of understanding the compensation for injury process specific to the trial (25 vs. 51%; p < 0.0001). Modifications to the key information sheet in Study 2 did not affect likelihood of enrolling (88 vs. 85 vs. 85%; p = 0.6); however, understanding of randomization differed by form (44 vs. 59 vs. 46%; p = 0.002). Conclusions These findings suggest that refining consent forms to clarify key information and tailoring compensation for injury language to the nature of the study, especially in the context of comparative effectiveness trials, may help to improve study comprehension but may not impact enrollment. Supplementary Information The online version contains supplementary material available at 10.1186/s12910-021-00736-x.
Collapse
|
15
|
Elliott D, Blencowe NS, Cousins S, Zahra J, Skilton A, Mathews J, Paramasivan S, Hoffmann C, McNair AG, Ochieng C, Richards H, Hossaini S, Scroggie DL, Main B, Potter S, Avery K, Donovan J, Blazeby JM. Using qualitative research methods to understand how surgical procedures and devices are introduced into NHS hospitals: the Lotus study protocol. BMJ Open 2021; 11:e049234. [PMID: 34862280 PMCID: PMC8647399 DOI: 10.1136/bmjopen-2021-049234] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Accepted: 10/05/2021] [Indexed: 01/08/2023] Open
Abstract
INTRODUCTION The development of innovative invasive procedures and devices are essential to improving outcomes in healthcare. However, how these are introduced into practice has not been studied in detail. The Lotus study will follow a wide range of 'case studies' of new procedures and/or devices being introduced into NHS trusts to explore what information is communicated to patients, how procedures are modified over time and how outcomes are selected and reported. METHODS AND ANALYSIS This qualitative study will use ethnographic approaches to investigate how new invasive procedures and/or devices are introduced. Consultations in which the innovation is discussed will be audio-recorded to understand information provision practice. To understand if and how procedures evolve, they will be video recorded and non-participant observations will be conducted. Post-operative interviews will be conducted with the innovating team and patients who are eligible for the intervention. Audio-recordings will be audio-recorded, transcribed verbatim and analysed thematically using constant comparison techniques. Video-recordings will be reviewed to deconstruct procedures into key components and document how the procedure evolves. Comparisons will be made between the different data sources. ETHICS AND DISSEMINATION The study protocol has Health Research Authority (HRA) and Health and Care Research Wales approval (Ref 18/SW/0277). Results will be disseminated at appropriate conferences and will be published in peer-reviewed journals. The findings of this study will provide a better understanding of how innovative invasive procedures and/or devices are introduced into practice.
Collapse
Affiliation(s)
- Daisy Elliott
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Natalie S Blencowe
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
- University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
| | - Sian Cousins
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Jesmond Zahra
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Anni Skilton
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | | | - Sangeetha Paramasivan
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Christin Hoffmann
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Angus Gk McNair
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
- North Bristol NHS Trust, Bristol, UK
| | - Cynthia Ochieng
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Hollie Richards
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Sina Hossaini
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Darren L Scroggie
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Barry Main
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
- University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
| | - Shelley Potter
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Kerry Avery
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
| | - Jenny Donovan
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Jane M Blazeby
- National Institute for Health Research Bristol Biomedical Research Centre, Surgical Innovation Theme, Centre for Surgical Research, University of Bristol, Bristol, UK
- University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
| |
Collapse
|
16
|
Davies L, Beard D, Cook JA, Price A, Osbeck I, Toye F. The challenge of equipoise in trials with a surgical and non-surgical comparison: a qualitative synthesis using meta-ethnography. Trials 2021; 22:678. [PMID: 34620194 PMCID: PMC8495989 DOI: 10.1186/s13063-021-05403-5] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2021] [Accepted: 06/26/2021] [Indexed: 01/10/2023] Open
Abstract
BACKGROUND Randomised controlled trials in surgery can be a challenge to design and conduct, especially when including a non-surgical comparison. As few as half of initiated surgical trials reach their recruitment target, and failure to recruit is cited as the most frequent reason for premature closure of surgical RCTs. The aim of this qualitative evidence synthesis was to identify and synthesise findings from qualitative studies exploring the challenges in the design and conduct of trials directly comparing surgical and non-surgical interventions. METHODS A qualitative evidence synthesis using meta-ethnography was conducted. Six electronic bibliographic databases (Medline, Central, Cinahl, Embase and PsycInfo) were searched up to the end of February 2018. Studies that explored patients' and health care professionals' experiences regarding participating in RCTs with a surgical and non-surgical comparison were included. The GRADE-CERQual framework was used to assess confidence in review findings. RESULTS In total, 3697 abstracts and 49 full texts were screened and 26 published studies reporting experiences of patients and healthcare professionals were included. The focus of the studies (24/26) was primarily related to the challenge of recruitment. Two studies explored reasons for non-compliance to treatment allocation following randomisation. Five themes related to the challenges to these types of trials were identified: (1) radical choice between treatments; (2) patients' discomfort with randomisation: I want the best treatment for me as an individual; (3) challenge of equipoise: patients' a priori preferences for treatment; (4) challenge of equipoise: clinicians' a priori preferences for treatment and (5) imbalanced presentation of interventions. CONCLUSION The marked dichotomy between the surgical and non-surgical interventions was highlighted in this review as making recruitment to these types of trials particularly challenging. This review identified factors that increase our understanding of why patients and clinicians may find equipoise more challenging in these types of trials compared to other trial comparisons. Trialists may wish to consider exploring the balance of potential factors influencing patient and clinician preferences towards treatments before they start recruitment, to enable issues specific to a particular trial to be identified and addressed. This may enable trial teams to make more efficient considered design choices and benefit the delivery of such trials.
Collapse
Affiliation(s)
- Loretta Davies
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, University of Oxford, Headington, Oxford, OX3 7LD, UK.
| | - David Beard
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, University of Oxford, Headington, Oxford, OX3 7LD, UK
| | - Jonathan A Cook
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, University of Oxford, Headington, Oxford, OX3 7LD, UK
| | - Andrew Price
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, University of Oxford, Headington, Oxford, OX3 7LD, UK
| | | | - Francine Toye
- Nuffield Orthopaedic Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| |
Collapse
|
17
|
McDermott C, Vennik J, Philpott C, le Conte S, Thomas M, Eyles C, Little P, Blackshaw H, Schilder A, Hopkins C. Maximising recruitment to a randomised controlled trial for chronic rhinosinusitis using qualitative research methods: the MACRO conversation study. Trials 2021; 22:54. [PMID: 33436031 PMCID: PMC7805190 DOI: 10.1186/s13063-020-04993-w] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Accepted: 12/22/2020] [Indexed: 11/10/2022] Open
Abstract
Background Randomised controlled trials (RCTs) are considered the ‘gold standard’ of medical evidence; however, recruitment can be challenging. The MACRO trial is a NIHR-funded RCT for chronic rhinosinusitis (CRS) addressing the challenge of comparing surgery, antibiotics and placebo. The embedded MACRO conversation study (MCS) used qualitative research techniques pioneered by the University of Bristol QuinteT team to explore recruitment issues during the pilot phase, to maximise recruitment in the main trial. Methods Setting: Five outpatient Ear Nose and Throat (ENT) departments recruiting for the pilot phase of the MACRO trial (ISRCTN Number: 36962030, prospectively registered 17 October 2018). We conducted a thematic analysis of telephone interviews with 18 recruiters and 19 patients and 61 audio-recordings of recruitment conversations. We reviewed screening and recruitment data and mapped patient pathways at participating sites. We presented preliminary findings to individual site teams. Group discussions enabled further exploration of issues, evolving strategies and potential solutions. Findings were reported back to the funder and used together with recruitment data to justify progression to the main trial. Results Recruitment in the MACRO pilot trial began slowly but accelerated in time to progress successfully to the main trial. Research nurse involvement was pivotal to successful recruitment. Engaging the wider network of clinical colleagues emerged as an important factor, ensuring the patient pathway through primary and secondary care did not inadvertently affect trial eligibility. The most common reason for patients declining participation was treatment preference. Good patient-clinician relationships engendered trust and supported patient decision-making. Overall, trial involvement appeared clearly presented by recruiters, possibly influenced by pre-trial training. The weakest area of understanding for patients appeared to be trial medications. A clear presentation of medical and surgical treatment options, together with checking patient understanding, had the potential to allay patient concerns. Conclusion The MACRO conversation study contributed to the learning process of optimising recruitment by helping to identify and address recruitment issues. Although some issues were trial-specific, others have applicability to many clinical trial situations. Using qualitative research techniques to identify/explore barriers and facilitators to recruitment may be valuable during the pilot phase of many RCTs including those with complex designs.
Collapse
Affiliation(s)
- Clare McDermott
- Primary Care and Populations Sciences, Faculty of Medicine, University of Southampton, Southampton, UK
| | - Jane Vennik
- Primary Care and Populations Sciences, Faculty of Medicine, University of Southampton, Southampton, UK.
| | - Carl Philpott
- Norwich Medical School, University of East Anglia, Norwich, UK.,James Paget University Hospital NHS Foundation Trust, Great Yarmouth, UK
| | - Steffi le Conte
- Surgical Interventional Trials Unit, University of Oxford, Oxford, UK
| | - Mike Thomas
- Primary Care and Populations Sciences, Faculty of Medicine, University of Southampton, Southampton, UK
| | - Caroline Eyles
- Primary Care and Populations Sciences, Faculty of Medicine, University of Southampton, Southampton, UK
| | - Paul Little
- Primary Care and Populations Sciences, Faculty of Medicine, University of Southampton, Southampton, UK
| | - Helen Blackshaw
- evidENT, Ear Institute, University College London, London, UK
| | - Anne Schilder
- evidENT, Ear Institute, University College London, London, UK
| | | |
Collapse
|
18
|
Bugge C, Kearney R, Dembinsky M, Khunda A, Graham M, Agur W, Breeman S, Dwyer L, Elders A, Forrest M, Goodman K, Guerrero K, Hemming C, Mason H, McClurg D, Melone L, Norrie J, Thakar R, Hagen S. The TOPSY pessary self-management intervention for pelvic organ prolapse: a study protocol for the process evaluation. Trials 2020; 21:836. [PMID: 33032651 PMCID: PMC7542744 DOI: 10.1186/s13063-020-04729-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2019] [Accepted: 09/08/2020] [Indexed: 11/21/2022] Open
Abstract
BACKGROUND Process evaluations have become a valued component, alongside clinical trials, of the wider evaluation of complex health interventions. They support understanding of implementation, and fidelity, related to the intervention and provide valuable insights into what is effective in a practical setting by examining the context in which interventions are implemented. The TOPSY study consists of a large multi-centre randomised controlled trial comparing the effectiveness of pessary self-management with clinic-based care in improving women's condition-specific quality of life, and a nested process evaluation. The process evaluation aims to examine and maximise recruitment to the trial, describe intervention fidelity and explore participants' and healthcare professionals' experiences. METHODS The trial will recruit 330 women from approximately 17 UK centres. The process evaluation uses a mixed-methods approach. Semi-structured interviews will be conducted with randomised women (18 per randomised group/n = 36), women who declined trial participation but agreed to interview (non-randomised women) (n = 20) and healthcare professionals recruiting to the trial (n ~ 17) and delivering self-management and clinic-based care (n ~ 17). The six internal pilot centres will be asked to record two to three recruitment discussions each (total n = 12-18). All participating centres will be asked to record one or two self-management teaching appointments (n = 30) and self-management 2-week follow-up telephone calls (n = 30). Process data (quantitative and qualitative) will be gathered in participant completed trial questionnaires. Interviews will be analysed thematically and recordings using an analytic grid to identify fidelity to the intervention. Quantitative analysis will be predefined within the process evaluation analysis plan. DISCUSSION The wide variety of pessary care delivered across the UK for women with pelvic organ prolapse presents specific localised contexts in which the TOPSY interventions will be implemented. Understanding this contextual variance is central to understanding how and in what circumstances pessary self-management can be implemented (should it be effective). The inclusion of non-randomised women provides an innovative way of collecting indispensable information about eligible women who decline trial participation, allowing broader contextualisation and considerations of generalisability of trial findings. Methodological insights from examination of recruitment processes and mechanisms have the potential to inform recruitment mechanisms and future recruitment strategies and study designs. TRIAL REGISTRATION ISRCTN62510577 . Registered on 6 October 2017.
Collapse
Affiliation(s)
- Carol Bugge
- Faculty of Health Sciences and Sport, University of Stirling, Stirling, UK.
| | - Rohna Kearney
- The Warrell Unit, St. Mary's Hospital, Manchester University Hospitals NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
- Faculty of Biology Medicine and Health, School of Medical Sciences, University of Manchester, Manchester, UK
| | - Melanie Dembinsky
- Faculty of Health Sciences and Sport, University of Stirling, Stirling, UK
| | - Aethele Khunda
- South Tees Hospitals NHS Foundation Trust, James Cook University Hospital, Middlesbrough, UK
| | - Margaret Graham
- Faculty of Health Sciences and Sport, University of Stirling, Stirling, UK
| | - Wael Agur
- NHS Ayrshire & Arran, Crosshouse Hospital, School of Medicine, Dentistry & Nursing, University of Glasgow, Kilmarnock, UK
| | - Suzanne Breeman
- Health Services Research Unit (HSRU), University of Aberdeen, Aberdeen, UK
| | - Lucy Dwyer
- The Warrell Unit, St. Mary's Hospital, Manchester University Hospitals NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
| | - Andrew Elders
- Nursing, Midwifery and Allied Health Professions Research Unit, Glasgow Caledonian University, Glasgow, UK
| | - Mark Forrest
- Health Services Research Unit (HSRU), University of Aberdeen, Aberdeen, UK
| | - Kirsteen Goodman
- Nursing, Midwifery and Allied Health Professions Research Unit, Glasgow Caledonian University, Glasgow, UK
| | - Karen Guerrero
- Department of Urogynaecology, NHS Greater Glasgow & Clyde, Glasgow, UK
| | - Christine Hemming
- Grampian University Hospitals NHS Trust, Aberdeen Maternity Hospital & Aberdeen Royal Infirmary, Aberdeen, UK
| | - Helen Mason
- Yunus Centre for Social Business and Health, Glasgow Caledonian University, Glasgow, UK
| | - Doreen McClurg
- Nursing, Midwifery and Allied Health Professions Research Unit, Glasgow Caledonian University, Glasgow, UK
| | - Lynn Melone
- Nursing, Midwifery and Allied Health Professions Research Unit, Glasgow Caledonian University, Glasgow, UK
| | - John Norrie
- Usher Institute of Population Health Sciences and Informatics, College of Medicine and Veterinary Medicine, The University of Edinburgh, Edinburgh, UK
| | - Ranee Thakar
- Croydon Health Services NHS Trust, Croydon University Hospital, Croydon, UK
| | - Suzanne Hagen
- Nursing, Midwifery and Allied Health Professions Research Unit, Glasgow Caledonian University, Glasgow, UK
| |
Collapse
|
19
|
Dickert NW, Bernard AM, Brabson JM, Hunter RJ, McLemore R, Mitchell AR, Palmer S, Reed B, Riedford M, Simpson RT, Speight CD, Steadman T, D Pentz R. Partnering With Patients to Bridge Gaps in Consent for Acute Care Research. THE AMERICAN JOURNAL OF BIOETHICS : AJOB 2020; 20:7-17. [PMID: 32364468 DOI: 10.1080/15265161.2020.1745931] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Clinical trials for acute conditions such as myocardial infarction and stroke pose challenges related to informed consent due to time limitations, stress, and severe illness. Consent processes should be sensitive to the context in which trials are conducted and to needs of patients and surrogate decision-makers. This manuscript describes a collaborative effort between ethicists, researchers, patients, and surrogates to develop patient-driven, patient-centered approaches to consent for clinical trials in acute myocardial infarction and stroke.Our group identified important ways in which existing consent processes and forms for clinical trials fail to meet patients' and surrogates' needs in the acute context. We collaborated to create model forms and consent processes that are substantially shorter and, hopefully, better-matched to patients' and surrogates' needs and expectations from the perspective of content, structure, and tone. These changes, however, challenge some common conventions regarding consent.
Collapse
|
20
|
Davies G, Mills N, Holcombe C, Potter S. Perceived barriers to randomised controlled trials in breast reconstruction: obstacle to trial initiation or opportunity to resolve? A qualitative study. Trials 2020; 21:316. [PMID: 32252788 PMCID: PMC7132957 DOI: 10.1186/s13063-020-4227-1] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2019] [Accepted: 03/03/2020] [Indexed: 01/26/2023] Open
Abstract
BACKGROUND Implant-based breast reconstruction (IBBR) is the most commonly performed breast reconstruction technique worldwide but the technique is evolving rapidly. High-quality evidence is needed to support practice. Randomised controlled trials (RCTs) provide the best evidence but can be challenging to conduct. iBRA is a four-phased study which aimed to inform the feasibility, design and conduct of an RCT in IBBR. In phase 3, the randomisation acceptability study, an electronic survey and qualitative interviews were conducted to explore professionals' perceptions of future trials in IBBR. Findings from the interviews are presented here. METHODS Semi-structured qualitative interviews were undertaken with a purposive sample of 31 health professionals (HPs) who completed the survey to explore their attitudes to the feasibility of potential RCTs in more detail. All interviews were transcribed verbatim and data were analysed thematically using constant comparative techniques. Sampling, data collection and analysis were undertaken iteratively and concurrently until data saturation was achieved. RESULTS Almost all HPs acknowledged the need for better evidence to support the practice of IBBR and most identified RCTs as generating the highest-quality evidence. Despite highlighting potential challenges, most participants supported the need for an RCT in IBBR. A minority, however, were strongly opposed to a future trial. The opposition and challenges identified centred around three key themes; (i) limited understanding of pragmatic study design and the value of randomisation in minimising bias; (ii) clinician and patient equipoise and (iii) aspects of surgical culture and training that were not supportive of RCTs. CONCLUSION There is a need for well-designed, large-scale RCTs to support the current practice of IBBR but barriers to their acceptability are evident. The perceived barriers to RCTs in breast reconstruction identified in this study are not insurmountable and have previously been overcome in other similar surgical trials. This may represent an opportunity, not only to establish the evidence base for IBBR, but also to improve engagement in RCTs in breast surgery in general to ultimately improve outcomes for patients. TRIAL REGISTRATION International Standard Randomised Controlled Trial Number ISRCTN37664281.
Collapse
Affiliation(s)
- Gareth Davies
- Bristol Centre for Surgical Research, Population Health Sciences, Bristol Medical School, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS UK
| | - Nicola Mills
- Bristol Centre for Surgical Research, Population Health Sciences, Bristol Medical School, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS UK
| | - Chris Holcombe
- Linda McCartney Centre, Royal Liverpool and Broadgreen University Hospital, Prescot Street, Liverpool, L7 8XP UK
| | - Shelley Potter
- Bristol Centre for Surgical Research, Population Health Sciences, Bristol Medical School, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS UK
- Bristol Breast Care Centre, North Bristol NHS Trust, Southmead Road, Bristol, BS10 5NB UK
| |
Collapse
|
21
|
Ecarnot F, Meunier-Beillard N, Quenot JP, Meneveau N. Factors associated with refusal or acceptance of older patients (≥ 65 years) to provide consent to participate in clinical research in cardiology: a qualitative study. Aging Clin Exp Res 2020; 32:133-140. [PMID: 30903598 DOI: 10.1007/s40520-019-01172-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2019] [Accepted: 03/08/2019] [Indexed: 11/27/2022]
Abstract
BACKGROUND Clinical research is an essential step in the successful translation of knowledge from basic research into concrete clinical applications, yet many people are reluctant to provide consent when actually approached to actively participate in clinical trials. AIMS We investigated the factors that influence older patient's (≥ 65 years) decisions to accept or refuse to participate in a prospective randomized clinical trial in secondary prevention after acute coronary syndrome. METHODS Qualitative approach based on individual semi-structured interviews with patients who were approached for consent to participate in a currently ongoing clinical trial was adopted. Patients were interviewed after the consent process (8 accepted; 8 refused the trial). Interviews were analysed using grounded theory methodology. RESULTS Sixteen patients aged ≥ 65 years participated. The main concept to emerge from these interviews is that the actual trial itself does not appear to be the primary determinant in the decision to participate in clinical research. Rather, patients' decisions to participate (or not) in clinical research appear to be primarily determined by their capacity to deal with the current health event that has disrupted their life, and by their available mental and physical resources. DISCUSSION AND CONCLUSION Older patients display varying levels of engagement in their own health, ranging from low engagement with high trust in the medical profession, to high engagement mirrored by distrust of the medical profession. Structural conditions, such as personal benefit from trial participation, or logistic barriers to participation, seem to affect both accepters and refusers in the same manner.
Collapse
Affiliation(s)
- Fiona Ecarnot
- Department of Cardiology, University Hospital Jean Minjoz, EA3920, University of Franche-Comté, 3 Boulevard Fleming, 25000, Besançon, France.
| | - Nicolas Meunier-Beillard
- Unité de Soutien Méthodologique à la Recherche - Délégation à la Recherche Clinique et à l'Innovation, François Mitterand University Hospital, Dijon, France
- Department of Intensive Care, François Mitterrand University Hospital, 14 rue Paul Gaffarel, Dijon, France
- INSERM CIC 1432, Clinical Epidemiology, University of Burgundy, Dijon, France
| | - Jean-Pierre Quenot
- Department of Intensive Care, François Mitterrand University Hospital, 14 rue Paul Gaffarel, Dijon, France
- INSERM CIC 1432, Clinical Epidemiology, University of Burgundy, Dijon, France
- Lipness Team, INSERM Research Center LNC-UMR1231 and LabExLipSTIC, University of Burgundy, Dijon, France
| | - Nicolas Meneveau
- Department of Cardiology, University Hospital Jean Minjoz, EA3920, University of Franche-Comté, 3 Boulevard Fleming, 25000, Besançon, France
| |
Collapse
|
22
|
Mukka S, Sjöholm P, Chammout G, Kelly-Pettersson P, Sayed-Noor AS, Sköldenberg O. External Validity of the HOPE-Trial: Hemiarthroplasty Compared with Total Hip Arthroplasty for Displaced Femoral Neck Fractures in Octogenarians. JB JS Open Access 2019; 4:e0061. [PMID: 31334467 PMCID: PMC6613851 DOI: 10.2106/jbjs.oa.18.00061] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND Randomized controlled trials (RCTs) are the most reliable way of evaluating the effect of new treatments by comparing them with previously accepted treatment regimens. The results obtained from an RCT are extrapolated from the study environment to the general health care system. The ability to do so is called external validity. We sought to evaluate the external validity of an RCT comparing the results of total hip arthroplasty with those of hemiarthroplasty for the treatment of displaced femoral neck fractures in patients ≥80 years of age. METHODS This prospective, single-center cohort study included 183 patients ≥80 years of age who had a displaced femoral neck fracture. All patients were screened according to the inclusion and exclusion criteria for an RCT comparing total hip arthroplasty and hemiarthroplasty. The population for this study consisted of patients who gave their informed consent and were randomized into the RCT (consenting group, 120 patients) as well as those who declined to give their consent to participate (non-consenting group, 63 patients). The outcome measurements were mortality, complications, and patient-reported outcome measures. Follow-up was carried out postoperatively with use of a mailed survey that included patient-reported outcome questionnaires. RESULTS We found a statistically significant and clinically relevant difference between the groups, with the non-consenting group having a higher risk of death compared with the consenting group. (hazard ratio, 4.6; 95% confidence interval, 1.9 to 11.1). No differences were found between the groups in terms of patient-reported outcome measures or surgical complications. CONCLUSIONS This cohort study indicates a higher mortality rate but comparable hip function and quality of life among eligible non-consenters as compared with eligible consenters when evaluating the external validity of an RCT in patients ≥80 years of age with femoral neck fracture. LEVEL OF EVIDENCE Therapeutic Level II. See Instructions for Authors for a complete description of levels of evidence.
Collapse
Affiliation(s)
- Sebastian Mukka
- Department of Surgical and Perioperative Sciences, Umeå University, Umeå, Sweden
| | - Pontus Sjöholm
- Department of Surgical and Perioperative Sciences, Umeå University, Umeå, Sweden
| | - Ghazi Chammout
- Departments of Orthopedics and Clinical Sciences at Danderyd Hospital, Karolinska Institute, Stockholm, Sweden
| | - Paula Kelly-Pettersson
- Departments of Orthopedics and Clinical Sciences at Danderyd Hospital, Karolinska Institute, Stockholm, Sweden
| | - Arkan S Sayed-Noor
- Department of Surgical and Perioperative Sciences, Umeå University, Umeå, Sweden
| | - Olof Sköldenberg
- Departments of Orthopedics and Clinical Sciences at Danderyd Hospital, Karolinska Institute, Stockholm, Sweden
| |
Collapse
|
23
|
Rooshenas L, Paramasivan S, Jepson M, Donovan JL. Intensive Triangulation of Qualitative Research and Quantitative Data to Improve Recruitment to Randomized Trials: The QuinteT Approach. QUALITATIVE HEALTH RESEARCH 2019; 29:672-679. [PMID: 30791819 DOI: 10.1177/1049732319828693] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
Randomized controlled trials (RCTs) can provide high quality evidence about the comparative effectiveness of health care interventions, but many RCTs struggle with or fail to complete recruitment. RCTs are built on the principles of the experimental method, but their planning, conduct, and interpretation can depend on complex social, behavioral, and cultural factors that may be best understood through qualitative research. Most qualitative studies undertaken alongside RCTs involve interviews that produce data that are used in a supportive or supplicatory role, but there is potential for qualitative research to be more influential. In this article, we describe the research methods underpinning the "QuinteT" (Qualitative Research Integrated Within Trials) approach to understand and address RCT recruitment difficulties. The QuinteT Recruitment Intervention (QRI) brings together multiple qualitative strategies and quantitative data and uses triangulation to understand recruitment issues rapidly. These nuanced understandings are used to inform the implementation of collaborative actions to improve recruitment.
Collapse
|
24
|
Turner KM, Percival J, Kessler D, Donovan JL. Synthesizing Qualitative Data Sets to Improve the Design of Trials and Complex Health Interventions: A Worked Example. QUALITATIVE HEALTH RESEARCH 2019; 29:693-699. [PMID: 30293516 DOI: 10.1177/1049732318803894] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Qualitative researchers are increasingly reanalyzing and synthesizing data sets from different studies, and this method has now been used across trials to inform trial methodology and delivery. Despite this work, however, limited guidance exists about how this method should be employed. This article details an example in which interview data collected during three primary care depression trials were brought together to explore trial participants' study and treatment journeys. It details the process involved and the decisions made. It also presents findings from this synthesis to illustrate how this method can be used to inform the development of future trials and complex interventions, through raising questions about how researchers currently define and design treatment arms and indicating what factors may improve or hinder participants' engagement with their allocated treatment.
Collapse
Affiliation(s)
- Katrina M Turner
- 1 University of Bristol, Bristol, United Kingdom
- 2 University Hospitals Bristol NHS Foundation Trust, Bristol, United Kingdom
| | | | | | - Jenny L Donovan
- 1 University of Bristol, Bristol, United Kingdom
- 2 University Hospitals Bristol NHS Foundation Trust, Bristol, United Kingdom
| |
Collapse
|
25
|
Rooshenas L, Scott LJ, Blazeby JM, Rogers CA, Tilling KM, Husbands S, Conefrey C, Mills N, Stein RC, Metcalfe C, Carr AJ, Beard DJ, Davis T, Paramasivan S, Jepson M, Avery K, Elliott D, Wilson C, Donovan JL. The QuinteT Recruitment Intervention supported five randomized trials to recruit to target: a mixed-methods evaluation. J Clin Epidemiol 2019; 106:108-120. [PMID: 30339938 PMCID: PMC6355457 DOI: 10.1016/j.jclinepi.2018.10.004] [Citation(s) in RCA: 45] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2018] [Revised: 09/28/2018] [Accepted: 10/10/2018] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To evaluate the impact of the QuinteT Recruitment Intervention (QRI) on recruitment in challenging randomized controlled trials (RCTs) that have applied the intervention. The QRI aims to understand recruitment difficulties and then implements "QRI actions" to address these as recruitment proceeds. STUDY DESIGN AND SETTING A mixed-methods study, comprising (1) before-and-after comparisons of recruitment rates and the numbers of patients approached and (2) qualitative case studies, including documentary analysis and interviews with RCT investigators. RESULTS Five UK-based publicly funded RCTs were included in the evaluation. All recruited to target. Randomized controlled trial 2 and RCT 5 both received up-front prerecruitment training before the intervention was applied. Randomized controlled trial 2 did not encounter recruitment issues and recruited above target from its outset. Recruitment difficulties, particularly communication issues, were identified and addressed through QRI actions in RCTs 1, 3, 4, and 5. Randomization rates significantly improved after QRI action in RCTs 1, 3, and 4. Quintet Recruitment Intervention actions addressed issues with approaching eligible patients in RCTs 3 and 5, which both saw significant increases in the number of patients approached. Trial investigators reported that the QRI had unearthed issues they had been unaware of and reportedly changed their practices after QRI action. CONCLUSION There is promising evidence to suggest that the QRI can support recruitment to difficult RCTs. This needs to be substantiated with future controlled evaluations.
Collapse
Affiliation(s)
- Leila Rooshenas
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom.
| | - Lauren J Scott
- NIHR Collaboration for Leadership in Applied Health Research and Care at University Hospitals Bristol NHS Foundation Trust, Bristol, United Kingdom
| | - Jane M Blazeby
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Chris A Rogers
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom; Clinical Trials and Evaluation Unit, Bristol Royal Infirmary, School of Clinical Sciences, University of Bristol, Bristol, United Kingdom
| | - Kate M Tilling
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Samantha Husbands
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Carmel Conefrey
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Nicola Mills
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Robert C Stein
- University College London Hospitals (UCLH), Biomedical Research Centre (BMC), University College London Hospitals, 1st Floor Central, 250 Euston Road, London NW1 2PG, UK
| | - Chris Metcalfe
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Andrew J Carr
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom
| | - David J Beard
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom; Royal College of Surgeons Surgical Intervention Trials Unit (SITU), University of Oxford, Oxford, United Kingdom
| | - Tim Davis
- Queen's Medical Centre, Nottingham University Hospitals NHS Trust, Derby Road, Nottingham NG7 2UH, UK
| | - Sangeetha Paramasivan
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Marcus Jepson
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Kerry Avery
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Daisy Elliott
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Caroline Wilson
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom
| | - Jenny L Donovan
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol BS8 2PS, Bristol, United Kingdom; NIHR Collaboration for Leadership in Applied Health Research and Care at University Hospitals Bristol NHS Foundation Trust, Bristol, United Kingdom
| |
Collapse
|
26
|
Patient-Consent Disconnects in Clinical Research. PATIENT-PATIENT CENTERED OUTCOMES RESEARCH 2018; 11:577-579. [PMID: 30270402 DOI: 10.1007/s40271-018-0331-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|