26
|
Aiyegbusi OL, Kyte D, Cockwell P, Marshall T, Dutton M, Walmsley-Allen N, Slade A, McMullan C, Calvert M. Patient and Clinician Perspectives on Electronic Patient-Reported Outcome Measures in the Management of Advanced CKD: A Qualitative Study. Am J Kidney Dis 2019; 74:167-178. [PMID: 31003865 DOI: 10.1053/j.ajkd.2019.02.011] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2018] [Accepted: 02/06/2019] [Indexed: 12/22/2022]
Abstract
RATIONALE & OBJECTIVE Chronic kidney disease (CKD) can substantially affect patients' health-related quality of life. Electronic patient-reported outcome measures (ePROMs) may capture symptoms and health-related quality of life and assist in the management of CKD. This study explored patient and clinician views on the use of a renal ePROM system. STUDY DESIGN Qualitative study. SETTING & PARTICIPANTS 12 patients with stage 4 or 5 CKD (non-dialysis dependent); 22 clinicians (6 CKD community nurses, 1 clinical psychologist, 10 nephrologists, 3 specialist registrars, and 2 renal surgeons) in the United Kingdom. ANALYTICAL APPROACH Semi-structured interviews and focus group discussion during which patients received paper versions of the Kidney Disease Quality of Life-36 and the Integrated Patient Outcome Scale-Renal to exemplify the type of content that could be included in an ePROM. Thematic analysis of interview transcripts. RESULTS 4 themes were identified: (1) general opinions of PROMs, (2) potential benefits and applications of an ePROM system, (3) practical considerations for the implementation of ePROMs, and (4) concerns, barriers, and facilitators. Patients were willing to complete ePROMs on a regular basis as part of their care despite clinician concerns about patient burden. Patients assessed the questionnaires favorably. Clinicians suggested that the extent of adoption of renal ePROM systems in routine clinical settings should be based on evidence of significant impact on patient outcomes. Clinicians were concerned that an ePROM system may raise patient expectations to unrealistic levels and expose clinicians to the risk for litigation. Patients and clinicians identified potential benefits and highlighted issues and concerns that need to be addressed to ensure the successful implementation of the renal ePROM system. LIMITATIONS Transferability of the findings may be limited because only English-speaking participants were recruited to the study. CONCLUSIONS A renal ePROM system may play a supportive role in the routine clinical management of patients with advanced CKD if the concerns of clinicians and patients can be sufficiently addressed.
Collapse
|
27
|
Retzer A, Turner GM, Slade A, Kyte D, McMullan C, Jones L, Belli A, Calvert M. Electronic patient reported outcomes to support care of patients with traumatic brain injury: PRiORiTy study qualitative protocol. BMJ Open 2019; 9:e024617. [PMID: 30782736 PMCID: PMC6352873 DOI: 10.1136/bmjopen-2018-024617] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/07/2018] [Revised: 09/11/2018] [Accepted: 12/07/2018] [Indexed: 11/04/2022] Open
Abstract
INTRODUCTION Traumatic brain injury (TBI) represents a major health and socioeconomic problem internationally. The expansive nature of injuries results in a heterogeneous population. The degree and type of long-term impacts following TBI and improvement following injury are highly variable. The use of electronic Patient Reported Outcomes Measures (ePROMs) could help identify residual impacts of TBI and support patient management and care. The Patient Reported Outcomes Research in Trauma study is a qualitative study exploring the long-term symptoms and impacts that are experienced by those with TBI and the potential utility of an ePROM platform to collect real-time information on patient symptoms and quality of life to inform treatment and identify support needs. METHODS AND ANALYSIS Semi-structured telephone and face-to-face interviews will be conducted with approximately 30-40 individuals recruited from five groups: (1) people with TBI; (2) carers and relatives of individuals with TBI; (3) TBI healthcare professionals; (4) researchers and (5) third sector staff members and volunteers working with those with TBI. Data will be analysed using directed thematic analysis employing an iterative coding frame that will be modified as analysis progresses. Intercoder triangulation will be employed to enhance credibility. ETHICS AND DISSEMINATION This study was approved by the West Midlands-Black Country Research Ethics Committee (Ref: 18/WM/0033). Findings will be disseminated via conference presentations, peer-reviewed journals, social media (@CPROR_UoB; http://www.birmingham.ac.uk/cpror) and the National Institute for Health Research Surgical Reconstruction and Microbiology Research Centre.
Collapse
|
28
|
Calvert M, Kyte D, Price G, Valderas JM, Hjollund NH. Maximising the impact of patient reported outcome assessment for patients and society. BMJ 2019; 364:k5267. [PMID: 30679170 DOI: 10.1136/bmj.k5267] [Citation(s) in RCA: 162] [Impact Index Per Article: 32.4] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|
29
|
Kaur G, Kyte D, Reeve BB, Basch E, Calvert M. Patient-reported outcome monitoring in a routine paediatric oncology setting: challenges and opportunities. Lancet Oncol 2019; 20:19-20. [DOI: 10.1016/s1470-2045(18)30785-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2018] [Accepted: 10/15/2018] [Indexed: 12/16/2022]
|
30
|
Anderson NE, Calvert M, Cockwell P, Dutton M, Aiyegbusi OL, Kyte D. Using patient-reported outcome measures (PROMs) to promote quality of care in the management of patients with established kidney disease requiring treatment with haemodialysis in the UK (PROM-HD): a qualitative study protocol. BMJ Open 2018; 8:e021532. [PMID: 30373779 PMCID: PMC6224733 DOI: 10.1136/bmjopen-2018-021532] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
INTRODUCTION Patients undergoing haemodialysis (HD) for end-stage kidney disease often report a poor quality of life (QoL) and identify that improving QoL has a higher priority for them than improvements in long-term survival. Research suggests that regular collection and usage of patient-reported outcome measures (PROMs) in patients with chronic conditions may reduce hospitalisation, improve QoL and overall survival. In the UK, despite increased use within research settings, PROMs have not been introduced into the routine clinical care for patients undergoing HD.We report the protocol for 'Using patient reported outcome measures (PROMs) to promote quality of care in the management of patients with established kidney disease requiring treatment with haemodialysis in the UK-PROM-HD'. The study aim is to investigate the methodological basis for the use of routine PROMs assessment, particularly using electronic formats (ePROMs) within clinical and research settings, to maximise the potential of PROM use in the management of the care of this patient group. METHODS AND ANALYSIS The project will use qualitative methodology to explore, by thematic analysis, the views, perceptions and experiences of patients receiving HD and members of the HD multidisciplinary team regarding the collection and use of PROMs in routine clinical care, particularly ePROMs. This will involve interviews with up to 30 patients or until saturation is achieved and three focus group sessions with approximately 18 members of the clinical team delivering care to this patient group, which will be interpreted broadly to include both professional and non-professional staff.
Collapse
|
31
|
Kyte D, Bishop J, Brettell E, Calvert M, Cockwell P, Dutton M, Eddington H, Hadley G, Ives NJ, Jackson LJ, Stringer S, Valente M. Use of an electronic patient-reported outcome measure in the management of patients with advanced chronic kidney disease: the RePROM pilot trial protocol. BMJ Open 2018; 8:e026080. [PMID: 30373785 PMCID: PMC6224762 DOI: 10.1136/bmjopen-2018-026080] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
INTRODUCTION Chronic kidney disease (CKD) affects up to 16% of adults in the UK. Patient quality of life is particularly reduced in end-stage renal disease and is strongly associated with increased hospitalisation and mortality. Thus, accurate and responsive healthcare is a key priority. Electronic patient-reported outcome measures (ePROMs) are online questionnaires which ask patients to self-rate their health status. Evidence in oncology suggests that the use of ePROM data within routine care, alongside clinical information, may enhance symptom management and improve patient outcomes. However, National Health Service (NHS)-based ePROM research in CKD is lacking. This pilot trial will assess the feasibility of undertaking a full-scale randomised controlled trial (RCT) in patients with CKD within the NHS. METHODS AND ANALYSIS The renal ePROM pilot trial is an investigator-led single-centre, open-label, two-arm randomised controlled pilot trial of 66 participants ≥18 years with advanced CKD. Participants will be randomised to receive either usual care or usual care supplemented with an ePROM intervention. Participants within the intervention arm will be asked to submit monthly self-reports of their health status using the ePROM system. The system will provide tailored information to patients in response to each report and notify the clinical team of patient deterioration. The renal clinical team will monitor for ePROM notifications and will respond with appropriate action, in line with standard clinical practice. Measures of study feasibility, participant quality of life and CKD severity will be completed at 3 monthly intervals. Health economic outcomes will be assessed. Clinicians will record treatment decision-making. Acceptability and feasibility of the protocol will be assessed alongside outcome measure and intervention compliance rates. Qualitative process evaluation will be conducted. ETHICS AND DISSEMINATION The findings will inform the design of a full-scale RCT and the results will be submitted for publication in peer-reviewed journals. The study has ethical approval. TRIAL REGISTRATION NUMBERS ISRCTN12669006; Pre-results.
Collapse
|
32
|
Aiyegbusi OL, Kyte D, Cockwell P, Marshall T, Dutton M, Walmsley-Allen N, Auti R, Calvert M. Development and usability testing of an electronic patient-reported outcome measure (ePROM) system for patients with advanced chronic kidney disease. Comput Biol Med 2018; 101:120-127. [DOI: 10.1016/j.compbiomed.2018.08.012] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2018] [Revised: 08/06/2018] [Accepted: 08/09/2018] [Indexed: 12/22/2022]
|
33
|
Isa F, Turner GM, Kaur G, Kyte D, Slade A, Pankhurst T, Kerecuk L, Keeley T, Ferguson J, Calvert M. Patient-reported outcome measures used in patients with primary sclerosing cholangitis: a systematic review. Health Qual Life Outcomes 2018; 16:133. [PMID: 29976215 PMCID: PMC6034220 DOI: 10.1186/s12955-018-0951-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2017] [Accepted: 06/04/2018] [Indexed: 02/08/2023] Open
Abstract
BACKGROUND Primary Sclerosing Cholangitis (PSC) is a rare chronic, cholestatic liver condition in which patients can experience a range of debilitating symptoms. Patient reported outcome measures (PROMs) could provide a valuable insight into the impact of PSC on patient quality of life and symptoms. A previous review has been conducted on the quality of life instruments used in liver transplant recipients. However, there has been no comprehensive review evaluating PROM use or measurement properties in PSC patients' to-date. The aim of the systematic review was to: (a) To identify and categorise which PROMs are currently being used in research involving the PSC population (b) To investigate the measurement properties of PROMs used in PSC. METHODS A systematic review of Medline, EMBASE and CINAHL, from inception to February 2018, was undertaken. The methodological quality of included studies was assessed using the Consensus-based Standards for selection of health Measurement Instruments (COSMIN) checklist. RESULTS Thirty-seven studies were identified, which included 36 different PROMs. Seven PROMs were generic, 10 disease-specific, 17 symptom-specific measures and 2 measures on dietary intake. The most common PROMs were the Short form-36 (SF-36) (n = 15) and Chronic liver disease questionnaire (CLDQ) (n = 6). Only three studies evaluated measurement properties, two studies evaluated the National Institute of Diabetes Digestive and Kidney Diseases Liver Transplant (NIDDK-QA) and one study evaluated the PSC PRO; however, according to the COSMIN guidelines, methodological quality was poor for the NIDDK-QA studies and fair for the PSC PRO study. CONCLUSION A wide variety of PROMs have been used to assess health-related quality of life and symptom burden in patients with PSC; however only two measures (NIDDK-QA and PSC PRO) have been formally validated in this population. The newly developed PSC PRO requires further validation in PSC patients with diverse demographics, comorbidities and at different stages of disease; however this is a promising new measure with which to assess the impact of PSC on patient quality of life and symptoms.
Collapse
|
34
|
Retzer A, Kyte D, Calman L, Glaser A, Stephens R, Calvert M. The importance of patient-reported outcomes in cancer studies. ACTA ACUST UNITED AC 2018. [DOI: 10.1080/23809000.2018.1472524] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
|
35
|
Slade A, Isa F, Kyte D, Pankhurst T, Kerecuk L, Ferguson J, Lipkin G, Calvert M. Patient reported outcome measures in rare diseases: a narrative review. Orphanet J Rare Dis 2018; 13:61. [PMID: 29688860 PMCID: PMC5914068 DOI: 10.1186/s13023-018-0810-x] [Citation(s) in RCA: 117] [Impact Index Per Article: 19.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2017] [Accepted: 04/16/2018] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND Rare diseases can lead to a significant reduction in quality of life for patients and their families. Ensuring the patients voice is central to clinical decision making is key to delivering, evaluating and understanding the efficacy of therapeutic interventions. Patient reported outcome measures (PROMs) are used to capture the patient's views about their health status and facilitate our understanding of the impact of these diseases and their treatments on patient's quality of life and symptoms. MAIN TEXT This review explores some of the current issues around the utilisation of PROMs in rare diseases, including small patient populations and dearth of valid PROMs. Difficulties in validating new or current PROMs for use in clinical trials and research are discussed. The review highlights potential solutions for some of the issues outlined in the review and the implementation of PROMs in research and clinical practice are discussed. CONCLUSION Patient input throughout the development of PROMs including qualitative research is essential to ensure that outcomes that matter to people living with rare disease are appropriately captured. Given the large number of rare diseases, small numbers of patients living with each condition and the cost of instrument development, creative and pragmatic solutions to PROM development and use may be necessary. Solutions include qualitative interviews, modern psychometrics and resources such as item banking and computer adaptive testing. Use of PROMs in rare disease research and clinical practice offers the potential to improve patient care and clinical outcomes.
Collapse
|
36
|
Mercieca-Bebber R, Calvert M, Kyte D, Stockler M, King MT. The administration of patient-reported outcome questionnaires in cancer trials: Interviews with trial coordinators regarding their roles, experiences, challenges and training. Contemp Clin Trials Commun 2018; 9:23-32. [PMID: 29696221 PMCID: PMC5898562 DOI: 10.1016/j.conctc.2017.11.009] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2017] [Revised: 11/10/2017] [Accepted: 11/22/2017] [Indexed: 11/24/2022] Open
Abstract
AIMS To explore cancer trial coordinators' roles and challenges in administering patient-reported outcome (PRO) questionnaires, and establish what PRO-specific training and guidance they received and needed. METHODS Eligible cancer trial coordinators experienced with PRO assessment from approved Australian sites participated in an audio-recorded, semi-structured interview (transcribed verbatim). Recruitment continued until data saturation. Transcripts underwent content analysis. RESULTS Twenty coordinators participated (professional training: nursing (n = 12), science/research (n = 4), both (n = 4)). PRO administration formed a minor component of most (85%) coordinators' roles. PRO administration challenges included managing 'English second language' participants, participants' companions who attempted to complete questionnaires, burdensome questionnaires, and balancing their duty of care against trial requirements. Coordinators reported inconsistencies in PRO administration, which appeared to arise as a result of confusion and inconsistent or contradictory PRO training. Inconsistencies concerned whether/when they explained the purpose of PRO assessment, which participants they approached to complete PROs, and whether they used PRO trial data to inform care.Coordinators received PRO training from various sources; most commonly study-specific start-up meetings (45%) or from colleagues (30%). Two received no PRO-specific training. Despite the challenges reported, many (55%) felt they did not need further PRO training. CONCLUSION Trial coordinators receive inconsistent PRO-specific training and are often unclear how to prioritise different aspects of data quality when faced with everyday challenges, leading to inconsistent methods, missing data, poor quality data, and even bias. Agreement on how coordinators should prioritise the requirements of PRO studies is a necessary pre-requisite for the development of much-needed, consensus-based PRO administration guidelines.
Collapse
|
37
|
Calvert M, Kyte D, Mercieca-Bebber R, Slade A, Chan AW, King MT, Hunn A, Bottomley A, Regnault A, Chan AW, Ells C, O'Connor D, Revicki D, Patrick D, Altman D, Basch E, Velikova G, Price G, Draper H, Blazeby J, Scott J, Coast J, Norquist J, Brown J, Haywood K, Johnson LL, Campbell L, Frank L, von Hildebrand M, Brundage M, Palmer M, Kluetz P, Stephens R, Golub RM, Mitchell S, Groves T. Guidelines for Inclusion of Patient-Reported Outcomes in Clinical Trial Protocols: The SPIRIT-PRO Extension. JAMA 2018; 319:483-494. [PMID: 29411037 DOI: 10.1001/jama.2017.21903] [Citation(s) in RCA: 459] [Impact Index Per Article: 76.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
Importance Patient-reported outcome (PRO) data from clinical trials can provide valuable evidence to inform shared decision making, labeling claims, clinical guidelines, and health policy; however, the PRO content of clinical trial protocols is often suboptimal. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) statement was published in 2013 and aims to improve the completeness of trial protocols by providing evidence-based recommendations for the minimum set of items to be addressed, but it does not provide PRO-specific guidance. Objective To develop international, consensus-based, PRO-specific protocol guidance (the SPIRIT-PRO Extension). Design, Setting, and Participants The SPIRIT-PRO Extension was developed following the Enhancing Quality and Transparency of Health Research (EQUATOR) Network's methodological framework for guideline development. This included (1) a systematic review of existing PRO-specific protocol guidance to generate a list of potential PRO-specific protocol items (published in 2014); (2) refinements to the list and removal of duplicate items by the International Society for Quality of Life Research (ISOQOL) Protocol Checklist Taskforce; (3) an international stakeholder survey of clinical trial research personnel, PRO methodologists, health economists, psychometricians, patient advocates, funders, industry representatives, journal editors, policy makers, ethicists, and researchers responsible for evidence synthesis (distributed by 38 international partner organizations in October 2016); (4) an international Delphi exercise (n = 137 invited; October 2016 to February 2017); and (5) consensus meeting (n = 30 invited; May 2017). Prior to voting, consensus meeting participants were informed of the results of the Delphi exercise and given data from structured reviews evaluating the PRO protocol content of 3 defined samples of trial protocols. Results The systematic review identified 162 PRO-specific protocol recommendations from 54 sources. The ISOQOL Taskforce (n = 21) reduced this to 56 items, which were considered by 138 international stakeholder survey participants and 99 Delphi panelists. The final wording of the SPIRIT-PRO Extension was agreed on at a consensus meeting (n = 29 participants) and reviewed by external group of experts during a consultation period. Eleven extensions and 5 elaborations to the SPIRIT 2013 checklist were recommended for inclusion in clinical trial protocols in which PROs are a primary or key secondary outcome. Extension items focused on PRO-specific issues relating to the trial rationale, objectives, eligibility criteria, concepts used to evaluate the intervention, time points for assessment, PRO instrument selection and measurement properties, data collection plan, translation to other languages, proxy completion, strategies to minimize missing data, and whether PRO data will be monitored during the study to inform clinical care. Conclusions and Relevance The SPIRIT-PRO guidelines provide recommendations for items that should be addressed and included in clinical trial protocols in which PROs are a primary or key secondary outcome. Improved design of clinical trials including PROs could help ensure high-quality data that may inform patient-centered care.
Collapse
|
38
|
Retzer A, Keeley T, Ahmed K, Armes J, Brown JM, Calman L, Copland C, Efficace F, Gavin A, Glaser A, Greenfield DM, Lanceley A, Taylor RM, Velikova G, Brundage M, Mercieca-Bebber R, King MT, Calvert M, Kyte D. Evaluation of patient-reported outcome protocol content and reporting in UK cancer clinical trials: the EPiC study qualitative protocol. BMJ Open 2018; 8:e017282. [PMID: 29431123 PMCID: PMC5829743 DOI: 10.1136/bmjopen-2017-017282] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
INTRODUCTION Patient-reported outcomes (PROs) are increasingly included within cancer clinical trials. If appropriately collected, analysed and transparently reported, these data might provide invaluable evidence to inform patient care. However, there is mounting indication that the design and reporting of PRO data in cancer trials may be suboptimal. This programme of research will establish via three interlinked studies whether these findings are applicable to UK cancer trials, and if so, how to best enhance the way PROs are assessed, managed and reported in clinical trials. This study will explore with key stakeholders factors that influence optimal PRO protocol content, implementation and reporting and make recommendations for training and guidance. METHODS AND ANALYSIS Semistructured interviews will be conducted with members of key stakeholder groups. The purposive sample of up to 48 participants will include: (1) trial chief investigators, trial management group members, statisticians and research nurses of cancer trials including primary or secondary PRO recruited via the National Cancer Research Institute (NCRI) Clinical Studies Group and Consumer Liaison Group and the UK Clinical Research Collaboration Registered UK Clinical Trial Unit Network; (2) NCRI Consumer Liaison Group members; (3) international experts in PRO oncology trial design; and (4) journal editors and funding bodies. Data will be analysed using directed thematic analysis employing a coding frame and modified as analysis progresses. Formal triangulation of coding and member checking will be employed to enhance credibility. ETHICS AND DISSEMINATION This study was approved by the University of Birmingham Ethics Committee (Ref: ERN_17-0085). Findings will be disseminated via conference presentations, peer-reviewed journals, patient groups and social media (@CPROR_UoB; http://www.birmingham.ac.uk/cpror). PROSPERO REGISTRATION NUMBER CRD42016036533.
Collapse
|
39
|
Williams FR, Vallance A, Faulkner T, Towey J, Kyte D, Durman S, Johnson J, Holt A, Perera MT, Ferguson J, Armstrong MJ. Home-based exercise therapy in patients awaiting liver transplantation: protocol for an observational feasibility trial. BMJ Open 2018; 8:e019298. [PMID: 29358444 PMCID: PMC5781094 DOI: 10.1136/bmjopen-2017-019298] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/26/2022] Open
Abstract
INTRODUCTION Liver disease is the third most common cause of premature mortality in the UK. Liver failure accelerates frailty, resulting in skeletal muscle atrophy, functional decline and an associated risk of liver transplant waiting list mortality. However, there is limited research investigating the impact of exercise on patient outcomes pre and post liver transplantation. The waitlist period for patients listed for liver transplantation provides a unique opportunity to provide and assess interventions such as prehabilitation. METHODS AND ANALYSIS This study is a phase I observational study evaluating the feasibility of conducting a randomised control trial (RCT) investigating the use of a home-based exercise programme (HBEP) in the management of patients awaiting liver transplantation. Twenty eligible patients will be randomly selected from the Queen Elizabeth University Hospital Birmingham liver transplant waiting list. Participants will be provided with an individually tailored 12-week HBEP, including step targets and resistance exercises. Activity trackers and patient diaries will be provided to support data collection. For the initial 6 weeks, telephone support will be given to discuss compliance with the study intervention, achievement of weekly targets, and to address any queries or concerns regarding the intervention. During weeks 6-12, participants will continue the intervention without telephone support to evaluate longer term adherence to the study intervention. On completing the intervention, all participants will be invited to engage in a focus group to discuss their experiences and the feasibility of an RCT. ETHICS AND DISSEMINATION The protocol is approved by the National Research Ethics Service Committee North West - Greater Manchester East and Health Research Authority (REC reference: 17/NW/0120). Recruitment into the study started in April 2017 and ended in July 2017. Follow-up of participants is ongoing and due to finish by the end of 2017. The findings of this study will be disseminated through peer-reviewed publications and international presentations. In addition, the protocol will be placed on the British Liver Trust website for public access. TRIAL REGISTRATION NUMBER NCT02949505; Pre-results.
Collapse
|
40
|
Mercieca-Bebber R, Friedlander M, Calvert M, Stockler M, Kyte D, Kok PS, King MT. A systematic evaluation of compliance and reporting of patient-reported outcome endpoints in ovarian cancer randomised controlled trials: implications for generalisability and clinical practice. J Patient Rep Outcomes 2017; 1:5. [PMID: 29757300 PMCID: PMC5934909 DOI: 10.1186/s41687-017-0008-3] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2017] [Accepted: 08/07/2017] [Indexed: 11/26/2022] Open
Abstract
Background This study aimed to evaluate the patient-reported outcome (PRO) content of ovarian cancer randomised-controlled trial (RCT) publications, describe PRO compliance, and explore potential relationships among these and completeness of PRO protocol content. Methods Publications of Phase III ovarian cancer RCTs with PRO endpoints were identified by Medline and Cochrane systematic search: January 2000 to February 2016. Two reviewers determined the number of Consolidated Standards of Reporting Trials (CONSORT)-PRO Extension items addressed in publications. Compliance rates (defined as the proportion of participants included in the principal PRO analysis, of those from whom PRO assessments were expected) were extracted. The relationship between CONSORT-PRO score and compliance rates was explored using scatter plots. Additionally CONSORT-PRO score and PRO compliance rates respectively were compared with corresponding PRO protocol scores obtained from a previous study. Results Thirty-six eligible RCTs (n = 33 with secondary PRO endpoint) were identified and analysed. The average number of CONSORT-PRO items addressed in publications was 6.7 (48%; Range 0–13.5/14). Three RCTs did not report PRO results; in 1 case due to poor compliance. Some compliance information was reported in 26 RCTs, but was considered complete for only 10 (28%) RCTs. Compliance rates were poor overall, ranging from 59 to 83%; therefore missing PRO data from 17 to 41% of participants in these trials could have been avoided. Of the 26 (73%) RCTs for which PRO protocol completeness scores were available, 6 RCTs reported complete compliance information and the 3 of these RCTs with highest PRO compliance had highest protocol checklist scores. Conclusions Few RCTs reported PRO compliance information in a manner enabling assessment of the generalisability of PRO results. This information is particularly important in RCTs of advanced ovarian cancer because it is important to be able to determine if missing data was due to worsening illness compared to methodological issues. Poor compliance appeared related to poor PRO protocol content, and in one case prevented PRO results from being reported, highlighting the need to address compliance strategies in the protocol. Adhering to protocol and CONSORT-PRO reporting guidance should improve PRO implementation and reporting respectively in ovarian cancer RCTs and allow results to meaningfully inform clinical practice. Electronic supplementary material The online version of this article (doi:10.1186/s41687-017-0008-3) contains supplementary material, which is available to authorized users.
Collapse
|
41
|
Aiyegbusi OL, Kyte D, Cockwell P, Marshall T, Dutton M, Slade A, Marklew N, Price G, Verdi R, Waters J, Sharpe K, Calvert M. Using Patient-Reported Outcome Measures (PROMs) to promote quality of care and safety in the management of patients with Advanced Chronic Kidney disease (PRO-trACK project): a mixed-methods project protocol. BMJ Open 2017; 7:e016687. [PMID: 28667225 PMCID: PMC5726096 DOI: 10.1136/bmjopen-2017-016687] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Abstract
INTRODUCTION Advanced chronic kidney disease (CKD) has a major effect on the quality of life and health status of patients and requires accurate and responsive management. The use of electronic patient-reported outcome measures (ePROMs) could assist patients with advanced pre-dialysis CKD, and the clinicians responsible for their care, by identifying important changes in symptom burden in real time. We report the protocol for 'Using Patient-Reported Outcome measures (PROMs) to promote quality of care and safety in the management of patients with Advanced Chronic Kidney Disease' (PRO-trACK) project, which will explore the feasibility and validity of an ePROM system for use in patients with advanced CKD. METHODS AND ANALYSIS The project will use a mixed-methods approach in three studies: (1) usability testing of the ePROM system involving up to 30 patients and focusing on acceptability and technical performance/stability; (2) ascertaining the views of patient and clinician stakeholders on the optimal use and administration of the CKD ePROM system-this will involve qualitative face-to-face/telephone interviewing with up to 30 patients or until saturation is achieved, focus groups with up to 15 clinical staff, management and IT team members; (3) psychometric assessment of the system, within a cohort of at least 180 patients with advanced CKD, to establish the measurement properties of the ePROM. ETHICS AND DISSEMINATION This project was approved by the West Midlands Edgbaston Research Ethics Committee (Reference 17/WM/0010) and received Health Research Authority (HRA) approval on 24 February 2017.The findings from this project will be provided to clinicians at the Department of Renal Medicine, Queen Elizabeth Hospitals, Birmingham (QEHB), NHS England, presented at conferences and to the Kidney Patients' Association, British Kidney Patient Association and the British Renal Society. Articles based on the findings will be written and submitted for publication in peer-reviewed journals.
Collapse
|
42
|
Aiyegbusi OL, Kyte D, Cockwell P, Marshall T, Gheorghe A, Keeley T, Slade A, Calvert M. Measurement properties of patient-reported outcome measures (PROMs) used in adult patients with chronic kidney disease: A systematic review. PLoS One 2017. [PMID: 28636678 PMCID: PMC5479575 DOI: 10.1371/journal.pone.0179733] [Citation(s) in RCA: 73] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Background Patient-reported outcome measures (PROMs) can provide valuable information which may assist with the care of patients with chronic kidney disease (CKD). However, given the large number of measures available, it is unclear which PROMs are suitable for use in research or clinical practice. To address this we comprehensively evaluated studies that assessed the measurement properties of PROMs in adults with CKD. Methods Four databases were searched; reference list and citation searching of included studies was also conducted. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to appraise the methodological quality of the included studies and to inform a best evidence synthesis for each PROM. Results The search strategy retrieved 3,702 titles/abstracts. After 288 duplicates were removed, 3,414 abstracts were screened and 71 full-text articles were retrieved for further review. Of these, 24 full-text articles were excluded as they did not meet the eligibility criteria. Following reference list and citation searching, 19 articles were retrieved bringing the total number of papers included in the final analysis to 66. There was strong evidence supporting internal consistency and moderate evidence supporting construct validity for the Kidney Disease Quality of Life-36 (KDQOL-36) in pre-dialysis patients. In the dialysis population, the KDQOL-Short Form (KDQOL-SF) had strong evidence for internal consistency and structural validity and moderate evidence for test-retest reliability and construct validity while the KDQOL-36 had moderate evidence of internal consistency, test-retest reliability and construct validity. The End Stage Renal Disease-Symptom Checklist Transplantation Module (ESRD-SCLTM) demonstrated strong evidence for internal consistency and moderate evidence for test-retest reliability, structural and construct validity in renal transplant recipients. Conclusions We suggest considering the KDQOL-36 for use in pre-dialysis patients; the KDQOL-SF or KDQOL-36 for dialysis patients and the ESRD-SCLTM for use in transplant recipients. However, further research is required to evaluate the measurement error, structural validity, responsiveness and patient acceptability of PROMs used in CKD.
Collapse
|
43
|
Kyte D, Cockwell P, Lencioni M, Skrybant M, Hildebrand MV, Price G, Squire K, Webb S, Brookes O, Fanning H, Jones T, Calvert M. Reflections on the national patient-reported outcome measures (PROMs) programme: Where do we go from here? J R Soc Med 2017; 109:441-445. [PMID: 27923896 DOI: 10.1177/0141076816677856] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
|
44
|
Jesky MD, Dutton M, Dasgupta I, Yadav P, Ng KP, Fenton A, Kyte D, Ferro CJ, Calvert M, Cockwell P, Stringer SJ. Health-Related Quality of Life Impacts Mortality but Not Progression to End-Stage Renal Disease in Pre-Dialysis Chronic Kidney Disease: A Prospective Observational Study. PLoS One 2016; 11:e0165675. [PMID: 27832126 PMCID: PMC5104414 DOI: 10.1371/journal.pone.0165675] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2016] [Accepted: 10/14/2016] [Indexed: 12/19/2022] Open
Abstract
Background Chronic kidney disease (CKD) is associated with reduced health-related quality of life (HRQL). However, the relationship between pre-dialysis CKD, HRQL and clinical outcomes, including mortality and progression to end-stage renal disease (ESRD) is unclear. Methods All 745 participants recruited into the Renal Impairment In Secondary Care study to end March 2014 were included. Demographic, clinical and laboratory data were collected at baseline including an assessment of HRQL using the Euroqol EQ-5D-3L. Health states were converted into an EQ-5Dindex score using a set of weighted preferences specific to the UK population. Multivariable Cox proportional hazards regression and competing risk analyses were undertaken to evaluate the association of HRQL with progression to ESRD or all-cause mortality. Regression analyses were then performed to identify variables associated with the significant HRQL components. Results Median eGFR was 25.8 ml/min/1.73 m2 (IQR 19.6–33.7ml/min) and median ACR was 33 mg/mmol (IQR 6.6–130.3 mg/mmol). Five hundred and fifty five participants (75.7%) reported problems with one or more EQ-5D domains. When adjusted for age, gender, comorbidity, eGFR and ACR, both reported problems with self-care [hazard ratio 2.542, 95% confidence interval 1.222–5.286, p = 0.013] and reduced EQ-5Dindex score [hazard ratio 0.283, 95% confidence interval 0.099–0.810, p = 0.019] were significantly associated with an increase in all-cause mortality. Similar findings were observed for competing risk analyses. Reduced HRQL was not a risk factor for progression to ESRD in multivariable analyses. Conclusions Impaired HRQL is common in the pre-dialysis CKD population. Reduced HRQL, as demonstrated by problems with self-care or a lower EQ-5Dindex score, is associated with a higher risk for death but not ESRD. Multiple factors influence these aspects of HRQL but renal function, as measured by eGFR and ACR, are not among them.
Collapse
|
45
|
Aiyegbusi OL, Kyte D, Cockwell P, Marshall T, Keeley T, Gheorghe A, Calvert M. Measurement properties of patient-reported outcome measures (PROMs) used in adult patients with chronic kidney disease: a systematic review protocol. BMJ Open 2016; 6:e012014. [PMID: 27733411 PMCID: PMC5073911 DOI: 10.1136/bmjopen-2016-012014] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Abstract
INTRODUCTION Chronic kidney disease (CKD) is associated with symptoms that can significantly reduce the quality of life (QoL) of patients. Patient-reported outcome measures (PROMs) may facilitate the assessment of the impact of disease and treatment on the QoL, from a patient perspective. PROMs can be used in research and routine clinical practice. METHODS AND ANALYSIS A systematic review of studies evaluating the measurement properties of PROMs in adults with CKD will be conducted. MEDLINE, EMBASE, PsycINFO and CINAHL Plus will be systematically searched from inception. Hand searching of reference lists and citations of included studies will be carried out. 2 reviewers will independently screen the titles and abstracts of all the studies retrieved during the systematic search to determine their eligibility. The COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist will be used to appraise the methodological quality of the selected studies following the full-text review. Data on the study population, questionnaire characteristics and measurement properties will be extracted from the selected papers. Finally, a narrative synthesis of extracted data will be undertaken. ETHICS AND DISSEMINATION Ethical permissions are not required for this study as data from published research articles will be used. Findings will be disseminated through publication in a peer-reviewed journal and presented at conferences. This systematic review will provide a comprehensive assessment of the measurement properties of PROMs currently available for use in adult patients with CKD and present evidence which may inform the selection of measures for use in research and clinical practice. TRIAL REGISTRATION NUMBER CRD42016035554.
Collapse
|
46
|
Kyte D, Ives J, Draper H, Calvert M. Current practices in patient-reported outcome (PRO) data collection in clinical trials: a cross-sectional survey of UK trial staff and management. BMJ Open 2016; 6:e012281. [PMID: 27697875 PMCID: PMC5073494 DOI: 10.1136/bmjopen-2016-012281] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
OBJECTIVES Patient-reported outcome measures (PROMs) collected in clinical trials should be administered in a standardised way across sites and routinely screened for avoidable missing data in order to maximise data quality/minimise risk of bias. Recent qualitative findings, however, have raised concerns about the consistency of PROM administration in UK trials. The purpose of this study was to determine the generalisability of these findings across the wider community of trial personnel. DESIGN Online cross-sectional survey. SETTING Participants were recruited from 55 UK Clinical Research Collaboration Registered Clinical Trials Units and 19 Comprehensive Local Research Networks. PARTICIPANTS Research nurses, data managers/coordinators, trial managers and chief/principal investigators involved in clinical trials collecting PROMs. ANALYSIS We undertook descriptive analyses of the quantitative data and directed thematic analysis of free-text comments. Factors associated with the management of missing PRO data were explored using logistic regression. RESULTS Survey data from 767 respondents supported the generalisability of qualitative study findings, suggesting inconsistencies in PROM administration with regard to: the level of assistance given to trial participants; the timing of PROM completion in relation to the clinical consultation; and the management of missing data. Having ≥10 years experience in a research role was significantly associated with the appropriate management of missing PROM data (OR 2.26 (95% CI 1.06 to 4.82), p=0.035). There was a consensus that more PROM guidance was needed in future trials and agreement between professional groups about the necessary components. CONCLUSIONS There are inconsistencies in the way PROMs are administered by trial staff. Such inconsistencies may reduce the quality of data and have the potential to introduce bias. There is a need for improved guidance in future trials that support trial personnel in conducting optimal PROM data collection to inform patient care.
Collapse
|
47
|
Ahmed K, Kyte D, Keeley T, Efficace F, Armes J, Brown JM, Calman L, Copland C, Gavin A, Glaser A, Greenfield DM, Lanceley A, Taylor R, Velikova G, Brundage M, Mercieca-Bebber R, King MT, Calvert M. Systematic evaluation of patient-reported outcome (PRO) protocol content and reporting in UK cancer clinical trials: the EPiC study protocol. BMJ Open 2016; 6:e012863. [PMID: 27655263 PMCID: PMC5051436 DOI: 10.1136/bmjopen-2016-012863] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
INTRODUCTION Emerging evidence suggests that patient-reported outcome (PRO)-specific information may be omitted in trial protocols and that PRO results are poorly reported, limiting the use of PRO data to inform cancer care. This study aims to evaluate the standards of PRO-specific content in UK cancer trial protocols and their arising publications and to highlight examples of best-practice PRO protocol content and reporting where they occur. The objective of this study is to determine if these early findings are generalisable to UK cancer trials, and if so, how best we can bring about future improvements in clinical trials methodology to enhance the way PROs are assessed, managed and reported. HYPOTHESIS Trials in which the primary end point is based on a PRO will have more complete PRO protocol and publication components than trials in which PROs are secondary end points. METHODS AND ANALYSIS Completed National Institute for Health Research (NIHR) Portfolio Cancer clinical trials (all cancer specialities/age-groups) will be included if they contain a primary/secondary PRO end point. The NIHR portfolio includes cancer trials, supported by a range of funders, adjudged as high-quality clinical research studies. The sample will be drawn from studies completed between 31 December 2000 and 1 March 2014 (n=1141) to allow sufficient time for completion of the final trial report and publication. Two reviewers will then review the protocols and arising publications of included trials to: (1) determine the completeness of their PRO-specific protocol content; (2) determine the proportion and completeness of PRO reporting in UK Cancer trials and (3) model factors associated with PRO protocol and reporting completeness and with PRO reporting proportion. ETHICS AND DISSEMINATION The study was approved by the ethics committee at University of Birmingham (ERN_15-0311). Trial findings will be disseminated via presentations at local, national and international conferences, peer-reviewed journals and social media including the CPROR twitter account and UOB departmental website (http://www.birmingham.ac.uk/cpro0r). TRIAL REGISTRATION NUMBER PROSPERO CRD42016036533.
Collapse
|
48
|
Mercieca-Bebber R, Friedlander M, Kok PS, Calvert M, Kyte D, Stockler M, King MT. The patient-reported outcome content of international ovarian cancer randomised controlled trial protocols. Qual Life Res 2016; 25:2457-2465. [PMID: 27294435 DOI: 10.1007/s11136-016-1339-x] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/07/2016] [Indexed: 10/21/2022]
Abstract
PURPOSE Patient-reported outcomes (PROs) provide the patient's perspective of the impact of treatment. Evidence suggests that PRO content of randomised controlled trials (RCTs) protocols is generally sub-optimal. This study aimed to describe and evaluate the PRO-specific content of ovarian cancer RCT protocols. METHODS Published, phase III, ovarian cancer RCTs with PRO endpoints were identified following a systematic search of Medline and Cochrane databases (Jan 2000 to Feb 2016). Corresponding RCT protocols were downloaded (if published) or obtained by contacting authors. Two investigators independently assessed adherence of PRO-specific content of included protocols to a checklist of 58 recommended PRO protocol items currently being developed by the International Society for Quality of Life Research. Discrepancies were resolved with a third investigator. RESULTS Of 41 eligible trials identified, 26 protocols were assessed (developed 1995-2010). We were unable to obtain the remaining 15 protocols. Protocols addressed a mean of 28 % PRO checklist items (range 8-66 %). Fifteen (58 % of assessed protocols) provided a rationale for PRO assessment, 8 (31 %) described a PRO objective, 24 (92 %) included a PRO assessment schedule, but only 6 (23 %) justified timing of PRO assessments. Twelve protocols (46 %) provided staff data collection instructions, 4 (15 %) included plans for monitoring PRO compliance, and 16 (62 %) included a PRO analysis plan. CONCLUSIONS On average, protocols addressed less than one-third of PRO protocol checklist items. In some cases, key guidance regarding PRO administration was lacking, which may lead to inconsistent and sub-optimal PRO methodology. Efforts are needed to improve PRO protocol content in cancer trials.
Collapse
|
49
|
Kyte D, Ives J, Draper H, Calvert M. Management of Patient-Reported Outcome (PRO) Alerts in Clinical Trials: A Cross Sectional Survey. PLoS One 2016; 11:e0144658. [PMID: 26785084 PMCID: PMC4718453 DOI: 10.1371/journal.pone.0144658] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2015] [Accepted: 11/20/2015] [Indexed: 11/19/2022] Open
Abstract
Background Assessment of patient-reported outcomes (PROs) provides valuable information to inform patient-centered care, but may also reveal ‘PRO alerts’: psychological distress or physical symptoms that may require an immediate response. Ad-hoc management of PRO alerts in clinical trials may result in suboptimal patient care or potentially bias trial results. To gain greater understanding of current practice in PRO alert management we conducted a national survey of personnel involved in clinical trials with a PRO endpoint. Methods and Findings We conducted a national cross-sectional survey of 767 UK-based research nurses, data managers/coordinators, trial managers and chief/principal investigators involved in clinical trials using PROs. Respondents were self-selected volunteers from a non-randomised sample of eligible individuals recruited via 55 UK Clinical Research Collaboration Registered Clinical Trials Units and 19 Comprehensive Local Research Networks. Questions centred on the proportion of trial personnel encountering alerts, how staff responded to PRO alerts and whether current guidance was deemed sufficient to support research personnel. We undertook descriptive analyses of the quantitative data and directed thematic analysis of free-text comments. 20% of research nurses did not view completed PRO questionnaires and were not in a position to discover alerts, 39–50% of the remaining respondent group participants reported encountering PRO alerts. Of these, 83% of research nurses and 54% of data managers/trial coordinators reported taking action to assist the trial participant, but less than half were able to record the intervention in the trial documentation. Research personnel reported current PRO alert guidance/training was insufficient. Conclusions Research personnel are intermittently exposed to PRO alerts. Some intervene to help trial participants, but are not able to record this intervention in the trial documentation, risking co-intervention bias. Other staff do not check PRO information during the trial, meaning alerts may remain undiscovered, or do not respond to alerts if they are inadvertently encountered; both of which may impact on patient safety. Guidance is needed to support PRO alert management that protects the interests of trial participants whilst avoiding potential bias.
Collapse
|
50
|
Soundy A, Rosenbaum S, Elder T, Kyte D, Stubbs B, Hemmings L, Roskell C, Collett J, Dawes H. The Hope and Adaptation Scale (HAS): Establishing Face and Content Validity. ACTA ACUST UNITED AC 2016. [DOI: 10.4236/ojtr.2016.42007] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|