1
|
Dieter AA, Halder GE, Pennycuff JF, Singh R, El-Nashar SA, Lipetskaia L, Orejuela FJ, Jeppson PC, Sleemi A, Raman SV, Balk EM, Rogers RG, Antosh DD. Patient-Reported Outcome Measures for Use in Women With Pelvic Organ Prolapse: A Systematic Review. Obstet Gynecol 2023; 141:1098-1114. [PMID: 37073897 PMCID: PMC10524573 DOI: 10.1097/aog.0000000000005212] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Accepted: 03/23/2023] [Indexed: 04/20/2023]
Abstract
OBJECTIVE To describe the psychometric properties of existing patient-reported outcome measures for women with prolapse using the COSMIN (Consensus-Based Standards for the Selection of Health Measurement Instruments) framework. Additional objectives were to describe the patient-reported outcome scoring method or interpretation, methods of administration, and to compile a list of the non-English languages in which the patient-reported outcomes are reportedly validated. DATA SOURCES PubMed and EMBASE was searched through September 2021. Study characteristics, patient-reported outcome details, and psychometric testing data were extracted. Methodologic quality was assessed with COSMIN guidelines. METHODS OF STUDY SELECTION Studies reporting the validation of a patient-reported outcome in women with prolapse (or women with pelvic floor disorders that included a prolapse assessment) and reporting psychometric testing data on English-language patient-reported outcome for at least one measurement property per COSMIN and the U.S. Department of Health and Human Services definitions were included, as well as studies reporting the translation of an existing patient-reported outcome into another language, a new method of patient-reported outcome administration, or a scoring interpretation. Studies reporting only pretreatment and posttreatment scores, only content or face validity, or only findings for nonprolapse domains of the patient-reported outcome were excluded. TABULATION, INTEGRATION, AND RESULTS Fifty-four studies covering 32 patient-reported outcomes were included; 106 studies assessing translation into a non-English language were excluded from the formal review. The number of validation studies per patient-reported outcome (one version of one questionnaire) ranged from 1 to 11. Reliability was the most reported measurement property, and most measurement properties received an average rating of sufficient. The condition-specific patient-reported outcomes had on average more studies and reported data across more measurement properties compared with adapted and generic patient-reported outcomes. CONCLUSION Although measurement property data vary on patient-reported outcomes for women with prolapse, most data were of good quality. Overall, condition-specific patient-reported outcomes had more studies and reported data across more measurement properties. SYSTEMATIC REVIEW REGISTRATION PROSPERO, CRD42021278796.
Collapse
|
2
|
Gray TG, Vickers H, Krishnaswamy P, Jha S. A systematic review of English language patient-reported outcome measures for use in urogynaecology and female pelvic medicine. Int Urogynecol J 2021; 32:2033-2092. [PMID: 34037815 DOI: 10.1007/s00192-021-04810-1] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Accepted: 04/17/2021] [Indexed: 12/17/2022]
Abstract
INTRODUCTION Patient-reported outcome measures (PROMs) are widely used in clinical practice and research in urogynaecology. There is no consensus on which PROMs should be used. No unifying document identifies all available PROMs and compares the psychometric properties of these. METHODS Systematic review of the literature following PRISMA guidelines. Studies where women had been administered an English-language PROM which assessed pelvic-floor symptomatology and psychometric properties had been reported were included. RESULTS 85 PROMs assessing pelvic-floor symptoms in a urogynaecology population were identified. 43 PROMs assessed lower urinary tract symptoms in 95 studies, four PROMS assessed vaginal symptoms in seven studies, 20 PROMs assessed bowel symptoms in 27 studies and three PROMs assessed sexual symptoms in seven studies. 15 PROMs assessed two or more of these symptom areas in 60 studies. PROMs with the with the best available psychometric evidence within these five areas were (urinary symptoms) the Incontinence Quality-of-Life questionnaire (I-QOL aka ICIQ-UIqol) and International Consultation on Incontinence Questionnaire (ICIQ-UI-SF), (bowel symptoms) the Accidental Bowel Leakage Evaluation (ABLE) questionnaire and the International Consultation on Incontinence Bowel questionnaire (ICIQ-B), (vaginal symptoms) the Pelvic Organ Prolapse Symptom Score (POPSS), (sexual symptoms) the Pelvic organ prolapse- urinary Incontinence Sexual function Questionnaire- IUGA revised (PISQ-IR) and (comprehensive PROMs) the Australian Pelvic Floor Questionnaire and the Electronic Personal Assessment Questionnaire-Pelvic-Floor (ePAQ-PF). CONCLUSIONS Multiple PROMs with robust psychometric properties are available. Some widely used PROMs have weak evidence. Formal recommendations on which English-language PROMs to use within clinical practice and research in urogynaecology are required.
Collapse
Affiliation(s)
- Thomas G Gray
- Department of Urogynaecology and Pelvic Reconstructive Surgery, Norfolk and Norwich University Hospitals NHS Foundation Trust, c/o Secretary, Room 27.3.024, Level Three, West Block, Colney Lane, Norwich, Norfolk, NR4 7UY, UK.
| | - Holly Vickers
- Department of Urogynaecology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK
| | - Priyanka Krishnaswamy
- Department of Urogynaecology, Queen Elizabeth University Hospital, G51 4TF, Glasgow, UK
| | - Swati Jha
- Department of Urogynaecology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK
| |
Collapse
|
3
|
Teig CJ, Grotle M, Bond MJ, Prinsen CAC, Engh MAE, Cvancarova MS, Kjøllesdal M, Martini A. Norwegian translation, and validation, of the Pelvic Floor Distress Inventory (PFDI-20) and the Pelvic Floor Impact Questionnaire (PFIQ-7). Int Urogynecol J 2017; 28:1005-1017. [PMID: 28062903 DOI: 10.1007/s00192-016-3209-z] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2016] [Accepted: 11/07/2016] [Indexed: 11/29/2022]
Abstract
INTRODUCTION AND HYPOTHESIS The goal was to translate into Norwegian, and validate, short versions of the Pelvic Floor Distress Inventory (PFDI-20) and the Pelvic Floor Impact Questionnaire (PFIQ-7) using a sample of women with symptomatic pelvic organ prolapse and pelvic floor dysfunction. METHODS Modified European Organization for Research and Treatment of Cancer Guidelines were used for translation and cultural adaptation. Of 212 eligible Norwegian women who consented to participate, 205 completed the questionnaires, of whom 50 were retested after 1 - 3 weeks, and 76 were tested 6 months after surgery. Reliability, validity and responsiveness were evaluated. Additionally, interpretability, the smallest detectable change, the standard error of measurement, floor and ceiling effects, and the percentages of missing items are reported. RESULTS Reliability ranged from 0.66 to 0.93 and intraclass correlation coefficients from 0.85 to 0.94. Both construct validity and responsiveness were found to be adequate. The responsiveness of the PFDI-20 was further supported by areas under the curve above 0.70. Estimates were lower for the PFIQ-7. The smallest detectable changes at the individual level were 15 - 21 % and 17 - 27 % for the PFDI-20 and PFIQ-7, respectively. The absolute values of the minimal important changes in the total scores were 48 and 47, respectively. No floor or ceiling effects were evident in the distributions of the PFDI-20 and PFIQ-7 total scores. CONCLUSIONS The translated questionnaires provided adequate reliability, validity and good responsiveness to change. These short versions of the PFDI and PFIQ are robust measuring instruments that will enable symptom severity and health-related quality of life to be evaluated in the Norwegian context.
Collapse
Affiliation(s)
- Catherine J Teig
- School of Medicine, Flinders University, Adelaide, Australia. .,Department of Obstetrics and Gynaecology, Akershus University Hospital, Lørenskog, Norway. .,The Pelvic Floor Centre, Division of Surgery, Akershus University Hospital, 1000, 1478, Lørenskog, Norway.
| | - Margreth Grotle
- Oslo and Akershus University College of Applied Sciences, Faculty of Health Sciences, Department of Physiotherapy, Oslo University Hospital, Oslo, Norway.,FORMI, Clinic for Surgery and Neurology, Oslo University Hospital, Oslo, Norway
| | - Malcolm J Bond
- School of Medicine, Flinders University, Adelaide, Australia
| | - Cecilia A C Prinsen
- VU University Medical Center, Department of Epidemiology and Biostatistics, Institute for Health and Care Research, Amsterdam, The Netherlands
| | - Marie A Ellström Engh
- Department of Obstetrics and Gynaecology, Akershus University Hospital, Lørenskog, Norway.,Faculty Division Akershus University Hospital, University of Oslo, Oslo, Norway
| | - Milada S Cvancarova
- FORMI, Clinic for Surgery and Neurology, Oslo University Hospital, Oslo, Norway.,Oslo and Akershus University College of Applied Sciences, Faculty of Health Sciences, Department of Nursing and Health Promotion, Oslo University Hospital, Oslo, Norway
| | | | - Angelita Martini
- School of Medicine, Flinders University, Adelaide, Australia.,Centre for Health Services Research, School of Population Health, University of Western Australia, Perth, Australia
| |
Collapse
|
4
|
Kim CH, Chung CK, Choi Y, Shin H, Woo JW, Kim SM, Lee HJ. The usefulness of a mobile device-based system for patient-reported outcomes in a spine outpatient clinic. Spine J 2016; 16:843-50. [PMID: 26961200 DOI: 10.1016/j.spinee.2016.02.048] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2015] [Revised: 01/28/2016] [Accepted: 02/23/2016] [Indexed: 02/03/2023]
Abstract
BACKGROUND CONTEXT Patient-reported outcomes (PROs) are typically collected using a paper form, but this format is cumbersome to incorporate into outpatient clinic visits as well as in research. Therefore, we developed a mobile device-based system (mobile system) for spinal PRO. We hypothesized that this system may improve the quality of care in an outpatient clinic. PURPOSE This study aimed to analyze the patient-reported efficacy of a mobile system through a survey of patients' responses compared with a paper system. STUDY DESIGN/SETTING A prospective observational study was carried out. PATIENT SAMPLE Surveys were conducted for 103 patients who had experience using both the paper and electronic systems in the outpatient clinic. OUTCOME MEASURES Patient-reported positive response score (PRS) was the outcome measure. METHODS The survey included the characteristics of the patients (sex, age, use of smartphone, familiarity with smartphone applications, proficiency of typing with mobile device, site of pain, and education level) and eight questions in four domains: (1) efficacy in the waiting room, (2) efficacy during the clinic visit, (3) overall satisfaction, and (4) opinion about the use of this system. The response to each question was scored from 1 to 5 (1, negative; 5, positive response). The patient-reported PRS was calculated by adding the scores of the 8 questions and converting the total range to 0-100 (60, neutral). RESULTS The mean PRS of the 8 questions was 79.8 (95% CI, 76.7-83.9). The mean PRS was 78.9 (75.6-82.2) at the waiting room and was 80.5 (77.1-83.9) during the clinic. The PRS for overall satisfaction and use of this system were 83.3 (79.6-87.0) and 77.1 (71.9-82.3), respectively. The use of smartphones and the proficiency of typing were independently significant predictors of PRS with an R(2) value of 0.325. CONCLUSIONS The mobile device-based system improved the patient-reported efficacy in spine outpatient clinics. However, various factors such as the use of smartphones need to be considered when developing and applying mobile systems.
Collapse
Affiliation(s)
- Chi Heon Kim
- Department of Neurosurgery, Seoul National University College of Medicine, 103 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea; Department of Neurosurgery, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea; Clinical Research Institute, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea
| | - Chun Kee Chung
- Department of Neurosurgery, Seoul National University College of Medicine, 103 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea; Department of Neurosurgery, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea; Clinical Research Institute, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea; Department of Brain and Cognitive Sciences, Seoul National University College of Natural Sciences, 1 Gwanak-ro, Gwanak-gu, 08826 Seoul, South Korea.
| | - Yunhee Choi
- Medical Research Collaborating Center, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea
| | - HyunJeong Shin
- Medical Research Collaborating Center, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea
| | - Ji Won Woo
- Department of Neurosurgery, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea
| | - Sung-Mi Kim
- Department of Neurosurgery, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea
| | - Hyuk-Joon Lee
- Department of Surgery and Cancer Research Institute, Seoul National University College of Medicine, 103 Daehak-ro, Jongno-gu, 03080 Seoul, South Korea
| |
Collapse
|
5
|
Rasmussen SL, Rejnmark L, Ebbehøj E, Feldt-Rasmussen U, Rasmussen ÅK, Bjorner JB, Watt T. High Level of Agreement between Electronic and Paper Mode of Administration of a Thyroid-Specific Patient-Reported Outcome, ThyPRO. Eur Thyroid J 2016; 5:65-72. [PMID: 27099841 PMCID: PMC4836128 DOI: 10.1159/000443609] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/08/2015] [Accepted: 12/21/2015] [Indexed: 12/29/2022] Open
Abstract
INTRODUCTION AND PURPOSE Use of electronic questionnaires to collect health-related quality-of-life data has evolved as an alternative to paper questionnaires. For the electronic questionnaire to be used interchangeably with the validated paper questionnaire, measurement properties similar to the original must be demonstrated. The aim of the present study was to assess the equivalence between the paper version and the electronic version of the thyroid-related quality-of-life questionnaire ThyPRO. METHODS Patients with Graves' hyperthyroidism or autoimmune hypothyroidism in a clinically stable phase were included. The patients were recruited from two endocrine outpatient centers. All patients completed both versions in a randomized test-retest set-up. Scores were compared using intraclass correlation coefficients (ICCs), paired t tests and Bland-Altman plots. Limits of agreement were compared with data from a previous paper-paper test-retest study. RESULTS 104 patients were included. ICCs were generally high for the 13 scales, ranging from 0.76 to 0.95. There was a small but significant difference in the scale score between paper and electronic administration for the Cosmetic complaints scale, but no differences were found for any other scale. Bland-Altman plots showed similar limits of agreement compared to the earlier test-retest study of the paper version of ThyPRO. CONCLUSION Based on our analyses using ICCs, paired t tests and Bland-Altman plots, we found adequate agreement between the paper and electronic questionnaires. The statistically significant difference in score found in the Cosmetic complaints scale is small and probably clinically insignificant.
Collapse
Affiliation(s)
- Sofie Larsen Rasmussen
- Department of Medical Endocrinology, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
| | - Lars Rejnmark
- Department of Endocrinology and Internal Medicine, Aarhus University Hospital, Aarhus, Denmark
| | - Eva Ebbehøj
- Department of Endocrinology and Internal Medicine, Aarhus University Hospital, Aarhus, Denmark
| | - Ulla Feldt-Rasmussen
- Department of Medical Endocrinology, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
| | - Åse Krogh Rasmussen
- Department of Medical Endocrinology, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
| | | | - Torquil Watt
- Department of Medical Endocrinology, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
- *Torquil Watt, MD, PhD, Department of Endocrinology, Copenhagen University Hospital Rigshospitalet, Blegdamsvej 9, DK-2100 Copenhagen Ø (Denmark), E-Mail
| |
Collapse
|
6
|
Time efficiency of a web-based questionnaire in urogynecology: a randomized study. Int Urogynecol J 2015; 27:621-7. [PMID: 26650226 DOI: 10.1007/s00192-015-2900-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2015] [Accepted: 11/15/2015] [Indexed: 10/22/2022]
Abstract
INTRODUCTION AND HYPOTHESIS Based on nationwide recommended questionnaires for women with pelvic floor dysfunction (PFD), we developed a web-based questionnaire (WBQ) that can be sent to women prior to their first visit. We hypothesized that using this WBQ would contribute to a more efficient first visit. Furthermore, we were interested in the satisfaction of patients who used the WBQ. METHODS Women referred for PFD were randomized between WBQ and no questionnaire. Time spent per consultation was recorded in total and in split times for history taking, physical examination, counseling, and administration. Patient experience was evaluated by a standardized telephone interview. RESULTS One hundred and twenty-eight women were randomized: 64 in the WBQ group and 64 in the control group. History taking was significantly shorter in the WBQ group [mean difference (MD) -1 m 32 s; 95 % confidence interval (CI) -2:41 to -0:23], and time for counseling was significantly longer (MD 1 m 21 s; 95 % CI 0:06-2:37). Overall time of the consultation was equal. The need for an additional visit tended to be less frequent in the WBQ group [53 % versus 64 %; relative risk (RR) 1.3, 95 % CI 0.8-2.0]. Forty-nine percent of women considered the WBQ time consuming without adding value. CONCLUSIONS The WBQ contributed to a slightly more efficient use of the first consultation. While differences were small and patient satisfaction was low, other benefits of the WBQ should define whether the WBQ will be introduced.
Collapse
|
7
|
Muehlhausen W, Doll H, Quadri N, Fordham B, O'Donohoe P, Dogar N, Wild DJ. Equivalence of electronic and paper administration of patient-reported outcome measures: a systematic review and meta-analysis of studies conducted between 2007 and 2013. Health Qual Life Outcomes 2015. [PMID: 26446159 DOI: 10.1186/s12955-015-0362-x.pubmedpmid:26446159;pubmedcentralpmcid:pmc4597451] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/07/2023] Open
Abstract
OBJECTIVE To conduct a systematic review and meta-analysis of the equivalence between electronic and paper administration of patient reported outcome measures (PROMs) in studies conducted subsequent to those included in Gwaltney et al's 2008 review. METHODS A systematic literature review of PROM equivalence studies conducted between 2007 and 2013 identified 1,997 records from which 72 studies met pre-defined inclusion/exclusion criteria. PRO data from each study were extracted, in terms of both correlation coefficients (ICCs, Spearman and Pearson correlations, Kappa statistics) and mean differences (standardized by the standard deviation, SD, and the response scale range). Pooled estimates of correlation and mean difference were estimated. The modifying effects of mode of administration, year of publication, study design, time interval between administrations, mean age of participants and publication type were examined. RESULTS Four hundred thirty-five individual correlations were extracted, these correlations being highly variable (I2 = 93.8) but showing generally good equivalence, with ICCs ranging from 0.65 to 0.99 and the pooled correlation coefficient being 0.88 (95% CI 0.87 to 0.88). Standardised mean differences for 307 studies were small and less variable (I2 = 33.5) with a pooled standardised mean difference of 0.037 (95% CI 0.031 to 0.042). Average administration mode/platform-specific correlations from 56 studies (61 estimates) had a pooled estimate of 0.88 (95% CI 0.86 to 0.90) and were still highly variable (I2 = 92.1). Similarly, average platform-specific ICCs from 39 studies (42 estimates) had a pooled estimate of 0.90 (95% CI 0.88 to 0.92) with an I2 of 91.5. After excluding 20 studies with outlying correlation coefficients (≥3SD from the mean), the I2 was 54.4, with the equivalence still high, the overall pooled correlation coefficient being 0.88 (95% CI 0.87 to 0.88). Agreement was found to be greater in more recent studies (p < 0.001), in randomized studies compared with non-randomised studies (p < 0.001), in studies with a shorter interval (<1 day) (p < 0.001), and in respondents of mean age 28 to 55 compared with those either younger or older (p < 0.001). In terms of mode/platform, paper vs Interactive Voice Response System (IVRS) comparisons had the lowest pooled agreement and paper vs tablet/touch screen the highest (p < 0.001). CONCLUSION The present study supports the conclusion of Gwaltney's previous meta-analysis showing that PROMs administered on paper are quantitatively comparable with measures administered on an electronic device. It also confirms the ISPOR Taskforce´s conclusion that quantitative equivalence studies are not required for migrations with minor change only. This finding should be reassuring to investigators, regulators and sponsors using questionnaires on electronic devicesafter migration using best practices. Although there is data indicating that migrations with moderate changes produce equivalent instrument versions, hence do not require quantitative equivalence studies, additional work is necessary to establish this. Furthermore, there is the need to standardize migration practices and reporting practices (i.e. include copies of tested instrument versions and screenshots) so that clear recommendations regarding equivalence testing can be made in the future.raising questions about the necessity of conducting equivalence testing moving forward.
Collapse
Affiliation(s)
- Willie Muehlhausen
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Helen Doll
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Nuz Quadri
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Bethany Fordham
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Paul O'Donohoe
- CRF Health, Brook House - 3rd Floor, 229-243 Shepherds Bush Road, Hammersmith, London, W6 7AN, UK.
| | - Nijda Dogar
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Diane J Wild
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| |
Collapse
|
8
|
Muehlhausen W, Doll H, Quadri N, Fordham B, O'Donohoe P, Dogar N, Wild DJ. Equivalence of electronic and paper administration of patient-reported outcome measures: a systematic review and meta-analysis of studies conducted between 2007 and 2013. Health Qual Life Outcomes 2015; 13:167. [PMID: 26446159 PMCID: PMC4597451 DOI: 10.1186/s12955-015-0362-x] [Citation(s) in RCA: 161] [Impact Index Per Article: 17.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2014] [Accepted: 10/01/2015] [Indexed: 11/10/2022] Open
Abstract
OBJECTIVE To conduct a systematic review and meta-analysis of the equivalence between electronic and paper administration of patient reported outcome measures (PROMs) in studies conducted subsequent to those included in Gwaltney et al's 2008 review. METHODS A systematic literature review of PROM equivalence studies conducted between 2007 and 2013 identified 1,997 records from which 72 studies met pre-defined inclusion/exclusion criteria. PRO data from each study were extracted, in terms of both correlation coefficients (ICCs, Spearman and Pearson correlations, Kappa statistics) and mean differences (standardized by the standard deviation, SD, and the response scale range). Pooled estimates of correlation and mean difference were estimated. The modifying effects of mode of administration, year of publication, study design, time interval between administrations, mean age of participants and publication type were examined. RESULTS Four hundred thirty-five individual correlations were extracted, these correlations being highly variable (I2 = 93.8) but showing generally good equivalence, with ICCs ranging from 0.65 to 0.99 and the pooled correlation coefficient being 0.88 (95% CI 0.87 to 0.88). Standardised mean differences for 307 studies were small and less variable (I2 = 33.5) with a pooled standardised mean difference of 0.037 (95% CI 0.031 to 0.042). Average administration mode/platform-specific correlations from 56 studies (61 estimates) had a pooled estimate of 0.88 (95% CI 0.86 to 0.90) and were still highly variable (I2 = 92.1). Similarly, average platform-specific ICCs from 39 studies (42 estimates) had a pooled estimate of 0.90 (95% CI 0.88 to 0.92) with an I2 of 91.5. After excluding 20 studies with outlying correlation coefficients (≥3SD from the mean), the I2 was 54.4, with the equivalence still high, the overall pooled correlation coefficient being 0.88 (95% CI 0.87 to 0.88). Agreement was found to be greater in more recent studies (p < 0.001), in randomized studies compared with non-randomised studies (p < 0.001), in studies with a shorter interval (<1 day) (p < 0.001), and in respondents of mean age 28 to 55 compared with those either younger or older (p < 0.001). In terms of mode/platform, paper vs Interactive Voice Response System (IVRS) comparisons had the lowest pooled agreement and paper vs tablet/touch screen the highest (p < 0.001). CONCLUSION The present study supports the conclusion of Gwaltney's previous meta-analysis showing that PROMs administered on paper are quantitatively comparable with measures administered on an electronic device. It also confirms the ISPOR Taskforce´s conclusion that quantitative equivalence studies are not required for migrations with minor change only. This finding should be reassuring to investigators, regulators and sponsors using questionnaires on electronic devicesafter migration using best practices. Although there is data indicating that migrations with moderate changes produce equivalent instrument versions, hence do not require quantitative equivalence studies, additional work is necessary to establish this. Furthermore, there is the need to standardize migration practices and reporting practices (i.e. include copies of tested instrument versions and screenshots) so that clear recommendations regarding equivalence testing can be made in the future.raising questions about the necessity of conducting equivalence testing moving forward.
Collapse
Affiliation(s)
- Willie Muehlhausen
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Helen Doll
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Nuz Quadri
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Bethany Fordham
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Paul O'Donohoe
- CRF Health, Brook House - 3rd Floor, 229-243 Shepherds Bush Road, Hammersmith, London, W6 7AN, UK.
| | - Nijda Dogar
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| | - Diane J Wild
- ICON Clinical Research, 6th Floor Seacourt Tower, West Way, Oxford, OX2 0JJ, UK.
| |
Collapse
|
9
|
Rutherford C, Costa D, Mercieca-Bebber R, Rice H, Gabb L, King M. Mode of administration does not cause bias in patient-reported outcome results: a meta-analysis. Qual Life Res 2015; 25:559-74. [PMID: 26334842 DOI: 10.1007/s11136-015-1110-8] [Citation(s) in RCA: 80] [Impact Index Per Article: 8.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/18/2015] [Indexed: 01/18/2023]
Abstract
PURPOSE Technological advances in recent decades have led to the availability of new modes to administer patient-reported outcomes (PROs). To aid selecting optimal modes of administration (MOA), we undertook a systematic review to determine whether differences in bias (both size and direction) exist among modes. METHODS We searched five electronic databases from 2004 (date of last comprehensive review on this topic) to April 2014, cross-referenced and searched reference lists. Studies that compared two or more MOA for a health-related PRO measure in adult samples were included. Two reviewers independently applied inclusion and quality criteria and extracted findings. Meta-analyses and meta-regressions were conducted using random-effects models. RESULTS Of 5100 papers screened, 222 were considered potentially relevant and 56 met eligibility criteria. No evidence of bias was found for: (1) paper versus electronic self-complete; and (2) self-complete versus assisted MOA. Heterogeneity for paper versus electronic comparison was explained by type of construct (i.e. physical vs. psychological). Heterogeneity for self-completion versus assisted modes was in part explained by setting (clinic vs. home); the largest bias was introduced when assisted completion occurred in the clinic and follow-up was by self-completion (either electronic or paper) in the home. CONCLUSIONS Self-complete paper and electronic MOA can be used interchangeably for research in clinic and home settings. Self-completion and assisted completion produce equivalent scores overall, although heterogeneity may be induced by setting. These results support the use of mixed MOAs within a research study, which may be a useful strategy for reducing missing PRO data.
Collapse
Affiliation(s)
- Claudia Rutherford
- Quality of Life Office, Psycho-oncology Co-operative Research Group, School of Psychology, University of Sydney, Level 6 North, Chris O'Brien Lifehouse (C39Z), Sydney, NSW, Australia.
| | - Daniel Costa
- Quality of Life Office, Psycho-oncology Co-operative Research Group, School of Psychology, University of Sydney, Level 6 North, Chris O'Brien Lifehouse (C39Z), Sydney, NSW, Australia
| | - Rebecca Mercieca-Bebber
- Quality of Life Office, Psycho-oncology Co-operative Research Group, School of Psychology, University of Sydney, Level 6 North, Chris O'Brien Lifehouse (C39Z), Sydney, NSW, Australia
- Sydney Medical School, University of Sydney, Sydney, NSW, Australia
| | - Holly Rice
- Centre for Medical Psychology and Evidence-Based Decision-Making, School of Psychology, University of Sydney, Sydney, NSW, Australia
| | | | - Madeleine King
- Quality of Life Office, Psycho-oncology Co-operative Research Group, School of Psychology, University of Sydney, Level 6 North, Chris O'Brien Lifehouse (C39Z), Sydney, NSW, Australia
- Sydney Medical School, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
10
|
Abstract
The objective of the article is to review key guidelines on the management of urinary incontinence (UI) to guide clinical management in a practical way. Guidelines produced by the European Association of Urology (updated in 2014), the Canadian Urological Association (updated in 2012), the International Consultation on Incontinence (updated in 2012), and the National Collaborating Centre for Women's and Children's Health (updated in 2013) were examined and their recommendations compared. In addition, specialised guidelines produced by the collaboration between the American Urological Association and the Society of Urodynamics, Female Pelvic Medicine and Urogenital Reconstruction on overactive bladder and the use of urodynamics were reviewed. The Appraisal of Guidelines for Research and Evaluation II (AGREE) instrument was used to evaluate the quality of these guidelines. There is general agreement between the groups on the recommended initial evaluation and the use of conservative therapies for first-line treatment, with a limited role for imaging or invasive testing in the uncomplicated patient. These groups have greater variability in their recommendations for invasive procedures; however, generally the mid-urethral sling is recommended for uncomplicated stress UI, with different recommendations on the approach, as well as the comparability to other treatments, such as the autologous fascial sling. This 'Guideline of Guidelines' provides a summary of the salient similarities and differences between prominent groups on the management of UI.
Collapse
Affiliation(s)
- Raveen Syan
- Department of Urology, New York University Langone Medical Center, New York, NY, USA
| | - Benjamin M Brucker
- Department of Obstetrics and Gynecology, New York University Langone Medical Center, New York, NY, USA
| |
Collapse
|
11
|
Campbell N, Ali F, Finlay AY, Salek SS. Equivalence of electronic and paper-based patient-reported outcome measures. Qual Life Res 2015; 24:1949-61. [PMID: 25702266 DOI: 10.1007/s11136-015-0937-3] [Citation(s) in RCA: 86] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/04/2015] [Indexed: 11/29/2022]
Abstract
AIM Electronic formats (ePROs) of paper-based patient-reported outcomes (PROs) should be validated before they can be reliably used. This review aimed to examine studies investigating measurement equivalence between ePROs and their paper originals to identify methodologies used and to determine the extent of such validation. METHODS Three databases (OvidSP, Web of Science and PubMed) were searched using a set of keywords. Results were examined for compliance with inclusion criteria. Articles or abstracts that directly compared screen-based electronic versions of PROs with their validated paper-based originals, with regard to their measurement equivalence, were included. Publications were excluded if the only instruments reported were stand-alone visual analogue scales or interactive voice response formats. Papers published before 2007 were excluded, as a previous meta-analysis examined papers published before this time. RESULTS Fifty-five studies investigating 79 instruments met the inclusion criteria. 53 % of the 79 instruments studied were condition specific. Several instruments, such as the SF-36, were reported in more than one publication. The most frequently reported formats for ePROs were Web-based versions. In 78 % of the publications, there was evidence of equivalence or comparability between the two formats as judged by study authors. Of the 30 publications that provided preference data, 87 % found that overall participants preferred the electronic format. CONCLUSIONS When examining equivalence between paper and electronic versions of PROs, formats are usually judged by authors to be equivalent. Participants prefer electronic formats. This literature review gives encouragement to the further widespread development and use of ePROs.
Collapse
Affiliation(s)
- Niloufar Campbell
- Centre for Socioeconomic Research, School of Pharmacy and Pharmaceutical Sciences, Cardiff, UK
| | | | | | | |
Collapse
|
12
|
Crisp CC, Fellner AN, Pauls RN. Validation of the Female Sexual Function Index (FSFI) for web-based administration. Int Urogynecol J 2014; 26:219-22. [DOI: 10.1007/s00192-014-2461-3] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2014] [Accepted: 06/19/2014] [Indexed: 10/25/2022]
|
13
|
Hunter J, Corcoran K, Leeder S, Phelps K. Is it time to abandon paper? The use of emails and the Internet for health services research--a cost-effectiveness and qualitative study. J Eval Clin Pract 2013; 19:855-61. [PMID: 22640009 DOI: 10.1111/j.1365-2753.2012.01864.x] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
RATIONALE A multidisciplinary primary care clinic in Sydney, Australia, was planning to use electronic questionnaires to measure patient-reported outcomes. METHODS Semi-structured interviews with 20 patients were undertaken to explore, among other things, practical issues regarding different questionnaire formats. The response rates and costs of email versus postal invitations were also evaluated. RESULTS Compared with postal invitations, email invitations offered a cost-effective and practical alternative, with a greater proportion of patients volunteering for an interview. Assuming the interface is well-designed and user-friendly, many patients were happy to use the Internet to answer questionnaires. Most patients thought alternate formats should also be offered. Patients discussed advantages and disadvantages of the Internet format. Although more younger patients and females had given the clinic an email address; both sexes, and young and old patients, expressed strong preferences for either wanting or not wanting to use the Internet. CONCLUSION Researchers should consider using email invitations as a cost-effective first-line strategy to recruit patients to participate in health services research. Internet questionnaires are potentially cheaper than paper questionnaires, and the format is acceptable to many patients. However, for the time being, concurrent alternate formats need to be offered to ensure wider acceptability and to maximize response rates.
Collapse
Affiliation(s)
- Jennifer Hunter
- Project Manager and Doctoral Candidate Research Assistant Professor and Director, Menzies Centre for Health Policy, School of Public Health University of Sydney, The University of Sydney, New South Wales, Australia Professor and Director, Uclinic, Surry Hills, New South Wales, Australia
| | | | | | | |
Collapse
|
14
|
Web versus paper-based completion of the epidemiology of prolapse and incontinence questionnaire. Female Pelvic Med Reconstr Surg 2013; 19:17-22. [PMID: 23321654 DOI: 10.1097/spv.0b013e31827bfd93] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVES This study aimed to examine the validity and reliability of a Web-based version of the epidemiology of prolapse and incontinence questionnaire (EPIQ). METHODS Participants included 876 women age 38 to 65 years attending primary care clinics in the Salt Lake Valley. Women completed a single Web- or paper-based version of the symptom bother questions from EPIQ, and a subset repeated the same or opposite method at 2 separate time points. To assess subscales for the Web-based version factor, analysis of the 22 EPIQ items related to pelvic floor disorder symptoms was performed using principal components analysis and varimax rotation. Internal consistency was assessed using coefficient α. Test-retest and intermethod reliability were assessed using intraclass correlation coefficients for domain scores. Correlations above 0.70 were considered acceptable. RESULTS Overall, 384 and 492 women completed at least 1 Web and 1 paper EPIQ and 93% were white with mean age of 50 (7) years. Of these, 63 completed Web-Web, 57 Web-paper, 47 paper-Web, and 109 paper-paper test-retest. Overall, factor analyses were consistent with the 7 domains of the original EPIQ. Cronbach α for the 4 symptomatic pelvic floor disorder domains and range of test-retest reliability for the various administration methods were similar to the original EPIQ instrument. Correlations for domain scores were above 0.70, except the anal incontinence scale (intraclass correlation coefficients, 0.68.) CONCLUSIONS Web administration of the EPIQ has similar psychometric properties with comparable internal consistency and test-retest reliability when administered in the same modality. Reliability between both methods of administration is acceptable.
Collapse
|
15
|
Parker-Autry CY, Barber MD, Kenton K, Richter HE. Measuring outcomes in urogynecological surgery: "perspective is everything". Int Urogynecol J 2012; 24:15-25. [PMID: 22930213 DOI: 10.1007/s00192-012-1908-7] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2012] [Accepted: 07/22/2012] [Indexed: 11/28/2022]
Abstract
Over 10 years have passed since the first US National Institutes of Health consensus panel considered the standardization of definitions of pelvic floor conditions and the criteria utilized for reporting pelvic floor research study outcomes. The literature is replete with pelvic floor outcome studies; however, a consistent standardized approach to the evaluation of patients and characterization of outcomes is still needed. The purpose of this overview is to describe how the use of outcome measures has evolved over time and to attempt to help readers utilize the best measures for their clinical and research needs.
Collapse
Affiliation(s)
- Candace Y Parker-Autry
- Department of Obstetrics and Gynecology, Division of Urogynecology and Pelvic Reconstructive Surgery, University of Alabama at Birmingham, Birmingham, AL 35233, USA
| | | | | | | |
Collapse
|
16
|
|
17
|
Management of sternal precautions following median sternotomy by physical therapists in Australia: a web-based survey. Phys Ther 2012; 92:83-97. [PMID: 21949431 DOI: 10.2522/ptj.20100373] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
Abstract
BACKGROUND Sternal precautions are utilized within many hospitals with the aim of preventing the occurrence of sternal complications (eg, infection, wound breakdown) following midline sternotomy. The evidence base for sternal precaution protocols, however, has been questioned due to a paucity of research, unknown effect on patient outcomes, and possible discrepancies in pattern of use among institutions. OBJECTIVE The objective of this study was to investigate and document the use of sternal precautions by physical therapists in the treatment of patients following median sternotomy in hospitals throughout Australia, from immediately postsurgery to discharge from the hospital. DESIGN A cross-sectional, observational design was used. An anonymous, Web-based survey was custom designed for use in the study. METHODS The questionnaire was content validated, and the online functionality was assessed. The senior cardiothoracic physical therapist from each hospital identified as currently performing cardiothoracic surgery (N=51) was invited to participate. RESULTS The response rate was 58.8% (n=30). Both public (n=18) and private (n=12) hospitals in all states of Australia were represented. Management protocols reported by participants included wound support (n=22), restrictions on lifting and transfers (n=23), and restrictions on mobility aid use (n=15). Factors influencing clinical practice most commonly included "workplace practices/protocols" (n=27) and "clinical experience" (n=22). Limitations The study may be limited by response bias. CONCLUSIONS Significant variation exists in the sternal precautions and protocols used in the treatment of patients following median sternotomy in Australian hospitals. Further research is needed to investigate whether the restrictions and precautions used are necessary and whether protocols have an impact on patient outcomes, including rates of recovery and length of stay.
Collapse
|
18
|
Ashley L, Jones H, Thomas J, Forman D, Newsham A, Morris E, Johnson O, Velikova G, Wright P. Integrating cancer survivors' experiences into UK cancer registries: design and development of the ePOCS system (electronic Patient-reported Outcomes from Cancer Survivors). Br J Cancer 2011; 105 Suppl 1:S74-81. [PMID: 22048035 PMCID: PMC3251955 DOI: 10.1038/bjc.2011.424] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Background: Understanding the psychosocial challenges of cancer survivorship, and identifying which patients experience ongoing difficulties, is a key priority. The ePOCS (electronic patient-reported outcomes from cancer survivors) project aims to develop and evaluate a cost-efficient, UK-scalable electronic system for collecting patient-reported outcome measures (PROMs), at regular post-diagnostic timepoints, and linking these with clinical data in cancer registries. Methods: A multidisciplinary team developed the system using agile methods. Design entailed process mapping the system's constituent parts, data flows and involved human activities, and undertaking usability testing. Informatics specialists built new technical components, including a web-based questionnaire tool and tracking database, and established component-connecting data flows. Development challenges were overcome, including patient usability and data linkage and security. Results: We have developed a system in which PROMs are completed online, using a secure questionnaire administration tool, accessed via a public-facing website, and the responses are linked and stored with clinical registry data. Patient monitoring and communications are semiautomated via a tracker database, and patient correspondence is primarily Email-based. The system is currently honed for clinician-led hospital-based patient recruitment. Conclusions: A feasibility test study is underway. Although there are possible challenges to sustaining and scaling up ePOCS, the system has potential to support UK epidemiological PROMs collection and clinical data linkage.
Collapse
Affiliation(s)
- L Ashley
- Psychosocial Oncology and Clinical Practice Research Group, University of Leeds, St James's Institute of Oncology, Beckett Street, Leeds, UK. mail:
| | | | | | | | | | | | | | | | | |
Collapse
|
19
|
Pakbaz M, Rolfsman E, Mogren I, Löfgren M. Vaginal prolapse--perceptions and healthcare-seeking behavior among women prior to gynecological surgery. Acta Obstet Gynecol Scand 2011; 90:1115-20. [PMID: 21692758 DOI: 10.1111/j.1600-0412.2011.01225.x] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
OBJECTIVE To investigate perceptions of vaginal prolapse and healthcare-seeking behavior in women prior to gynecological surgery. DESIGN Prospective, cross-sectional study using a web-based questionnaire. SETTING Clinics including patients in the Swedish National Register for Gynecological Surgery (Gynop-register). POPULATION 214 women with vaginal prolapse and 347 women without prolapse as reference patients. METHODS A questionnaire was developed for assessment of women's perception of prolapse and their healthcare-seeking behavior. Data were collected through the Gynop-register. For comparisons between the study groups, Student's t-test and the chi-squared test were used. MAIN OUTCOME MEASURES Perceptions of prolapse, healthcare-seeking behavior, and source of information. RESULTS The most common definition of prolapse reported by the women was presence of a vaginal bulge. Reasons for seeking healthcare were interference with physical activity and increasing symptoms. One in five women with prolapse could not relate the symptoms to prolapse. Participants in the prolapse group gained less information on their own condition from brochures and public media compared to participants in the reference group (p<0.001). CONCLUSION There appeared to be a lack of information on pelvic organ prolapse in the public domain. Healthcare professionals have a significant role to play in informing women about symptoms related to the condition and the available treatment options.
Collapse
Affiliation(s)
- Mojgan Pakbaz
- Department of Clinical Sciences, Obstetrics and Gynecology Department of Applied Educational Science, Umeå University, Umeå, Sweden.
| | | | | | | |
Collapse
|
20
|
Parnell BA, Dunivan GC, Connolly A, Jannelli ML, Wells EC, Geller EJ. Validation of web-based administration of the Pelvic Organ Prolapse/Urinary Incontinence Sexual Function Questionnaire (PISQ-12). Int Urogynecol J 2010; 22:357-61. [PMID: 20972537 DOI: 10.1007/s00192-010-1297-8] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2010] [Accepted: 09/26/2010] [Indexed: 11/26/2022]
Abstract
INTRODUCTION AND HYPOTHESIS We studied a web-based version of the Pelvic Organ Prolapse/Urinary Incontinence Sexual Function Questionnaire (PISQ-12). METHODS A randomized crossover study in which subjects completed both a web-based and paper-based version of the PISQ-12, with a 2-week separation between the completion of the two versions. Demographic data and questionnaire preferences were also assessed. Group 1 completed the web version first, and group 2 completed the paper version first. RESULTS We recruited 52 women and 50 (96.2%) completed the study. Demographic data were similar for the two groups. There was no difference in total PISQ-12 score (P = 0.41) and a high degree of correlation between versions (r = 0.88). Women preferred the web-based PISQ-12 (77.6%) over the paper-based version. CONCLUSION The web-based version of the PISQ-12 is a reliable alternative to the standard paper-based version and was preferred by women in this study regardless of age, race, and education.
Collapse
Affiliation(s)
- Brent A Parnell
- Department of Obstetrics and Gynecology, Division of Female Pelvic Medicine and Reconstructive Surgery, University of North Carolina at Chapel Hill, Campus Box 7570, Chapel Hill, NC 27599-7570, USA
| | | | | | | | | | | |
Collapse
|