1
|
Alons E, Brauner L, Luinge M, Terwee CB, van Ewijk L, Gerrits E. Identifying Relevant Concepts for the Development of a Communicative Participation Item Bank for Children and Adolescents: A Systematic Review of Existing Instruments. J Speech Lang Hear Res 2024:1-20. [PMID: 38358947 DOI: 10.1044/2024_jslhr-23-00376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/17/2024]
Abstract
PURPOSE This study aims to systematically identify items that measure communicative participation from measurement instruments that measure (aspects of) communication and/or participation in children and adolescents (5-18 years old) with communication disorders, for developing an item bank. METHOD A systematic literature search was performed in MEDLINE and Embase to search for patient-reported outcome measures (PROMs) or parent reports measuring aspects of communication and/or participation in children and adolescents. The individual items of the included measurement instruments were reviewed on whether they measure communicative participation. The items were then classified into one of the International Classification of Functioning, Disability and Health (ICF) for Children and Youth (World Health Organization, 2007) domains of activities and participation. RESULTS A total of 29 instruments were found, nine PROMs and 20 parent reports. One hundred forty-five items were identified that measure communicative participation. From these 145 items, 74 were retrieved from PROMs (51%), and 71 were retrieved from parent reports (49%). The majority of items were classified in ICF Domain 7, interpersonal interactions and relationships (73.8%), followed by Domain 8, major life areas (13.8%), and Domain 9, community, social, and civic life (8.3%). Only a few items were found in Domains 5 and 6, and none was found in Domains 1, 2, and 4. CONCLUSIONS We identified 145 items potentially useful for developing an item bank addressing communicative participation in children and adolescents with communication disorders. However, item development in collaboration with the target population is needed to ensure that these items fully reflect the construct.
Collapse
Affiliation(s)
- Eline Alons
- Research Centre for Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, the Netherlands
- Department of Languages, Literature and Communication, Institute for Language Sciences, Utrecht University, the Netherlands
| | - Laurien Brauner
- Research Centre for Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, the Netherlands
- Department of Languages, Literature and Communication, Institute for Language Sciences, Utrecht University, the Netherlands
| | - Margreet Luinge
- Centre of Expertise Healthy Ageing and Youth, Education and Society, Hanze University of Applied Sciences, Groningen, the Netherlands
| | - Caroline B Terwee
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit, the Netherlands
- Methodology Program, Amsterdam Public Health Research Institute, the Netherlands
| | - Lizet van Ewijk
- Research Centre for Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, the Netherlands
| | - Ellen Gerrits
- Research Centre for Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, the Netherlands
- Department of Languages, Literature and Communication, Institute for Language Sciences, Utrecht University, the Netherlands
| |
Collapse
|
2
|
Oosterveer DM, van Meijeren-Pont W, Arwert H, Terwee CB, Vliet Vlieland TP. The psychometric properties of the PROMIS® profile CAT in people with stroke. Top Stroke Rehabil 2024:1-7. [PMID: 38334131 DOI: 10.1080/10749357.2024.2312642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Accepted: 01/27/2024] [Indexed: 02/10/2024]
Abstract
BACKGROUND The Patient-Reported Outcomes Measurement Information System® (PROMIS) Profile Computer Adaptive Testing (CAT) consists of seven CATs and one single item measuring most relevant aspects of health-related quality of life (HRQoL). The aim of our study was to determine construct validity and floor and ceiling effects of the PROMIS Profile CAT in Dutch people with stroke. METHODS People with stroke receiving rehabilitation completed the PROMIS Profile CAT and the EuroQol-5 dimensions (EQ5D). Construct validity was evaluated with hypotheses testing based on expected correlations between the profile domains and the domains of the EQ5D. The proportion of participants with the lowest and highest scores were calculated for each profile domain to assess floor and ceiling effects. RESULTS 160 participants were included (median age 61 years, 41.9% female). For the PROMIS Profile domains Physical Function, Anxiety, Depression, Sleep Disturbance, Pain Interference, and Pain Intensity > 75% of the results met our hypotheses. For Fatigue and Ability to Participate in Social Roles and Activities only 60% of hypotheses were met. No floor or ceiling effects were found, with the exception of a floor effect for Pain Intensity which probably indicates that many participants had no pain. CONCLUSION Most domains of the PROMIS Profile CAT showed sufficient construct validity and no problematic floor or ceiling effects in people with stroke. These CATs and the single item Pain Intensity can be used to efficiently measure HRQoL in people with stroke.
Collapse
Affiliation(s)
- Daniëlla M Oosterveer
- Basalt, Leiden/The Hague, The Netherlands
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Leiden, The Netherlands
- Department of Rehabilitation, Alrijne Hospital, Leiden, The Netherlands
| | - Winke van Meijeren-Pont
- Basalt, Leiden/The Hague, The Netherlands
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Leiden, The Netherlands
| | - Henk Arwert
- Basalt, Leiden/The Hague, The Netherlands
- Haaglanden Medical Center, Department of Rehabilitation, The Hague, The Netherlands
| | - Caroline B Terwee
- Amsterdam UMC, Vrije Universiteit Amsterdam, Department of Epidemiology and Data Science, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute - Methodology, Amsterdam, The Netherlands
| | - Thea Pm Vliet Vlieland
- Basalt, Leiden/The Hague, The Netherlands
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
3
|
Dubbelman MA, Postema MC, Jutten RJ, Harrison JE, Ritchie CW, Aleman A, de Jong FJ, Schalet BD, Terwee CB, van der Flier WM, Scheltens P, Sikkes SAM. What's in a score: A longitudinal investigation of scores based on item response theory and classical test theory for the Amsterdam Instrumental Activities of Daily Living Questionnaire in cognitively normal and impaired older adults. Neuropsychology 2024; 38:96-105. [PMID: 37676135 DOI: 10.1037/neu0000914] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/08/2023] Open
Abstract
OBJECTIVE We aimed to investigate whether item response theory (IRT)-based scoring allows for a more accurate, responsive, and less biased assessment of everyday functioning than traditional classical test theory (CTT)-based scoring, as measured with the Amsterdam Instrumental Activities of Daily Living Questionnaire. METHOD In this longitudinal multicenter study including cognitively normal and impaired individuals, we examined IRT-based and CTT-based score distributions and differences between diagnostic groups using linear regressions, and investigated scale attenuation. We compared change over time between scoring methods using linear mixed models with random intercepts and slopes for time. RESULTS Two thousand two hundred ninety-four participants were included (66.6 ± 7.7 years, 54% female): n = 2,032 (89%) with normal cognition, n = 93 (4%) with subjective cognitive decline, n = 79 (3%) with mild cognitive impairment, and n = 91 (4%) with dementia. At baseline, IRT-based and CTT-based scores were highly correlated (r = -0.92). IRT-based scores showed less scale attenuation than CTT-based scores. In a subsample of n = 1,145 (62%) who were followed for a mean of 1.3 (SD = 0.6) years, IRT-based scores declined significantly among cognitively normal individuals (unstandardized coefficient [B] = -0.15, 95% confidence interval, 95% CI [-0.28, -0.03], effect size = -0.02), whereas CTT-based scores did not (B = 0.20, 95% CI [-0.02, 0.41], effect size = 0.02). In the other diagnostic groups, effect sizes of change over time were similar. CONCLUSIONS IRT-based scores were less affected by scale attenuation than CTT-based scores. With regard to responsiveness, IRT-based scores showed more signal than CTT-based scores in early disease stages, highlighting the IRT-based scores' superior suitability for use in preclinical populations. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
Affiliation(s)
- Mark A Dubbelman
- Department of Neurology, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC
| | - Merel C Postema
- Department of Neurology, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC
| | - Roos J Jutten
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School
| | - John E Harrison
- Department of Neurology, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC
| | | | - André Aleman
- Department of Neurosciences, University Medical Center Groningen, University of Groningen
| | | | | | | | - Wiesje M van der Flier
- Department of Neurology, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC
| | - Philip Scheltens
- Department of Neurology, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC
| | - Sietske A M Sikkes
- Department of Neurology, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC
| |
Collapse
|
4
|
Terluin B, Trigg A, Fromy P, Schuller W, Terwee CB, Bjorner JB. Estimating anchor-based minimal important change using longitudinal confirmatory factor analysis. Qual Life Res 2023:10.1007/s11136-023-03577-w. [PMID: 38151593 DOI: 10.1007/s11136-023-03577-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/01/2023] [Indexed: 12/29/2023]
Abstract
PURPOSE The minimal important change (MIC) is defined as the smallest within-individual change in a patient-reported outcome measure (PROM) that patients on average perceive as important. We describe a method to estimate this value based on longitudinal confirmatory factor analysis (LCFA). The method is evaluated and compared with a recently published method based on longitudinal item response theory (LIRT) in simulated and real data. We also examined the effect of sample size on bias and precision of the estimate. METHODS We simulated 108 samples with various characteristics in which the true MIC was simulated as the mean of individual MICs, and estimated MICs based on LCFA and LIRT. Additionally, both MICs were estimated in existing PROMIS Pain Behavior data from 909 patients. In another set of 3888 simulated samples with sample sizes of 125, 250, 500, and 1000, we estimated LCFA-based MICs. RESULTS The MIC was equally well recovered with the LCFA-method as using the LIRT-method, but the LCFA analyses were more than 50 times faster. In the Pain Behavior data (with higher scores indicating more pain behavior), an LCFA-based MIC for improvement was estimated to be 2.85 points (on a simple sum scale ranging 14-42), whereas the LIRT-based MIC was estimated to be 2.60. The sample size simulations showed that smaller sample sizes decreased the precision of the LCFA-based MIC and increased the risk of model non-convergence. CONCLUSION The MIC can accurately be estimated using LCFA, but sample sizes need to be preferably greater than 125.
Collapse
Affiliation(s)
- Berend Terluin
- Department of General Practice, Amsterdam UMC, Vrije Universiteit Amsterdam, de Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands.
- Amsterdam Public Health research institute, Amsterdam, The Netherlands.
| | - Andrew Trigg
- Medical Affairs Statistics, Bayer plc, Reading, UK
| | - Piper Fromy
- SeeingTheta, 2 Chemin des Vaux, 49400, Saumur, France
| | - Wouter Schuller
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, de Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
- Spine Clinic, Provinciale weg 152-154, 1506 ME, Zaandam, The Netherlands
| | - Caroline B Terwee
- Amsterdam Public Health research institute, Amsterdam, The Netherlands
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, de Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
| | - Jakob B Bjorner
- QualityMetric, Johnston, Rhode Island, USA
- Department of Public Health, University of Copenhagen, Copenhagen, Denmark
- National Research Centre for the Working Environment, Copenhagen, Denmark
| |
Collapse
|
5
|
Terwee CB, Roorda LD. Country-specific reference values for PROMIS ® pain, physical function and participation measures compared to US reference values. Ann Med 2023; 55:1-11. [PMID: 36426680 PMCID: PMC9704075 DOI: 10.1080/07853890.2022.2149849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
Abstract
INTRODUCTION Patient-Reported Outcomes Measurement Information System (PROMIS®) is commonly used across medical conditions. To facilitate interpretation of scores across countries, we calculated Dutch reference values for PROMIS Physical Function (PROMIS-PF), Pain Interference (PROMIS-PI), Pain Behavior (PROMIS-PB), Ability to Participate in Social Roles and Activities (PROMIS-APSRA), and Satisfaction with Social Roles and Activities (PROMIS-SSRA), as compared to US reference values. PATIENTS AND METHODS A panel completed full PROMIS-PF (n=1310), PROMIS-PI and PROMIS-PB (n=1052), and PROMIS-APSRA and PROMIS-SSRA (n=1002) item banks and reported their level of health per domain (no, mild, moderate, severe limitations). T-scores were calculated by sample and subgroups (age, gender, self-reported level of domain). Distribution-based and anchor-based thresholds for mild, moderate, and severe scores were determined. RESULTS Mean T-scores were close to the US mean of 50 for PROMIS-PF (49.8) and PROMIS-APSRA (50.6), lower for PROMIS-SSRA (47.5) and higher for PROMIS-PI (54.9) and PROMIS-PB (52.0). Distribution-based thresholds for mild, moderate, and severe scores were comparable to US recommended cut-off values (except for PROMIS-PI) but participants reported limitations 'earlier' than suggested thresholds. CONCLUSION Dutch reference values were close to US reference values for some PROMIS domains but not all. We recommend country-specific reference values to facilitate worldwide PROMIS use.KEY MESSAGESPROMIS offers universally applicable IRT-based efficient and patient-friendly measures to assess commonly relevant patient-reported outcomes across medical conditions.To support the use of PROMIS in daily clinical practice and research across the world, country-specific general population reference values should be obtained.More research is necessary to obtain reliable and valid cut-off values for what constitutes mild, moderate and severe scores from the patients' perspective.
Collapse
Affiliation(s)
- Caroline B Terwee
- Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.,Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Leo D Roorda
- Amsterdam Rehabilitation Research Center
- Reade, Amsterdam, The Netherlands
| |
Collapse
|
6
|
Gorst SL, Seylanova N, Dodd SR, Harman NL, O'Hara M, Terwee CB, Williamson PR, Needham DM, Munblit D, Nicholson TR. Core outcome measurement instruments for use in clinical and research settings for adults with post-COVID-19 condition: an international Delphi consensus study. Lancet Respir Med 2023; 11:1101-1114. [PMID: 37926103 DOI: 10.1016/s2213-2600(23)00370-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Revised: 07/04/2023] [Accepted: 09/26/2023] [Indexed: 11/07/2023]
Abstract
Post-COVID-19 condition (also known as long COVID) is a new, complex, and poorly understood disorder. A core outcome set (COS) for post-COVID-19 condition in adults has been developed and agreement is now required on the most appropriate measurement instruments for these core outcomes. We conducted an international consensus study involving multidisciplinary experts and people with lived experience of long COVID. The study comprised a literature review to identify measurement instruments for the core outcomes, a three-round online modified Delphi process, and an online consensus meeting to generate a core outcome measurement set (COMS). 594 individuals from 58 countries participated. The number of potential instruments for the 12 core outcomes was reduced from 319 to 19. Consensus was reached for inclusion of the modified Medical Research Council Dyspnoea Scale for respiratory outcomes. Measures for two relevant outcomes from a previously published COS for acute COVID-19 were also included: time until death, for survival, and the Recovery Scale for COVID-19, for recovery. Instruments were suggested for consideration for the remaining nine core outcomes: fatigue or exhaustion, pain, post-exertion symptoms, work or occupational and study changes, and cardiovascular, nervous system, cognitive, mental health, and physical outcomes; however, consensus was not achieved for instruments for these outcomes. The recommended COMS and instruments for consideration provide a foundation for the evaluation of post-COVID-19 condition in adults, which should help to optimise clinical care and accelerate research worldwide. Further assessment of this COMS is warranted as new data emerge on existing and novel measurement instruments.
Collapse
Affiliation(s)
- Sarah L Gorst
- MRC-NIHR Trials Methodology Research Partnership, Department of Health Data Science, University of Liverpool, Liverpool, UK
| | | | - Susanna R Dodd
- MRC-NIHR Trials Methodology Research Partnership, Department of Health Data Science, University of Liverpool, Liverpool, UK
| | - Nicola L Harman
- MRC-NIHR Trials Methodology Research Partnership, Department of Health Data Science, University of Liverpool, Liverpool, UK
| | | | - Caroline B Terwee
- Methodology Program, Amsterdam Public Health Research Institute, and Department of Epidemiology and Data Science, Amsterdam UMC, Amsterdam, Netherlands
| | - Paula R Williamson
- MRC-NIHR Trials Methodology Research Partnership, Department of Health Data Science, University of Liverpool, Liverpool, UK
| | - Dale M Needham
- Outcomes After Critical Illness and Surgery Research Group, Pulmonary and Critical Care Medicine, Department of Medicine, and Department of Physical Medicine and Rehabilitation, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Daniel Munblit
- Department of Paediatrics and Paediatric Infectious Diseases, Institute of Child's Health, Sechenov First Moscow State Medical University (Sechenov University), Moscow, Russia; Research and Clinical Center for Neuropsychiatry, Moscow, Russia; Care for Long Term Conditions Division, Florence Nightingale Faculty of Nursing, Midwifery and Palliative Care, King's College London, London, UK
| | - Timothy R Nicholson
- Neuropsychiatry Research and Education Group, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK.
| |
Collapse
|
7
|
Terwee CB. Common measures or common metrics? the value of IRT-based common metrics. J Patient Rep Outcomes 2023; 7:117. [PMID: 37982948 PMCID: PMC10661660 DOI: 10.1186/s41687-023-00657-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 11/13/2023] [Indexed: 11/21/2023] Open
Abstract
There is a clear need to harmonize outcome measurement. Some authors propose to express scores as T scores to facilitate interpretation of PROM results in clinical practice. While this is a step in the right direction, there are important limitations to the acceptance of the T score metric as a common metric when T scores are based on raw sum scores of ordinal items: Such T scores of different instruments are not exactly comparable because they are not interval scaled; T scores of different measures are only on the same scale if exactly the same reference group is used; and the T sore metric cannot be maintained because it is reference population-dependent and needs to be updated regularly. These limitations can be overcome by using an item response theory (IRT)-based metric. Items from different measures can be placed on the same IRT metric to make scores comparable on an interval scale. The PROMIS initiative used IRT to develop item banks for measuring various health outcomes. Other PROMs have been linked to the PROMIS metric. Although PROMIS uses a T-score metric for practical reasons, the underlying PROMIS metric is actually an IRT metric. An IRT approach also enables further development of an item bank while preserving the underlying metric. Therefore, IRT-based metrics should be considered as common metrics for the future.
Collapse
Affiliation(s)
- Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, the Netherlands.
| |
Collapse
|
8
|
van Geel N, Duponselle J, Delbaere L, Herbelet S, Eleftheriadou V, Ezzedine K, Forman M, Garg A, Hamzavi IH, Seneschal J, Spuls P, Terwee CB, Wolkerstorfer A, Speeckaert R, Pandya AG. Clinician-reported outcome measures for the assessment of vitiligo: A scoping review. J Eur Acad Dermatol Venereol 2023; 37:2231-2242. [PMID: 37602494 DOI: 10.1111/jdv.19448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 08/04/2023] [Indexed: 08/22/2023]
Abstract
Clinician-reported outcome measures (ClinROMs) are essential for assessment of vitiligo in clinical trials and daily practice. Several instruments have been developed and tested to measure, for example, vitiligo extent, repigmentation and activity. The goal of this review was to identify all introductory publications of ClinROMs for vitiligo that include at least some aspects of validation and to describe the instruments' characteristics, intention for use and practical strengths and limitations. A search strategy was conducted in PubMed, Embase and Cochrane Library (CENTRAL) from inception to July 2022. Based on the literature search (n = 2860), 10 articles were identified, describing 14 different ClinROMs. Six ClinRoms measured disease extent and/or repigmentation, seven evaluated disease activity and one was a composite score. The Vitiligo Area Scoring Index (VASI), and Vitiligo Extent Score (VES and VESplus) measure overall disease extent and/or repigmentation. The VASI relies on hand units (1% body surface area), whereas the VES and VESplus use a picture-based scoring technique. The Vitiligo Extent Score for a Target Area (VESTA) measures repigmentation percentage for target lesions. One global assessment score for extent has been validated. Vitiligo disease activity scores included a static measure of clinical activity signs (Vitiligo Signs of Activity Score [VSAS]) and two measures assessing dynamic evolution (Vitiligo Disease Activity Score [VDAS] and Vitiligo Disease Improvement Score [VDIS]). The Vitiligo European Task Force assessment tool (VETFa) is a composite score. Depending on the practical strengths and limitations as well as the research question and setting (clinical trials vs. daily practice), the choice of an appropriate ClinROM may differ. Fourteen ClinROMs in vitiligo were identified to measure vitiligo extent, repigmentation, and activity. Further research evaluating the validity, reliability, and responsiveness of each instrument and worldwide consensus on which instrument to use for a specific outcome (domain) is greatly needed.
Collapse
Affiliation(s)
- Nanja van Geel
- Department of Dermatology, Ghent University Hospital, Ghent, Belgium
| | - Jolien Duponselle
- Department of Dermatology, Ghent University Hospital, Ghent, Belgium
| | - Liesbeth Delbaere
- Department of Dermatology, Ghent University Hospital, Ghent, Belgium
| | - Sandrine Herbelet
- Department of Dermatology, Ghent University Hospital, Ghent, Belgium
| | | | - Khaled Ezzedine
- Department of Dermatology, University Hospital Henri Mondor, EpiDermE EA 7379, Université Paris-Est Créteil Val de Marne, Créteil, France
| | | | - Amit Garg
- Department of Dermatology, Donald and Barbara Zucker School of Medicine at Hofstra/Northwell, New Hyde Park, New York, USA
| | - Iltefat H Hamzavi
- Department of Dermatology, Henry Ford Health, Detroit, Michigan, USA
| | - Julien Seneschal
- Department of Dermatology and Pediatric Dermatology, National Reference Center for Rare Skin disorders, Hospital Saint-André, University of Bordeaux, CNRS UMR 5164, ImmunoConcept, Bordeaux, France
| | - Phyllis Spuls
- Department of Dermatology, Amsterdam Public Health/Infection and Immunology, Location AMC, A0-227, University of Amsterdam, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Albert Wolkerstorfer
- Department of Dermatology, Amsterdam Public Health/Infection and Immunology, Location AMC, A0-227, University of Amsterdam, Amsterdam, The Netherlands
| | | | - Amit G Pandya
- Department of Dermatology, The University of Texas Southwestern Medical Center, Dallas, Texas, USA
| |
Collapse
|
9
|
Liegl G, Roorda LD, Terwee CB, Steultjens M, Roos EM, Guillemin F, Benedetti MG, Dagfnrud H, de Carvalho Bastone A, Peter WF. Correction to: Suitability of the animated activity questionnaire for use as computer adaptive test: establishing the AAQ‑CAT. Qual Life Res 2023; 32:3003. [PMID: 37493901 PMCID: PMC10473977 DOI: 10.1007/s11136-023-03490-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/27/2023]
Affiliation(s)
- Gregor Liegl
- Center for Patient-Centered Outcomes Research, Charité- Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität Zu Berlin, Berlin, Germany.
| | - Leo D Roorda
- Amsterdam Rehabilitation Research Center | Reade, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Martijn Steultjens
- School of Health and Life Sciences, Glasgow Caledonian University, Glasgow, UK
| | - Ewa M Roos
- Institute of Sports Science and Clinical Biomechanics, University of Southern Denmark, Odense, Denmark
| | - Francis Guillemin
- EA 4360 APEMAC, Inserm CIC-EC 1433, University Hospital, Université de Lorraine, Nancy, France
| | - Maria Grazia Benedetti
- Physical Medicine and Rehabilitation Unit, IRCCS Istituto Ortopedico Rizzoli, Bologna, Italy
| | - Hanne Dagfnrud
- Diakonhjemmet Hospital, Oslo, Norway
- University of Oslo, Oslo, Norway
| | - Alessandra de Carvalho Bastone
- Department of Physical Therapy, Universidade Federal dos Vales do Jequitinhonha e Mucuri (UFVJM), Diamantina, MG, Brazil
| | - Wilfred F Peter
- Amsterdam Rehabilitation Research Center | Reade, Amsterdam, The Netherlands
| |
Collapse
|
10
|
Oosterveer DM, van Meijeren-Pont W, van Markus-Doornbosch F, Stegeman E, Terwee CB, Ribbers GM, Vliet Vlieland TP. Translation and cross-cultural adaptation of the ICHOM standard set for stroke: the Dutch version. J Patient Rep Outcomes 2023; 7:91. [PMID: 37695409 PMCID: PMC10495300 DOI: 10.1186/s41687-023-00630-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Accepted: 08/28/2023] [Indexed: 09/12/2023] Open
Abstract
INTRODUCTION The International Consortium for Health Outcomes Measurement (ICHOM) developed a standard set of patient-centered outcome measures for use in stroke patients. In addition to the Patient-Reported Outcomes Measurement Information System (PROMIS) Global Health, it is comprised of 25 questions that are not part of a specific questionnaire. This study aimed to translate these 25 single questions into Dutch. METHODS Two native Dutch-speaking translators independently translated the original ICHOM questions into Dutch. A consensus translation was made by these translators and a third person. This translation was subsequently translated back to English independently by two native English-speaking translators. Afterwards a pre-final version was made by consensus of a committee. After field-testing among 30 stroke patients, a final version was made. RESULTS The forward and backward translations led to eight cross-cultural adaptations. Based on the interviews with stroke patients, 12 questions were changed to enhance comprehensibility leading to a final Dutch translation of the 25 single questions. CONCLUSIONS A Dutch translation of the 25 single questions of the ICHOM Standard Set for Stroke was developed. Now a complete ICHOM Standard Set for Stroke can be used in Dutch populations allowing comparison and improvement of stroke care.
Collapse
Affiliation(s)
- Daniëlla M Oosterveer
- Basalt, Wassenaarseweg 501, 2333 AL, Leiden/The Hague, The Netherlands.
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Leiden, The Netherlands.
- Alrijne, Department of Rehabilitation Medicine, Leiden, The Netherlands.
| | - Winke van Meijeren-Pont
- Basalt, Wassenaarseweg 501, 2333 AL, Leiden/The Hague, The Netherlands
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Leiden, The Netherlands
| | - Frederike van Markus-Doornbosch
- Basalt, Wassenaarseweg 501, 2333 AL, Leiden/The Hague, The Netherlands
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Leiden, The Netherlands
| | - Etienne Stegeman
- Basalt, Wassenaarseweg 501, 2333 AL, Leiden/The Hague, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute - Methodology, Amsterdam, The Netherlands
| | - Gerard M Ribbers
- Department of Rehabilitation, Erasmus University Medical Center, Rotterdam, The Netherlands
- Rijndam Rehabilitation Center, Rotterdam, The Netherlands
| | - Thea Pm Vliet Vlieland
- Basalt, Wassenaarseweg 501, 2333 AL, Leiden/The Hague, The Netherlands
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
11
|
Terwee CB, Elders PJM, Blom MT, Beulens JW, Rolandsson O, Rogge AA, Rose M, Harman N, Williamson PR, Pouwer F, Mokkink LB, Rutters F. Patient-reported outcomes for people with diabetes: what and how to measure? A narrative review. Diabetologia 2023; 66:1357-1377. [PMID: 37222772 PMCID: PMC10317894 DOI: 10.1007/s00125-023-05926-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 03/03/2023] [Indexed: 05/25/2023]
Abstract
Patient-reported outcomes (PROs) are valuable for shared decision making and research. Patient-reported outcome measures (PROMs) are questionnaires used to measure PROs, such as health-related quality of life (HRQL). Although core outcome sets for trials and clinical practice have been developed separately, they, as well as other initiatives, recommend different PROs and PROMs. In research and clinical practice, different PROMs are used (some generic, some disease-specific), which measure many different things. This is a threat to the validity of research and clinical findings in the field of diabetes. In this narrative review, we aim to provide recommendations for the selection of relevant PROs and psychometrically sound PROMs for people with diabetes for use in clinical practice and research. Based on a general conceptual framework of PROs, we suggest that relevant PROs to measure in people with diabetes are: disease-specific symptoms (e.g. worries about hypoglycaemia and diabetes distress), general symptoms (e.g. fatigue and depression), functional status, general health perceptions and overall quality of life. Generic PROMs such as the 36-Item Short Form Health Survey (SF-36), WHO Disability Assessment Schedule (WHODAS 2.0), or Patient-Reported Outcomes Measurement Information System (PROMIS) measures could be considered to measure commonly relevant PROs, supplemented with disease-specific PROMs where needed. However, none of the existing diabetes-specific PROM scales has been sufficiently validated, although the Diabetes Symptom Self-Care Inventory (DSSCI) for measuring diabetes-specific symptoms and the Diabetes Distress Scale (DDS) and Problem Areas in Diabetes (PAID) for measuring distress showed sufficient content validity. Standardisation and use of relevant PROs and psychometrically sound PROMs can help inform people with diabetes about the expected course of disease and treatment, for shared decision making, to monitor outcomes and to improve healthcare. We recommend further validation studies of diabetes-specific PROMs that have sufficient content validity for measuring disease-specific symptoms and consider generic item banks developed based on item response theory for measuring commonly relevant PROs.
Collapse
Affiliation(s)
- Caroline B Terwee
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, the Netherlands.
| | - Petra J M Elders
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, the Netherlands
- Amsterdam UMC, Department of General Practice, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Marieke T Blom
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, the Netherlands
| | - Joline W Beulens
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Olaf Rolandsson
- Department of Public Health and Clinical Medicine, Family Medicine, Umeå University, Umeå, Sweden
| | - Alize A Rogge
- Center for Patient-Centered Outcomes Research, Department of Psychosomatic Medicine, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Matthias Rose
- Center for Patient-Centered Outcomes Research, Department of Psychosomatic Medicine, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Nicola Harman
- Department of Health Data Science, University of Liverpool, Liverpool, UK
| | - Paula R Williamson
- Department of Health Data Science, University of Liverpool, Liverpool, UK
| | - Frans Pouwer
- Steno Diabetes Center Odense, Odense, Denmark
- Department of Psychology, University of Southern Denmark, Odense, Denmark
- Amsterdam UMC, Department of Medical Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Lidwine B Mokkink
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, the Netherlands
| | - Femke Rutters
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| |
Collapse
|
12
|
Ter Wal N, van Ewijk L, Visser-Meily JMA, Volkmer A, Gerrits E, Terwee CB. Further development in measuring communicative participation: identifying items to extend the applicability of the communicative participation item bank. J Patient Rep Outcomes 2023; 7:49. [PMID: 37237158 DOI: 10.1186/s41687-023-00586-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Accepted: 04/24/2023] [Indexed: 05/28/2023] Open
Abstract
BACKGROUND The ability to communicate is a prerequisite for participation in today's society. To measure participation in adults with communication disorders, the Communicative Participation Item Bank (CPIB) was developed in 2006. Since then, several new PROMs have been developed to measure communication and the impact of communication disorders on participation. Moreover, the CPIB items do not all appear to be relevant to certain populations with communication problems and context of communicative participation is changing rapidly, given the increased use of digital communication forms. The purpose of this study was to identify new PROMs developed since 2006 that aim to measure (aspects of) communication, in order to select items that are suitable for expanding the Communicative Participation Item Bank to make the item bank more widely applicable (e.g., to the hearing-impaired population) and tailored to the current societal context. METHODS Medline and Embase were used to search for PROMs that aim to measure (aspects of) communication. Each new PROM as well as the CPIB, was evaluated to determine to what extent it contains items that measure communicative participation and to what extent these items capture all communicative participation domains by linking each item to the ICF Activities and Participation domains. RESULTS This study identified 31 new PROMs, containing 391 items that were labelled as measuring communicative participation. The majority of the 391 items measure aspects of ICF Activities and Participation domain 'communication', followed by the domain 'interpersonal interactions and relationships'. The other ICF Activity and Participation domains were less often addressed. Analysis of the CPIB showed that items do not cover all domains of participation as defined in the ICF, such as the 'major life areas' domain. CONCLUSIONS We found a potential pool of 391 items measuring communicative participation that could be considered for extending the CPIB. We found items in domains that are already present in the CPIB, but also items that relate to new domains, such as an item on talking with customers or clients for the 'major life areas' domain. Inclusion of new items in other domains would benefit the comprehensiveness of the item bank.
Collapse
Affiliation(s)
- Nicole Ter Wal
- Research Centre Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, P.O. box 12011, Utrecht, 3501 AA, The Netherlands.
- Department of Languages, Literature and Communication, Utrecht Institute of Linguistics OTS, Utrecht University, Utrecht, The Netherlands.
| | - Lizet van Ewijk
- Research Centre Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, P.O. box 12011, Utrecht, 3501 AA, The Netherlands
| | - Johanna M A Visser-Meily
- Department of Rehabilitation, Physical Therapy Science & Sports, UMC Utrecht Brain Centre, University Medical Centre Utrecht, Utrecht, The Netherlands
- Centre of Excellence for Rehabilitation Medicine, UMC Utrecht Brain Centre, De Hoogstraat Rehabilitation, University Medical Centre Utrecht and Utrecht University, Utrecht, The Netherlands
| | - Anna Volkmer
- Department of Language and Cognition, University College London, London, UK
| | - Ellen Gerrits
- Research Centre Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, P.O. box 12011, Utrecht, 3501 AA, The Netherlands
- Department of Languages, Literature and Communication, Utrecht Institute of Linguistics OTS, Utrecht University, Utrecht, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam Public Health research institute, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
13
|
Wang Y, Devji T, Carrasco-Labra A, King MT, Terluin B, Terwee CB, Walsh M, Furukawa TA, Guyatt GH. A step-by-step approach for selecting an optimal minimal important difference. BMJ 2023; 381:e073822. [PMID: 37236647 DOI: 10.1136/bmj-2022-073822] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Affiliation(s)
- Yuting Wang
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON L8S 4L8, Canada
| | - Tahira Devji
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON L8S 4L8, Canada
- Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Alonso Carrasco-Labra
- Department of Preventive and Restorative Sciences; Center for Integrative Global Oral Health, School of Dental Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Madeleine T King
- School of Psychology, University of Sydney, Sydney, NSW, Australia
| | - Berend Terluin
- Vrije Universiteit Medical Centre Amsterdam, Department of General Practice, Amsterdam, Netherlands
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, Netherlands
| | - Caroline B Terwee
- Vrije Universiteit Medical Centre Amsterdam, Department of Epidemiology and Data Science, Amsterdam, Netherlands
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, Netherlands
| | - Michael Walsh
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON L8S 4L8, Canada
- Department of Medicine, McMaster University, Hamilton, ON, Canada
- Population Health Research Institute, Hamilton Health Sciences/McMaster University, Hamilton, ON, Canada
| | - Toshi A Furukawa
- Department of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan
| | - Gordon H Guyatt
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON L8S 4L8, Canada
| |
Collapse
|
14
|
Voshaar MO, Terwee CB, Haverman L, van der Kolk B, Harkes M, van Woerden CS, van Breda F, Breukink S, de Hoop I, Vermeulen H, de Graaf E, Hazelzet J, van Leiden B, Stienen J, Hoekstra M, Bart H, van Bommel H, Determann D, Verburg M, van der Wees P, Beurskens AJ. Correction: Development of a standard set of PROs and generic PROMs for Dutch medical specialist care. Qual Life Res 2023; 32:1607. [PMID: 37022586 PMCID: PMC10172220 DOI: 10.1007/s11136-023-03412-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/07/2023]
Affiliation(s)
- Martijn Oude Voshaar
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands.
- Department of Medical Cell BioPhysics & TechMed Center, University of Twente, Enschede, The Netherlands.
| | - Caroline B Terwee
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
- Epidemiology and Data Science, Amsterdam UMC Location Vrije Universiteit, Amsterdam, the Netherlands
- Methodology, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Lotte Haverman
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
- Dutch Society of Medical Specialists, Amphia Hospital, Utrecht, The Netherlands
- Dutch Nurses' Association, Amphia Hospital, Utrecht, The Netherlands
| | - Bas van der Kolk
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
| | - Marleen Harkes
- Dutch Society of Medical Specialists, Amphia Hospital, Utrecht, The Netherlands
| | | | - Fenna van Breda
- Dutch Society of Medical Specialists, Amphia Hospital, Utrecht, The Netherlands
| | - Stephanie Breukink
- Dutch Society of Medical Specialists, Amphia Hospital, Utrecht, The Netherlands
| | - Irma de Hoop
- Dutch Nurses' Association, Amphia Hospital, Utrecht, The Netherlands
| | - Hester Vermeulen
- Dutch Nurses' Association, Amphia Hospital, Utrecht, The Netherlands
| | - Evelien de Graaf
- Dutch Nurses' Association, Amphia Hospital, Utrecht, The Netherlands
| | - Jan Hazelzet
- Dutch Federation of University Medical Centres, Utrecht, The Netherlands
| | | | - Jozette Stienen
- Dutch Hospital Association &, Amphia Hospital, Breda, The Netherlands
| | | | - Hans Bart
- The Netherlands Patients Federation, Utrecht, The Netherlands
| | - Hester van Bommel
- Pharos - Dutch Centre of Expertise On Health Disparities, Utrecht, The Netherlands
| | - Domino Determann
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
| | - Mariët Verburg
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
| | - Philip van der Wees
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
- Radboud University Medical Center, Radboud Institute for Health Sciences, IQ Healthcare and Department of Rehabilitation, Nijmegen, The Netherlands
| | - Anna J Beurskens
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
- Department of Family Medicine, CAPHRI School for Public Health and Primary Care, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
15
|
Terwee CB, van der Willik EM, van Breda F, van Jaarsveld BC, van de Putte M, Jetten IW, Dekker FW, Meuleman Y, van Ittersum FJ. Responsiveness and minimal important change of seven PROMIS computerized adaptive tests (CAT) in patients with advanced chronic kidney disease. J Patient Rep Outcomes 2023; 7:35. [PMID: 37016107 PMCID: PMC10073363 DOI: 10.1186/s41687-023-00574-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Accepted: 03/11/2023] [Indexed: 04/06/2023] Open
Abstract
BACKGROUND The Patient-Reported Outcomes Measurement Information System (PROMIS®) has the potential to harmonize the measurement of health-related quality of life (HRQL) across medical conditions. We evaluated responsiveness and minimal important change (MIC) of seven Dutch-Flemish PROMIS computerized adaptive tests (CAT) in Dutch patients with advanced chronic kidney disease (CKD). METHODS CKD patients (eGFR < 30 ml/min.1.73m2) completed at baseline and after 6 months seven PROMIS CATs (assessing physical function, pain interference, fatigue, sleep disturbance, anxiety, depression, and ability to participate in social roles and activities), Short Form Health Survey 12 (SF-12), PROMIS Pain Intensity single item, Dialysis Symptom Index (DSI), and Global Rating Scales (GRS) of change. Responsiveness was assessed by testing predefined hypotheses about expected correlations among measures, area under the ROC Curve, and effect sizes. MIC was determined with predictive modelling. RESULTS 207 patients were included; 186 (90%) completed the follow-up. Most results were in accordance with expectations (70-91% of hypotheses confirmed), with some exceptions for PROMIS Anxiety and Ability to Participate (60% and 42% of hypotheses confirmed, respectively). For PROMIS Anxiety and Depression correlations with the GRS were too low (0.04 and 0.20, respectively) to calculate a MIC. MIC values, representing minimal important deterioration, ranged from 0.4 to 2.5 T-score points for the other domains. CONCLUSION We found sufficient responsiveness of PROMIS CATs Physical Function, Fatigue, Sleep Disturbance, and Depression. The results for PROMIS CATs Pain Interference were almost sufficient, but some results for Anxiety and Ability to Participate in Social Roles and Activities were not as expected. Reported MIC values should be interpreted with caution because most patients did not change.
Collapse
Affiliation(s)
- Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit, P.O. box 7057, Amsterdam, 1007 MB, the Netherlands.
- Amsterdam Public Health research institute, Methodology, Amsterdam, The Netherlands.
| | - Esmee M van der Willik
- Department of Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit, P.O. box 7057, Amsterdam, 1007 MB, the Netherlands
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Fenna van Breda
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Brigit C van Jaarsveld
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Marlon van de Putte
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Isabelle W Jetten
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Friedo W Dekker
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Yvette Meuleman
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Frans J van Ittersum
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| |
Collapse
|
16
|
Liegl G, Roorda LD, Terwee CB, Steultjens M, Roos EM, Guillemin F, Benedetti MG, Dagfinrud H, de Carvalho Bastone A, Peter WF. Suitability of the animated activity questionnaire for use as computer adaptive test: establishing the AAQ-CAT. Qual Life Res 2023:10.1007/s11136-023-03402-4. [PMID: 37010805 PMCID: PMC10329068 DOI: 10.1007/s11136-023-03402-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/10/2023] [Indexed: 04/04/2023]
Abstract
PURPOSE The animated activity questionnaire (AAQ) is a computer-based measure of activity limitations. To answer a question, patients choose the animation of a person performing an activity that matches their own level of limitation. The AAQ has not yet been tested for suitability to be applied as computer-adaptive test (CAT). Thus, the objective of this study was to develop and evaluate an AAQ-based CAT to facilitate the application of the AAQ in daily clinical care. METHODS Patients (n = 1408) with hip/knee osteoarthritis from Brazil, Denmark, France, The Netherlands, Norway, Spain, and the UK responded to all 17 AAQ items. Assumptions of item-response theory (IRT) modelling were investigated. To establish item parameters for the CAT, a graded response model was estimated. To evaluate the performance of post-hoc simulated AAQ-based CATs, precision, test length, and construct validity (correlations with well-established measures of activity limitations) were evaluated. RESULTS Unidimensionality (CFI = 0.95), measurement invariance (R2-change < 2%), and IRT item fit (S-X2 p > .003) of the AAQ were supported. Performing simulated CATs, the mean test length was more than halved (≤ 8 items), while the range of precise measurement (standard error ≤ 0.3) was comparable to the full AAQ. The correlations between original AAQ scores and three AAQ-CAT versions were ≥ 0.95. Correlations of AAQ-CAT scores with patient-reported and performance measures of activity limitations were ≥ 0.60. CONCLUSION The almost non-verbal AAQ-CAT is an innovative and efficient tool in patients with hip/knee osteoarthritis from various countries, measuring activity limitations with lower respondent burden, but similar precision and construct validity compared to the full AAQ.
Collapse
Affiliation(s)
- Gregor Liegl
- Center for Patient-Centered Outcomes Research, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany.
| | - Leo D Roorda
- Amsterdam Rehabilitation Research Center | Reade, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Martijn Steultjens
- School of Health and Life Sciences, Glasgow Caledonian University, Glasgow, UK
| | - Ewa M Roos
- Institute of Sports Science and Clinical Biomechanics, University of Southern Denmark, Odense, Denmark
| | - Francis Guillemin
- EA 4360 APEMAC, Inserm CIC-EC 1433, University Hospital, Université de Lorraine, Nancy, France
| | | | - Hanne Dagfinrud
- Diakonhjemmet Hospital, Oslo, Norway
- University of Oslo, Oslo, Norway
| | - Alessandra de Carvalho Bastone
- Department of Physical Therapy, Universidade Federal dos Vales do Jequitinhonha e Mucuri (UFVJM), Diamantina, MG, Brazil
| | - Wilfred F Peter
- Amsterdam Rehabilitation Research Center | Reade, Amsterdam, The Netherlands
| |
Collapse
|
17
|
Terwee CB, van Litsenburg RRL, Elsman EBM, Roorda LD. Psychometric properties and reference values of the Patient-Reported Outcomes Measurement Information System (PROMIS) sleep item banks in the Dutch general population. J Sleep Res 2023; 32:e13753. [PMID: 36254358 DOI: 10.1111/jsr.13753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 08/29/2022] [Accepted: 09/21/2022] [Indexed: 11/29/2022]
Abstract
Psychometric properties of the v1.0 Patient-Reported Outcomes Measurement Information System (PROMIS®) sleep disturbance (27 items) and sleep-related impairment (SRI; 16 items) item banks, short forms derived from the item bank, and simulated computerised adaptive test (CAT), were assessed in a representative sample of 1,006 adults from the Dutch general population. For sleep disturbance all items fitted the item response theory model. Four items showed differential item functioning (i.e., lack of measurement invariance) for age and two for language but the impact on scores (expressed as T-scores) was small. Reliable scores (r > 0.90) were found for 92.2%-96.3% of respondents with the full bank, short forms with six and eight items, and CAT, but for only 25.6% with the four-item short form. For SRI two items did not fit the item response theory model. Four items showed differential item functioning for language but the impact on T-scores was small. Reliable scores were found for 82.1% with the full bank, for 47.8%-69.5% with short forms and CAT. T-scores of 49.7 and 49.3 represent the average score of the Dutch general population for sleep disturbance and SRI, respectively. In conclusion, sufficient structural validity, reliability, and cross-cultural validity was found for the full banks but short forms of four items are not reliable enough for clinical practice. For SRI we recommend the full item bank if this is the primary outcome.
Collapse
Affiliation(s)
- Caroline B Terwee
- Amsterdam UMC, location Vrije Universiteit Amsterdam, Epidemiology and Data Science, Amsterdam, the Netherlands.,Amsterdam Public Health, Methodology, Amsterdam, the Netherlands
| | | | - Ellen B M Elsman
- Amsterdam UMC, location Vrije Universiteit Amsterdam, Epidemiology and Data Science, Amsterdam, the Netherlands
| | - Leo D Roorda
- Amsterdam Rehabilitation Research Center
- Reade, Amsterdam, the Netherlands
| |
Collapse
|
18
|
Ter Wal N, van Ewijk L, Dijkhuis L, Visser-Meily JMA, Terwee CB, Gerrits E. Everyday Barriers in Communicative Participation According to People With Communication Problems. J Speech Lang Hear Res 2023; 66:1033-1050. [PMID: 36787154 DOI: 10.1044/2022_jslhr-22-00405] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
PURPOSE The purpose of this study was to gain a comprehensive understanding of participation situations that are challenging for people with communication problems, to provide input for the further development of potential items for the Communicative Participation Item Bank (CPIB). METHOD A purposive sampling strategy was used to include a diverse group of people with communication problems. Diaries were used as a sensitizing exercise for inductive in-depth interviews. In these interviews, elements of communicative participation situations (concepts) were elicited that participants themselves experienced as difficult because of their communication problem. A thematic content analysis was used to identify overarching themes. In addition, new items were formulated based on the raw codes of the transcripts and linked to the International Classification of Functioning, Disability and Health Activity and Participation domains to examine the distribution of items across the breadth of the construct of communicative participation. RESULTS Eighteen interviews yielded 44 different concepts. They were clustered in six themes, which capture the person, location, topic, mode, moment, and pace of communication. In total, 103 new items measuring communicative participation were formulated. Most of these items relate to International Classification of Functioning, Disability and Health Activity and Participation domains "interpersonal interactions and relationships," "major life areas," and "community, social, and civic life." CONCLUSIONS This study resulted in an overview of self-reported barriers in daily communicative participation experienced by people with communication problems. These communicative participation situations can be captured within 44 concepts, which are covered by six themes. Future work should investigate if the newly written items can be added to the CPIB. The concepts and the themes can be used in designing and delivering a participation-focused intervention for this population.
Collapse
Affiliation(s)
- Nicole Ter Wal
- Research Centre Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, the Netherlands
- Department of Languages, Literature and Communication, Institute for Language Sciences (ILS), Utrecht University, the Netherlands
| | - Lizet van Ewijk
- Research Centre Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, the Netherlands
| | - Lotti Dijkhuis
- Research Centre Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, the Netherlands
| | - Johanna M A Visser-Meily
- Department of Rehabilitation, Physical Therapy Science & Sports, UMC Utrecht Brain Centre, University Medical Centre Utrecht, the Netherlands
- Centre of Excellence for Rehabilitation Medicine, UMC Utrecht Brain Centre, University Medical Centre Utrecht and Utrecht University, and De Hoogstraat Rehabilitation, the Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, UMC, Vrije Universiteit Amsterdam, the Netherlands
| | - Ellen Gerrits
- Research Centre Healthy and Sustainable Living, HU University of Applied Sciences Utrecht, the Netherlands
- Department of Languages, Literature and Communication, Institute for Language Sciences (ILS), Utrecht University, the Netherlands
| |
Collapse
|
19
|
Wang Y, Devji T, Carrasco-Labra A, Qasim A, Hao Q, Kum E, Devasenapathy N, King MT, Terluin B, Terwee CB, Walsh M, Furukawa TA, Tsujimoto Y, Guyatt GH. An extension MID credibility item addressing construct proximity is a reliable alternative to correlation item. J Clin Epidemiol 2023; 157:46-52. [PMID: 36878330 DOI: 10.1016/j.jclinepi.2023.03.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 02/15/2023] [Accepted: 03/01/2023] [Indexed: 03/07/2023]
Abstract
OBJECTIVE To extend the anchor-based minimal important differences (MIDs) credibility instrument by adding an item addressing construct proximity as the alternative to the correlation item. STUDY DESIGN AND SETTING The credibility instrument includes one core items addressing the correlation between the patient-reported outcome measure (PROM) and the anchor. However, the majority of MID studies in the literature fail to report the correlation. As an alternative item, we added a subjective assessment of similarity of the constructs (i.e., construct proximity) between the PROM and anchor and generated principles for the assessment. We sampled 101 MIDs and analyzed the assessments performed by each pair of raters. By calculating weighted Cohen's kappa, we assessed the reliability of the assessments. RESULTS Construct proximity assessment is based on the anticipated association between the anchor and PROM constructs: the closer the anticipated association, the higher the rating. Our detailed principles address the most frequently used anchors: transition ratings, measures of satisfaction, other PROMs, and clinical measures. The assessments showed acceptable agreement (weighted kappa 0.74, 95% CI 0.55 to 0.94) between raters. CONCLUSION In the absence of a reported correlation coefficient, construct proximity assessment provides a useful alternative in the credibility assessment of anchor-based MID estimates.
Collapse
Affiliation(s)
- Yuting Wang
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. 1280 Main St East, Hamilton, Canada, L8S 4L8.
| | - Tahira Devji
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. 1280 Main St East, Hamilton, Canada, L8S 4L8; Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada. 1 King's College Cir, M5S 1A8, ON, Canada
| | - Alonso Carrasco-Labra
- Department of Preventive and Restorative Sciences; Center for Integrative Global Oral Health, School of Dental Medicine, University of Pennsylvania, Philadelphia, PA, United States, 240 S 40th St, Philadelphia, PA, 19104
| | - Anila Qasim
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. 1280 Main St East, Hamilton, Canada, L8S 4L8
| | - Qiukui Hao
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. 1280 Main St East, Hamilton, Canada, L8S 4L8
| | - Elena Kum
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. 1280 Main St East, Hamilton, Canada, L8S 4L8
| | - Niveditha Devasenapathy
- The George Institute for Global Health, 308, Elegance Tower, Jasola District Centre, New Delhi-110025, India
| | - Madeleine T King
- School of Psychology, Griffith Taylor Building (A19), The University of Sydney, NSW 2006, Australia
| | - Berend Terluin
- Amsterdam UMC location Vrije Universiteit Amsterdam, Department of General Practice, Amsterdam, The Netherlands; Amsterdam Public Health research institute, Methodology, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Amsterdam UMC location Vrije Universiteit Amsterdam, Department of Epidemiology and Data Science, Amsterdam, the Netherlands; Amsterdam Public Health research institute, Methodology, Amsterdam, The Netherlands
| | - Michael Walsh
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. 1280 Main St East, Hamilton, Canada, L8S 4L8; Department of Medicine, McMaster University, Hamilton, Ontario, Canada. 1280 Main St East, Hamilton, Canada, L8S 4L8; Population Health Research Institute, Hamilton Health Sciences /McMaster University, Hamilton, Ontario, Canada. 1280 Main St East, Hamilton, Canada, L8S 4L8
| | - Toshi A Furukawa
- Department of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Yoshida Konoe-cho, Sakyo-ku, Kyoto 606-8501 Japan
| | - Yasushi Tsujimoto
- Department of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Yoshida Konoe-cho, Sakyo-ku, Kyoto 606-8501 Japan; Scientific Research Works Peer Support Group (SRWS-PSG), Koraibashi 1-7-7-2302, Chuo-ku, Osaka, 541-0043, Japan; Oku Medical Clinic, Shimmori 7-1-4, Asahi-ku, Osaka, 535-0022, Japan
| | - Gordon H Guyatt
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. 1280 Main St East, Hamilton, Canada, L8S 4L8
| |
Collapse
|
20
|
Schuller W, Terwee CB, Terluin B, Rohrich DC, Ostelo RWJG, de Vet HCW. Responsiveness and Minimal Important Change of the PROMIS Pain Interference Item Bank in Patients Presented in Musculoskeletal Practice. J Pain 2023; 24:530-539. [PMID: 36336326 DOI: 10.1016/j.jpain.2022.10.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Revised: 10/19/2022] [Accepted: 10/20/2022] [Indexed: 11/06/2022]
Abstract
We evaluated the responsiveness of the Patient Reported Outcome Information System Pain Interference item bank in patients with musculoskeletal pain by testing predefined hypotheses about the relationship between the change scores on the item bank, change scores on legacy instruments and Global Ratings of Change (GRoC), and we estimated Minimal Important Change (MIC). Patients answered the full Dutch-Flemish V1.1 item bank. From the responses we derived scores for the standard 8-item short form (SF8a) and a CAT-score was simulated. Correlations between the change scores on the item bank, GRoC and legacy instruments were calculated, together with Effect Sizes, Standardized Response Means, and Area Under the Curve. GRoC were used as an anchor for estimating the MIC with (adjusted) predictive modeling. Of 1,677 patients answering baseline questionnaires 960 completed follow-up questionnaires at 3 months. The item bank correlated moderately high with the GRoC (Spearman's rho 0.63) and with the legacy instruments (Pearson's R ranging from .45 to .68). It showed a high ES (.97) and Standardized Response Means (.71), and could distinguish well between improved and not improved patients based on the GRoC (Area Under the Curve .77). Comparable results were found for the derived SF8a and CAT-scores. The MIC was estimated to be 3.2 (CI 2.6-3.7) T-score points. PERSPECTIVE: Our study supports the responsiveness of the PROMIS-PI item bank in patients with musculoskeletal complaints. Almost all predefined hypotheses were met (94%). The PROMIS-PI item bank correlated well with several legacy instruments which supports generic use of the item bank. MIC for PROMIS-PI was estimated to be 3.2 T-score points.
Collapse
Affiliation(s)
- Wouter Schuller
- Amsterdam UMC location Vrije Universiteit, Epidemiology and Data Science, Amsterdam, The Netherlands; Amsterdam Public Health Research Institute, Methodology, Amsterdam, The Netherlands; Spine Clinic, Zaandam, The Netherlands.
| | - Caroline B Terwee
- Amsterdam UMC location Vrije Universiteit, Epidemiology and Data Science, Amsterdam, The Netherlands; Amsterdam Public Health Research Institute, Methodology, Amsterdam, The Netherlands
| | - Berend Terluin
- Amsterdam UMC location Vrije Universiteit, General Practice, Amsterdam, The Netherlands
| | - Daphne C Rohrich
- Department of Internal Medicine, Sint Antonius Hospital, Nieuwegein, The Netherlands
| | - Raymond W J G Ostelo
- Department of Health Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands; Department of Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit & Amsterdam Movement Sciences, Musculoskeletal Health, Amsterdam, The Netherlands
| | - Henrica C W de Vet
- Amsterdam UMC location Vrije Universiteit, Epidemiology and Data Science, Amsterdam, The Netherlands; Amsterdam Public Health Research Institute, Methodology, Amsterdam, The Netherlands
| |
Collapse
|
21
|
Oude Voshaar M, Terwee CB, Haverman L, van der Kolk B, Harkes M, van Woerden CS, van Breda F, Breukink S, de Hoop I, Vermeulen H, de Graaf E, Hazelzet J, van Leiden B, Stienen J, Hoekstra M, Bart H, van Bommel H, Determann D, Verburg M, van der Wees P, Beurskens AJ. Development of a standard set of PROs and generic PROMs for Dutch medical specialist care : Recommendations from the Outcome-Based Healthcare Program Working Group Generic PROMs. Qual Life Res 2023; 32:1595-1605. [PMID: 36757571 PMCID: PMC10172289 DOI: 10.1007/s11136-022-03328-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/13/2022] [Indexed: 02/10/2023]
Abstract
PURPOSE The added value of measuring patient-reported outcomes (PROs) for delivering patient-centered care and assessment of healthcare quality is increasingly evident. However, healthcare system wide data collection initiatives are hampered by the proliferation of patient-reported outcome measures (PROMs) and conflicting data collection standards. As part of a national initiative of the Dutch Ministry of Health, Welfare and Sport we developed a consensus-based standard set of generic PROs and PROMs to be implemented across Dutch medical specialist care. METHODS A working group of mandated representatives of umbrella organizations involved in Dutch medical specialist care, together with PROM experts and patient organizations worked through a structured, consensus-driven co-creation process. This included literature reviews, online expert and working group meetings, and feedback from national patient- and umbrella organizations. The 'PROM-cycle' methodology was used to select feasible, valid, and reliable PROMs to obtain domain scores for each of the PROs included in the set. RESULTS Eight PROs across different domains of health were ultimately endorsed: symptoms (pain & fatigue), functioning (physical, social/participation, mental [anxiety & depression]), and overarching (quality of life & perceived overall health). A limited number of generic PROMs was endorsed. PROMIS short forms were selected as the preferred instruments for all PROs. Several recommendations were formulated to facilitate healthcare system level adoption and implementation of the standard set. CONCLUSIONS We developed a consensus-based standard set of Generic PROMs and a set of recommendations to facilitate healthcare system wide implementation across Dutch medical specialist care.
Collapse
Affiliation(s)
- Martijn Oude Voshaar
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands.
- Department of Medical Cell BioPhysics & TechMed Center, University of Twente, Enschede, The Netherlands.
| | - Caroline B Terwee
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
- Epidemiology and Data Science, Amsterdam UMC Location Vrije Universiteit, Amsterdam, the Netherlands
- Methodology, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Lotte Haverman
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
- Dutch Society of Medical Specialists, Amphia Hospital, Utrecht, The Netherlands
- Dutch Nurses' Association, Amphia Hospital, Utrecht, The Netherlands
| | - Bas van der Kolk
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
| | - Marleen Harkes
- Dutch Society of Medical Specialists, Amphia Hospital, Utrecht, The Netherlands
| | | | - Fenna van Breda
- Dutch Society of Medical Specialists, Amphia Hospital, Utrecht, The Netherlands
| | - Stephanie Breukink
- Dutch Society of Medical Specialists, Amphia Hospital, Utrecht, The Netherlands
| | - Irma de Hoop
- Dutch Nurses' Association, Amphia Hospital, Utrecht, The Netherlands
| | - Hester Vermeulen
- Dutch Nurses' Association, Amphia Hospital, Utrecht, The Netherlands
| | - Evelien de Graaf
- Dutch Nurses' Association, Amphia Hospital, Utrecht, The Netherlands
| | - Jan Hazelzet
- Dutch Federation of University Medical Centres, Utrecht, The Netherlands
| | | | - Jozette Stienen
- Dutch Hospital Association &, Amphia Hospital, Breda, The Netherlands
| | | | - Hans Bart
- The Netherlands Patients Federation, Utrecht, The Netherlands
| | - Hester van Bommel
- Pharos - Dutch Centre of Expertise On Health Disparities, Utrecht, The Netherlands
| | - Domino Determann
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
| | - Mariët Verburg
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
| | - Philip van der Wees
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
- Radboud University Medical Center, Radboud Institute for Health Sciences, IQ Healthcare and Department of Rehabilitation, Nijmegen, The Netherlands
| | - Anna J Beurskens
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
- Department of Family Medicine, CAPHRI School for Public Health and Primary Care, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
22
|
Langendoen-Gort M, Rutters F, Huijts D, Elders PJ, Terwee CB, Hugtenburg JG. Validation of an Announced Telephone Pill Count Compared to a Home-Visit Pill Count in People With Type 2 Diabetes or Cardiovascular Disease. Clin Pharmacol Drug Dev 2023; 12:85-93. [PMID: 36394278 PMCID: PMC10100458 DOI: 10.1002/cpdd.1185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Accepted: 09/20/2022] [Indexed: 11/19/2022]
Abstract
We aimed to assess the validity of an announced telephone pill count in people with type 2 diabetes or cardiovascular disease by comparing this method to a home-visit pill count. We also assessed whether a second telephone pill count improved accuracy. People aged ≥35 years using oral type 2 diabetes or cardiovascular disease medication were included. Thirty-four participants completed a telephone pill count followed by a home-visit pill count, and a subsample of this population (n = 11) completed a second telephone pill count. Scatterplots were used for a visual representation of the number of pills counted with both methods, intraclass correlation coefficients for agreement, and Bland-Altman plots for absolute differences and outliers. A total of 203 pill counts were conducted. The study population consisted of 53% men, with a mean age of 69.6 (±9.2) years and an average of 6.1 (±2.8) medication prescriptions per participant. Scatterplots showed that pills counted with both methods were mostly scattered around the y = x equation. Agreement between the first telephone pill count and home-visit pill count was high, with intraclass correlation coefficients of 0.96 (medication count level) and 0.98 (individual level). No learning effects were observed in the subsample (n = 11), the intraclass correlation coefficient for the first telephone pill count was 0.88 versus 0.89 for the second telephone pill count. Bland-Altman plots indicated high agreement between the two methods. An announced telephone pill count is considered a valid alternative for a home-visit pill count in people with type 2 diabetes or cardiovascular disease. A single pill count appears sufficient.
Collapse
Affiliation(s)
- Marlous Langendoen-Gort
- Amsterdam UMC, location Vrije Universiteit Amsterdam, Department of General Practice, Amsterdam, the Netherlands.,Amsterdam Public Health Research Institute, Health Behaviors & Chronic Diseases, Amsterdam, the Netherlands
| | - Femke Rutters
- Amsterdam Public Health Research Institute, Health Behaviors & Chronic Diseases, Amsterdam, the Netherlands.,Amsterdam UMC, location Vrije Universiteit Amsterdam, Department of Epidemiology and Data Science, Amsterdam, the Netherlands
| | - Daniëlle Huijts
- Amsterdam UMC, location Vrije Universiteit Amsterdam, Department of General Practice, Amsterdam, the Netherlands.,Amsterdam Public Health Research Institute, Health Behaviors & Chronic Diseases, Amsterdam, the Netherlands
| | - Petra Jm Elders
- Amsterdam UMC, location Vrije Universiteit Amsterdam, Department of General Practice, Amsterdam, the Netherlands.,Amsterdam Public Health Research Institute, Health Behaviors & Chronic Diseases, Amsterdam, the Netherlands
| | - Caroline B Terwee
- Amsterdam UMC, location Vrije Universiteit Amsterdam, Department of Epidemiology and Data Science, Amsterdam, the Netherlands.,Amsterdam Public Health Research Institute, Methodology, Amsterdam, the Netherlands
| | - Jacqueline G Hugtenburg
- Amsterdam Public Health Research Institute, Health Behaviors & Chronic Diseases, Amsterdam, the Netherlands.,Amsterdam UMC, location Vrije Universiteit Amsterdam, Department of Clinical Pharmacology and Pharmacy, Amsterdam, the Netherlands.,Amsterdam Public Health Research Institute, Aging & Later Life, Amsterdam, the Netherlands
| |
Collapse
|
23
|
Butcher NJ, Monsour A, Mew EJ, Chan AW, Moher D, Mayo-Wilson E, Terwee CB, Chee-A-Tow A, Baba A, Gavin F, Grimshaw JM, Kelly LE, Saeed L, Thabane L, Askie L, Smith M, Farid-Kapadia M, Williamson PR, Szatmari P, Tugwell P, Golub RM, Monga S, Vohra S, Marlin S, Ungar WJ, Offringa M. Guidelines for Reporting Outcomes in Trial Protocols: The SPIRIT-Outcomes 2022 Extension. JAMA 2022; 328:2345-2356. [PMID: 36512367 DOI: 10.1001/jama.2022.21243] [Citation(s) in RCA: 36] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
IMPORTANCE Complete information in a trial protocol regarding study outcomes is crucial for obtaining regulatory approvals, ensuring standardized trial conduct, reducing research waste, and providing transparency of methods to facilitate trial replication, critical appraisal, accurate reporting and interpretation of trial results, and knowledge synthesis. However, recommendations on what outcome-specific information should be included are diverse and inconsistent. To improve reporting practices promoting transparent and reproducible outcome selection, assessment, and analysis, a need for specific and harmonized guidance as to what outcome-specific information should be addressed in clinical trial protocols exists. OBJECTIVE To develop harmonized, evidence- and consensus-based standards for describing outcomes in clinical trial protocols through integration with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 statement. EVIDENCE REVIEW Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for outcome-specific reporting to be addressed in clinical trial protocols. FINDINGS The scoping review and consultation with experts identified 108 recommendations relevant to outcome-specific reporting to be addressed in trial protocols, the majority (72%) of which were not included in the SPIRIT 2013 statement. All recommendations were consolidated into 56 items for Delphi voting; after the Delphi survey process, 19 items met criteria for further evaluation at the consensus meeting and possible inclusion in the SPIRIT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 9 items that elaborate on the SPIRIT 2013 statement checklist items and are related to completely defining and justifying the choice of primary, secondary, and other outcomes (SPIRIT 2013 statement checklist item 12) prospectively in the trial protocol, defining and justifying the target difference between treatment groups for the primary outcome used in the sample size calculations (SPIRIT 2013 statement checklist item 14), describing the responsiveness of the study instruments used to assess the outcome and providing details on the outcome assessors (SPIRIT 2013 statement checklist item 18a), and describing any planned methods to account for multiplicity relating to the analyses or interpretation of the results (SPIRIT 2013 statement checklist item 20a). CONCLUSIONS AND RELEVANCE This SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement provides 9 outcome-specific items that should be addressed in all trial protocols and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.
Collapse
Affiliation(s)
- Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Andrea Monsour
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Emma J Mew
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Chronic Disease Epidemiology, School of Public Health, Yale University, New Haven, Connecticut
| | - An-Wen Chan
- Department of Medicine, Women's College Research Institute, University of Toronto, Toronto, Ontario, Canada
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
| | - Evan Mayo-Wilson
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill
| | - Caroline B Terwee
- Amsterdam University Medical Centers, Vrije Universiteit, Department of Epidemiology and Data Science, Amsterdam, the Netherlands
- Department of Methodology, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Alyssandra Chee-A-Tow
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Ami Baba
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Frank Gavin
- public panel member, Toronto, Ontario, Canada
| | - Jeremy M Grimshaw
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Lauren E Kelly
- Department of Pharmacology and Therapeutics, University of Manitoba, Winnipeg, Canada
- Children's Hospital Research Institute of Manitoba, Winnipeg, Canada
| | - Leena Saeed
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Lehana Thabane
- Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Lisa Askie
- NHMRC Clinical Trials Centre, University of Sydney, Sydney, New South Wales, Australia
| | | | - Mufiza Farid-Kapadia
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Paula R Williamson
- MRC-NIHR Trials Methodology Research Partnership, Department of Health Data Science, University of Liverpool, Liverpool, England
| | - Peter Szatmari
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Peter Tugwell
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Bruyère Research Institute, Ottawa, Ontario, Canada
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Robert M Golub
- Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Suneeta Monga
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Sunita Vohra
- Departments of Pediatrics and Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Canada
| | - Susan Marlin
- Clinical Trials Ontario, Toronto, Canada
- Department of Public Health Sciences, Queen's University, Kingston, Ontario, Canada
| | - Wendy J Ungar
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada
- Division of Neonatology, The Hospital for Sick Children, Toronto, Ontario, Canada
| |
Collapse
|
24
|
Butcher NJ, Monsour A, Mew EJ, Chan AW, Moher D, Mayo-Wilson E, Terwee CB, Chee-A-Tow A, Baba A, Gavin F, Grimshaw JM, Kelly LE, Saeed L, Thabane L, Askie L, Smith M, Farid-Kapadia M, Williamson PR, Szatmari P, Tugwell P, Golub RM, Monga S, Vohra S, Marlin S, Ungar WJ, Offringa M. Guidelines for Reporting Outcomes in Trial Reports: The CONSORT-Outcomes 2022 Extension. JAMA 2022; 328:2252-2264. [PMID: 36511921 DOI: 10.1001/jama.2022.21022] [Citation(s) in RCA: 79] [Impact Index Per Article: 39.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
IMPORTANCE Clinicians, patients, and policy makers rely on published results from clinical trials to help make evidence-informed decisions. To critically evaluate and use trial results, readers require complete and transparent information regarding what was planned, done, and found. Specific and harmonized guidance as to what outcome-specific information should be reported in publications of clinical trials is needed to reduce deficient reporting practices that obscure issues with outcome selection, assessment, and analysis. OBJECTIVE To develop harmonized, evidence- and consensus-based standards for reporting outcomes in clinical trial reports through integration with the Consolidated Standards of Reporting Trials (CONSORT) 2010 statement. EVIDENCE REVIEW Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for the reporting of outcomes in clinical trial reports. FINDINGS The scoping review and consultation with experts identified 128 recommendations relevant to reporting outcomes in trial reports, the majority (83%) of which were not included in the CONSORT 2010 statement. All recommendations were consolidated into 64 items for Delphi voting; after the Delphi survey process, 30 items met criteria for further evaluation at the consensus meeting and possible inclusion in the CONSORT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 17 items that elaborate on the CONSORT 2010 statement checklist items and are related to completely defining and justifying the trial outcomes, including how and when they were assessed (CONSORT 2010 statement checklist item 6a), defining and justifying the target difference between treatment groups during sample size calculations (CONSORT 2010 statement checklist item 7a), describing the statistical methods used to compare groups for the primary and secondary outcomes (CONSORT 2010 statement checklist item 12a), and describing the prespecified analyses and any outcome analyses not prespecified (CONSORT 2010 statement checklist item 18). CONCLUSIONS AND RELEVANCE This CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement provides 17 outcome-specific items that should be addressed in all published clinical trial reports and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.
Collapse
Affiliation(s)
- Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Andrea Monsour
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Emma J Mew
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Chronic Disease Epidemiology, School of Public Health, Yale University, New Haven, Connecticut
| | - An-Wen Chan
- Department of Medicine, Women's College Research Institute, University of Toronto, Toronto, Ontario, Canada
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
| | - Evan Mayo-Wilson
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill
| | - Caroline B Terwee
- Amsterdam University Medical Centers, Vrije Universiteit, Department of Epidemiology and Data Science, Amsterdam, the Netherlands
- Department of Methodology, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Alyssandra Chee-A-Tow
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Ami Baba
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Frank Gavin
- public panel member, Toronto, Ontario, Canada
| | - Jeremy M Grimshaw
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Lauren E Kelly
- Department of Pharmacology and Therapeutics, University of Manitoba, Winnipeg, Canada
- Children's Hospital Research Institute of Manitoba, Winnipeg, Canada
| | - Leena Saeed
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Lehana Thabane
- Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Lisa Askie
- NHMRC Clinical Trials Centre, University of Sydney, Sydney, New South Wales, Australia
| | | | - Mufiza Farid-Kapadia
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Paula R Williamson
- MRC-NIHR Trials Methodology Research Partnership, Department of Health Data Science, University of Liverpool, Liverpool, England
| | - Peter Szatmari
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Peter Tugwell
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Bruyère Research Institute, Ottawa, Ontario, Canada
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Robert M Golub
- Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Suneeta Monga
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Sunita Vohra
- Departments of Pediatrics and Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Canada
| | - Susan Marlin
- Clinical Trials Ontario, Toronto, Canada
- Department of Public Health Sciences, Queen's University, Kingston, Ontario, Canada
| | - Wendy J Ungar
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada
- Division of Neonatology, The Hospital for Sick Children, Toronto, Ontario, Canada
| |
Collapse
|
25
|
de Vries CEE, Tsangaris E, Makarawung DJS, Mink van der Molen AB, van Veen RN, Hoogbergen MM, Ziekenhuis C, Pusic AL, Terwee CB, Cano S, Klassen AF. Validation of the Dutch Version of the BODY-Q Measuring Appearance, Health-related Quality of Life, and Experience of Healthcare in Patients Undergoing Bariatric and Body Contouring Surgery. Aesthet Surg J 2022; 43:569-579. [PMID: 36478151 PMCID: PMC10085541 DOI: 10.1093/asj/sjac311] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Revised: 10/27/2022] [Accepted: 10/28/2022] [Indexed: 12/13/2022] Open
Abstract
Abstract
Background
The BODY-Q is a patient-reported outcome measure (PROM) developed for use in bariatric and body contouring surgery.
Objectives
The objective of this study was to examine the validity and reliability of the Dutch version of the BODY-Q.
Methods
The BODY-Q consists of 163 items in 21 independently functioning scales that measure appearance, health-related quality of life (HRQL) and experience of care. The data used to validate the Dutch BODY-Q were provided by two prospective multicenter cohort studies across three hospitals in the Netherlands. The BODY-Q was administered before and after surgery at 3 or 4 months and 12 months. Rasch Measurement Theory (RMT) analysis was used to evaluate the BODY-Q for targeting, category threshold order, Rasch model fit, Person Separation Index (PSI), and differential item functioning (DIF) by language (original English data versus Dutch data).
Results
Data were collected between January 2016 and May 2019. A total of 876 participants were included in the study who provided 1614 assessments. Validity was supported by three RMT findings: most scales showed good targeting, 160/163 (98.2%) items evidenced ordered thresholds, and 142/163 (87.1%) items fit to the RMT model. Reliability was high with PSI values >0.70 for 19/21 scales. There was negligible influence of DIF by language on person item locations and the scales scoring.
Conclusions
This study provides evidence for the reliability and validity of the Dutch BODY-Q for use in bariatric and body contouring patients in the Netherlands. The Dutch BODY-Q can be used in (inter)national research and clinical practice.
Collapse
Affiliation(s)
- Claire E E de Vries
- Plastic surgery resident, Patient-Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women’s Hospital , Boston, MA
| | - Elena Tsangaris
- Researcher, Patient-Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women’s Hospital , Boston, MA
| | - Dennis J S Makarawung
- PhD student, Department of Plastic and Reconstructive Surgery, University Medical Center Utrecht , Utrecht , the Netherlands
| | - Aebele B Mink van der Molen
- Plastic surgeon, Department of Plastic and Reconstructive Surgery, University Medical Center Utrecht , Utrecht , the Netherlands
| | - Ruben N van Veen
- Surgeon, Department of Surgery , OLVG, Amsterdam , the Netherlands
| | - Maarten M Hoogbergen
- Plastic surgeon, Department of Plastic and Reconstructive Surgery , Eindhoven , The Netherlands
| | | | - Andrea L Pusic
- Plastic surgeon, Division of Plastic Surgery, Brigham and Women’s Hospital , Boston, MA
| | - Caroline B Terwee
- Professor, Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit , Amsterdam , the Netherlands
| | - Stefan Cano
- Chief scientific officer, Modus Outcomes , Letchworth Garden City , UK
| | - Anne F Klassen
- Professor, Faculty of Health Sciences, McMaster University , Hamilton, Ontario , Canada
| |
Collapse
|
26
|
van Geel N, Hamzavi IH, Pandya AG, Wolkerstorfer A, Seneschal J, Garg A, Spuls P, Terwee CB, Mallett S, Speeckaert R, Meurant JM, Eleftheriadou V, Ezzedine K. Vitiligo International Task force for an Agreed List of core data (VITAL): study protocol of a vitiligo core outcome set (COS) and contextual factors for clinical trials, registries, and clinical practice. Trials 2022; 23:591. [PMID: 35871019 PMCID: PMC9308182 DOI: 10.1186/s13063-022-06497-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Accepted: 06/25/2022] [Indexed: 11/16/2022] Open
Abstract
Background There is a lack of consensus related to the collection of standardized data for individuals with vitiligo enrolled in clinical trials and registries as well as those seen in clinical practice which causes difficulty in accurately interpreting, comparing, and pooling of data. Several years ago, efforts to initiate work on developing core outcome sets were performed and a consensus was reached in 2015 on the first core domain set for vitiligo clinical trials. Methods/design This project aims to further develop a core outcome set for vitiligo clinical trials as well as create internationally agreed-upon core outcome sets for registries and clinical practice. These core outcome sets will include a core domain set and a core measurement instruments set and will be supplemented by contextual factors, including baseline and treatment-related characteristics. In a preparatory exercise, the 2015 core domain set will be re-evaluated and will serve as the basis for the list of outcome domains used to initiate the consensus process. This project will consist of two parts. Part 1 will focus on the selection of a core domain set, or “what to measure” and contextual factors, for each setting based on electronic surveys (e-Delphi technique) and a conclusive consensus meeting by a large group of international stakeholders. Part 2 will include selection of core measurement instruments, or “how to measure,” and measurement details (e.g., scale and timing) for the core domain sets and contextual factors agreed upon in part 1. Part 2 will be based on consensus meetings with stakeholders involved in part 1 and will be guided by C3 (CHORD-COUSIN Collaboration), Harmonising Outcome Measures for Eczema (HOME), COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN), and Outcome Measures in Rheumatology (OMERACT) recommendations including information on measurement properties of available instruments (systematic review and expert/patient opinion). At the end of part 2, all stakeholders involved will be invited to participate in a final meeting in which the ultimate core data sets (core outcome sets and contextual factors) will be presented and the dissemination plan and implementation goals will be defined. Discussion This project will harmonize data collection between clinical trials, registries, and clinical practices, facilitating new insights in vitiligo. Trial registration This study is registered in the Core Outcome Measures for Effectiveness Trials (COMET) database and on the C3 (CHORD-COUSIN Collaboration) website.
Collapse
|
27
|
Oosterveer DM, Arwert H, Terwee CB, Schoones JW, Vlieland TPMV. Measurement properties and interpretability of the PROMIS item banks in stroke patients: a systematic review. Qual Life Res 2022; 31:3305-3315. [PMID: 35567674 DOI: 10.1007/s11136-022-03149-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/22/2022] [Indexed: 11/26/2022]
Abstract
PURPOSE Both the International Consortium for Health Outcomes Measurement and the National Institutes of Health recommend the use of Patient-Reported Outcomes Measurement Information System (PROMIS®) measures in clinical care and research for stroke patients. This study aimed to systematically review the literature on the measurement properties and interpretability of PROMIS measures in stroke patients. METHODS Nine databases were searched from January 1st, 2007 till April 12th, 2021 for studies concerning the measurement properties and interpretability of PROMIS measures in stroke patients. The findings of these studies were analyzed according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guideline for systematic reviews of Patient-Reported Outcome Measures (PROMs). RESULTS Ten studies were included. The PROMIS Global Health was studied the most: its two subscales had sufficient structural validity in one study of very good quality, sufficient construct validity with > 75% of hypotheses tested confirmed (high GRADE rating), sufficient internal consistency, i.e. α ≥ 0.70 in two studies (high GRADE rating), sufficient reliability, i.e. ICC ≥ 0.70 in one study of doubtful quality, and indeterminate responsiveness in one study of inadequate quality. For other PROMIS measures, the measurement properties and interpretability were limitedly studied. CONCLUSION The PROMIS Global Health showed sufficient structural and construct validity and internal consistency in stroke patients. There is a need for further research on content validity, structural validity, and measurement invariance of PROMIS measures in stroke patients. Trial Registration Information: CRD42020203044 (PROSPERO).
Collapse
Affiliation(s)
| | - Henk Arwert
- Basalt Rehabilitation, Wassenaarseweg 501, 2333 AL, Leiden, The Netherlands
- Department of Rehabilitation, Haaglanden Medical Center, The Hague, The Netherlands
| | - Caroline B Terwee
- Epidemiology and Data Science, Amsterdam University Medical Center Location Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Methology, Amsterdam Public Health, Amsterdam, The Netherlands
| | - Jan W Schoones
- Directorate of Research Policy (Formerly: Walaeus Library), Leiden University Medical Center, Leiden, The Netherlands
| | - Thea P M Vliet Vlieland
- Basalt Rehabilitation, Wassenaarseweg 501, 2333 AL, Leiden, The Netherlands
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
28
|
Sabet TS, Anderson DB, Stubbs PW, Buchbinder R, Terwee CB, Chiarotto A, Gagnier J, Verhagen AP. Identifying common core outcome domains from core outcome sets of musculoskeletal conditions: protocol for a systematic review. Syst Rev 2022; 11:248. [PMID: 36403060 PMCID: PMC9675955 DOI: 10.1186/s13643-022-02120-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/02/2022] [Accepted: 11/03/2022] [Indexed: 11/21/2022] Open
Abstract
BACKGROUND Core outcome sets (COSs) aim to reduce outcome heterogeneity in clinical practice and research by suggesting a minimum number of agreed-upon outcomes in clinical trials. Most COSs in the musculoskeletal field are developed for specific conditions. We propose that there are likely to be common core domains within existing musculoskeletal COSs that may be used as a starting point in the development of future COSs. We aim to identify common core domains from existing COSs and to facilitate the development of new COSs for musculoskeletal conditions. As a secondary aim, we will assess the development quality of these COSs. METHODS A systematic review including musculoskeletal COSs. We will search Core Outcome Measures in Effectiveness Trials (COMET) database, MEDLINE, EMBASE, Scopus, Cochrane Methodology Register and International Consortium for Health Outcome Measurement (ICHOM). Studies will be included if related to the development of a COS in adults with musculoskeletal conditions and for any type of intervention. Quality will be assessed using the Core Outcome Set-Standards for Development (COS-STAD) recommendations. Data extracted will include scope of the COS, health condition, interventions and outcome domains. Primary outcomes will be all core domains recommended within each COS. We define a common core outcome domain as one present in at least 67% of all COSs. All findings will be summarized and presented using descriptive statistics. DISCUSSION This systematic review of COSs will describe the core domains recommended within each musculoskeletal COS. Common domains found may be used in the initial stages of development of future musculoskeletal COSs. SYSTEMATIC REVIEW REGISTRATION PROSPERO CRD42021239141.
Collapse
Affiliation(s)
- Tamer S Sabet
- Discipline of Physiotherapy, Graduate School of Health, The University of Technology Sydney, New South Wales, Australia. .,Department of Health Professionals, Faculty of Medicine and Health Science, Macquarie University, New South Wales, Australia. .,Center for Health and Wellness, Healthcare Department, Occupational Health, QatarEnergy, Doha, Qatar.
| | - David B Anderson
- Sydney School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia.,Sydney Spine Institute, Burwood, New South Wales, Australia
| | - Peter W Stubbs
- Discipline of Physiotherapy, Graduate School of Health, The University of Technology Sydney, New South Wales, Australia
| | - Rachelle Buchbinder
- School of Public Health and Preventive Medicine, Monash University, Victoria, Australia
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit, Amsterdam, The Netherlands.,Amsterdam Public Health research institute, Methodology, Amsterdam, The Netherlands
| | - Alessandro Chiarotto
- Department of General Practice, Erasmus MC, University Medical Center, Rotterdam, The Netherlands.,Department of Health Sciences, Faculty of Science, VU University Amsterdam, Amsterdam Movement Sciences, Amsterdam, The Netherlands
| | - Joel Gagnier
- Department of Epidemiology & Biostatistics, Schulich School of Medicine & Dentistry, Western University, London, Ontario, Canada.,Department of Surgery, Schulich School of Medicine & Dentistry, Western University, London, Ontario, Canada
| | - Arianne P Verhagen
- Discipline of Physiotherapy, Graduate School of Health, The University of Technology Sydney, New South Wales, Australia
| |
Collapse
|
29
|
Langendoen-Gort M, Groeneveld L, Prinsen CAC, Beulens JW, Elders PJM, Halperin I, Mukerji G, Terwee CB, Rutters F. Patient-reported outcome measures for assessing health-related quality of life in people with type 2 diabetes: A systematic review. Rev Endocr Metab Disord 2022; 23:931-977. [PMID: 35779199 PMCID: PMC9515038 DOI: 10.1007/s11154-022-09734-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 05/07/2022] [Indexed: 11/26/2022]
Abstract
Patient-Reported Outcome Measures (PROMs) are important tools to assess outcomes relevant to patients, with Health-Related Quality Of Life (HRQOL) as an important construct to be measured. Many different HRQOL PROMs are used in the type 2 diabetes field, however a complete overview of these PROMs is currently lacking. We therefore aimed to systematically describe and classify the content of all PROMs that have specifically been developed or validated to measure (aspects of) HRQOL in people with type 2 diabetes. A literature search was performed in PubMed and EMBASE until 31 December 2021. Studies on the development or validation of a PROM measuring HRQOL, or aspects of HRQOL, in people with type 2 diabetes were included. Title and abstract and full-text screening were conducted by two independent researchers and data extraction was performed independently by one of the researchers. Data were extracted on language in which the PROM was developed, target population, construct(s) being measured, names of (sub)scales and number of items per (sub)scale. In addition, all PROMs and subscales were classified according to specific aspects of HRQOL based on the Wilson & Cleary model (symptom status, functional status, general health perceptions) to aid researchers in PROM selection. In total 220 studies were identified that developed or validated PROMs that measure (aspects of) HRQOL in people with type 2 diabetes. Of the 116 unique HRQOL PROMs, 91 (of the subscales) measured symptom status, 60 measured functional status and 26 measured general health perceptions. In addition, 16 of the PROMs (subscales) measured global quality of life. 61 of the 116 PROMs (subscales) also include characteristics of the individual (e.g. aspects of personality, coping) or environment (e.g. social or financial support) and patient-reported experience measures (PREMs, e.g. measure of a patient's perception of their personal experience of the healthcare they have received, e.g. treatment satisfaction), which are not part of the HRQOL construct. Only 9 of the 116 PROMs measure all aspects of HRQOL based on the Wilson & Cleary model. Finally, 8 of the 116 PROMs stating to measure HRQOL, measured no HRQOL construct. In conclusion, a large number of PROMs are available for people with type 2 diabetes, which intend to measure (aspects of) HRQOL. These PROMs measure a large variety of (sub)constructs, which are not all HRQOL constructs, with a small amount of PROMs not measuring HRQOL at all. There is a need for consensus on which aspects of HRQOL should be measured in people with type 2 diabetes and which PROMs to use in research and daily practice. PROSPERO: CRD42017071012. COMET database: http://www.comet-initiative.org/studies/details/956 .
Collapse
Affiliation(s)
- Marlous Langendoen-Gort
- General Practice, Amsterdam UMC, Location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Amsterdam Public Health, Health Behaviors & Chronic Diseases, Amsterdam, The Netherlands
| | - Lenka Groeneveld
- Epidemiology and Data Science, Amsterdam UMC, Location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Amsterdam Public Health, Health Behaviors & Chronic Diseases, Amsterdam, The Netherlands
| | - Cecilia A C Prinsen
- Epidemiology and Data Science, Amsterdam UMC, Location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Amsterdam Public Health, Methodology, Amsterdam, The Netherlands
| | - Joline W Beulens
- Epidemiology and Data Science, Amsterdam UMC, Location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Amsterdam Public Health, Health Behaviors & Chronic Diseases, Amsterdam, The Netherlands
- Amsterdam Cardiovascular Sciences, Diabetes & Metabolism, Amsterdam, The Netherlands
| | - Petra J M Elders
- General Practice, Amsterdam UMC, Location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Amsterdam Public Health, Health Behaviors & Chronic Diseases, Amsterdam, The Netherlands
- Amsterdam Cardiovascular Sciences, Diabetes & Metabolism, Amsterdam, The Netherlands
| | - Ilana Halperin
- Department of Medicine, Temerty Faculty of Medicine, Sunnybrook Health Sciences Center, King's College Circle, University of Toronto, Toronto, ON, Canada
| | - Geetha Mukerji
- Department of Medicine, Temerty Faculty of Medicine, Sunnybrook Health Sciences Center, King's College Circle, University of Toronto, Toronto, ON, Canada
- Women's College Hospital Institute for Health System Solutions and Virtual Care, 76 Grenville Street, Toronto, ON, Canada
| | - Caroline B Terwee
- Epidemiology and Data Science, Amsterdam UMC, Location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Amsterdam Public Health, Methodology, Amsterdam, The Netherlands
| | - Femke Rutters
- Epidemiology and Data Science, Amsterdam UMC, Location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands.
- Amsterdam Public Health, Health Behaviors & Chronic Diseases, Amsterdam, The Netherlands.
- Amsterdam Cardiovascular Sciences, Diabetes & Metabolism, Amsterdam, The Netherlands.
| |
Collapse
|
30
|
Inhulsen MBMR, van Stralen MM, Terwee CB, Ujcic-Voortman JK, Seidell JC, Busch V. Measuring sleep health in primary school-aged children: A systematic review of instruments and their content validity. Sleep 2022; 45:6695369. [PMID: 36087112 PMCID: PMC9644118 DOI: 10.1093/sleep/zsac215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 07/13/2022] [Indexed: 12/03/2022] Open
Abstract
Study Objectives This review aimed to summarize instruments that measure one or more domains of sleep health (i.e. duration, quality, efficiency, timing, daytime sleepiness and sleep-related behaviors) in a general population of 4–12-year old children, and to assess these instruments’ content validity. Other measurement properties were evaluated for instruments with indications of sufficient content validity. Methods A systematic literature search was performed in PubMed, PsycINFO, Web of Science, and EmBase. Methodological quality, content validity, and other measurement properties were assessed via the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology. Instruments with indications of sufficient content validity (i.e. relevance, comprehensiveness and comprehensibility) were further evaluated on other measurement properties (i.e. other aspects of validity, reliability, responsiveness). A modified GRADE approach was applied to determine the quality of evidence. Results Twenty instruments, containing 36 subscales, were included. None of the instruments measured all sleep health domains. For five (subscales of) instruments sufficient relevance and comprehensibility was found. The quality of evidence ranged from very low to moderate. For these five instruments all additional measurement properties were assessed. Sufficient results were found for structural validity (n = 1), internal consistency (n = 1), and construct validity (n = 1), with quality of evidence ranging from very low to high. Conclusions Several (subscales of) instruments measuring domains of child sleep health showed good promise, demonstrating sufficient relevance, comprehensibility, and some also sufficient results on other measurement properties. However, more high quality studies on instrument development and the evaluation of measurement properties are required. PROSPERO registration number: CRD42021224109
Collapse
Affiliation(s)
- Maj-Britt M R Inhulsen
- Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute , Amsterdam , the Netherlands
- Sarphati Amsterdam, Public Health Service (GGD), City of Amsterdam , Amsterdam , the Netherlands
| | - Maartje M van Stralen
- Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute , Amsterdam , the Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute , Amsterdam , the Netherlands
| | - Joanne K Ujcic-Voortman
- Sarphati Amsterdam, Public Health Service (GGD), City of Amsterdam , Amsterdam , the Netherlands
| | - Jacob C Seidell
- Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute , Amsterdam , the Netherlands
- Sarphati Amsterdam, Public Health Service (GGD), City of Amsterdam , Amsterdam , the Netherlands
| | - Vincent Busch
- Sarphati Amsterdam, Public Health Service (GGD), City of Amsterdam , Amsterdam , the Netherlands
| |
Collapse
|
31
|
Terwee CB, Elders PJM, Langendoen-Gort M, Elsman EBM, Prinsen CAC, van der Heijden AA, de Wit M, Beulens JWJ, Mokkink LB, Rutters F. Content Validity of Patient-Reported Outcome Measures Developed for Assessing Health-Related Quality of Life in People with Type 2 Diabetes Mellitus: a Systematic Review. Curr Diab Rep 2022; 22:405-421. [PMID: 35819705 PMCID: PMC9355936 DOI: 10.1007/s11892-022-01482-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 03/18/2022] [Indexed: 12/12/2022]
Abstract
PURPOSE OF REVIEW We aimed to systematically evaluate the content validity of patient-reported outcome measures (PROMs) specifically developed to measure (aspects of) health-related quality of life (HRQOL) in people with type 2 diabetes. A systematic review was performed in PubMed and Embase of PROMs measuring perceived symptoms, physical function, mental function, social function/participation, and general health perceptions, and that were validated to at least some extent. Content validity (relevance, comprehensiveness, and comprehensibility) was evaluated using COSMIN methodology. RECENT FINDINGS We identified 54 (different versions of) PROMs, containing 150 subscales. We found evidence for sufficient content validity for only 41/150 (27%) (subscales of) PROMs. The quality of evidence was generally very low. We found 66 out of 150 (44%) (subscales of) PROMs with evidence for either insufficient relevance, insufficient comprehensiveness, or insufficient comprehensibility. For measuring diabetes-specific symptoms, physical function, mental function, social function/participation, and general health perceptions, we identified one to 11 (subscales of) PROMs with sufficient content validity, although quality of the evidence was generally low. For measuring depressive symptoms, no PROM with sufficient content validity was identified. For each aspect of HRQL, we found at least one PROM with sufficient content validity, except for depressive symptoms. The quality of the evidence was mostly very low.
Collapse
Affiliation(s)
- Caroline B Terwee
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands.
| | - Petra J M Elders
- Amsterdam UMC, Department of General Practice, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Marlous Langendoen-Gort
- Amsterdam UMC, Department of General Practice, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Ellen B M Elsman
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Cecilia A C Prinsen
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Amber A van der Heijden
- Amsterdam UMC, Department of General Practice, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Maartje de Wit
- Amsterdam UMC, Department of Medical Psychology, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Joline W J Beulens
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Lidwine B Mokkink
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Femke Rutters
- Amsterdam UMC, Department of Epidemiology and Data Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| |
Collapse
|
32
|
Dubbelman MA, Verrijp M, Terwee CB, Jutten RJ, Postema MC, Barkhof F, Berckel BNM, Gillissen F, Teeuwen V, Teunissen C, van de Flier WM, Scheltens P, Sikkes SAM. Determining the Minimal Important Change of Everyday Functioning in Dementia: Pursuing Clinical Meaningfulness. Neurology 2022; 99:e954-e964. [PMID: 35641309 PMCID: PMC9502738 DOI: 10.1212/wnl.0000000000200781] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Accepted: 04/11/2022] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND AND OBJECTIVES Decline in everyday functioning is a key clinical change in Alzheimer disease and related disorders (ADRD). An important challenge remains the determination of what constitutes a clinically meaningful change in everyday functioning. We aimed to investigate this by establishing the minimal important change (MIC): the smallest amount of change that has a meaningful effect on patients' lives. We retrospectively investigated meaningful change in a memory clinic cohort. METHODS In the first, qualitative part of the study, community-recruited informal caregivers of patients with ADRD and memory clinic clinicians completed a survey in which they judged various situations representing changes in everyday functioning. Their judgments of meaningful change were used to determine thresholds for MIC, both for decline and improvement, on the Amsterdam Instrumental Activities of Daily Living (IADL) Questionnaire. In the second, quantitative part, we applied these values in an independent longitudinal cohort study of unselected memory clinic patients. RESULTS MIC thresholds were established at the average threshold of caregivers (N = 1,629; 62.4 ± 9.5 years; 77% female) and clinicians (N = 13): -2.2 points for clinically meaningful decline and +5.0 points for clinically meaningful improvement. Memory clinic patients (N = 230; 64.3 ± 7.7 years; 39% female; 60% dementia diagnosis) were followed for 1 year, 102 (45%) of whom showed a decline larger than the MIC, after a mean of 6.7 ± 3.5 months. Patients with a dementia diagnosis and more atrophy of the medial temporal lobe had larger odds (odds ratio [OR] = 3.4, 95% CI [1.5-7.8] and OR = 5.0, 95% CI [1.2-20.0], respectively) for passing the MIC threshold for decline than those with subjective cognitive complaints and no atrophy. DISCUSSION We were able to operationalize clinically meaningful decline in IADL by determining the MIC. The usefulness of the MIC was supported by our findings from the clinical sample that nearly half of a sample of unselected memory clinic patients showed a meaningful decline in less than a year. Disease stage and medial temporal atrophy were predictors of functional decline greater than the MIC. Our findings provide guidance in interpreting changes in IADL and may help evaluate treatment effects and monitor disease progression.
Collapse
Affiliation(s)
- Mark A Dubbelman
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands.
| | - Merike Verrijp
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Caroline B Terwee
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Roos J Jutten
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Merel C Postema
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Frederik Barkhof
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Bart N M Berckel
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Freek Gillissen
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Vivianne Teeuwen
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Charlotte Teunissen
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Wiesje M van de Flier
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Philip Scheltens
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| | - Sietske A M Sikkes
- From the Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (M.A.D., M.V., M.C.P., F.G., V.T., W.M.F., P.S., S.A.M.S.); Department of Epidemiology and Data Science, Amsterdam UMC, The Netherlands (C.B.T., W.M.F.); Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston (R.J.J.); Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, The Netherlands (F.B., B.N.M.B.); Institutes of Neurology and Healthcare Engineering, University College London, United Kingdom (F.B.); Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, The Netherlands (C.T.); and Faculty of Behavioural and Movement Sciences (S.A.M.S.), Clinical Developmental Psychology & Clinical Neuropsychology, Vrije Universiteit Amsterdam, the Netherlands
| |
Collapse
|
33
|
Elsman EBM, Flens G, de Beurs E, Roorda LD, Terwee CB. Towards standardization of measuring anxiety and depression: Differential item functioning for language and Dutch reference values of PROMIS item banks. PLoS One 2022; 17:e0273287. [PMID: 35998333 PMCID: PMC9398458 DOI: 10.1371/journal.pone.0273287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 08/05/2022] [Indexed: 11/30/2022] Open
Abstract
Introduction The outcomes anxiety and depression are measured frequently by healthcare providers to assess the impact of a disease, but with numerous instruments. PROMIS item banks provide an opportunity for standardized measurement. Cross-cultural validity of measures and the availability of reference values are prerequisites for standardized measurement. Methods PROMIS Anxiety and Depression item banks were completed by 1002 representative Dutch persons. To evaluate cross-cultural validity, data from US participants in PROMIS wave 1 were used and differential item functioning (DIF) was investigated, using an iterative hybrid of logistic regression and item response theory. McFadden’s pseudo R2-change of 2% was the critical threshold. The impact of any DIF on full item banks and short forms was investigated. To obtain Dutch reference values, T-scores for anxiety and depression were calculated for the complete Dutch sample, and age-group and gender subpopulations. Thresholds corresponding to normal limits, mild, moderate and severe symptoms were computed. Results In both item banks, two items had DIF but with minimal impact on population level T-scores for full item banks and short forms. The Dutch general population had a T-score of 49.9 for anxiety and 49.6 for depression, similar to the T-scores of 50.0 of the US general population. T-scores for age-group and gender subpopulations were also similar to T-scores of the US general population. Thresholds for mild, moderate and severe anxiety and depression were set to 55, 60 and 70, identical to US thresholds. Conclusions The limited number of items with DIF and its minimal impact, enables the use of standard (US) item parameters and comparisons of scores between Dutch and US populations. The Dutch reference values provide an important tool for healthcare professionals and researchers to evaluate and interpret symptoms of anxiety and depression, stimulating the uptake of PROMIS measures, and contributing to standardized outcome measurement.
Collapse
Affiliation(s)
- Ellen B. M. Elsman
- Department of Epidemiology and Data Science, Amsterdam UMC, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Gerard Flens
- Alliance for Quality in Mental Health Care, Utrecht, The Netherlands
| | - Edwin de Beurs
- Arkin GGZ, Amsterdam, The Netherlands
- Clinical Psychology, Faculty of Social Sciences, Leiden University, Amsterdam, The Netherlands
| | - Leo D. Roorda
- Amsterdam Rehabilitation Research Center | Reade, Amsterdam, The Netherlands
| | - Caroline B. Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- * E-mail:
| |
Collapse
|
34
|
de Vries CEE, Terwee CB, Al Nawas M, van Wagensveld BA, Janssen IMC, Liem RSL, Nienhuijs SW, Cohen RV, van Rossum EFC, Brown WA, Ghaferi AA, Ottosson J, Coulman KD, Petry TBZ, Sogg S, West-Smith L, Halford JCG, Salas XR, Dixon JB, Al-Sabah S, Lee WJ, Andersen JR, Flint SW, Hoogbergen MM, Backman B, Govers E, Isack N, Clay C, Birney S, Gunn M, Masterson P, Roberts A, Nesbitt J, Meloni R, le Brocq S, de Blaeij S, Kraaijveld C, van der Steen F, Visser B, Hamers P, Monpellier VM. Outcomes of the first global multidisciplinary consensus meeting including persons living with obesity to standardize patient-reported outcome measurement in obesity treatment research. Obes Rev 2022; 23:e13452. [PMID: 35644939 PMCID: PMC9539945 DOI: 10.1111/obr.13452] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/02/2022] [Revised: 03/07/2022] [Accepted: 03/08/2022] [Indexed: 11/30/2022]
Abstract
Quality of life is a key outcome that is not rigorously measured in obesity treatment research due to the lack of standardization of patient-reported outcomes (PROs) and PRO measures (PROMs). The S.Q.O.T. initiative was founded to Standardize Quality of life measurement in Obesity Treatment. A first face-to-face, international, multidisciplinary consensus meeting was conducted to identify the key PROs and preferred PROMs for obesity treatment research. It comprised of 35 people living with obesity (PLWO) and healthcare providers (HCPs). Formal presentations, nominal group techniques, and modified Delphi exercises were used to develop consensus-based recommendations. The following eight PROs were considered important: self-esteem, physical health/functioning, mental/psychological health, social health, eating, stigma, body image, and excess skin. Self-esteem was considered the most important PRO, particularly for PLWO, while physical health was perceived to be the most important among HCPs. For each PRO, one or more PROMs were selected, except for stigma. This consensus meeting was a first step toward standardizing PROs (what to measure) and PROMs (how to measure) in obesity treatment research. It provides an overview of the key PROs and a first selection of the PROMs that can be used to evaluate these PROs.
Collapse
Affiliation(s)
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - May Al Nawas
- Department of Surgery, St. Antonius Hospital, Nieuwegein, The Netherlands
| | | | - Ignace M C Janssen
- Nederlandse Obesitas Kliniek (Dutch Obesity Clinic), Huis Ter Heide, The Netherlands
| | - Ronald S L Liem
- Department of Surgery, Groene Hart Hospital, Gouda, The Netherlands.,Dutch Obesity Clinic, The Hague, The Netherlands
| | - Simon W Nienhuijs
- Department of Surgery, Catharina Hospital Eindhoven, The Netherlands
| | - Ricardo V Cohen
- The Center for Obesity and Diabetes, Oswaldo Cruz German Hospital, São Paulo, Brazil
| | - Elisabeth F C van Rossum
- Obesity Centre CGG, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands.,Department of Internal Medicine, Division of Endocrinology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Wendy A Brown
- Department of Surgery, Central Clinical School, Monash University, Alfred Hospital, Melbourne, Victoria, Australia
| | - Amir A Ghaferi
- Department of Surgery, University of Michigan, Ann Arbor, Michigan, USA
| | - Johan Ottosson
- Department of Surgery, Faculty of Medicine and Health, Örebro University, Örebro, Sweden
| | - Karen D Coulman
- Bristol Centre for Surgical Research, Population Health Sciences, Bristol Medical School, North Bristol NHS Trust, Bristol, UK
| | - Tarissa B Z Petry
- The Center for Obesity and Diabetes, Oswaldo Cruz German Hospital, São Paulo, Brazil
| | - Stephanie Sogg
- Massachusetts General Hospital Weight Center, Harvard Medical School, Boston, Massachusetts, USA
| | - Lisa West-Smith
- Department of Surgery, Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | | | - Ximena Ramos Salas
- Obesity Canada, Edmonton, Alberta, Canada.,European Association for the Study of Obesity, Teddington, UK
| | - John B Dixon
- Baker IDI Heart and Diabetes Institute, Melbourne, Australia
| | - Salman Al-Sabah
- Department of Surgery, Jaber Al-Ahmad Hospital, Ministry of Health, Kuwait City, Kuwait
| | - Wei-Jei Lee
- Department of Surgery, Min-Sheng General Hospital, Taoyuan, Taiwan
| | - John Roger Andersen
- Faculty of Health and Social Sciences, Western Norway University of Applied Sciences, Førde, Norway.,Centre of Health Research, Førde Hospital Trust, Førde, Norway
| | - Stuart W Flint
- School of Psychology, University of Leeds, Leeds, UK.,Scales Insights, Nexus, University of Leeds, Leeds, UK
| | | | - Brooke Backman
- Bariatric Surgery Registry, Monash University, Melbourne, Victoria, Australia
| | - Ellen Govers
- Amstelring and Dutch Knowledge Centre of Dietitians on Obesity (KDOO), Amsterdam, The Netherlands
| | | | | | - Susie Birney
- European Coalition for People Living with Obesity, Dublin, Ireland
| | - Maureen Gunn
- European Coalition for People Living with Obesity, Dublin, Ireland
| | - Paul Masterson
- European Coalition for People Living with Obesity, Dublin, Ireland
| | - Audrey Roberts
- European Coalition for People Living with Obesity, Dublin, Ireland
| | - Jacky Nesbitt
- European Coalition for People Living with Obesity, Dublin, Ireland
| | - Riccardo Meloni
- People Living with Obesity Representatives of the S.Q.O.T. Initiative, Amsterdam, The Netherlands
| | | | | | - Christina Kraaijveld
- People Living with Obesity Representatives of the S.Q.O.T. Initiative, Amsterdam, The Netherlands
| | - Floor van der Steen
- People Living with Obesity Representatives of the S.Q.O.T. Initiative, Amsterdam, The Netherlands
| | - Bibian Visser
- People Living with Obesity Representatives of the S.Q.O.T. Initiative, Amsterdam, The Netherlands
| | - Petra Hamers
- People Living with Obesity Representatives of the S.Q.O.T. Initiative, Amsterdam, The Netherlands
| | - Valerie M Monpellier
- Nederlandse Obesitas Kliniek (Dutch Obesity Clinic), Huis Ter Heide, The Netherlands
| |
Collapse
|
35
|
van der Willik EM, van Breda F, van Jaarsveld BC, van de Putte M, Jetten IW, Dekker FW, Meuleman Y, van Ittersum FJ, Terwee CB. Validity and reliability of Patient-Reported Outcomes Measurement Information System (PROMIS®) using Computerized Adaptive Testing (CAT) in patients with advanced chronic kidney disease. Nephrol Dial Transplant 2022; 38:1158-1169. [PMID: 35913734 PMCID: PMC10157750 DOI: 10.1093/ndt/gfac231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Indexed: 11/14/2022] Open
Abstract
BACKGROUND The Patient-Reported Outcomes Measurement Information System (PROMIS®) has been recommended for computerized adaptive testing (CAT) of health-related quality of life (HRQOL). This study compared the content, validity and reliability of seven PROMIS CATs to the 12-item Short-Form Health Survey (SF-12) in patients with advanced chronic kidney disease (CKD). METHODS Adult CKD patients with an eGFR < 30 ml/min.1.73m2 not receiving dialysis treatment completed seven PROMIS CATs (assessing physical function, pain interference, fatigue, sleep disturbance, anxiety, depression, and ability to participate in social roles and activities), the SF-12 and, additionally, the PROMIS Pain Intensity single item and Dialysis Symptom Index (DSI) at inclusion and 2-weeks. A content comparison was performed between PROMIS CATs and SF-12. Construct validity of PROMIS CATs was assessed using Pearson's correlations. Test-retest reliability of all patient-reported outcome measures (PROMs) was assessed by calculating the intra-class correlation coefficient (ICC) and minimal detectable change (MDC). RESULTS In total, 207 patients participated in the study. A median of 45 items (10 minutes) was completed for PROMIS CATs. All PROMIS CATs showed evidence for sufficient construct validity. PROMIS CATs, most SF-12 domains and summary scores, and DSI showed sufficient test-retest reliability (ICC ≥ 0.70). PROMIS CATs had a lower MDC compared to the SF-12 (5.7-7.4 compared to 11.2-21.7 across domains, respectively). CONCLUSION PROMIS CATs showed sufficient construct validity and test-retest reliability in patients with advanced CKD. PROMIS CATs required more items but showed better reliability than the SF-12. Future research is needed to investigate the feasibility of PROMIS CATs for routine nephrology care.
Collapse
Affiliation(s)
- Esmee M van der Willik
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health research institute, Amsterdam, The Netherlands.,Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Fenna van Breda
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Brigit C van Jaarsveld
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Marlon van de Putte
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Isabelle W Jetten
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Friedo W Dekker
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Yvette Meuleman
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Frans J van Ittersum
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health research institute, Amsterdam, The Netherlands
| |
Collapse
|
36
|
Elsman EBM, Roorda LD, Smidt N, de Vet HCW, Terwee CB. Measurement properties of the Dutch PROMIS-29 v2.1 profile in people with and without chronic conditions. Qual Life Res 2022; 31:3447-3458. [PMID: 35751760 PMCID: PMC9587921 DOI: 10.1007/s11136-022-03171-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/07/2022] [Indexed: 11/26/2022]
Abstract
PURPOSE To investigate the structural validity, internal consistency, measurement invariance, and construct validity of the Dutch PROMIS-29 v2.1 profile, including seven physical (e.g., pain, physical function), mental (e.g., depression, anxiety), and social (e.g., role functioning) domains of health, in a Dutch general population sample including subsamples with and without chronic diseases. METHODS The PROMIS-29 was completed by 63,602 participants from the Lifelines cohort study. Structural validity of the PROMIS-29, including unidimensionality of each domain and the physical and mental health summary scores, was evaluated using factor analyses (criteria: CFI ≥ 0.95, TLI ≥ 0.95, RMSEA ≤ 0.06, SRMR ≤ 0.08). Internal consistency, measurement invariance (no differential item functioning (DIF) for age, gender, administration mode, educational level, ethnicity, chronic diseases), and construct validity (hypotheses on known-groups validity and correlations between domains) were assessed per domain. RESULTS The factor structure of the seven domains was supported (CFI = 0.994, TLI = 0.993, RMSEA = 0.046, SRMR = 0.031) as was unidimensionality of each domain, both in the entire sample and the subsamples. Model fit of the physical and mental health summary scores reached the criteria, and scoring coefficients were obtained. Cronbach's alpha for the seven PROMIS-29 domains ranged from 0.75 to 0.96 in the complete sample. No DIF was detected. Of the predefined hypotheses, 78% could be confirmed. CONCLUSION Sufficient structural validity, internal consistency and measurement invariance were found, both in the entire sample and in subsamples with and without chronic diseases. Requirements for sufficient evidence for construct validity were (almost) met for most subscales. Future studies should investigate test-retest reliability, measurement error, and responsiveness of the PROMIS-29.
Collapse
Affiliation(s)
- Ellen B M Elsman
- Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam UMC, Vrije Universiteit Amsterdam, de Boelelaan 1089a, 1081 HV, Amsterdam, The Netherlands
| | - Leo D Roorda
- Amsterdam Rehabilitation Research Center | Reade, Amsterdam, The Netherlands
| | - Nynke Smidt
- Department of Epidemiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Henrica C W de Vet
- Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam UMC, Vrije Universiteit Amsterdam, de Boelelaan 1089a, 1081 HV, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam UMC, Vrije Universiteit Amsterdam, de Boelelaan 1089a, 1081 HV, Amsterdam, The Netherlands.
| |
Collapse
|
37
|
Peersmann SHM, Luijten MAJ, Haverman L, Terwee CB, Grootenhuis MA, van Litsenburg RRL. Psychometric properties and CAT performance of the PROMIS pediatric sleep disturbance, sleep-related impairment, and fatigue item banks in Dutch children and adolescents. Psychol Assess 2022; 34:860-869. [PMID: 35708925 DOI: 10.1037/pas0001150] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
This study's aim is to evaluate the psychometric properties of the pediatric Patient-Reported Outcomes Measurement Information System (PROMIS) sleep disturbance (SD), sleep-related impairment (SRI), and fatigue item banks in Dutch children and adolescents since they are yet to be validated in this population. Children and adolescents aged 8-18 years old (n = 1,325), representative of the Dutch general population, were invited. The following psychometric properties of both item banks were assessed: structural validity by fitting a graded response model (GRM) for which assumptions were checked and assessing item fit, reliability, and efficiency for the full-length item bank, short forms, and computerized adaptive test (CAT). Mean T scores and cutoff scores for mild, moderate, and severe scores were determined. A total of 527 children (response rate 39.7%) were included. SD did not meet the assumption of unidimensionality. The SRI and fatigue item banks showed sufficient structural validity. Three items showed GRM misfit; SRI item w026c and fatigue items 3224R1r and 4191R1r. Both item banks measured reliable (> .90) at the mean of the population and 2SD in the clinical direction. CATs outperformed short forms in efficiency. Mean T scores for the Dutch population were: SRI 47.5 (SD = 10.0) and fatigue 39.8 (SD = 12.4). Cutoffs included SRI minimal ≥ 34.7, moderate ≥ 55.6, severe ≥ 63.2 and fatigue minimal ≥ 23.9, moderate ≥ 49.9, severe ≥ 61.3. PROMIS pediatric SRI and fatigue item banks, short forms, and CAT showed sufficient structural validity and reliability in the Dutch population. Dutch reference values are provided. More research is needed for the PROMIS SD item bank. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
|
38
|
Elsman EBM, Butcher NJ, Mokkink LB, Terwee CB, Tricco A, Gagnier JJ, Aiyegbusi OL, Barnett C, Smith M, Moher D, Offringa M. Study protocol for developing, piloting and disseminating the PRISMA-COSMIN guideline: a new reporting guideline for systematic reviews of outcome measurement instruments. Syst Rev 2022; 11:121. [PMID: 35698213 PMCID: PMC9195229 DOI: 10.1186/s13643-022-01994-5] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Accepted: 05/28/2022] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND Systematic reviews of outcome measurement instruments are important tools in the evidence-based selection of these instruments. COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) has developed a comprehensive and widespread guideline to conduct systematic reviews of outcome measurement instruments, but key information is often missing in published reviews. This hinders the appraisal of the quality of outcome measurement instruments, impacts the decisions of knowledge users regarding their appropriateness, and compromises reproducibility and interpretability of the reviews' findings. To facilitate sufficient, transparent, and consistent reporting of systematic reviews of outcome measurement instruments, an extension of the PRISMA (Preferred Reporting of Items for Systematic reviews and Meta-Analyses) 2020 guideline will be developed: the PRISMA-COSMIN guideline. METHODS The PRISMA-COSMIN guideline will be developed in accordance with recommendations for reporting guideline development from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. First, a candidate reporting item list will be created through an environmental literature scan and expert consultations. Second, an international Delphi study will be conducted with systematic review authors, biostatisticians, epidemiologists, psychometricians/clinimetricians, reporting guideline developers, journal editors as well as patients, caregivers, and members of the public. Delphi panelists will rate candidate items for inclusion on a 5-point scale, suggest additional candidate items, and give feedback on item wording and comprehensibility. Third, the draft PRISMA-COSMIN guideline and user manual will be iteratively piloted by applying it to systematic reviews in several disease areas to assess its relevance, comprehensiveness, and comprehensibility, along with usability and user satisfaction. Fourth, a consensus meeting will be held to finalize the PRISMA-COSMIN guideline through roundtable discussions and voting. Last, a user manual will be developed and the final PRISMA-COSMIN guideline will be disseminated through publications, conferences, newsletters, and relevant websites. Additionally, relevant journals and organizations will be invited to endorse and implement PRISMA-COSMIN. Throughout the project, evaluations will take place to identify barriers and facilitators of involving patient/public partners and employing a virtual process. DISCUSSION The PRISMA-COSMIN guideline will ensure that the reports of systematic reviews of outcome measurement instruments are complete and informative, enhancing their reproducibility, ease of use, and uptake.
Collapse
Affiliation(s)
- Ellen B M Elsman
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands. .,Quality of Care, Amsterdam Public Health, Amsterdam, The Netherlands.
| | - Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada.,Department of Psychiatry, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Lidwine B Mokkink
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands.,Methodology, Amsterdam Public Health, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands.,Methodology, Amsterdam Public Health, Amsterdam, The Netherlands
| | - Andrea Tricco
- Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Toronto, Ontario, Canada.,Epidemiology Division and Institute of Health Policy, Management, and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.,Queen's Collaboration for Health Care Quality Joanna Briggs Institute Centre of Excellence, Queen's University, Kingston, Canada
| | - Joel J Gagnier
- Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, London, Ontario, Canada.,Department of Surgery, Schulich School of Medicine and Dentistry, London, Ontario, Canada.,Department of Orthopaedic Surgery, University of Michigan, Ann Arbor, Michigan, USA.,Department of Epidemiology, School of Public Health, University of Michigan, Ann Arbor, Michigan, USA
| | - Olalekan Lee Aiyegbusi
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Carolina Barnett
- Division of Neurology, Department of Medicine, University Health Network and University of Toronto, Toronto, Ontario, Canada
| | | | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada.,Management and Evaluation, Institute of Health Policy, University of Toronto, Toronto, Ontario, Canada.,Division of Neonatology, The Hospital for Sick Children, Toronto, Ontario, Canada
| |
Collapse
|
39
|
Elsman EBM, Mokkink LB, Langendoen-Gort M, Rutters F, Beulens J, Elders PJM, Terwee CB. Systematic review on the measurement properties of diabetes-specific patient-reported outcome measures (PROMs) for measuring physical functioning in people with type 2 diabetes. BMJ Open Diabetes Res Care 2022; 10:e002729. [PMID: 35675952 PMCID: PMC9185403 DOI: 10.1136/bmjdrc-2021-002729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Accepted: 05/09/2022] [Indexed: 11/03/2022] Open
Abstract
We aimed to systematically assess the measurement properties of diabetes-specific patient-reported outcome measures (PROMs) for measuring physical functioning, one of the core outcomes, in adults with type 2 diabetes.We performed a systematic literature search for PROMs or subscales measuring physical function that were validated to at least some extent in EMBASE and MEDLINE. Measurement properties were evaluated according to the COSMIN guideline for systematic reviews of PROMs.In total 21 articles were included, describing 12 versions of 7 unique diabetes-specific PROMs or subscales measuring physical functioning. In general, there were few high-quality studies on measurement properties of PROMs measuring physical functioning in adults with type 2 diabetes. The Dependence/Daily Life subscale of the Diabetic Foot Ulcer Scale-Short Form (DFS-SF) and the Impact of Weight on Activities of Daily Living Questionnaire (IWADL) were most extensively evaluated. Both had sufficient ratings for aspects of content validity, although with mostly very low-quality evidence. Sufficient ratings for structural validity, internal consistency, and reliability were also found for both instruments, but responsiveness was rated inconsistent for both instruments. The other PROMs or subscales often had insufficient aspects of content validity, or their unidimensionality could not be confirmed.This systematic review showed that the Dependence/Daily Life subscale of the DFS-SF and the IWADL could be used to measure physical functioning in people with type 2 diabetes in research or clinical practice, while keeping the limitations of these instruments in mind. The measurement properties that have not been evaluated extensively for these PROMs should be evaluated in future studies.The study protocol was registered in the PROSPERO database, number CRD42021234890.
Collapse
Affiliation(s)
- Ellen B M Elsman
- Department of Epidemiology and Data Science, Amsterdam UMC Locatie VUmc, Amsterdam, The Netherlands
| | - Lidwine B Mokkink
- Department of Epidemiology and Data Science, Amsterdam UMC Locatie VUmc, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Marlous Langendoen-Gort
- Department of General Practice and Elderly Care, Amsterdam UMC Locatie VUmc, Amsterdam, The Netherlands
| | - Femke Rutters
- Department of Epidemiology and Data Science, Amsterdam UMC Locatie VUmc, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Joline Beulens
- Department of Epidemiology and Data Science, Amsterdam UMC Locatie VUmc, Amsterdam, The Netherlands
| | - Petra J M Elders
- Amsterdam Public Health Research Institute, Amsterdam, Netherlands
- Department of General Practice and Elderly Care, Amsterdam UMC Locatie VUmc, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC Locatie VUmc, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| |
Collapse
|
40
|
Dubbelman MA, Terwee CB, Verrijp M, Visser LNC, Scheltens P, Sikkes SAM. Giving meaning to the scores of the Amsterdam instrumental activities of daily living questionnaire: a qualitative study. Health Qual Life Outcomes 2022; 20:47. [PMID: 35331258 PMCID: PMC8943938 DOI: 10.1186/s12955-022-01958-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Accepted: 03/15/2022] [Indexed: 11/25/2022] Open
Abstract
Background Everyday functioning is a clinically relevant concept in dementia, yet little is known about the clinical meaningfulness of scores on functional outcome measures. We aimed to establish clinically meaningful scoring categories for the Amsterdam Instrumental Activities of Daily Living Questionnaire (A-IADL-Q), representing no, mild, moderate and severe problems in daily functioning. Methods Informal caregivers (n = 6) of memory-clinic patients and clinicians (n = 13), including neurologists and nurse specialists, working at various memory clinics in The Netherlands. In focus groups, participants individually ranked nine summaries of fictional patients from least to most impairment in daily functioning. Then, they placed bookmarks to demarcate the thresholds for mild, moderate and severe problems. Individual bookmark placements were then discussed to reach consensus. Clinicians completed a survey in which they placed bookmarks, individually. Results While individual categorizations varied somewhat, caregivers and clinicians generally agreed on the thresholds, particularly about the distinction between ‘no’ and ‘mild’ problems. Score categories were no problems (T-score ≥ 60), mild problems (T-score 50–59), moderate problems (T-score 40–49), and severe problems in daily functioning (T-score < 40), on a scale ranging 20–80. Conclusions Our findings provide categories for determining the level of functional impairment, which can facilitate interpretation of A-IADL-Q scores. These categories can subsequently be used by clinicians to improve communication with patients and caregivers. Supplementary Information The online version contains supplementary material available at 10.1186/s12955-022-01958-2.
Collapse
Affiliation(s)
- Mark A Dubbelman
- Department of Neurology, Amsterdam Neuroscience, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC, Location VUmc, P.O. Box 7057, 1007 MB, Amsterdam, The Netherlands.
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Amsterdam, The Netherlands
| | - Merike Verrijp
- Department of Neurology, Amsterdam Neuroscience, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC, Location VUmc, P.O. Box 7057, 1007 MB, Amsterdam, The Netherlands
| | - Leonie N C Visser
- Department of Neurology, Amsterdam Neuroscience, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC, Location VUmc, P.O. Box 7057, 1007 MB, Amsterdam, The Netherlands.,Division of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Center for Alzheimer Research, Karolinska Institutet, Stockholm, Sweden
| | - Philip Scheltens
- Department of Neurology, Amsterdam Neuroscience, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC, Location VUmc, P.O. Box 7057, 1007 MB, Amsterdam, The Netherlands
| | - Sietske A M Sikkes
- Department of Neurology, Amsterdam Neuroscience, Alzheimer Center Amsterdam, Vrije Universiteit Amsterdam, Amsterdam UMC, Location VUmc, P.O. Box 7057, 1007 MB, Amsterdam, The Netherlands.,Faculty of Behavioural and Movement Sciences, Clinical Developmental Psychology and Clinical Neuropsychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
41
|
Heesterbeek MR, Luijten MAJ, Gouw SC, Limperg PF, Fijnvandraat K, Coppens M, Kruip MJHA, Eikenboom J, Grootenhuis MA, Flens G, Terwee CB, Peters M, Haverman L. Measuring anxiety and depression in young adult men with haemophilia using PROMIS. Haemophilia 2022; 28:e79-e82. [PMID: 35305286 DOI: 10.1111/hae.14534] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Revised: 02/23/2022] [Accepted: 02/23/2022] [Indexed: 11/30/2022]
Affiliation(s)
- M R Heesterbeek
- Emma Children's Hospital, Amsterdam UMC, University of Amsterdam, Child and Adolescent Psychiatry and Psychosocial Care, Amsterdam Reproduction and Development, Amsterdam Public Health, Amsterdam, The Netherlands
| | - M A J Luijten
- Emma Children's Hospital, Amsterdam UMC, University of Amsterdam, Child and Adolescent Psychiatry and Psychosocial Care, Amsterdam Reproduction and Development, Amsterdam Public Health, Amsterdam, The Netherlands.,Amsterdam UMC, Epidemiology and Data Science, Vrije Universiteit, Amsterdam, The Netherlands
| | - S C Gouw
- Emma Children's Hospital, Amsterdam UMC, Paediatric Haematology, University of Amsterdam, Amsterdam, The Netherlands.,Department of Clinical Epidemiology, Leiden University Medical Centre, Leiden, The Netherlands
| | - P F Limperg
- Emma Children's Hospital, Amsterdam UMC, University of Amsterdam, Child and Adolescent Psychiatry and Psychosocial Care, Amsterdam Reproduction and Development, Amsterdam Public Health, Amsterdam, The Netherlands
| | - K Fijnvandraat
- Emma Children's Hospital, Amsterdam UMC, Paediatric Haematology, University of Amsterdam, Amsterdam, The Netherlands
| | - M Coppens
- Department of Vascular Medicine, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centres, University of Amsterdam, Amsterdam, the Netherlands
| | - M J H A Kruip
- Erasmus MC, Department of Haematology Rotterdam, Erasmus University Medical Centre, The Netherlands
| | - J Eikenboom
- Department of Internal Medicine, Division of Thrombosis and Haemostasis, Leiden University Medical Centre, Leiden, The Netherlands
| | - M A Grootenhuis
- Princess Máxima Centre for Paediatric Oncology, Utrecht, The Netherlands
| | - G Flens
- Alliance for Quality in Mental Health Care, Utrecht, The Netherlands
| | - C B Terwee
- Emma Children's Hospital, Amsterdam UMC, Paediatric Haematology, University of Amsterdam, Amsterdam, The Netherlands
| | - M Peters
- Amsterdam UMC, Epidemiology and Data Science, Vrije Universiteit, Amsterdam, The Netherlands
| | - L Haverman
- Emma Children's Hospital, Amsterdam UMC, University of Amsterdam, Child and Adolescent Psychiatry and Psychosocial Care, Amsterdam Reproduction and Development, Amsterdam Public Health, Amsterdam, The Netherlands
| |
Collapse
|
42
|
Arwert HJ, Oosterveer DM, Schoones JW, Terwee CB, Vliet Vlieland TP. The use of PROMIS measures in clinical research in stroke patients, a systematic literature review. Arch Rehabil Res Clin Transl 2022; 4:100191. [PMID: 35756978 PMCID: PMC9214304 DOI: 10.1016/j.arrct.2022.100191] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
Objective To systematically describe the use and outcomes of Patient-Reported Outcomes Measurement Information System (PROMIS) measures in clinical studies in populations with stroke. Data Sources A systematic search on the use of PROMIS measures in clinical stroke studies in 9 electronic databases. Study Selection Studies had to be original, reporting on outcome data using PROMIS measures in populations with stroke (ischemic and/or hemorrhagic), from January 1st, 2007. Initially, 174 unique studies met the inclusion criteria. In 2 steps, titles, abstracts and full-text articles were screened for eligibility (2 authors independently). Data Extraction From the selected articles, study characteristics, type of PROMIS measures, and its outcomes were extracted by 2 authors independently. The authors discussed their views to achieve consensus. A third author was consulted if necessary. Data Synthesis In total, 27 studies (24,366 patients) were included, predominantly from the United States (22); most study populations were hospital-based (20); the number of patients ranged from 30-3283. In general, patients had no or mild symptoms (median modified Rankin scale 1). Two different generic PROMIS measures were reported (PROMIS Global Health, PROMIS 29) and 9 PROMIS measures focusing on specific domains (sleep, pain, physical functioning, self-efficacy, satisfaction with social roles, depression, anxiety, cognition, fatigue). These match the International Classification of Functioning, Disability, and Health (ICF) domains mentioned in the Core Set for Stroke. The measures were administered 1-55 months after stroke. Outcome data are provided. Pooling of data was not achieved because of a large variety in study characteristics (inclusion criteria, follow-up moments, data processing). Conclusions The PROMIS measures in this review could be relevant from a patient's perspective, covering ICF core set domains for patients with stroke. The large variety in study characteristics hampers comparisons across populations. Many different outcome measures are used to report results of stroke rehabilitation studies.
Collapse
Affiliation(s)
- Henk J. Arwert
- Department of Rehabilitation, Leiden University Medical Center, Leiden, the Netherlands
- Corresponding author Henk J Arwert, MD, PhD, Leiden University Medical Center, Department of Rehabilitation, Albinusdreef 2, 2333 ZA Leiden, the Netherlands.
| | | | | | - Caroline B. Terwee
- Department of Epidemiology and Data Science, Amsterdam University Medical Center, Amsterdam, the Netherlands
| | - Thea P.M. Vliet Vlieland
- Department of Orthopedics, Rehabilitation, and Physical Therapy, Leiden University Medical Center, Leiden, the Netherlands
| |
Collapse
|
43
|
Terluin B, Griffiths P, Trigg A, Terwee CB, Bjorner JB. Present state bias in transition ratings was accurately estimated in simulated and real data. J Clin Epidemiol 2021; 143:128-136. [PMID: 34965478 DOI: 10.1016/j.jclinepi.2021.12.024] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Revised: 11/14/2021] [Accepted: 12/22/2021] [Indexed: 10/19/2022]
Abstract
OBJECTIVE Patient-reported transition ratings are supposed to reflect the change between a previous baseline health state and a present follow-up state, but may reflect the present state to a greater extent. This so-called 'present state bias' (PSB) potentially threatens the validity of transition ratings. Several criteria have been proposed to assess PSB. We examined how well these criteria perform and to which extent confirmatory factor analysis (CFA) for categorical data provides an accurate assessment of the degree of PSB. STUDY DESIGN AND SETTING We simulated a multiple samples with baseline and follow-up item responses to a hypothetical questionnaire, and transition ratings. The samples varied with respect to various distributional characteristics and the degree of PSB. The performance of criteria proposed in the literature, and a new CFA-based criterion, were evaluated by the proportion of explained variance in PSB. In addition, four real datasets were analyzed. RESULTS The known criteria explained 36-74% of the variance in PSB. A new CFA-based criterion, namely the ratio of the factor loadings of the transition ratings plus one, explained 81-98% of the variance in PSB across the samples. CONCLUSION Present state bias in transition ratings can be estimated accurately using CFA.
Collapse
Affiliation(s)
- Berend Terluin
- Department of General Practice, Amsterdam Public Health research institute, Amsterdam UMC, Vrije Universiteit Amsterdam, de Boelelaan 1117, 1081 HV Amsterdam, The Netherlands.
| | | | - Andrew Trigg
- Patient-Centered Outcomes, Adelphi Values, Adelphi Mill, Bollington, Cheshire, SK10 5JB United Kingdom.
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam Public Health research institute, Amsterdam UMC, Vrije Universiteit Amsterdam, de Boelelaan 1117, 1081 HV Amsterdam, The Netherlands.
| | - Jakob B Bjorner
- QualityMetric, Johnston, Rhode Island, USA; Department of Public Health, University of Copenhagen, Copenhagen, Denmark.
| |
Collapse
|
44
|
Geraedts ACM, Mulay S, Terwee CB, Vahl AC, Verhagen HJM, Ünlü Ç, Ubbink DT, Koelemay MJW, Balm R. Patient-Reported Outcomes of Yearly Imaging Surveillance in Patients Following Endovascular Aortic Aneurysm Repair. Ann Vasc Surg 2021; 82:221-227. [PMID: 34902477 DOI: 10.1016/j.avsg.2021.11.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 11/04/2021] [Accepted: 11/06/2021] [Indexed: 11/16/2022]
Abstract
Little is known about the impact of standardized imaging surveillance on anxiety levels and well-being of patients after endovascular aortic aneurysm repair (EVAR). We hypothesize that patient anxiety levels increase just before receiving the imaging results compared with standard anxiety levels. METHODS Prospective cohort study from November 2018 to May 2020 including post-EVAR patients visiting the outpatient clinics of 4 Dutch hospitals for imaging follow-up. The Patient-Reported Outcomes Measurement Information System (PROMIS) was used. Patients completed the PROMIS Anxiety v1.0 Short Form (SF) 4a, PROMIS-Global Health Scale v1.2, and PROMIS-Physical Function v1.2 SF8b at 2 time points: prior to the result of the imaging study (T1: pre-visit) and 6-8 months later (T2: reference measurement). Mean T-scores at T1 were compared to T2, and T2 to the general 65+ Dutch population. RESULTS Altogether 342 invited patients were eligible, 214 completed the first questionnaire, 189 returned 2 completed questionnaires and 128 patients did not participate. Out of 214 respondents, 195 were male (91.1%) and the mean (standard deviation) age was 75.2 (7.0) years. There were no significant differences between T1 and T2 in anxiety levels (0.48; 95% confidence interval[CI] -0.42-1.38), global mental health (0.27; 95% CI -0.79-0.84), global physical health (0.10; 95% CI -0.38-1.18) and physical function (0.53; 95% CI -0.26-1.32). Compared with the 65+ Dutch population, at T2 patients experienced more anxiety (3.8; 95% CI 2.96-5.54), had worse global physical health (-3.2; 95% CI -4.38 - -2.02) and physical function (-2.4; 95% CI -4.00 - -0.80). Global mental health was similar (-1.0; 95% CI -2.21 - 0.21). CONCLUSIONS Post-EVAR patients do not experience more anxiety just before receiving surveillance imaging results than outside this period, but do suffer from more anxiety and worse physical outcomes than the 65+ Dutch population.
Collapse
Affiliation(s)
- A C M Geraedts
- Department of Surgery, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centres, University of Amsterdam, Amsterdam, The Netherlands.
| | - S Mulay
- Department of Surgery, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centres, University of Amsterdam, Amsterdam, The Netherlands
| | - C B Terwee
- Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - A C Vahl
- Department of Surgery, OLVG, Amsterdam, The Netherlands
| | - H J M Verhagen
- Department of Vascular Surgery, Erasmus Medical Centre, Rotterdam, The Netherlands
| | - Ç Ünlü
- Department of Vascular Surgery, Noordwest Hospital, Alkmaar, The Netherlands
| | - D T Ubbink
- Department of Surgery, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centres, University of Amsterdam, Amsterdam, The Netherlands
| | - M J W Koelemay
- Department of Surgery, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centres, University of Amsterdam, Amsterdam, The Netherlands
| | - R Balm
- Department of Surgery, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centres, University of Amsterdam, Amsterdam, The Netherlands.
| |
Collapse
|
45
|
van Balen EC, Haverman L, Hassan S, Taal EM, Smit C, Driessens MH, Beckers EAM, Coppens M, Eikenboom J, Hooimeijer HL, Leebeek FWG, van Vulpen LFD, Schols SEM, Terwee CB, Rosendaal FR, van der Bom JG, Gouw SC. Validation of PROMIS Profile-29 in adults with hemophilia in the Netherlands. J Thromb Haemost 2021; 19:2687-2701. [PMID: 34245088 PMCID: PMC8596807 DOI: 10.1111/jth.15454] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Revised: 06/19/2021] [Accepted: 07/07/2021] [Indexed: 12/12/2022]
Abstract
BACKGROUND The Patient-Reported Outcomes Measurement Information System (PROMIS) Profile-29 questionnaire is widely used worldwide, but it has not yet been validated in the Netherlands, nor in persons with hemophilia. OBJECTIVE To validate the Dutch-Flemish version of the PROMIS-29 Profile v2.01 in adults with hemophilia. METHODS Dutch males with hemophilia (all severities) completed questionnaires that contained sociodemographic and clinical characteristics, the PROMIS-29, RAND-36, and the Hemophilia Activities List (HAL). Structural validity of each subscale was assessed with confirmatory factor analysis (CFA). Internal consistency was calculated for each subscale with sufficient model fit in CFA. Construct validity was assessed by testing hypotheses about (1) correlations of each PROMIS-29 subscale with corresponding scales of RAND-36 and domains of HAL, and (2) mean differences in T-scores between subgroups with different hemophilia severities, self-reported joint impairment, and HIV infection status. We considered ≥75% of data in accordance with the hypotheses evidence for construct validity. RESULTS In total, 770 persons with hemophilia participated in this cross-sectional study. CFA revealed sufficient structural validity for five subscales: Physical Function, Depression, Sleep Disturbance, Ability to Participate in Social Roles and Activities, and Pain Interference. Internal consistency was high and Cronbach's alpha ranged from 0.79 for Sleep Disturbance to 0.96 for Pain Interference. Differences between clinical subgroups were in the expected direction. Construct validity was confirmed for Physical Function, Anxiety, Depression, Fatigue, Sleep Disturbance, and Pain Intensity. CONCLUSION This study revealed sufficient evidence for structural validity, internal consistency, and construct validity for most PROMIS Profile-29 subscales among people with hemophilia in the Netherlands.
Collapse
Affiliation(s)
- Erna C. van Balen
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
| | - Lotte Haverman
- Child and Adolescent Psychiatry & Psychosocial CareAmsterdam Reproduction and DevelopmentAmsterdam Public HealthEmma Children’s HospitalAmsterdam UMCUniversity of AmsterdamAmsterdamThe Netherlands
| | - Shermarke Hassan
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
| | - Elisabeth M. Taal
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
| | - Cees Smit
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
| | | | - Erik A. M. Beckers
- Department of HematologyMaastricht University Medical CentreMaastrichtThe Netherlands
| | - Michiel Coppens
- Department of Vascular MedicineAmsterdam Cardiovascular SciencesAmsterdam University Medical CentersUniversity of AmsterdamAmsterdamThe Netherlands
| | - Jeroen Eikenboom
- Department of Internal MedicineDivision of Thrombosis and HemostasisLeiden University Medical CenterLeidenThe Netherlands
| | - Hélène L. Hooimeijer
- Department of PaediatricsUniversity Medical Center GroningenGroningenThe Netherlands
| | | | - Lize F. D. van Vulpen
- Department of Benign HematologyVan CreveldkliniekUniversity Medical Center UtrechtUtrecht UniversityUtrechtThe Netherlands
| | - Saskia E. M. Schols
- Department of HematologyRadboud University Medical CenterNijmegenthe Netherlands
- Hemophilia Treatment Center Nijmegen‐Eindhoven‐MaastrichtNijmegenThe Netherlands
| | - Caroline B. Terwee
- Department of Epidemiology and Data ScienceAmsterdam Public Health Research InstituteAmsterdam UMCVrije Universiteit AmsterdamThe Netherlands
| | - Frits R. Rosendaal
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
| | - Johanna G. van der Bom
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
- Center for Clinical Transfusion ResearchSanquin Research/LUMCLeidenThe Netherlands
| | - Samantha C. Gouw
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
- Department of Pediatric HematologyEmma Children’s HospitalAmsterdam UMCUniversity of AmsterdamAmsterdamThe Netherlands
| |
Collapse
|
46
|
Verbeek DO, Terwee CB, Haverman L. How to use the patient-reported outcomes measurement information system (PROMIS) in international orthopaedic trauma research: a practical approach. Injury 2021; 52:3537-3539. [PMID: 33752876 DOI: 10.1016/j.injury.2021.03.021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Accepted: 03/09/2021] [Indexed: 02/02/2023]
Affiliation(s)
- Diederik O Verbeek
- Department of Surgery, Division of Trauma, Maastricht University Medical Center +, P Debyelaan 25, 6202 AZ, Maastricht, The Netherlands.
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam UMC, Vrije Universiteit, De Boelelaan 1117, 1081 HV Amsterdam, The Netherlands.
| | - Lotte Haverman
- Department of Child and Adolescent Psychiatry and Psychosocial Care, Amsterdam Reproduction and Development, Amsterdam Public Health, Emma Children's Hospital, Amsterdam UMC, University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands; Department of Strategy and Policy, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
| |
Collapse
|
47
|
Bernstein DN, Reitblat C, van de Graaf VA, O’Donnell E, Philpotts LL, Terwee CB, Poolman RW. Is There An Association Between Bundled Payments and "Cherry Picking" and "Lemon Dropping" in Orthopaedic Surgery? A Systematic Review. Clin Orthop Relat Res 2021; 479:2430-2443. [PMID: 33942797 PMCID: PMC8509989 DOI: 10.1097/corr.0000000000001792] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Accepted: 04/01/2021] [Indexed: 01/31/2023]
Abstract
BACKGROUND The goal of bundled payments-lump monetary sums designed to cover the full set of services needed to provide care for a condition or medical event-is to provide a reimbursement structure that incentivizes improved value for patients. There is concern that such a payment mechanism may lead to patient screening and denying or providing orthopaedic care to patients based on the number and severity of comorbid conditions present associated with complications after surgery. Currently, however, there is no clear consensus about whether such an association exists. QUESTIONS/PURPOSES In this systematic review, we asked: (1) Is the implementation of a bundled payment model associated with a change in the sociodemographic characteristics of patients undergoing an orthopaedic procedure? (2) Is the implementation of a bundled payment model associated with a change in the comorbidities and/or case-complexity characteristics of patients undergoing an orthopaedic procedure? (3) Is the implementation of a bundled payment model associated with a change in the recent use of healthcare resources characteristics of patients undergoing an orthopaedic procedure? METHODS This systematic review was registered in PROSPERO before data collection (CRD42020189416). Our systematic review included scientific manuscripts published in MEDLINE, Embase, Web of Science, Econlit, Policyfile, and Google Scholar through March 2020. Of the 30 studies undergoing full-text review, 20 were excluded because they did not evaluate the outcome of interest (patient selection) (n = 8); were editorial, commentary, or review articles (n = 5); did not evaluate the appropriate intervention (introduction of a bundled payment program) (n = 4); or assessed the wrong patient population (not orthopaedic surgery patients) (n = 3). This led to 10 studies included in this systematic review. For each study, patient factors analyzed in the included studies were grouped into the following three categories: sociodemographics, comorbidities and/or case complexity, or recent use of healthcare resources characteristics. Next, each patient factor falling into one of these three categories was examined to evaluate for changes from before to after implementation of a bundled payment initiative. In most cases, studies utilized a difference-in-difference (DID) statistical technique to assess for changes. Determination of whether the bundled payment initiative required mandatory participation or not was also noted. Scientific quality using the Adapted Newcastle-Ottawa Scale had a median (range) score of 8 (7 to 8; highest possible score: 9), and the quality of the total body of evidence for each patient characteristic group was found to be low using the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) tool. We could not assess the likelihood of publication using funnel plots because of the variation of patient factors analyzed in each study and the heterogeneity of data precluded a meta-analysis. RESULTS Of the nine included studies that reported on the sociodemographic characteristics of patients selected for care, seven showed no change with the implementation of bundled payments, and two demonstrated a difference. Most notably, the studies identified a decrease in the percentage of patients undergoing an orthopaedic operative intervention who were dual-eligible (range DID estimate -0.4% [95% CI -0.75% to -0.1%]; p < 0.05 to DID estimate -1.0% [95% CI -1.7% to -0.2%]; p = 0.01), which means they qualified for both Medicare and Medicaid insurance coverage. Of the 10 included studies that reported on comorbidities and case-complexity characteristics, six reported no change in such characteristics with the implementation of bundled payments, and four studies noted differences. Most notably, one study showed a decrease in the number of treated patients with disabilities (DID estimate -0.6% [95% CI -0.97% to -0.18%]; p < 0.05) compared with before bundled payment implementation, while another demonstrated a lower number of Elixhauser comorbidities for those treated as part of a bundled payment program (before: score of 0-1 in 63.6%, 2-3 in 27.9%, > 3 in 8.5% versus after: score of 0-1 in 50.1%, 2-3 in 38.7%, > 3 in 11.2%; p = 0.033). Of the three included studies that reported on the recent use of healthcare resources of patients, one study found no difference in the use of healthcare resources with the implementation of bundled payments, and two studies did find differences. Both studies found a decrease in patients undergoing operative management who recently received care at a skilled nursing facility (range DID estimate -0.50% [95% CI -1.0% to 0.0%]; p = 0.04 to DID estimate: -0.53% [95% CI -0.96% to -0.10%]; p = 0.01), while one of the studies also found a decrease in patients undergoing operative management who recently received care at an acute care hospital (DID estimate -0.8% [95% CI -1.6% to -0.1%]; p = 0.03) or as part of home healthcare (DID estimate -1.3% [95% CI -2.0% to -0.6%]; p < 0.001). CONCLUSION In six of 10 studies in which differences in patient characteristics were detected among those undergoing operative orthopaedic intervention once a bundled payment program was initiated, the effect was found to be minimal (approximately 1% or less). However, our findings still suggest some level of adverse patient selection, potentially worsening health inequities when considered on a large scale. It is also possible that our findings reflect better care, whereby the financial incentives lead to fewer patients with a high risk of complications undergoing surgical intervention and vice versa for patients with a low risk of complications postoperatively. However, this is a fine line, and it may also be that patients with a high risk of complications postoperatively are not being offered surgery enough, while patients at low risk of complications postoperatively are being offered surgery too frequently. Evaluation of the longer-term effect of these preliminary bundled payment programs on patient selection is warranted to determine whether adverse patient selection changes over time as health systems and orthopaedic surgeons become accustomed to such reimbursement models.
Collapse
Affiliation(s)
- David N. Bernstein
- Harvard Combined Orthopaedic Residency Program, Massachusetts General Hospital, Boston, MA, USA
- Department of Orthopaedic Surgery, Leiden University Medical Center, Leiden, the Netherlands
- Harvard Medical School, Boston, MA, USA
| | - Chanan Reitblat
- Harvard Medical School, Boston, MA, USA
- Harvard Business School, Boston, MA, USA
| | | | - Evan O’Donnell
- Harvard Medical School, Boston, MA, USA
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, MA, USA
| | | | - Caroline B. Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Rudolf W. Poolman
- Department of Orthopaedic Surgery, Leiden University Medical Center, Leiden, the Netherlands
- Department of Orthopaedic Surgery, Joint Research, OLVG, Amsterdam, the Netherlands
| |
Collapse
|
48
|
Matvienko-Sikar K, Avery K, Blazeby JM, Devane D, Dodd S, Egan AM, Gorst SL, Hughes K, Jacobsen P, Kirkham JJ, Kottner J, Mellor K, Millward CP, Patel S, Quirke F, Saldanha IJ, Smith V, Terwee CB, Young AE, Williamson PR. Use of core outcome sets was low in clinical trials published in major medical journals. J Clin Epidemiol 2021; 142:19-28. [PMID: 34715310 DOI: 10.1016/j.jclinepi.2021.10.012] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2021] [Revised: 10/08/2021] [Accepted: 10/20/2021] [Indexed: 02/07/2023]
Abstract
OBJECTIVES To examine current practices in late-phase trials published in major medical journals and examine trialists' views about core outcome set (COS) use. STUDY DESIGN AND SETTING A sequential multi-methods study was conducted. We examined late-phase trials published between October 2019 and March 2020 in JAMA, NEJM, The Lancet, BMJ, and Annals of Internal Medicine. The COMET database was searched for COS potentially relevant to trials not reporting using a COS; overlap of trial and COS outcomes was examined. An online survey examined awareness of, and decisions to search for and use a COS. RESULTS Ninety-five trials were examined; 93 (98%) did not report using a COS. Relevant COS were identified for 31 trials (33%). Core outcomes were measured in 9 (23%) studies; all trials measured at least one core outcome. Thirty-one trialists (33%) completed our survey. The most common barrier to COS use was trialist's own outcome preferences and choice (68%). The most common perceived facilitator was awareness and knowledge about COS (90%). CONCLUSION COS use in this cohort of trials was low, even when relevant COS were available. Increased use of COS in clinical trials can improve evaluation of intervention effects and evidence synthesis and reduce research waste.
Collapse
Affiliation(s)
| | - Kerry Avery
- NIHR Bristol Biomedical Research Centre at University Hospitals Bristol NHS Foundation Trust and the University of Bristol, Bristol Medical School, Population Health Sciences, University of Bristol, Bristol, UK
| | - Jane M Blazeby
- NIHR Bristol Biomedical Research Centre at University Hospitals Bristol NHS Foundation Trust and the University of Bristol, Bristol Medical School, Population Health Sciences, University of Bristol, Bristol, UK
| | - Declan Devane
- Aras Moyola, School of Nursing and Midwifery, National University of Ireland, Galway, 26 Upper Newcastle, Galway, H91 E3YV, Ireland; Health Research Board Trials Methodology Research Network, National University of Ireland, Galway, Ireland
| | - Susanna Dodd
- Department of Health Data Science, University of Liverpool (a member of Liverpool Health Partners), MRC/NIHR Trials Methodology Research Partnership, Liverpool, UK
| | - Aoife M Egan
- Division of Endocrinology, Diabetes and Metabolism, Mayo Clinic School of Medicine, Rochester, MN, USA
| | - Sarah L Gorst
- Department of Health Data Science, University of Liverpool (a member of Liverpool Health Partners), MRC/NIHR Trials Methodology Research Partnership, Liverpool, UK
| | - Karen Hughes
- Department of Health Data Science, University of Liverpool (a member of Liverpool Health Partners), MRC/NIHR Trials Methodology Research Partnership, Liverpool, UK
| | | | - Jamie J Kirkham
- Centre for Biostatistics, Manchester Academic Health Science Centre, University of Manchester, Manchester, UK
| | - Jan Kottner
- Charité-Universitätsmedizin Berlin, Institute of Clinical Nursing Science, Berlin, Germany
| | - Katie Mellor
- Centre for Statistics in Medicine, Nuffield Department of Orthopedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Christopher P Millward
- Department of Neurosurgery, The Walton Centre NHS Foundation Trust, Liverpool, UK; Institute of Systems, Molecular & Integrative Biology, University of Liverpool, Liverpool, UK
| | - Smitaa Patel
- Birmingham Clinical Trials Unit, University of Birmingham, Birmingham, UK
| | - Fiona Quirke
- Health Research Board Trials Methodology Research Network, National University of Ireland, Galway, Ireland; College of Medicine, Nursing and Health Sciences, National University of Ireland Galway, Galway, Ireland
| | - Ian J Saldanha
- Department of Health Services, Center for Evidence Synthesis in Health, Policy and Practice, and Department of Epidemiology, Brown University School of Public Health, Providence, RI, USA
| | - Valerie Smith
- School of Nursing and Midwifery, University of Dublin Trinity College, Ireland
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Amber E Young
- Centre for Surgical Research, Population Health Sciences Bristol Medical School, Bristol, UK
| | - Paula R Williamson
- Department of Health Data Science, University of Liverpool (a member of Liverpool Health Partners), MRC/NIHR Trials Methodology Research Partnership, Liverpool, UK
| |
Collapse
|
49
|
Pellicciari L, Chiarotto A, Giusti E, Crins MHP, Roorda LD, Terwee CB. Psychometric properties of the patient-reported outcomes measurement information system scale v1.2: global health (PROMIS-GH) in a Dutch general population. Health Qual Life Outcomes 2021; 19:226. [PMID: 34579721 PMCID: PMC8477486 DOI: 10.1186/s12955-021-01855-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Accepted: 09/03/2021] [Indexed: 12/21/2022] Open
Abstract
Purpose To assess the psychometric properties of the Dutch-Flemish Patient-Reported Outcome Measurement Information System Scale v1.2 – Global Health (PROMIS-GH). Methods The PROMIS-GH (also referred to as PROMIS-10) was administered to 4370 persons from the Dutch general population. Unidimensionality (CFI ≥ 0.95; TLI ≥ 0.95; RMSEA ≤ 0.06; SRMR ≤ 0.08), local independence (residual correlations < 0.20), monotonicity (H > 0.30), model fit with the Graded Response Model (GRM, p < 0.001), internal consistency (alpha > 0.75), precision (total score information across the latent trait), measurement invariance (no Differential Item Functioning [DIF]), and cross-cultural validity (no DIF for language, Dutch vs. United States English) of its subscales, composed of four items each, Global Mental Health (GMH) and Global Physical Health (GPH), were assessed. Results Confirmatory factor analyses, on both subscales, revealed slight departures from unidimensionality for GMH (CFI = 0.98; TLI = 0.95, RMSEA = 0.22; SRMR = 0.04) and GPH (CFI = 0.99; TLI = 0.97; RMSEA = 0.12; SRMR = 0.03). Local independence, monotonicity, GRM model fit, internal consistency, precision and cross-cultural validity were supported. However, Global10 (emotional problems) showed misfit on the GMH subscale, while Global08 (fatigue) presented DIF for age. Conclusion The psychometric properties of the PROMIS-GH in the Dutch population were considered acceptable. Sufficient local independence, monotonicity, GRM fit, internal consistency, measurement invariance and cross-cultural validity were found. If future studies find similar results, structural validity of the GMH could be enhanced by improving or replacing Global10 (emotional problems). Supplementary Information The online version contains supplementary material available at 10.1186/s12955-021-01855-0.
Collapse
Affiliation(s)
| | - Alessandro Chiarotto
- Department of Health Sciences, Amsterdam Movement Sciences Research Institute, VU University, Amsterdam, The Netherlands.,Department of General Practice, Erasmus MC, , University Medical Center, Rotterdam, The Netherlands
| | - Emanuele Giusti
- Psychology Research Laboratory, IRCCS Istituto Auxologico Italiano, Milan, Italy.,Department of Psychology, Catholic University of the Sacred Heart, Milan, Italy
| | - Martine H P Crins
- Amsterdam Rehabilitation Research Center
- Reade, Amsterdam, The Netherlands.,Zuyderland MC Department of Quality and Safety, Amsterdam, The Netherlands
| | - Leo D Roorda
- Amsterdam Rehabilitation Research Center
- Reade, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, de Boelelaan 1089a, 1081 HV, Amsterdam, The Netherlands.
| |
Collapse
|
50
|
Terwee CB, Zuidgeest M, Vonkeman HE, Cella D, Haverman L, Roorda LD. Common patient-reported outcomes across ICHOM Standard Sets: the potential contribution of PROMIS®. BMC Med Inform Decis Mak 2021; 21:259. [PMID: 34488730 PMCID: PMC8420145 DOI: 10.1186/s12911-021-01624-5] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Accepted: 08/27/2021] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND The International Consortium for Health Outcomes Measurement (ICHOM) develops condition-specific Standard Sets of outcomes to be measured in clinical practice for value-based healthcare evaluation. Standard Sets are developed by different working groups, which is inefficient and may lead to inconsistencies in selected PROs and PROMs. We aimed to identify common PROs across ICHOM Standard Sets and examined to what extend these PROs can be measured with a generic set of PROMs: the Patient-Reported Outcomes Measurement Information System (PROMIS®). METHODS We extracted all PROs and recommended PROMs from 39 ICHOM Standard Sets. Similar PROs were categorized into unique PRO concepts. We examined which of these PRO concepts can be measured with PROMIS. RESULTS A total of 307 PROs were identified in 39 ICHOM Standard Sets and 114 unique PROMs are recommended for measuring these PROs. The 307 PROs could be categorized into 22 unique PRO concepts. More than half (17/22) of these PRO concepts (covering about 75% of the PROs and 75% of the PROMs) can be measured with a PROMIS measure. CONCLUSION Considerable overlap was found in PROs across ICHOM Standard Sets, and large differences in terminology used and PROMs recommended, even for the same PROs. We recommend a more universal and standardized approach to the selection of PROs and PROMs. Such an approach, focusing on a set of core PROs for all patients, measured with a system like PROMIS, may provide more opportunities for patient-centered care and facilitate the uptake of Standard Sets in clinical practice.
Collapse
Affiliation(s)
- Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam UMC, Vrije Universiteit Amsterdam, De Boelelaan 1089a, 1081 HV, Amsterdam, The Netherlands.
| | | | - Harald E Vonkeman
- Department of Rheumatology and Clinical Immunology, Medisch Spectrum Twente, Enschede, The Netherlands
- Department of Psychology, Health and Technology, University of Twente, Enschede, The Netherlands
| | - David Cella
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, USA
| | - Lotte Haverman
- Psychosocial Department, Emma Children's Hospital Amsterdam UMC, University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
| | - Leo D Roorda
- Amsterdam Rehabilitation Research Center | Reade, Amsterdam, The Netherlands
| |
Collapse
|