1
|
Williams GL, Flens G, Terwee CB, de Beurs E, Spinhoven P, Paap MCS. Extending the PROMIS item bank "ability to participate in social roles and activities": a psychometric evaluation using IRT. Qual Life Res 2024; 33:2129-2144. [PMID: 38780673 PMCID: PMC11286634 DOI: 10.1007/s11136-024-03666-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/10/2024] [Indexed: 05/25/2024]
Abstract
OBJECTIVE Our objective was to explore whether the extension of the PROMIS item bank Ability to Participate in Social Roles and Activities (APSRA) with new items would result in more effective targeting (i.e., selecting items that are appropriate for each individual's trait level), and more reliable measurements across all latent trait levels. METHODS A sample of 1,022 Dutch adults completed all 35 items of the original item bank plus 17 new items (in Dutch). The new items presented in this publication have been translated provisionally from Dutch into English for presentation purposes. We evaluated the basic IRT assumptions unidimensionality, local independence, and monotonicity. Furthermore, we examined the item parameters, and assessed differential item functioning (DIF) for sex, education, region, age, and ethnicity. In addition, we compared the test information functions, item parameters, and θ scores, for the original and extended item bank in order to assess whether the measurement range had improved. RESULTS We found that the extended item bank was compatible with the basic IRT assumptions and showed good reliability. Moreover, the extended item bank improved the measurement in the lower trait range, which is important for reliably assessing functioning in clinical populations (i.e., persons reporting lower levels of participation). CONCLUSION We extended the PROMIS-APSRA item bank and improved its psychometric quality. Our study contributes to PROMIS measurement innovation, which allows for the addition of new items to existing item banks, without changing the interpretation of the scores and while maintaining the comparability of the scores with other PROMIS instruments.
Collapse
Affiliation(s)
- Guido L Williams
- LMcare, Zwolle, The Netherlands.
- Institute of Psychology, Leiden University, Leiden, The Netherlands.
| | - Gerard Flens
- Quality Alliance Mental Health, Akwa GGZ, Utrecht, The Netherlands
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC Location Vrije Universiteit, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, The Netherlands
| | - Edwin de Beurs
- Institute of Psychology, Leiden University, Leiden, The Netherlands
- Department of Research, Arkin GGZ, Amsterdam, The Netherlands
| | - Philip Spinhoven
- Institute of Psychology, Leiden University, Leiden, The Netherlands
- Department of Psychiatry, Leiden University Medical Center, Leiden, The Netherlands
| | - Muirne C S Paap
- Department of Child and Family Welfare, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, The Netherlands
- Department of Research and Innovation, Clinic Mental Health and Addiction, Oslo University Hospital, Oslo, Norway
| |
Collapse
|
2
|
Luijten MAJ, Haverman L, Terwee CB, Poeze M, Verbeek DO. Enhancing the Evaluation of Physical Function Following Orthopaedic Trauma Care: Comparison of PROMIS Computerized Adaptive Testing and Short Musculoskeletal Function Assessment. J Orthop Trauma 2024; 38:390-396. [PMID: 38837210 DOI: 10.1097/bot.0000000000002814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/01/2024] [Indexed: 06/07/2024]
Abstract
OBJECTIVES To compare measurement properties of Patient-Reported Outcomes Measurement Information System (PROMIS) (physical function [PF] and pain interference [PI]) computerized adaptive testing to traditional Short Musculoskeletal Function Assessment (SMFA) (dysfunction index [DI] and bother index [BI]). To explore factors associated with PROMIS scores. METHODS DESIGN Cross-sectional study. SETTING Level I Trauma Center. PATIENT SELECTION CRITERIA Isolated upper/lower extremity fracture patients were recruited from the orthopaedic trauma outpatient clinic (October 1, 2021 to January 1, 2023). OUTCOME MEASURES Correlations (Pearson), reliability (standard error [SE] [T score]), efficiency (amount of information per item [1 - SE2/Nitems]), and floor/ceiling effects were assessed. An r > 0.7 represented high correlation, and SE ≤ 2.2 represented sufficient reliability. Factors associated with worse PROMIS scores were also identified. RESULTS In total, 202 patients completed PROMs at median 98 days follow-up. Correlations between PROMIS-PF and SMFA-DI, and PROMIS-PI and SMFA-BI were -0.84 and 0.65. Reliability was very high for both instruments (mean SE 2.0 [PROMIS-PF], SE 2.1 [PROMIS-PI], and SE 1.2 [SMFA-DI], SE 1.8 [SMFA-BI]). Relative efficiency for PROMIS-PF versus SMFA-DI, and PROMIS-PI versus SMFA-BI was 7.8 (SD 2.5) and 4.1 (SD 1.7), respectively. Neither PROMIS nor SMFA exhibited floor/ceiling effects. In the multivariable regression analyses, elevated levels of depression, among other factors, showed an (independent) association with worse PROMIS-PF and PROMIS-PI scores. CONCLUSIONS PROMIS-PF and PROMIS-PI CATs showed a (high and moderate) correlation with SMFA and hence measure a comparable construct of physical function and discomfort. As computerized adaptive tests are much more efficient to administer, they present a compelling alternative to SMFA for evaluating impact of fracture treatment. The relation between symptoms of depression and PROMIS scores emphasizes the importance of psychosocial aspects of health in orthopaedic trauma patients. LEVEL OF EVIDENCE Prognostic Level III. See Instructions for Authors for a complete description of levels of evidence.
Collapse
Affiliation(s)
- Michiel A J Luijten
- Department of Epidemiology and Data Science, Amsterdam UMC Location Vrije Universiteit, Amsterdam, The Netherlands
- Department of Child and Adolescent Psychiatry and Psychosocial Care, Emma Children's Hospital, Amsterdam UMC Location AMC, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, The Netherlands
| | - Lotte Haverman
- Department of Child and Adolescent Psychiatry and Psychosocial Care, Emma Children's Hospital, Amsterdam UMC Location AMC, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Mental Health and Digital Health Amsterdam, The Netherlands; and
| | - Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC Location Vrije Universiteit, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Methodology, Amsterdam, The Netherlands
| | - Martijn Poeze
- Department of Surgery, Division of Trauma, Maastricht University Medical Center+, Maastricht, The Netherlands
| | - Diederik O Verbeek
- Department of Surgery, Division of Trauma, Maastricht University Medical Center+, Maastricht, The Netherlands
| |
Collapse
|
3
|
van Hoorn ES, Willems SP, Al Arashi W, de Moor AS, van Kwawegen CB, Teela L, Oude Voshaar MA, Kremer Hovinga IC, Schutgens RE, Schols SE, Leebeek FW, Haverman L, Cnossen MH, Gouw SC, Lingsma HF. Psychometrics of patient-reported outcomes measurement information system in von Willebrand disease, inherited platelet function disorders, and rare bleeding disorders. Res Pract Thromb Haemost 2024; 8:102474. [PMID: 39076727 PMCID: PMC11284954 DOI: 10.1016/j.rpth.2024.102474] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Revised: 06/05/2024] [Accepted: 06/07/2024] [Indexed: 07/31/2024] Open
Abstract
Background Patient-reported outcomes measurement information system (PROMIS) measures can be used to measure patient-reported outcomes. PROMIS measures, including computer adaptive tests (CATs) and short forms, have demonstrated the ability to adequately assess outcomes in patients with hemophilia. It is, however, unclear if PROMIS measures are suitable for patients with von Willebrand disease (VWD), inherited platelet function disorders (IPFDs), and rare bleeding disorders (RBDs). Objectives To evaluate the feasibility, measurement properties, and relevance of PROMIS measures in adults with VWD, IPFDs, and RBDs. Methods In this cross-sectional multicenter study, adults with VWD, IPFDs, and RBDs completed 9 PROMIS measures and the Short Form-36 version 2 (SF-36v2) electronically. Feasibility was determined by the number of completed items and floor/ceiling effects. Measurement properties included construct validity based on a multitrait-multimethod analysis and reliability using the reliability coefficient and greatest lower bound. Relevance was evaluated based on comparison with the Dutch general population. Results In total, 111 patients (median age, 57 years [IQR, 44-67]; 60% VWD, 16% IPFD, 24% RBD) participated. Mean number of items answered varied from 5.3 to 8.7 (range, 4-12) per PROMIS CAT in patients with VWD. Construct validity was supported for all CATs and all instruments had a good reliability (≥0.70). The PROMIS measures had less ceiling effects than the SF-36v2. Conclusion The PROMIS measures are a feasible, valid, and reliable alternative for the SF-36v2 in patients with primarily nonsevere forms of VWD. The relevance of the selected measures was limited. Additional research is necessary to evaluate the PROMIS measures in adults with IPFDs and RBDs.
Collapse
Affiliation(s)
- Evelien S. van Hoorn
- Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Sterre P.E. Willems
- Department of Hematology, Radboud university medical center Nijmegen, Hemophilia Treatment Center Nijmegen-Eindhoven-Maastricht, Nijmegen, The Netherlands
| | - Wala Al Arashi
- Department of Pediatric Hematology, Erasmus MC Sophia Children's Hospital, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Annick S. de Moor
- Center for Benign Hematology, Thrombosis and Hemostasis, Van Creveldkliniek University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Calvin B. van Kwawegen
- Department of Hematology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Lorynn Teela
- Child and Adolescent Psychiatry & Psychosocial Care, Emma Children’s Hospital, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
- Public Health, Mental Health and Digital Health, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
- Reproduction and Development, Child Development, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
| | - Martijn A.H. Oude Voshaar
- Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Idske C.L. Kremer Hovinga
- Center for Benign Hematology, Thrombosis and Hemostasis, Van Creveldkliniek University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Roger E.G. Schutgens
- Center for Benign Hematology, Thrombosis and Hemostasis, Van Creveldkliniek University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Saskia E.M. Schols
- Department of Hematology, Radboud university medical center Nijmegen, Hemophilia Treatment Center Nijmegen-Eindhoven-Maastricht, Nijmegen, The Netherlands
| | - Frank W.G. Leebeek
- Department of Hematology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Lotte Haverman
- Child and Adolescent Psychiatry & Psychosocial Care, Emma Children’s Hospital, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
- Public Health, Mental Health and Digital Health, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
- Reproduction and Development, Child Development, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
| | - Marjon H. Cnossen
- Department of Pediatric Hematology, Erasmus MC Sophia Children's Hospital, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Samantha C. Gouw
- Pediatric Hematology, Emma Children’s Hospital, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
| | - Hester F. Lingsma
- Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| |
Collapse
|
4
|
Almohaya HS, Bakhsh HR, Bin Sheeha B, Aldhahi MI, Alhasani R. Translation and Cultural Adaptation into Arabic of Patient-Reported Outcome Measurement Information System ® Item Banks: Cognitive Function Abilities and Physical Function for Samples with Mobility Aid Users. Healthcare (Basel) 2024; 12:211. [PMID: 38255098 PMCID: PMC10815503 DOI: 10.3390/healthcare12020211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2023] [Revised: 01/07/2024] [Accepted: 01/12/2024] [Indexed: 01/24/2024] Open
Abstract
PURPOSE This study aimed to provide Arabic-speaking individuals with tools to assess their cognitive abilities and physical function and to contribute to a better understanding of these capabilities in this population. Thus, the specific objective was to translate into Arabic and culturally adapt two Patient-Reported Outcome Measurement Information System (PROMIS) item banks: the Adult Cognitive Function Abilities and the Physical Function for Samples with Mobility Aid Users item banks. This study employed the Functional Assessment of Chronic Illness Therapy (FACIT) multilingual translation methodology to ensure cultural and linguistic relevance. The translation process included forward and back translations, expert reviews, and finalisation by a language coordinator. Cognitive debriefing interviews were conducted with 30 native healthy Arabic speakers to assess the clarity and comprehension of translated items. Most items were well understood, but two items related to cognitive ability and four related to physical functions required revision to address participant confusion. The translations were refined based on the participants' feedback and expert recommendations. This study followed a rigorous translation process and included cognitive debriefing interviews to ensure linguistic and cultural equivalence. The availability of these tools in Arabic enhances cross-cultural research and practice in healthcare and contributes to a global understanding of cognitive and physical functions.
Collapse
Affiliation(s)
| | | | | | | | - Rehab Alhasani
- Department of Rehabilitation Sciences, College of Health and Rehabilitation Sciences, Princess Nourah bint Abdulrahman University (PNU), P.O. Box 84428, Riyadh 11671, Saudi Arabia (H.R.B.); (B.B.S.); (M.I.A.)
| |
Collapse
|
5
|
Hermans ME, van Oers HA, Geurtsen GJ, Haverman L, Hollak CEM, Rubio-Gozalbo ME, Bosch AM. The challenges of classical galactosemia: HRQoL in pediatric and adult patients. Orphanet J Rare Dis 2023; 18:135. [PMID: 37268983 DOI: 10.1186/s13023-023-02749-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 05/18/2023] [Indexed: 06/04/2023] Open
Abstract
BACKGROUND Classical galactosemia (CG), an inborn error of galactose metabolism, results in long-term complications including cognitive impairment and movement disorders, despite early diagnosis and dietary treatment. Two decades ago, lower motor-, cognitive- and social health related quality of life (HRQoL) was demonstrated in pediatric and adult patients. Since then, the diet has been relaxed, newborn screening was implemented and new international guidelines resulted in major changes in follow-up. The aim of this study was to assess HRQoL of CG by means of online self- and/or proxy-HRQoL-questionnaires focusing on the main areas of concern of CG (i.e. anxiety, depression, cognition, fatigue, social- and upper extremity function) within the patient-reported outcomes measurement information system (PROMIS®) and generic HRQoL-questionnaires (TAPQOL, TACQOL, TAAQOL). RESULTS Data of 61 Dutch patients (aged 1-52 years) were collected and compared to available Dutch or US reference populations. On the PROMIS-questionnaires, children reported more fatigue (P = 0.044), lower function in upper extremities (P = 0.021), more cognitive difficulties (P = 0.055, d = 0.56) and higher anxiety (P = 0.063, d = 0.52) than reference children although the latter findings remained non-significant. Parents of CG patients reported lower quality of peer relationships of their children (P < 0.001). Both children and parents reported lower cognitive functioning (P = 0.005, P = 0.010) on the TACQOL. Adults reported on PROMIS domains lower cognitive functioning (P = 0.030), higher anxiety (P = 0.004) and more fatigue (P = 0.026). Cognitive difficulties were reported on the TAAQOL by adults (P < 0.001), as well as physical-, sleeping and social difficulties. CONCLUSIONS CG remains to impact the HRQoL of pediatric and adult patients negatively on several domains including cognition, anxiety, motor function and fatigue. A lower social health was mainly reported by parents, and not by patients themselves. The Covid-19 pandemic might have amplified the results on anxiety although higher levels of anxiety fit pre-pandemic findings. The reported fatigue is a new finding in CG. Because the effect of lockdown fatigue could not be eliminated and fatigue is a frequent finding in patients with chronic disorders, future studies are warranted. Clinicians and researchers should be attentive to both pediatric and adult patients, and the age-dependent difficulties they might encounter.
Collapse
Affiliation(s)
- Merel E Hermans
- Emma Children's Hospital, Department of Pediatrics, Division of Metabolic Diseases, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
- Inborn Errors of Metabolism, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam, The Netherlands
| | - Hedy A van Oers
- Emma Children's Hospital, Child and Adolescent Psychiatry and Psychosocial Care, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
- Child Development, Amsterdam Reproduction and Development, Amsterdam, The Netherlands
- Mental Health and Quality of Care, Amsterdam Public Health, Amsterdam, The Netherlands
| | - Gert J Geurtsen
- Department of Medical Psychology, Amsterdam Neuroscience Degeneration, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
| | - Lotte Haverman
- Emma Children's Hospital, Child and Adolescent Psychiatry and Psychosocial Care, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
- Child Development, Amsterdam Reproduction and Development, Amsterdam, The Netherlands
- Amsterdam Public Health, Mental Health and Digital Health, Amsterdam, The Netherlands
| | - Carla E M Hollak
- Division of Endocrinology and Metabolism, Department of Internal Medicine, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, the Netherlands
| | - M Estela Rubio-Gozalbo
- Department of Pediatrics and Laboratory Genetic Metabolic Diseases, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Annet M Bosch
- Emma Children's Hospital, Department of Pediatrics, Division of Metabolic Diseases, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands.
- Inborn Errors of Metabolism, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam, The Netherlands.
| |
Collapse
|
6
|
Terwee CB, van der Willik EM, van Breda F, van Jaarsveld BC, van de Putte M, Jetten IW, Dekker FW, Meuleman Y, van Ittersum FJ. Responsiveness and minimal important change of seven PROMIS computerized adaptive tests (CAT) in patients with advanced chronic kidney disease. J Patient Rep Outcomes 2023; 7:35. [PMID: 37016107 PMCID: PMC10073363 DOI: 10.1186/s41687-023-00574-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Accepted: 03/11/2023] [Indexed: 04/06/2023] Open
Abstract
BACKGROUND The Patient-Reported Outcomes Measurement Information System (PROMIS®) has the potential to harmonize the measurement of health-related quality of life (HRQL) across medical conditions. We evaluated responsiveness and minimal important change (MIC) of seven Dutch-Flemish PROMIS computerized adaptive tests (CAT) in Dutch patients with advanced chronic kidney disease (CKD). METHODS CKD patients (eGFR < 30 ml/min.1.73m2) completed at baseline and after 6 months seven PROMIS CATs (assessing physical function, pain interference, fatigue, sleep disturbance, anxiety, depression, and ability to participate in social roles and activities), Short Form Health Survey 12 (SF-12), PROMIS Pain Intensity single item, Dialysis Symptom Index (DSI), and Global Rating Scales (GRS) of change. Responsiveness was assessed by testing predefined hypotheses about expected correlations among measures, area under the ROC Curve, and effect sizes. MIC was determined with predictive modelling. RESULTS 207 patients were included; 186 (90%) completed the follow-up. Most results were in accordance with expectations (70-91% of hypotheses confirmed), with some exceptions for PROMIS Anxiety and Ability to Participate (60% and 42% of hypotheses confirmed, respectively). For PROMIS Anxiety and Depression correlations with the GRS were too low (0.04 and 0.20, respectively) to calculate a MIC. MIC values, representing minimal important deterioration, ranged from 0.4 to 2.5 T-score points for the other domains. CONCLUSION We found sufficient responsiveness of PROMIS CATs Physical Function, Fatigue, Sleep Disturbance, and Depression. The results for PROMIS CATs Pain Interference were almost sufficient, but some results for Anxiety and Ability to Participate in Social Roles and Activities were not as expected. Reported MIC values should be interpreted with caution because most patients did not change.
Collapse
Affiliation(s)
- Caroline B Terwee
- Department of Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit, P.O. box 7057, Amsterdam, 1007 MB, the Netherlands.
- Amsterdam Public Health research institute, Methodology, Amsterdam, The Netherlands.
| | - Esmee M van der Willik
- Department of Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit, P.O. box 7057, Amsterdam, 1007 MB, the Netherlands
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Fenna van Breda
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Brigit C van Jaarsveld
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Marlon van de Putte
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Isabelle W Jetten
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Friedo W Dekker
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Yvette Meuleman
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Frans J van Ittersum
- Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| |
Collapse
|