1
|
Shih VH, Slagle AF, Ivanescu C, Flore G, Meyers O, Kreindler J, Martin UJ, Werkström V. Psychometric Validation and Meaningful Change Thresholds of the New Nasal Polyposis Symptom Diary. Ann Otol Rhinol Laryngol 2023; 132:1638-1648. [PMID: 37271980 PMCID: PMC10571433 DOI: 10.1177/00034894231177769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
OBJECTIVES The Nasal Polyposis Symptom Diary (NPSD) is a novel and short patient-reported outcome (PRO) tool specifically developed to assess important and relevant symptoms reported by patients with chronic rhinosinusitis with nasal polyposis (CRSwNP). We evaluated the psychometric properties of 4 predefined NPSD-derived scores intended to support symptom-improvement assessments of investigational therapies for inclusion in product labeling. METHODS Five hundred eighteen patients with severe CRSwNP from a Phase III clinical trial (NCT03401229) completed the NPSD, comprising 11 items: 8 symptom-specific, 2 symptom-impact, and 1 optional medication-compliance. The psychometric characteristics of 3 single-item symptom scores (Nasal Blockage Score [NBS], Nasal Congestion Score [NCS], and Difficulty with Sense of Smell Score [DSS]) and a Total Symptom Score (TSS, summary of the 8 symptom-specific items) were evaluated for reliability, validity, and ability to detect change. Within-patient meaningful change thresholds (MCTs) were established using anchor- and distribution-based methods. Comparative PROs included the 22-item Sino-Nasal Outcome Test (SNOT-22) and Patient Global Impression of Severity (PGI-S). RESULTS The TSS exhibited strong internal consistency (Cronbach α = .88) and test-retest reliability (intraclass correlation coefficient >.80). Correlation between the TSS and SNOT-22 total score indicated good convergent validity (r = .70). All 4 NPSD scores demonstrated known-groups validity (significant differences among subgroups of patients with predetermined disease severity levels based on PGI-S categories) and were sensitive to detect change in patients' clinical status (significant differences among subgroups of patients with reported changes between 2 time-points in PGI-S and Patient Global Impression of Change scores). MCTs for improvement were established at 1.0 point for NBS, NCS, and DSS, and 4.0 points for TSS. CONCLUSION These findings support the reliability, validity, and suitability of the 4 NPSD-derived scores for evaluating treatment effect on CRSwNP symptoms and their use in clinical trials with predetermined MCTs for improvement.
Collapse
Affiliation(s)
| | | | - Cristina Ivanescu
- IQVIA Real World Solutions, Patient Centered Solutions, New York, NY, USA
| | - Giulio Flore
- IQVIA Real World Solutions, Patient Centered Solutions, New York, NY, USA
| | - Oren Meyers
- IQVIA Real World Solutions, Patient Centered Solutions, New York, NY, USA
| | | | | | | |
Collapse
|
2
|
Dimachkie MM, Kishnani PS, Ivanescu C, Flore G, Gwaltney C, van der Beek NAME, Hamed A, An Haack K, Pollissard L, Baranowski E, Sparks SE, DasMahapatra P. Measurement Properties of 2 Novel PROs, the Pompe Disease Symptom Scale and Pompe Disease Impact Scale, in the COMET Study. Neurol Clin Pract 2023; 13:e200181. [PMID: 37559825 PMCID: PMC10409572 DOI: 10.1212/cpj.0000000000200181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Accepted: 06/09/2023] [Indexed: 08/11/2023]
Abstract
BACKGROUND AND OBJECTIVES The Pompe Disease Symptom Scale (PDSS) and Impact Scale (PDIS) were created to measure the severity of symptoms and functional limitations experienced by patients with late-onset Pompe disease (LOPD). The objectives of this analysis were to establish a scoring algorithm and to examine the reliability, validity, and responsiveness of the measures using data from the COMET clinical trial. METHODS The COMET trial was a randomized, double-blind study comparing the efficacy and safety of avalglucosidase alfa and alglucosidase alfa in patients with LOPD aged 16-78 years at baseline. Adult participants (18 years or older) completed the PDSS and PDIS daily for 14 days at baseline and for 2 weeks before quarterly clinic visits for 1 year after randomization using an electronic diary. Data were pooled across treatment groups for the current analyses. Factor analysis and inter-item correlations were used to derive a scoring algorithm. Test-retest and internal consistency analyses examined the reliability of the measures. Correlations with criterion measures were used to evaluate validity and sensitivity to change. Anchor and distribution-based analyses were conducted to estimate thresholds for meaningful change. RESULTS Five multi-item domain scores were derived from the PDSS (Shortness of Breath, Overall Fatigue, Fatigue/Pain, Upper Extremity Weakness, Pain) and 2 from the PDIS (Mood, Difficulty Performing Activities). Internal consistency (Cronbach α > 0.90) and test-retest reliability (intraclass correlation >0.60) of the scores were supported. Cross-sectional and longitudinal correlations with the criterion measures generally supported the validity of the scores (r > 0.40). Within-patient meaningful change estimates ranging from 1.0 to 1.5 points were generated for the PDSS and PDIS domain scores. DISCUSSION The PDSS and PDIS are reliable and valid measures of LOPD symptoms and functional impacts. The measures can be used to evaluate burden of LOPD and effects of treatments in clinical trials, observational research, and clinical practice. TRIAL REGISTRATION INFORMATION ClinicalTrials.gov identifier: NCT02782741.
Collapse
Affiliation(s)
- Mazen M Dimachkie
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Priya S Kishnani
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Cristina Ivanescu
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Giulio Flore
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Chad Gwaltney
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Nadine A M E van der Beek
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Alaa Hamed
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Kristina An Haack
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Laurence Pollissard
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Eileen Baranowski
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Susan E Sparks
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| | - Pronabesh DasMahapatra
- University of Kansas Medical Center (MMD), Kansas City, KS; Duke University Medical Center (PSK), Durham, NC; IQVIA Netherland (CI, GF), Amsterdam-Zuidoost, North Holland Province, The Netherlands; Gwaltney Consulting (CG), Westerly, RI; Center for Lysosomal and Metabolic Diseases (NAMEB), Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Sanofi (AH, EB, SES, PD), Cambridge, MA; and Sanofi (KAH, LP), Chilly-Mazarin, France
| |
Collapse
|
3
|
Rofail D, Griffiths P, Flore G, Hussein M, Sivapalasingam S, Podolanczuk AJ, Rodriguez AM, Mastey V, Gwaltney C. Reliability and Validity of an Instrument of COVID-19 Patient-Reported Symptoms in Outpatients. JAMA Netw Open 2022; 5:e2239053. [PMID: 36306132 PMCID: PMC9617168 DOI: 10.1001/jamanetworkopen.2022.39053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
IMPORTANCE Patient-reported outcome instruments are key in assessing COVID-19-related symptoms and associated burden. However, a valid and reliable instrument to assess symptom severity and progression among outpatients with COVID-19 is not yet available. OBJECTIVES To assess the extent to which the Symptoms Evolution of COVID-19 (SE-C19) instrument is valid, reliable, and able to detect symptom changes in outpatients with COVID-19, as well as to establish a definition of symptom resolution. DESIGN, SETTING, AND PARTICIPANTS In this diagnostic/prognostic study, psychometric properties of SE-C19 were assessed in participants recruited into an ongoing, adaptive, phase 1/2/3, randomized, double-blind, placebo-controlled clinical trial, during 2020 to 2022. Adult outpatients with symptomatic COVID-19 were randomized 1:1:1 to receive 2.4 g or 8.0 g intravenous casirivimab and imdevimab or placebo, in outpatient centers at 114 sites, from 2 countries (US and Mexico). MAIN OUTCOMES AND MEASURES Reliability, validity, and sensitivity to change of the SE-C19 were assessed. SE-C19 and Patient Global Impression of Severity (PGIS) were administered daily from predose at day 1 to day 29. RESULTS Analysis was conducted on 657 adult outpatients (342 female patients [52.1%], 562 White patients [85.5%]), and 337 non-Hispanic patients [51.3%]. At baseline, patients reported a mean (SD) of 6.6 (3.9) symptoms (ie, rated as at least mild) with a mean (SD) of 3.8 (3.3) of these symptoms being rated as moderate or severe. Stable patients according to PGIS showed scores with intraclass correlation values indicating moderate-to-good test-retest reliability (ie, 0.50-0.90). At baseline, 20 item scores (87%) varied significantly across PGIS-defined groups, supporting the validity of the SE-C19. A symptom-resolution end point was defined after excluding the item sneezing due to its low ability to discriminate severity levels, and excluding confusion, rash, and vomiting, due to their low prevalence in this population. Symptom resolution required complete absence of all remaining items, except cough, fatigue, and headache, which could be mild or moderate in severity. A total of 19 of 23 items from the SE-C19 instrument were identified as valid and reliable to measure disease-related symptoms in outpatients with COVID-19. CONCLUSIONS AND RELEVANCE This study identified 19 items that are valid and reliable to measure disease-related symptoms in outpatients with COVID-19, and proposed a definition of symptom resolution for potential use in future clinical trials.
Collapse
Affiliation(s)
- Diana Rofail
- Regeneron Pharmaceuticals, Inc, Sleepy Hollow, New York
| | | | | | | | | | - Anna J. Podolanczuk
- Pulmonary Critical Care Medicine, Weill Cornell Medical College, New York, New York
| | | | - Vera Mastey
- Regeneron Pharmaceuticals, Inc, Sleepy Hollow, New York
| | | |
Collapse
|