Content validation of the SF-36v2® health survey with AL amyloidosis patients

Development and initial validation of the AL-PROfile patient-reported outcome measure in light chain (AL) amyloidosis

OBJECTIVE

To evaluate the psychometric properties of the AL-PROfile, a patient-reported outcome measure combining the Patient-Reported Outcomes Measurement Information System (PROMIS)-29, two items from PROMIS Cognitive Function, and select Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) items.

METHODS

Content validity was assessed through cognitive debriefing interviews of 20 patients who completed the AL-PROfile (Study 1). Study 2 involved 297 participants who completed the AL-PROfile and Medical Outcomes Study 36-item Short-Form Health Survey (SF-36). Reliability (internal consistency and test-retest reliability) and validity (convergent and discriminant validity, known groups validity by stage/organ involvement) were calculated.

RESULTS

Study 1 participants found the AL-PROfile straightforward confirming the relevance of the included content. Some felt that certain questions were not related to their amyloidosis experience. Study 2 demonstrated acceptable internal consistency for all domains/items except PROMIS Cognitive Function and acceptable test-retest reliability for all except PROMIS Cognitive Function and PRO-CTCAE nausea. Large correlations were seen for the same domain across measures while correlations for divergent domains within a measure and different domains across different measures were small. The PRO-CTCAE items showed small to medium correlations with each other and with PROMIS and SF-36 domains. Stage was associated with physical function, fatigue, social roles, swelling, and shortness of breath scores.

CONCLUSION

The AL-PROfile has acceptable reliability and validity for use in systemic light chain amyloidosis patients.

Outcomes in Facial Feminization Surgery: A Systematic Review

Objective: Review literature on facial feminization surgery (FFS) for the transgender population and identify whether heterogeneity in reported outcomes and outcome measures exists across studies, as measured by a lack of consensus, and number of outcomes and outcome measures used. Evidence Review: A search of MEDLINE and EMBASE (database inception to January 20, 2021) was performed to retrieve FFS studies. Primary outcomes included number of reported outcomes and outcome measures; secondary outcomes included clinimetric properties of outcome measures and study characteristics. Findings: In total, 15 articles were included. Sixty-nine outcomes and 12 outcome measures were identified. Of those outcome measures, zero were found to be valid, reliable, and responsive in patients who had undergone FFS. A variety of FFS interventions were studied, with the three most common interventions being: rhinoplasty (n = 7, 46.7%), mandibuloplasty (n = 7, 46.7%), and chondrolaryngoplasty (n = 6, 40%). Conclusion and Relevance: Heterogeneity was evident in reported outcomes and outcome measures in FFS literature and there is currently no outcome measure commonly used for this patient population.

Association Between Hematologic Response and Change in Health-Related Quality of Life Among Patients with Light-Chain (AL) Amyloidosis

Purpose

The purpose of this secondary data analysis was to examine the association between hematologic response and health-related quality of life (HRQoL) among patients with light-chain (AL) amyloidosis.

Patients and Methods

Data for this secondary analysis were collected through a non-interventional, longitudinal, online self-report survey of patients with AL amyloidosis. Patients completed an initial online survey, with follow-up surveys administered 1, 6, 12, 18, and 24 months after completion of the initial survey. The online survey included an assessment of patients' most recent self-reported hematologic response status. Eight domains and 2 summary components of HRQoL were evaluated with the SF-36v2® Health Survey. A series of logistic regression models were used to examine the association between self-reported hematologic response at 24 months (dichotomized as new or maintained complete hematologic response; less than a complete response) and change in HRQoL from baseline to 24 months (dichotomized as meaningful worsening; improvement or preservation).

Results

For all measured domains of HRQoL except physical functioning, there was no statistically significant relationship between meaningful worsening in HRQoL and hematologic response status at 24 months. Patients without a complete hematologic response had an odds of experiencing meaningful worsening of HRQoL that was similar to that of patients with a complete hematologic response.

Conclusion

Among patients with AL amyloidosis, change in HRQoL was generally not associated with hematologic response. Achieving a complete hematologic response does not necessarily mean that a patient will experience increased or stable HRQoL. When defining treatment success, it is important to recognize that clinical markers such as hematologic response may not fully encapsulate the patient experience.

Health-Related Quality of Life Instruments for Clinical Trials in AL Amyloidosis: Report from the Amyloidosis Forum HRQOL Working Group

Systemic AL (light chain) amyloidosis is a rare protein misfolding disorder associated with plasma cell dyscrasia affecting various organs leading to organ dysfunction and failure. The Amyloidosis Forum is a public-private partnership between the Amyloidosis Research Consortium and the US Food and Drug Administration Center for Drug Evaluation and Research with the goal of accelerating the development of effective treatments for AL amyloidosis. In recognition of this goal, 6 individual working groups were formed to identify and/or provide recommendations related to various aspects of patient-relevant clinical trial endpoints. This review summarizes the methods, findings, and recommendations of the Health-Related Quality of Life (HRQOL) Working Group. The HRQOL Working Group sought to identify existing patient-reported outcome (PRO) assessments of HRQOL for use in clinical trials and practice deemed relevant across a broad spectrum of patients with AL amyloidosis. A systematic review of the AL amyloidosis literature identified 1) additional signs/symptoms not currently part of an existing conceptual model, and 2) relevant PRO instruments used to measure HRQOL. The Working Group mapped content from each identified instrument to areas of impact in the conceptual model to determine which instrument(s) provide coverage of relevant concepts. The SF-36v2^® Health Survey (SF-36v2; QualityMetric Incorporated, LLC) and Patient-Reported Outcomes Measurement Information System-29 Profile (PROMIS-29; HealthMeasures) were identified as instruments relevant to patients with AL amyloidosis. Existing evidence of reliability and validity was evaluated with a recommendation for future work focused on estimating clinically meaningful within-patient change thresholds for these instruments. For sponsors, the context of use-including specific research objectives, trial population, and investigational product under study-should inherently drive selection of the appropriate PRO instrument and endpoint definitions to detect meaningful change and enable patient-focused drug development.

Systematic Review of the Effect of a One-Day Versus Seven-Day Recall Duration on Patient Reported Outcome Measures (PROMs)

BACKGROUND

There is ongoing uncertainty around the most suitable recall period for patient-reported outcome measures (PROMs).

METHOD

This systematic review integrates quantitative and qualitative literature across health, economics, and psychology to explore the effect of a one-day (or '24-h') versus seven-day (or 'one week') recall period. The following databases were searched from database inception to 30 November 2021: MEDLINE, EMBASE, PsycINFO, Web of Science, EconLit, CINAHL Complete, Cochrane Library, and Sociological Abstracts. Studies were included that compared a one-day (or '24-h') versus seven-day (or weekly) recall period condition on patient-reported scores for PROM and Health-Related Quality-of-Life (HRQoL) instrument scores in adult populations (aged 18 and above) or combined paediatric and adult populations with a majority of respondents aged over 18 years. Studies were excluded if they assessed health behaviours only, used ecological momentary assessment to derive an index of daily recall, or incorporated clinician reports of patient symptoms. We extracted results relevant to six domains with generic health relevance: physical functioning, pain, cognition, psychosocial wellbeing, sleep-related symptoms and aggregated disease-specific signs and symptoms. Quantitative studies compared weekly recall scores with the mean or maximum score over the last seven days or with the same-day recall score.

RESULTS

Overall, across the 24 quantitative studies identified, 158 unique results were identified. Symptoms tended to be reported as more severe and HRQoL lower when assessed with a weekly recall than a one-day recall. A narrative synthesis of 33 qualitative studies integrated patient perspectives on the suitability of a one-day versus seven-day recall period for assessing health state or quality of life. Participants had mixed preferences, some noted the accuracy of recall for the one-day period but others preferred the seven-day recall for conditions characterised by high symptom variability, or where PROMs concepts required integration of infrequent experiences or functioning over time.

CONCLUSION

This review identified a clear trend toward higher symptom scores and worse quality of life being reported for a seven-day compared to a one-day recall. The review also identified anomalies in this pattern for some wellbeing items and a need for further research on positively framed items. A better understanding of the impact of using different recall periods within PROMs and HRQoL instruments will help contextualise future comparisons between instruments. Questionnaires ask patients about their health over different time periods (e.g., "what were your symptoms like over the last week?" versus "what were your symptoms like today?"). Studies find that people may report their symptoms as more severe when they are asked to think about their symptoms over the last week compared to the last day. Understanding how different time periods influence patient responses will allow researchers to compare and develop new questionnaires and may help clinicians to choose the best questionnaire to understand their patient's condition. We conducted a systematic literature review on studies which had looked at the impact of using different recall periods on patient responses. We found 24 studies that compared patient scores from questionnaires asking their health "over the last day" compared to "over the last week". Overall, symptoms tended to be reported as more severe and health as poorer when they were reported over the last week compared to the last day on average. We also found 33 studies that asked patients to describe which recall period they preferred. Patients had mixed preferences with more preferring a seven-day recall where symptoms and health impacts varied a lot.

Content validation of the SF-36v2® Health Survey Acute for use in hypoparathyroidism

PURPOSE

The purpose of this study was to conduct cognitive debriefing (CD) interviews with adults diagnosed with chronic hypoparathyroidism (HP) to assess the content validity of the SF-36v2® Health Survey Acute (SF-36v2) measure in this population.

METHODS

CD interviews were conducted with adults with HP in the United States (US). Interviews were conducted by a trained moderator using a semi-structured interview guide, employing a think-aloud method in conjunction with verbal probing. Participants were asked whether each item was understandable, relevant, important, and sensitive to change in relation to HP. Additionally, comprehension of instructions, response options, and the appropriateness of a 1-week recall period was assessed.

RESULTS

Sixteen adults with HP participated in individual CD telephone interviews. All items in the SF-36v2 were reported to be understood, relevant, important, and sensitive to change by at least half, and in most cases, by a strong majority of study participants. Most of the study sample confirmed comprehension of the instructions and the entire sample understood all response options.

CONCLUSION

The study findings show that the items in the SF-36v2® are applicable to adults with HP. The overall high levels of endorsement of items provide strong evidence of the measure's content validity for this population. The SF-36v2 is therefore recommended for usage in clinical trials examining adults with HP, although it is recommended that this generic measure be supplemented with disease-specific instruments such as the recently developed Hypoparathyroidism Patient Experience Scale-Symptom (HPES-Symptom) and Hypoparathyroidism Patient Experience Scale-Impact (HPES-Impact) measures.

Health-related quality of life in patients with light chain amyloidosis treated with bortezomib, cyclophosphamide, and dexamethasone ± daratumumab: Results from the ANDROMEDA study

In the phase 3 ANDROMEDA trial, patients treated with daratumumab, bortezomib, cyclophosphamide, and dexamethasone (D-VCd) had significantly higher rates of organ and hematologic response compared with patients who received VCd alone. Here, we present patient-reported outcomes (PROs) from the ANDROMEDA trial. PROs were assessed through cycle 6 using three standardized questionnaires. Treatment effect through cycle 6 was measured by a repeated-measures, mixed-effects model. The magnitude of changes in PROs versus baseline was generally low, but between-group differences favored the D-VCd group. Results were generally consistent irrespective of hematologic, cardiac, or renal responses. More patients in the D-VCd group experienced meaningful improvements in PROs; median time to improvement was more rapid in the D-VCd group versus the VCd group. After cycle 6, patients in the D-VCd group received daratumumab monotherapy and their PRO assessments continued, with improvements in health-related quality of life (HRQoL) reported through cycle 19. PROs of subgroups with renal and cardiac involvement were consistent with those of the intent-to-treat population. These results demonstrate that the previously reported clinical benefits of D-VCd were achieved without decrement to patients' HRQoL and provide support of D-VCd in patients with AL amyloidosis.

Work Outcomes Among Patients with Light Chain (AL) Amyloidosis: Findings from Three Patient Cohorts

Background

Light chain (AL) amyloidosis is a rare and progressive disease that affects myriad organs and systems. Patients with cardiac involvement have the highest risk of death. This report compiles findings across three cohorts of patients with AL amyloidosis to understand patterns of employment and work impacts.

Methods

Data came from three cohorts recruited through patient advocacy organizations in the US. Patients in Cohort 1 completed the SF-36v2^® Health Survey (SF-36v2), the Work Productivity and Activity Impairments – Specific Health Problem (WPAI) questionnaire, and the 12-item Kansas City Cardiomyopathy Questionnaire (KCCQ-12). The relationship between work impacts (WPAI scores) and HRQoL (SF-36v2 scores) was investigated using multivariable logistic regression and summarized according to cardiac severity using New York Heart Association (NYHA) classes estimated from KCCQ-12 scores. Changes in employment, days of missed work, and long-term disability due to AL amyloidosis were summarized for patients diagnosed in the past 24 months and stratified by NYHA class (Cohort 2). Findings were contextualized using patient interviews (Cohort 3).

Results

Work-related impacts, especially reduced productivity, were common among patients with AL amyloidosis. WPAI scores were significantly related to HRQoL (p<0.05 for all models). Among patients with cardiac involvement, the greatest degree of work impacts was observed for those in NYHA class 3 or 4. Changes in employment, missed work, and long-term disability were common among newly diagnosed patients, especially among those in NYHA class 3 or 4. Patient interviews supported the survey findings; patients described absences, reduced productivity at work, and loss of employment due to the disease and its treatment.

Conclusion

Patients with AL amyloidosis, particularly those with more advanced disease, experience impacts across a range of employment-related outcomes. These findings highlight the need for more effective treatments and interventions which may improve functioning and patient outcomes, while reducing indirect costs associated with the disease.

The use of PROMIS patient-reported outcomes (PROs) to inform light chain (AL) amyloid disease severity at diagnosis

We sought to evaluate how PROMIS patient-reported outcome (PRO) measures correlated with disease characteristics in systemic light chain (AL) amyloidosis patients at diagnosis. Newly diagnosed AL patients were recruited at two centres (N = 61). Patients completed the PROMIS Global Health v1.2, PROMIS-29 Profile v2.0 and Fatigue 8a v1.0. We assigned disease severity based on stage, presence of cardiac AL, and number of organs involved. We evaluated a) known groups validity by comparing PROMIS T-scores by disease severity, b) internal consistency using Cronbach's alpha and c) convergent/discriminant validity based on correlations across the domains and summary scores. Using receiver operating characteristic (ROC) curve analysis, NT-proBNP cut-off level corresponding to normal/mild vs moderate/severe PRO scores was determined. The median age was 68 (48-83) years with 58% males. Sixty-six percent had cardiac involvement and 25% had 3 or more organs involved with AL amyloidosis; 14% had stage 1, 28% stage 2, 36% stage 3 and 16% stage 4 disease. PROMIS measures had acceptable to excellent internal consistency and expected patterns of correlations. PROMIS Global Physical Health score was worse than the Global Mental Health Score at diagnosis; Physical function, fatigue and anxiety were the most impaired domains. PROMIS Global Health summary scores discriminated across AL amyloidosis stage and number of organs involved. Physical Function showed the strongest effects across known groups by stage, cardiac involvement and number of organs involved followed by Ability to Participate in Social Roles and Activities. A diagnostic NT-proBNP cut-off of 4200 pg/ml identified patients with moderate/severe PRO scores for these domains. Our results provide evidence for reliability and validity of select PROMIS short form measures in AL amyloidosis at diagnosis.

Patient-reported outcomes in systemic AL amyloidosis with functional assessment of cancer therapy-general (FACT-G) and patient-reported outcomes measurement information system-global health (PROMIS-GH) in a real-world population

We performed an observational study on health-related quality of life (HRQoL) in patients with AL amyloidosis diagnosed between 2012 and 2017 at our institution. A total of 81 patients were included, with a median age of 64 years. The mean FACT-G (Functional Assessment of Cancer Therapy-General) total score at baseline (≤2 months from diagnosis) was 74 (±15), compared to a normative score of 80 (±18) in the general U.S. population. Significant HRQoL deficit was noted only in the functional well-being (FWB) domain of FACT-G. Using PROMIS-GH (Patient-Reported Outcomes Measurement Information System-Global Health) at baseline (n = 18), a greater deficit was noted in the global physical health (GPH) compared to global mental health (GMH) domain. FACT-FWB and PROMIS-GPH domain scores were able to significantly discriminate between revised Mayo stages. Development and validation of an amyloid-specific PRO instrument incorporating specific domains of interest is urgently needed to pursue patient-centered drug development.

Content validation of the SF-36v2® health survey with AL amyloidosis patients

Background

This study examined the content validity of the SF-36v2® Health Survey (SF-36v2) in patients with AL amyloidosis using qualitative interviews with physicians and patients. The study included three distinct phases of qualitative research: concept elicitation interviews among physicians, concept elicitation interviews among patients, and cognitive debriefing interviews among patients. The concept elicitation interviews focused on areas of health-related quality of life that are affected by AL amyloidosis and may be affected by treatment, while patient cognitive debriefings aimed to confirm whether the SF-36v2 instructions, recall period, items, and response choices were comprehensive and understandable to AL amyloidosis patients.

Results

Physicians discussed the importance of measuring physical functioning, general health, mental/emotional health, sleep, fatigue, and work impact; though they also reported that they do not routinely use a standard Patient-Reported Outcome (PRO) measure of health-related quality of life. Patients described social, physical, role, and emotional impacts of AL amyloidosis and various treatments. Cognitive debriefing interviews confirmed the relevance of the concepts measured by the SF-36v2 and indicated that patients found the SF-36v2 both easy to understand and complete, that the SF-36v2 instructions and items were comprehensive and understandable without change, and the response choices and recall period were appropriate for use with patients with AL amyloidosis.

Conclusions

The findings support the content validity of the SF-36v2 as an appropriate measure of health-related quality of life in patients with AL amyloidosis.

Psychometric validation of the SF-36 Health Survey in light chain amyloidosis: results from community-based and clinic-based samples

Background

Light chain (AL) amyloidosis, a rare and life-threatening protein misfolding disorder, causes organ damage and severely impacts health-related quality of life (HRQoL). No patient-reported outcome (PRO) HRQoL measure has been validated for use in an AL amyloidosis patient population, leaving a gap for researchers conducting observational studies and clinical trials for drug development. The SF-36 Health Survey (SF-36) has been the most frequently used PRO in AL amyloidosis studies to date, and early qualitative validation studies support its use in this population. The aim of this study was to assess the psychometric properties of the SF-36 among patients with AL amyloidosis.

Methods

Data from community-based (n=341) and clinic-based (n=1,438) observational studies were used to document the psychometric properties of the SF-36 in this disease population. Reliability was estimated using internal consistency (Cronbach’s alpha) and test–retest reliability (intraclass correlation). Convergent validity, known-groups validity, and the ability to detect change were assessed with available criterion variables.

Results

Scale reliability (Cronbach’s alpha ≥0.780 for all scores) and test–retest reliability (intraclass correlation coefficients ≥0.731 for all) were acceptable. Scale convergent validity was supported by strong correlations with conceptually related measures. Mean SF-36 scores varied by response to treatment (P<0.05 for all scores) and a self-reported measure of disease severity (P<0.001 for all scores). Data indicate that the SF-36 is sensitive to changes in other measures over time.

Conclusion

This study provided clear and consistent evidence of the psychometric properties of the SF-36 in both community-based and clinic-based samples of patients with AL amyloidosis.