Poor agreement between clinician response ratings and calculated response measures in patients with chronic graft-versus-host disease

Patient-reported treatment response in chronic graft-versus-host disease

Chronic graft-versus-host disease (GvHD) treatment response is assessed using National Institutes of Health (NIH) Consensus Criteria in clinical trials, and by clinician assessment in routine practice. Patient-reported treatment response is central to the experience of chronic GvHD manifestations as well as treatment benefit and toxicity, but how they correlate with clinician- or NIH-responses has not been well-studied. We aimed to characterize 6-month patientreported response, determine associated chronic GvHD baseline organ features and changes, and evaluate which patientreported quality of life and chronic GvHD symptom burden measures correlated with patient-reported response. From two nationally representative Chronic GVHD Consortium prospective observational studies, 382 subjects were included in this analysis. Patient and clinician responses were categorized as improved (completely gone, very much better, moderately better, a little better) versus not improved (about the same, a little worse, moderately worse, very much worse). At six months, 270 (71%) patients perceived chronic GvHD improvement, while 112 (29%) perceived no improvement. Patient-reported response had limited correlation with either clinician-reported (kappa 0.37) or NIH chronic GvHD response criteria (kappa 0.18). Notably, patient-reported response at six months was significantly associated with subsequent failure-free survival. In multivariate analysis, NIH responses in eye, mouth, and lung had significant association with 6-month patient-reported response, as well as a change in Short Form 36 general health and role physical domains and Lee Symptom Score skin and eye changes. Based on these findings, patient-reported responses should be considered as an important complementary endpoint in chronic GvHD clinical trials and drug development.

Chronic graft-versus-host-disease treatment in Brazil: analyses of failure-free survival

Failure-free survival (FFS), defined as the absence of new systemic treatment, recurrence of original malignancy and mortality not associated with recurrence after allogeneic hematopoietic stem cell transplantation (HCT), is a robust clinical measure to interpret results of initial systemic treatment of chronic graft-versus-host disease (cGVHD). We evaluate FFS after initial treatment of cGVHD in a mixed-race cohort from a resource-constrained country. This retrospective study included 354 consecutive patients after their first HCT between January 2014 and August 2020, who received initial systemic treatment for moderate or severe cGVHD at 13 Brazilian centers. Cox regression models were used to identify risk factors for treatment failure. The overall median follow-up among survivors was 28 months (range 1-71) after initial treatment. FFS was 89% at 6 months, 71% at 1 year and 52% at 2 years. New systemic treatment was the major cause of failure. In multivariable models, prior grades II-IV acute GVHD, a National Institutes of Health severity score of 3 in liver, gastrointestinal tract or lung involvement, and onset of initial treatment of cGVHD within 12 months after transplantation were all associated with an increased risk of treatment failure. Our results could serve as a benchmark for the design of future clinical trials evaluating initial treatment of cGVHD in resource-constrained locations.

Organ Changes Associated with Provider-Assessed Responses in Patients with Chronic Graft-versus-Host Disease

Assessments of overall improvement and worsening of chronic graft-versus-host disease (GVHD) manifestations by the algorithm recommended by National Institutes of Health (NIH) response criteria do not align closely with those reported by providers, particularly when patients have mixed responses with improvement in some manifestations but worsening in others. To elucidate the changes that influence provider assessment of response, we used logistic regression to generate an overall change index based on specific manifestations of chronic GVHD measured at baseline and 6 months later. We hypothesized that this overall change index would correlate strongly with overall improvement as determined by providers. The analysis included 488 patients from 2 prospective observational studies who were randomly assigned in a 3:2 ratio to discovery and replication cohorts. Changes in bilirubin and scores of the lower gastrointestinal tract, mouth, joint/fascia, lung, and skin were correlated with provider-assessed improvement, suggesting that the main NIH response measures capture relevant information. Conversely, changes in the eye, esophagus, and upper gastrointestinal tract did not correlate with provider-assessed response, suggesting that these scales could be modified or dropped from the NIH response assessment. The area under the receiver operator characteristic curve in the replication cohort was 0.72, indicating that the scoring algorithm for overall change based on NIH response measures is not well calibrated with provider-assessed response.

Crowdsourcing to delineate skin affected by chronic graft-vs-host disease

BACKGROUND

Estimating the extent of affected skin is an important unmet clinical need both for research and practical management in many diseases. In particular, cutaneous burden of chronic graft-vs-host disease (cGVHD) is a primary outcome in many trials. Despite advances in artificial intelligence and 3D photography, progress toward reliable automated techniques is hindered by limited expert time to delineate cGVHD patient images. Crowdsourcing may have potential to provide the requisite expert-level data.

MATERIALS AND METHODS

Forty-one three-dimensional photographs of three cutaneous cGVHD patients were delineated by a board-certified dermatologist. 410 two-dimensional projections of the raw photos were each annotated by seven crowd workers, whose consensus performance was compared to the expert.

RESULTS

The consensus delineation by four of seven crowd workers achieved the highest agreement with the expert, measured by a median Dice index of 0.7551 across all 410 images, outperforming even the best worker from the crowd (Dice index 0.7216). For their internal agreement, crowd workers achieved a median Fleiss's kappa of 0.4140 across the images. The time a worker spent marking an image had only weak correlation with the surface area marked, and very low correlation with accuracy. Percent of pixels selected by the consensus exhibited good correlation (Pearson R = 0.81) with the patient's affected surface area.

CONCLUSION

Crowdsourcing may be an efficient method for obtaining demarcations of affected skin, on par with expert performance. Crowdsourced data generally agreed with the current clinical standard of percent body surface area to assess cGVHD severity in the skin.

A review of late complications of allogeneic hematopoietic stem cell transplantations

Allogeneic hematopoietic stem cell transplantation (allo-HSCT) is an effective and curative treatment of different malignant and non-malignant diseases. Early transplant-related mortality after allo-HSCT has decreased with reduced-intensity conditioning regimens and effective anti-infectious treatments, but late transplant-related mortality is still a problem. Physicians are now paying more attention to late complications that may worsen the quality of life of many transplant recipients. Chronic graft versus host disease (cGVHD) is one of the major causes of late transplant-related mortality after allo-HSCT. This review discusses recent advances that have been made in clinical evaluation and treatment of late transplant-related complications including cGVHD. The different sites of involvement are organs, especially the skin and eye, and the gastrointestinal, endocrinologic, metabolic, renal, cardiologic, pulmonary, connective tissue, and neurological systems. In addition, this review includes infections and secondary malignancies in post-transplant settings that worsen quality of life in long-term follow-ups.

Oral chronic GVHD outcomes and resource utilization: a subanalysis from the chronic GVHD consortium

OBJECTIVES

This study evaluated the extent to which oral chronic graft-versus-host disease (cGVHD) consensus assessments are predictive of management across institutions with and without oral medicine (OM) centers, and whether ancillary care guidelines are followed within clinical practice.

METHODS

Longitudinal oral cGVHD data were abstracted from the cGVHD Consortium, and additional mouth-specific management data were analyzed across five transplant centers.

RESULTS

Seventy-nine patients with 656 visits were observed for a median of 7.1 months with one visit per follow-up month. Ancillary therapies for oral cGVHD were prescribed for 67% of patients for a median of 0.46 months (per follow-up month) at OM centers and 0.78 months at non-OM centers. Patients treated with ancillary therapy were more likely to have an National Institutes of Health (NIH) mouth score of ≥1 (P < 0.001, odds ratio: 5.1) and mouth pain (P = 0.01, odds ratio: 2.6). The odds ratios of receiving ancillary therapy from OM experts were higher than transplant physicians (53%; P = 0.03).

CONCLUSIONS

Oral cGVHD consensus assessments corresponding with ancillary therapy use were mouth pain and NIH mouth score, with higher odds ratios of receiving therapy from OM experts. Ancillary care guidelines for oral cGVHD are reflected in academic clinical practice with respect to utilization of recommended prescriptions.

Predictors of survival, nonrelapse mortality, and failure-free survival in patients treated for chronic graft-versus-host disease

Chronic graft-versus-host disease (GVHD) is a pleotropic syndrome that lacks validated methods of measuring response in clinical trials, although several end points have been proposed. To investigate the prognostic significance of these proposed end points, such as the 2005 National Institutes of Health (NIH) response measures, 2014 NIH response measures, clinician-reported response, and patient-reported response, we tested their ability to predict subsequent overall survival (OS), nonrelapse mortality (NRM), and failure-free survival (FFS). Patients (n = 575) were enrolled on a prospective chronic GVHD observational trial. At 6 months, clinician-reported response (P = .004) and 2014 NIH-calculated response (P = .001) correlated with subsequent FFS, and clinician-reported response predicted OS (P = .007). Multivariate models were used to identify changes in organ involvement, laboratory values, and patient-reported outcomes that were associated with long-term outcomes. At 6 months, a change in the 2005 NIH 0 to 3 clinician-reported skin score and 0 to 10 patient-reported itching score predicted subsequent FFS. Change in the Lee skin symptom score and Functional Assessment of Cancer Therapy-Bone Marrow Transplant score predicted subsequent OS. Change in the Lee skin symptom score predicted subsequent NRM. This study provides evidence that clinician-reported response and patient-reported outcomes are predictive of long-term survival. The trial was registered at www.clinicaltrials.gov as #NCT00637689.

A Randomized Phase II Crossover Study of Imatinib or Rituximab for Cutaneous Sclerosis after Hematopoietic Cell Transplantation

PURPOSE

Cutaneous sclerosis occurs in 20% of patients with chronic graft-versus-host disease (GVHD) and can compromise mobility and quality of life.

EXPERIMENTAL DESIGN

We conducted a prospective, multicenter, randomized, two-arm phase II crossover trial of imatinib (200 mg daily) or rituximab (375 mg/m(2) i.v. weekly × 4 doses, repeatable after 3 months) for treatment of cutaneous sclerosis diagnosed within 18 months (NCT01309997). The primary endpoint was significant clinical response (SCR) at 6 months, defined as quantitative improvement in skin sclerosis or joint range of motion. Treatment success was defined as SCR at 6 months without crossover, recurrent malignancy or death. Secondary endpoints included changes of B-cell profiles in blood (BAFF levels and cellular subsets), patient-reported outcomes, and histopathology between responders and nonresponders with each therapy.

RESULTS

SCR was observed in 9 of 35 [26%; 95% confidence interval (CI); 13%-43%] participants randomized to imatinib and 10 of 37 (27%; 95% CI, 14%-44%) randomized to rituximab. Six (17%; 95% CI, 7%-34%) patients in the imatinib arm and 5 (14%; 95% CI, 5%-29%) in the rituximab arm had treatment success. Higher percentages of activated B cells (CD27(+)) were seen at enrollment in rituximab-treated patients who had treatment success (P = 0.01), but not in imatinib-treated patients.

CONCLUSIONS

These results support the need for more effective therapies for cutaneous sclerosis and suggest that activated B cells define a subgroup of patients with cutaneous sclerosis who are more likely to respond to rituximab.

National Institutes of Health Consensus Development Project on Criteria for Clinical Trials in Chronic Graft-versus-Host Disease: VI. The 2014 Clinical Trial Design Working Group Report

Treatment of chronic graft-versus-host disease is intended to produce a sustainable benefit by reducing symptom burden, controlling objective manifestations of disease activity, preventing damage and impairment, and improving overall survival without causing disproportionate harms related to the treatment itself. Successful management can control the disease until systemic treatment is no longer needed. The complexity of the disease, the extended duration of follow-up needed to observe disease resolution and withdrawal of immunosuppressive treatment, and the lack of fully developed shorter term endpoints impede progress in the field. Identification and characterization of primary endpoints demonstrating clinical benefit without requiring years of follow-up is urgently needed, with the understanding that clinical benefit encompasses not only the self-evident benefit of the primary endpoint but also any other associated benefits. This report discusses regulatory considerations, eligibility criteria, the value of controlled trial designs, the merits of proposed primary endpoints, and key considerations elaborated from experience and progress during the past decade. The report concludes by mapping an overall approach that could support and lead to maximally informative clinical trials, especially those that seek to demonstrate clinical benefit along a pathway to regulatory review and approval.

How we treat chronic graft-versus-host disease

Chronic graft-versus-host disease (GVHD) remains a common and potentially life-threatening complication of allogeneic hematopoietic stem cell transplantation (HCT). The 2-year cumulative incidence of chronic GVHD requiring systemic treatment is ~30% to 40% by National Institutes of Health criteria. The risk of chronic GVHD is higher and the duration of treatment is longer after HCT with mobilized blood cells than with marrow cells. Clinical manifestations can impair activities of daily living and often linger for years. Hematology and oncology specialists who refer patients to centers for HCT are often subsequently involved in the management of chronic GVHD when patients return to their care after HCT. Treatment of these patients can be optimized under shared care arrangements that enable referring physicians to manage long-term administration of immunosuppressive medications and supportive care with guidance from transplant center experts. Keys to successful collaborative management include early recognition in making the diagnosis of chronic GVHD, comprehensive evaluation at the onset and periodically during the course of the disease, prompt institution of systemic and topical treatment, appropriate monitoring of the response, calibration of treatment intensity over time in order to avoid overtreatment or undertreatment, and the use of supportive care to prevent complications and disability.

Current issues in chronic graft-versus-host disease

Chronic graft-versus-host disease (GVHD) is a frequent and potentially life-threatening complication of allogeneic hematopoietic stem cell transplantation. Increased transplantation of older patients and the more frequent use of unrelated donors has led to increased numbers of patients with this painful complication. Recent advances have been made in understanding the pathophysiology of chronic GVHD and in establishing precise criteria for diagnosis and classification of disease manifestations. These advances will hopefully pave the way for improving both the prophylaxis and treatment of chronic GVHD.

Current issues in chronic graft-versus-host disease

Chronic graft-versus-host disease (GVHD) is a frequent and potentially life-threatening complication of allogeneic hematopoietic stem cell transplantation. Increased transplantation of older patients and the more frequent use of unrelated donors has led to increased numbers of patients with this painful complication. Recent advances have been made in understanding the pathophysiology of chronic GVHD and in establishing precise criteria for diagnosis and classification of disease manifestations. These advances will hopefully pave the way for improving both the prophylaxis and treatment of chronic GVHD.

National Institutes of Health classification for chronic graft-versus-host disease predicts outcome of allo-hematopoietic stem cell transplant after fludarabine-busulfan-antithymocyte globulin conditioning regimen

Abstract In 2005, the National Institutes of Health (NIH) proposed standard criteria for diagnosis, organ scoring and global assessment of chronic graft-versus-host disease (cGvHD) severity. We retrospectively reclassified cGvHD with NIH criteria in a monocentric cohort of 130 consecutive adult patients with hematological malignancies presenting cGvHD after receiving allo-hematopoietic stem cell transplant (HSCT) with a fludarabine-busulfan-antithymocyte globulin (ATG) conditioning regimen, among 313 consecutive HSCT recipients. We compared NIH and Seattle classifications to correlate severity and outcome. The follow up range was effectively 2-120 months. Forty-four percent developed Seattle-defined cGvHD (22% limited, 78% extensive forms). Using NIH criteria, there were 23%, 40% and 37% mild, moderate and severe forms, respectively, and 58%, 32% and 8% classic cGvHD, late acute GvHD and overlap syndrome. Five-year overall survival was 55% (49-61), and cumulative incidences of non-relapse mortality (NRM) and relapse/progression at 2 years were 19% (14-23) and 19% (14-24). NIH mild and moderate forms were associated with better survival compared to severe cGvHD (hazard ratio [HR] = 3.28, 95% confidence interval [CI]: 1.38-7.82, p = 0.007), due to higher NRM among patients with severe cGvHD (HR = 3.04, 95% CI: 1.05-8.78, p = 0.04) but comparable relapse risk (p = NS). In conclusion, the NIH classification appears to be more accurate in predicting outcome mostly by the reclassification of old-defined extensive forms into NIH-defined moderate or severe.

Investigator feedback about the 2005 NIH diagnostic and scoring criteria for chronic GVHD

The 2005 National Institutes of Health (NIH) consensus criteria for chronic graft-versus-host disease (cGVHD) have set standards for reporting. Many questions, however, have arisen regarding implementation and utilization. To identify perceived areas of controversy, we conducted an international survey on diagnosis and scoring of cGVHD. Agreement was observed for 50% to 83% of the 72 questions in 7 topic areas. There was agreement in the need for modifying criteria in 6 situations: 2 or more distinctive manifestations should be enough to diagnose cGVHD, symptoms not due to cGVHD should be scored differently, active disease and fixed deficits should be distinguished, a minimum threshold body surface area of hidebound skin involvement should be required for a skin score 3, asymptomatic oral lichenoid changes should be considered a score 1, and lung biopsy should be unnecessary to diagnose cGVHD in a patient with bronchiolitis obliterans as the only manifestation. The survey also identified 26 points of controversy. Whenever possible, studies should be conducted to confirm the appropriateness of any revisions. In cases where data are not available, clarification of the NIH recommendations by consensus is necessary. This survey should inform future research in the field and revisions of the current consensus criteria.

Plasma CXCL9 elevations correlate with chronic GVHD diagnosis

There are no validated biomarkers for chronic GVHD (cGVHD). We used a protein microarray and subsequent sequential enzyme-linked immunosorbent assay to compare 17 patients with treatment-refractory de novo-onset cGVHD and 18 time-matched control patients without acute or chronic GVHD to identify 5 candidate proteins that distinguished cGVHD from no cGVHD: CXCL9, IL2Rα, elafin, CD13, and BAFF. We then assessed the discriminatory value of each protein individually and in composite panels in a validation cohort (n = 109). CXCL9 was found to have the highest discriminatory value with an area under the receiver operating characteristic curve of 0.83 (95% confidence interval, 0.74-0.91). CXCL9 plasma concentrations above the median were associated with a higher frequency of cGVHD even after adjustment for other factors related to developing cGVHD including age, diagnosis, donor source, and degree of HLA matching (71% vs 20%; P < .001). A separate validation cohort from a different transplant center (n = 211) confirmed that CXCL9 plasma concentrations above the median were associated with more frequent newly diagnosed cGVHD after adjusting for the aforementioned factors (84% vs 60%; P = .001). Our results confirm that CXCL9 is elevated in patients with newly diagnosed cGVHD.

Symptom burden and comorbidities impact the consistency of responses on patient-reported functional outcomes

OBJECTIVE

To assess the influence of symptom intensity, mood, and comorbidities on patient-clinician agreement and the consistency of responses to functional patient-reported outcomes (PROs).

DESIGN

Two data sources were used. The first, a cross-sectional database of patients with breast cancer who completed functional PROs and were administered the FIM, was used to examine whether average pain intensity (as measured with an 11-point numeric rating scale [NRS]) and Rand Mental Health inventory scores differed among those rating their functional independence as different than clinicians. The second, a longitudinal database of 311 adults with late-stage lung cancer who completed the Activity Measure for Post Acute Care Computer Adaptive Test (AM PAC CAT) with differences between their expected and actual responses as reflected in their AM PAC CAT SEs.

SETTING

Two tertiary medical centers.

PARTICIPANTS

Data source #1, 163 women with stage IV breast cancer; data source #2, 311 adults with late-stage lung cancer.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Data source #1, FIM, pain NRS, Older Americans Resource Study activities of daily living subscale, Physical Function-10, Mental Health Inventory-17. Data source #2, AM PAC CAT and NRS symptom ratings.

RESULTS

Pain intensity was significantly higher when clinicians and patients disagreed regarding a patient's independence in the ability to transfer (NRS pain severity, 3.78 vs 2.40; P=.014), groom (3.71 vs 2.36, P=.009), bathe (3.76 vs 2.40, P=.016), and dress (3.09 vs 2.44, P=.034). The magnitude of AM PAC CAT SEs was significantly associated with the severity of participants' pain, dyspnea, and fatigue, as well as the presence of musculoskeletal disorders and coronary artery disease. Neither mood nor emotional distress was associated with clinician-patient agreement or AM PAC CAT SE.

CONCLUSIONS

Pain intensity is associated with disagreement between patients and clinicians about the patient's level of functioning. Moreover, physical symptoms (pain, dyspnea, fatigue) as well as specific medical comorbidities (musculoskeletal disorders, coronary artery disease), but not mood, are associated with inconsistency in patients' assessment of their functional abilities.

Measurement of oral chronic GVHD: results from the Chronic GVHD Consortium

Oral chronic GVHD (cGVHD) is a serious complication of alloSCT. Scales and instruments to measure oral cGVHD activity and severity have not been prospectively validated. The objective of this study was to describe the characteristics of oral cGVHD and determine the measures most sensitive to change. Patients enrolled in the cGVHD Consortium with oral involvement were included. Clinicians scored oral changes according to the National Institutes of Health (NIH) criteria, and patients completed symptom and quality-of-life measures at each visit. Both rated change on an eight-point scale. Of the 458 participants, 72% (n=331) had objective oral involvement at enrollment. Lichenoid change was the most common feature (n=293; 89%). At visits where oral change could be assessed, 50% of clinicians and 56% of patients reported improvement, with worsening reported in 4-5% for both the groups (weighted kappa=0.41). Multivariable regression modeling suggested that the measurement changes most predictive of perceived change by clinicians and patients were erythema and lichenoid, NIH severity and symptom scores. Oral cGVHD is common and associated with a range of signs and symptoms. Measurement of erythema and lichenoid changes and symptoms may adequately capture the activity of oral cGVHD in clinical trials but require prospective validation.

Failure-free survival after second-line systemic treatment of chronic graft-versus-host disease

This study attempted to characterize causes of treatment failure, identify associated prognostic factors, and develop shorter-term end points for trials testing investigational products or regimens for second-line systemic treatment of chronic graft-versus-host disease (GVHD). The study cohort (312 patients) received second-line systemic treatment of chronic GVHD. The primary end point was failure-free survival (FFS) defined by the absence of third-line treatment, nonrelapse mortality, and recurrent malignancy during second-line treatment. Treatment change was the major cause of treatment failure. FFS was 56% at 6 months after second-line treatment. Lower steroid doses at 6 months correlated with subsequent withdrawal of immunosuppressive treatment. Multivariate analysis showed that high-risk disease at transplantation, lower gastrointestinal involvement at second-line treatment, and severe NIH global score at second-line treatment were associated with increased risks of treatment failure. These three factors were used to define risk groups, and success rates at 6 months were calculated for each risk group either without or with various steroid dose limits at 6 months as an additional criterion of success. These success rates could be used as the basis for a clinically relevant and efficient shorter-term end point in clinical studies that evaluate agents for second-line systemic treatment of chronic GVHD.

The adult respiratory distress syndrome. Clinical features, factors influencing prognosis and principles of management

Low-dose IL-2 is efficacious in steroid-refractory cGVHD, with objective responses in >50% of patients, and durable disease control. IL-2 initiation earlier after cGVHD onset, prior to severe impairment of Treg:Tcon ratios, improves likelihood of clinical response.