Development of a lack of appetite item bank for computer-adaptive testing (CAT)

Development of an EORTC Item Bank for Computer-Adaptive Testing of Nausea and Vomiting

OBJECTIVES

Nausea and vomiting (NV) remain common cancer symptoms and frequent side effects of anticancer therapies despite available antiemetics. They can lead to treatment disruption and discontinuation. NV is an important patient reported outcome in oncology. This study aimed to build an item bank for computer-adaptive testing (CAT) based on NV questions in the European Organisation for Research for Treatment of Cancer, Quality of Life for Cancer Patients (EORTC QLQ-C30) questionnaire and complete the first three phases of development as described in the EORTC Quality of Life Group guidelines.

DATA SOURCES

The development followed a standard procedure. The three phases include conceptualization and literature search (phase 1); item classification, selection, formulation and rating, and expert evaluations (phase 2); and patient pretesting (phase 3). The literature search resulted in a preliminary list of 115 items. Following classification, formulation, and rating, 21 candidate items adhered to the QLQ-C30 format. Evaluation by experts (n = 11) from five countries and patients (n = 31) pretesting in Denmark, Poland, and the UK lead to a final list of 20 items.

CONCLUSION

The selection, development, and refining of NV items have been described. The nature of this testing ensures an initial CAT item bank that after field testing (phase 4) and psychometric analysis is expected to provide a precise and efficient NV measurement while still being comparable to the original QLQ-C30 scale.

IMPLICATIONS FOR NURSING PRACTICE

Access to reliable tools that facilitate NV comprehensive assessment is an important issue for nurses caring for patients with cancer. This CAT item bank is meant to support clinical decisions when all phases of testing are completed.

Brazilian Validation of the European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group (QLG) Computerised Adaptive Tests (CAT) Core

Background: This study aimed to validate the Brazilian version of EORTC CAT Core and compare the Brazilian results with those from the original European EORTC CAT Core validation study. Methods: After validated translation, 168 cancer patients from Brazil receiving radiation therapy with or without chemotherapy was assessed. Translated EORTC CAT Core and all QLQ-C30 items were administered to patients using CHES (Computer-Based Health Evaluation System) before (T0) and after (T1) treatment initiation. The association between QLQ-C30 and CAT scores and ceiling/floor effects were estimated. Based on estimates of relative validity (cross-sectional, known-group differences and changes over time), relative sample-size requirements for CAT compared to QLQ-C30 were estimated. Results: Correlation coefficients between CAT and QLQ-C30 domains ranged from 0.63 to 0.93; except for dyspnoea, all coefficients were >0.82 (corresponding figures were 0.81–0.93 in the European study). On average across domains, floor/ceiling was reduced by 10% using CAT (9% in the European study) corresponding to a relative reduction of 32% (37% in the European study). Analyses of known-group validity and responsiveness indicated that, on average across domains, the sample-size requirements may be reduced by 17% using CAT rather than QLQ-C30, without loss of power (28% in the European study). The Brazilian sample had less symptom/quality of life impairment than the European sample, which likely explains the lower sample-size reduction using CAT when comparing with the European sample. Conclusions: The results in the Brazilian cohort were generally similar to those from the European sample and confirm the validity and usefulness of the EORTC CAT Core.

International validation of the EORTC CAT Core: a new adaptive instrument for measuring core quality of life domains in cancer

BACKGROUND

The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group (QLG) has developed computerised adaptive tests (CATs) for the 14 functional and symptom domains of the EORTC QLQ-C30 quality of life questionnaire. This is expected to optimise measurement precision, relevance to patients and flexibility. Here, we present the first international validation of the EORTC CAT Core.

METHODS

A heterogeneous sample of 699 cancer patients scheduled for chemotherapy and/or radiotherapy was recruited across seven European countries. The EORTC CAT Core and all QLQ-C30 items were administered to participants before and after initiating treatment. Correlations between CAT and QLQ-C30 scores and floor/ceiling effects were calculated. Using several grouping variables, relative validity (cross-sectional known groups difference), responsiveness (changes over time) and relative sample size requirements of the CAT compared to the QLQ-C30 were estimated.

RESULTS

Correlations of the CAT and QLQ-C30 ranged from 0.81 to 0.93 across domains. The mean relative reduction in floor and ceiling effects using the CAT was 42% (range 3-99%). Analyses of known groups validity and responsiveness indicated that, across domains, mean sample size requirements for the CAT were 72% and 70%, respectively, of those using the QLQ-C30.

CONCLUSIONS

The EORTC CAT Core measures the same domains as the QLQ-C30 with reduced floor/ceiling effects. The CAT generally facilitated the use of smaller samples (about 30% smaller on average) without loss of power compared to the QLQ-C30. Based on this study, the EORTC QLG will release the EORTC CAT Core for general use.

Psychometric evaluation of an item bank for computerized adaptive testing of the EORTC QLQ-C30 cognitive functioning dimension in cancer patients

BACKGROUND

The European Organisation of Research and Treatment of Cancer (EORTC) Quality of Life Group is developing computerized adaptive testing (CAT) versions of all EORTC Quality of Life Questionnaire (QLQ-C30) scales with the aim to enhance measurement precision. Here we present the results on the field-testing and psychometric evaluation of the item bank for cognitive functioning (CF).

METHODS

In previous phases (I-III), 44 candidate items were developed measuring CF in cancer patients. In phase IV, these items were psychometrically evaluated in a large sample of international cancer patients. This evaluation included an assessment of dimensionality, fit to the item response theory (IRT) model, differential item functioning (DIF), and measurement properties.

RESULTS

A total of 1030 cancer patients completed the 44 candidate items on CF. Of these, 34 items could be included in a unidimensional IRT model, showing an acceptable fit. Although several items showed DIF, these had a negligible impact on CF estimation. Measurement precision of the item bank was much higher than the two original QLQ-C30 CF items alone, across the whole continuum. Moreover, CAT measurement may on average reduce study sample sizes with about 35-40% compared to the original QLQ-C30 CF scale, without loss of power.

CONCLUSION

A CF item bank for CAT measurement consisting of 34 items was established, applicable to various cancer patients across countries. This CAT measurement system will facilitate precise and efficient assessment of HRQOL of cancer patients, without loss of comparability of results.

A parallel-group randomized clinical trial of individually tailored, multidisciplinary, palliative rehabilitation for patients with newly diagnosed advanced cancer: the Pal-Rehab study protocol

BACKGROUND

The effect of early palliative care and rehabilitation on the quality of life of patients with advanced cancer has been only sparsely described and needs further investigation. In the present trial we combine elements of early, specialized palliative care with cancer rehabilitation in a 12-week individually tailored, palliative rehabilitation program initiated shortly after a diagnosis of advanced cancer.

METHODS

This single center, randomized, controlled trial will include 300 patients with newly diagnosed advanced cancer recruited from the Department of Oncology, Vejle Hospital. The patients are randomized to a specialized palliative rehabilitation intervention integrated in standard oncology care or to standard oncology care alone. The intervention consists of a multidisciplinary group program, individual consultations, or a combination of both. At baseline and after six and 12 weeks the patients will be asked to fill out questionnaires on symptoms, quality of life, and symptoms of depression and anxiety. Among the symptoms and problems assessed, patients are asked to indicate the problem they need help with to the largest extent. The effect of the intervention on this problem is the primary outcome measure of the study. Secondary outcome measures include survival and economic consequences.

DISCUSSION

To our knowledge the Pal-Rehab study is the first randomized, controlled, phase III trial to evaluate individually tailored, palliative rehabilitation in standard oncology care initiated shortly after an advanced cancer diagnosis. The study will contribute with evidence on the effectiveness of implementing early palliative care in standard oncology treatment and hopefully offer new knowledge and future directions as to the content of palliative rehabilitation programs.

TRIAL REGISTRATION

Clinicaltrials.gov Identifier: NCT02332317 , registered retrospectively on December 30, 2014. One study participant had been enrolled at the time.

Development of an item bank for computerized adaptive testing of self-reported cognitive difficulty in cancer patients

Background

The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group is developing computerized adaptive testing (CAT) versions of each scale of the EORTC Quality of Life Questionnaire (EORTC QLQ-C30). This study aims to develop an item bank for the EORTC QLQ-C30 cognitive functioning scale, which can be used for CAT.

Methods

The complete developmental approach comprised four phases: (I) conceptualization and literature search, (II) operationalization, (III) pretesting, and (IV) field-testing. This paper describes phases I-III.I) A literature search was performed to identify self-report instruments and items measuring cognitive complaints on concentration and memory. II) A multistep item-selection procedure was applied to select and generate items that were relevant and compatible with the 'QLQ-C30 item style.' III) Cancer patients from different countries evaluated the item list for wording (ie, whether items were difficult, confusing, annoying, upsetting or intrusive), and whether relevant issues were missing.

Results

A list of 439 items was generated by the literature search. In the multistep item-selection procedure, these items were evaluated for relevance, redundancy, clarity, and response format, resulting in an list of 45 items. A total of 32 patients evaluated this item list in the pretesting phase, resulting in a preliminary list of 44 items.

Conclusion

Phase I-III resulted in an item list of 44 items measuring self-reported cognitive complaints that was endorsed by international experts and cancer patients in several countries. This list will be evaluated for its psychometric characteristics in phase IV.

An emotional functioning item bank of 24 items for computerized adaptive testing (CAT) was established

OBJECTIVE

To improve measurement precision, the European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group is developing an item bank for computerized adaptive testing (CAT) of emotional functioning (EF). The item bank will be within the conceptual framework of the widely used EORTC Quality of Life questionnaire (QLQ-C30).

STUDY DESIGN AND SETTING

On the basis of literature search and evaluations by international samples of experts and cancer patients, 38 candidate items were developed. The psychometric properties of the items were evaluated in a large international sample of cancer patients. This included evaluations of dimensionality, item response theory (IRT) model fit, differential item functioning (DIF), and of measurement precision/statistical power.

RESULTS

Responses were obtained from 1,023 cancer patients from four countries. The evaluations showed that 24 items could be included in a unidimensional IRT model. DIF did not seem to have any significant impact on the estimation of EF. Evaluations indicated that the CAT measure may reduce sample size requirements by up to 50% compared to the QLQ-C30 EF scale without reducing power.

CONCLUSION

On the basis of thorough psychometric evaluations, we have established an EF item bank of 24 items. This will allow for more precise and flexible measurement of EF, while maintaining backward compatibility with the QLQ-C30 EF scale.