1
|
Paiva CE, Barroso EM, Carneseca EC, de Pádua Souza C, dos Santos FT, Mendoza López RV, Ribeiro Paiva SB. A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: a systematic review. BMC Med Res Methodol 2014; 14:8. [PMID: 24447633 PMCID: PMC3899385 DOI: 10.1186/1471-2288-14-8] [Citation(s) in RCA: 91] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2013] [Accepted: 01/13/2014] [Indexed: 01/08/2023] Open
Abstract
BACKGROUND Patient-reported outcome validation needs to achieve validity and reliability standards. Among reliability analysis parameters, test-retest reliability is an important psychometric property. Retested patients must be in a clinically stable condition. This is particularly problematic in palliative care (PC) settings because advanced cancer patients are prone to a faster rate of clinical deterioration. The aim of this study was to evaluate the methods by which multi-symptom and health-related qualities of life (HRQoL) based on patient-reported outcomes (PROs) have been validated in oncological PC settings with regards to test-retest reliability. METHODS A systematic search of PubMed (1966 to June 2013), EMBASE (1980 to June 2013), PsychInfo (1806 to June 2013), CINAHL (1980 to June 2013), and SCIELO (1998 to June 2013), and specific PRO databases was performed. Studies were included if they described a set of validation studies. Studies were included if they described a set of validation studies for an instrument developed to measure multi-symptom or multidimensional HRQoL in advanced cancer patients under PC. The COSMIN checklist was used to rate the methodological quality of the study designs. RESULTS We identified 89 validation studies from 746 potentially relevant articles. From those 89 articles, 31 measured test-retest reliability and were included in this review. Upon critical analysis of the overall quality of the criteria used to determine the test-retest reliability, 6 (19.4%), 17 (54.8%), and 8 (25.8%) of these articles were rated as good, fair, or poor, respectively, and no article was classified as excellent. Multi-symptom instruments were retested over a shortened interval when compared to the HRQoL instruments (median values 24 hours and 168 hours, respectively; p = 0.001). Validation studies that included objective confirmation of clinical stability in their design yielded better results for the test-retest analysis with regard to both pain and global HRQoL scores (p < 0.05). The quality of the statistical analysis and its description were of great concern. CONCLUSION Test-retest reliability has been infrequently and poorly evaluated. The confirmation of clinical stability was an important factor in our analysis, and we suggest that special attention be focused on clinical stability when designing a PRO validation study that includes advanced cancer patients under PC.
Collapse
Affiliation(s)
- Carlos Eduardo Paiva
- Department of Clinical Oncology, Barretos Cancer Hospital, Barretos, São Paulo CEP 14784-400, Brazil
- Palliative Care and Quality of Life Research Group, Post-Graduate Program, Barretos Cancer Hospital, Barretos, São Paulo, Brazil
- Researcher Support Center, Learning and Research Institute, Barretos Cancer Hospital, Barretos, São Paulo, Brazil
| | - Eliane Marçon Barroso
- Palliative Care and Quality of Life Research Group, Post-Graduate Program, Barretos Cancer Hospital, Barretos, São Paulo, Brazil
| | - Estela Cristina Carneseca
- Palliative Care and Quality of Life Research Group, Post-Graduate Program, Barretos Cancer Hospital, Barretos, São Paulo, Brazil
- Researcher Support Center, Learning and Research Institute, Barretos Cancer Hospital, Barretos, São Paulo, Brazil
| | - Cristiano de Pádua Souza
- Department of Clinical Oncology, Barretos Cancer Hospital, Barretos, São Paulo CEP 14784-400, Brazil
| | - Felipe Thomé dos Santos
- Department of Clinical Oncology, Barretos Cancer Hospital, Barretos, São Paulo CEP 14784-400, Brazil
| | | | - Sakamoto Bianca Ribeiro Paiva
- Palliative Care and Quality of Life Research Group, Post-Graduate Program, Barretos Cancer Hospital, Barretos, São Paulo, Brazil
- Researcher Support Center, Learning and Research Institute, Barretos Cancer Hospital, Barretos, São Paulo, Brazil
| |
Collapse
|
2
|
Correia FR, De Carlo MMRDP. Evaluation of quality of life in a palliative care context: an integrative literature review. Rev Lat Am Enfermagem 2012; 20:401-10. [DOI: 10.1590/s0104-11692012000200025] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2011] [Accepted: 11/25/2011] [Indexed: 01/29/2023] Open
Abstract
The use of scales that have been validated and standardized for different cultures is very useful for identifying demands in the field of Palliative Care and implementing the most appropriate care. This integrative literature review focuses on instruments assessing the Quality of Life of patients under Palliative Care through a journal search in electronic databases. The study consisted of 49 papers identified in Medline/PubMed, of which 18 met the inclusion criteria previously defined. Information concerning the selected studies is presented and later categorized, with a greater emphasis on the analysis of the psychometric properties of validations of the Palliative Outcome Scale, conducted in three countries. This review enabled the identification of instruments already developed and validated for different cultures, increasing the possibility of knowledge in the field.
Collapse
|
3
|
Quality Indicators for Care of Cancer Patients in Their Last Days of Life: Literature Update and Experts' Evaluation. J Palliat Med 2012; 15:308-16. [DOI: 10.1089/jpm.2011.0393] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
|
4
|
Albers G, Echteld MA, de Vet HCW, Onwuteaka-Philipsen BD, van der Linden MHM, Deliens L. Evaluation of quality-of-life measures for use in palliative care: a systematic review. Palliat Med 2010; 24:17-37. [PMID: 19843620 DOI: 10.1177/0269216309346593] [Citation(s) in RCA: 100] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
PURPOSE In this literature review we evaluated the feasibility and clinimetric quality of quality-of-life (QoL) measurement instruments suitable for use in palliative care. METHODS We conducted a systematic literature review to identify instruments measuring (at least one domain of) QoL. We selected articles that present data on patients receiving palliative care and at least one measurement property. A checklist was used to describe the characteristics of the instruments, and a widely accepted rating list was used to evaluate the clinimetric aspects. RESULTS 29 instruments were identified and evaluated, most of which were targeted at palliative patients in general. None of the instruments demonstrated satisfactory results for all measurement properties. Fourteen instruments received positive ratings for construct validity. Thirteen instruments were tested for reliability, but only two were tested adequately and had positive results (ICC>0.70). Responsiveness was not tested adequately for any of the instruments. Very few of the studies provided information on the interpretation of the scores. Overall, the MQOL, followed by the QUAL-E and the QODD, received the best ratings for their measurement properties. CONCLUSIONS Many measurement instruments were identified, but most had not yet been adequately evaluated. The evaluation of existing instruments with good content validity should have priority over the development of new instruments.
Collapse
Affiliation(s)
- Gwenda Albers
- Department of Public and Occupational Health, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam, The Netherlands.
| | | | | | | | | | | |
Collapse
|
5
|
Jordhoy MS, Inger Ringdal G, Helbostad JL, Oldervoll L, Loge JH, Kaasa S. Assessing physical functioning: a systematic review of quality of life measures developed for use in palliative care. Palliat Med 2007; 21:673-82. [PMID: 18073253 DOI: 10.1177/0269216307083386] [Citation(s) in RCA: 46] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
BACKGROUND Physical decline is experienced by all palliative care patients and affects most aspects of life. Physical functioning (PF) is therefore a crucial domain for quality of life (Qol) assessments. The purpose of this study was to review how PF assessments are performed in Qol instruments developed for palliative care METHODS For identification of instruments, Medline searches up to April 2005 were performed using the terms (palliative care OR end of life care OR terminal care) AND quality of life AND (assessment OR instrument OR questionnaire). A total of 1326 hits were screened. Named QoL instruments were extracted from 240 abstracts and 46 relevant reports. Items assessing PF were then identified and classified according to activity domains as described by the WHO International Classification of Functioning Disability and Health. RESULTS Of 224 different instruments detected, 39 were identified as developed for palliative care. Of these, 11 included original PF assessments. Two were comprehensive performance status measures made for staff assessment, 9 were multidimensional tools including 2-7 PF items. The content and phrasing of items varied considerably. All instruments included some aspects of self-care, whereas the coverage of mobility, domestic, work--and leisure activities was inconsistent. INTERPRETATION Despite its importance, PF assessment seems to be a minor part of palliative care QoL instruments. Clear definitions and conceptualization of PF are needed, as well as a consensus on relevant aspects to include in improved instruments. Performance scales already developed should be further explored with regard to content, validity and psychometric properties.
Collapse
Affiliation(s)
- Marit S Jordhoy
- Department of Cancer Research and Molecular Medicine, Faculty of Medicine, Norwegian University of Science and Technology (NTNU), Trondheim, Norway.
| | | | | | | | | | | |
Collapse
|
6
|
Mularski RA, Dy SM, Shugarman LR, Wilkinson AM, Lynn J, Shekelle PG, Morton SC, Sun VC, Hughes RG, Hilton LK, Maglione M, Rhodes SL, Rolon C, Lorenz KA. A systematic review of measures of end-of-life care and its outcomes. Health Serv Res 2007; 42:1848-70. [PMID: 17850523 PMCID: PMC2254566 DOI: 10.1111/j.1475-6773.2007.00721.x] [Citation(s) in RCA: 143] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
OBJECTIVE To identify psychometrically sound measures of outcomes in end-of-life care and to characterize their use in intervention studies. DATA SOURCES English language articles from 1990 to November 2005 describing measures with published psychometric data and intervention studies of end-of-life care. STUDY DESIGN Systematic review of end-of-life care literature. EXTRACTION METHODS Two reviewers organized identified measures into 10 major domains. Eight reviewers extracted and characterized measures from intervention studies. PRINCIPAL FINDINGS Of 24,423 citations, we extracted 200 articles that described 261 measures, accepting 99 measures. In addition to 35 measures recommended in a prior systematic review, we identified an additional 64 measures of the end-of-life experience. The most robust measures were in the areas of symptoms, quality of life, and satisfaction; significant gaps existed in continuity of care, advance care planning, spirituality, and caregiver well-being. We also reviewed 84 intervention studies in which 135 patient-centered outcomes were assessed by 97 separate measures. Of these, 80 were used only once and only eight measures were used in more than two studies. CONCLUSIONS In general, most measures have not undergone rigorous development and testing. Measure development in end-of-life care should focus on areas with identified gaps, and testing should be done to facilitate comparability across the care settings, populations, and clinical conditions. Intervention research should use robust measures that adhere to these standards.
Collapse
Affiliation(s)
- Richard A Mularski
- Center for Health Research, Kaiser Permanente Northwest, Oregon Health & Science University, 3800 N. Interstate, WIN 1060, Portland, OR 97227, USA
| | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
7
|
Groot MM, Derksen EWC, Crul BJP, Grol RPTM, Vernooij-Dassen MJFJ. Living on borrowed time: experiences in palliative care. PATIENT EDUCATION AND COUNSELING 2007; 65:381-6. [PMID: 17150325 DOI: 10.1016/j.pec.2006.09.009] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2006] [Revised: 08/24/2006] [Accepted: 09/25/2006] [Indexed: 05/12/2023]
Abstract
OBJECTIVE To gain insight into the experiences of a palliative care patient and her husband who were living on borrowed time. METHODS A qualitative single case design was used. Systematic content analysis of the interview data, obtained in an in-depth semi-structured interview, from the husband and wife was conducted to extract themes relating to living on borrowed time. RESULTS Three themes were identified: shifts in the interpretation of physical signs and symptoms, altered view of the future and altered choices and priorities. CONCLUSION The identified themes lead to a better understanding of the phenomenon of living on borrowed time. Yet, refinement of, and variation within the themes still need to be studied in order to get more grips on the themes and to be better able to help patients to integrate the 'new reality'. PRACTICE IMPLICATIONS Our findings can be used to support professionals in the practical application of care when their patients need to integrate the 'new reality' and seek new equilibrium, e.g. converted into a conversational guide, or used for educational purposes.
Collapse
Affiliation(s)
- Marieke M Groot
- Centre for Quality of Care Research, Radboud University Nijmegen Medical Centre, The Netherlands.
| | | | | | | | | |
Collapse
|
8
|
Wedding U, Röhrig B, Klippstein A, Brix C, Pientka L, Höffken K. Co-morbidity and functional deficits independently contribute to quality of life before chemotherapy in elderly cancer patients. Support Care Cancer 2007; 15:1097-104. [PMID: 17318590 DOI: 10.1007/s00520-007-0228-9] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2006] [Accepted: 01/29/2007] [Indexed: 12/27/2022]
Abstract
UNLABELLED GOAL OF THE WORK: The quality of life (QoL) of patients with cancer is a major area of concern for both patients and their physicians. The independent contribution of functional impairment and co-morbidity to QoL is unclear. MATERIALS AND METHODS We investigated initial global QoL in 477 patients: 195 cancer patients aged 60 years or older (group A), 152 cancer patients below the age of 60 years (group B), admitted as inpatients for chemotherapy initiation and 130 patients aged 60 years or older admitted for non-cancer-related disorders (group C). Global QoL was assessed by the EORTC-QLQ-C30 subscale, functional status by the Karnofsky Performance Scale (KPS) and the Instrumental Activities of Daily Living (IADL) scale, and co-morbidity by the Cumulative Illness Rating Scale (CIRS). RESULTS In multivariate analyses, global QoL is significantly associated with KPS, IADL and co-morbidity in group A (r (2) = 0.27), with KPS and IADL in group B (r (2) = 0.23), and with age, KPS and IADL in group C (r (2) = 0.38). CONCLUSIONS IADL contributes to global QoL in addition to the known effect of KPS. In addition, co-morbidity independently influences global QoL in elderly cancer patients.
Collapse
Affiliation(s)
- Ulrich Wedding
- Internal Medicine Clinic II, Department of Haematology and Medical Oncology, Friedrich Schiller University, Erlanger Allee 101, 07747 Jena, Germany.
| | | | | | | | | | | |
Collapse
|
9
|
Jakobsson E, Bergh I, Gaston-Johansson F, Stolt CM, Ohlén J. The Turning Point: Clinical Identification of Dying and Reorientation of Care. J Palliat Med 2006; 9:1348-58. [PMID: 17187543 DOI: 10.1089/jpm.2006.9.1348] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Palliative care is increasingly organized within the setting of formal health care systems but the demarcation has become unclear between, on the one hand, care directed at cure and rehabilitation and palliative care aimed at relief of suffering on the other. With the purpose to increase the understanding about the turning point reflecting identification of dying and reorientation of care, this study explores this phenomenon as determined from health care records of a representative sample (n = 229). A turning point was identified in 160 records. Presence of circulatory diseases, sporadic confinement to bed, and deterioration of condition had a significant impact upon the incidence of such turning point. The time interval between the turning point and actual death ranged between one and 210 days. Thirty percent of these turning points were documented within the last day of life, 33% during the last 2-7 days, 19.5% during the last 8-30 days, 13% during the last 31-90 days, and 4.5% during the last 91-210 days of life. The time interval between the turning point and actual death was significantly longer among individuals with neoplasm(s) and significantly shorter among individuals suffering from musculoskeletal diseases. Perhaps this reflects a discrepancy between the ideals of palliative care, and a misinterpretation of the meaning of palliative care in everyday clinical practice. The findings underscore that improvement in timing of clinical identification of dying and reorientation of care will likely favour a shift from life-extending care to palliative care.
Collapse
Affiliation(s)
- Eva Jakobsson
- Faculty of Health Caring Sciences, The Sahlgrenska Academy at Göteborg University, Institute of Nursing, Gothenburg, Sweden.
| | | | | | | | | |
Collapse
|
10
|
Ruiz de Zuazu HM, Tiberio López G. Cartas al director. Med Clin (Barc) 2005. [DOI: 10.1157/13072048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
11
|
Mendoza Ruiz de Zuazu H, Tiberio López G, Aizpuru Barandiaran F, Viñez Irujo O, Anderiz López M. Neumonía en el anciano. Factores relacionados con la mortalidad durante el episodio y tras el alta hospitalaria. Med Clin (Barc) 2004; 123:332-6. [PMID: 15388035 DOI: 10.1016/s0025-7753(04)74507-8] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
BACKGROUND AND OBJECTIVE Pneumonia in the elderly (PIE) is a growing disease that causes great morbidity and mortality with frequent admissions to hospital and increasing health costs. The objective of our study was yo analyze the characteristics of PIE in an internal medicine hospital ward, the influence of quality of life (Katz index and scale of Karnofsky) on its evolution and after the discharge and the factors of poor prognosis during the episode of PIE and throughout the ambulatory follow-up. PATIENTS AND METHOD All the patients suffering from PIE admitted to the internal medicine ward of our hospital during a two years period were included in the study (125). Five of them were referred from geriatric centers. Mean age was 77.9 years (range = 65-95). The most frequent chronic disease was COPD (53.6%) and 10.4% were taking oral corticosteroids. We studied the association of several factors laboratory, clinical and radiological with the evolution of PIE and after discharge. RESULTS Patients rated high on the indicators of quality of life used (78.4% scored 5 or greater on the Katz index and 76% scored 80 or greater on the scale of Karnofsky) and their comorbidity was low (44% lesser than or equal to 1 and 6.4% greater than or equal to 5). Fever above 38 C was recorded in 40% of cases. Mean APACHE score was 12.8. 21.6% patients had pleural effusion and 20% had multilobar involvement. Overall mortality was 8.8% (11 patients). Fifteen patients suffered major complications during admission. One hundred patients out of the 114 who survived the episode of PIE were followed up on an ambulatory basis. Thirty of those died within 12 months after discharge. CONCLUSIONS In our study, a poorer quality of life and a higher APACHE score were related to a greater mortality during the episode of PIE. After hospital discharge, a greater mortality was associated with a poor quality of life, comorbidity and low concentrations of albumin.
Collapse
|