Developing a reliable, valid, and feasible plan for quality-of-care measurement for cancer: how should we measure?

Treatment Patterns Among De Novo Metastatic Cancer Patients Who Died Within 1 Month of Diagnosis

BACKGROUND

Little is known about patterns of and factors associated with treatment for de novo metastatic cancer patients who die soon after diagnosis. In this study, we examine treatment patterns for patients newly diagnosed with metastatic lung, colorectal, breast, or pancreatic cancer who died within 1 month of diagnosis.

METHODS

We identified 100 848 adult patients in the National Cancer Database with de novo metastatic lung, colorectal, breast, and pancreatic cancer, diagnosed between 2004 and 2014 and who died within 1 month. We performed descriptive and multivariable logistic regression analyses to examine receipt of surgery, chemotherapy, radiation, and hormonal therapy by cancer type, adjusting for sociodemographic and clinical variables.

RESULTS

Treatment substantially varied by cancer type, over time, age, insurance, and facility type. Surgery ranged from 0.4% in pancreatic to 28.3% in colorectal cancer (CRC) patients, chemotherapy from 5.8% among CRC to 11% in lung and breast cancer patients, and radiotherapy from 1.3% in pancreatic to 18.7% in lung cancer patients. Use of some treatments (eg, surgery for CRC and breast cancer) progressively declined between 2004 and 2014. Compared with lung cancer patients treated at National Cancer Institute-designated cancer centers, those treated at community cancer centers had 48% lower odds of radiation.

CONCLUSIONS

Treatment of patients diagnosed with imminently fatal de novo metastatic cancer varied markedly by cancer type and patient/facility characteristics. These variations warrant more research to better identify patients with imminently fatal de novo metastatic cancer who may not benefit from aggressive and expensive therapies.

Importance of adherence to guidelines in breast cancer clinical practice. The Italian experience (AIOM)

Aims and background

Project RIGHT (Research for the Identification of the most effective and hIGHly accepted clinical guidelines for cancer Treatment) is promoted by the Italian Association of Medical Oncology (AIOM) to evaluate the concordance between AIOM breast cancer guidelines and clinical practice in Italy. In RIGHT-1, feasibility and the appropriateness of indicators were assessed in patients with early breast cancer. RIGHT-2 evaluated the compliance with guidelines in a nationwide program.

Methods

Thirty-five Italian centers participated in the RIGHT-2 survey. Ten indicators were evaluated to verify an agreement between 2005 AIOM breast cancer guidelines and practice. Patients with clinical stage I-II invasive breast cancer, age ≤70 years, who had their first visit at the oncology center between October 2005 and November 2006 were included.

Results

In RIGHT-2, ≥90% adherence for the diagnosis indicator and three therapy indicators were observed. The lowest degree of compliance (0%) was observed for the follow-up indicator in asymptomatic patients.

Conclusions

In RIGHT-2, compliance to the 2005 AIOM breast cancer guidelines was 64%. When the follow-up indicator was eliminated, overall adherence to AIOM guidelines was 71%. The results highlight the need to continue improving the already good standards of breast cancer care.

Delivering High-Quality Cancer Care: The Critical Role of Quality Measurement

In 1999, the Institute of Medicine (IOM) published Ensuring Quality Cancer Care, an influential report that described an ideal cancer care system and issued ten recommendations to address pervasive gaps in the understanding and delivery of quality cancer care. Despite generating much fervor, the report's recommendations-including two recommendations related to quality measurement-remain largely unfulfilled. Amidst continuing concerns regarding increasing costs and questionable quality of care, the IOM charged a new committee with revisiting the 1999 report and with reassessing national cancer care, with a focus on the aging US population. The committee identified high-quality patient-clinician relationships and interactions as central drivers of quality and attributed existing quality gaps, in part, to the nation's inability to measure and improve cancer care delivery in a systematic way. In 2013, the committee published its findings in Delivering High-Quality Cancer Care: Charting a New Course for a System in Crisis, which included two recommendations that emphasize coordinated, patient-centered quality measurement and information technology enhancements: Develop a national quality reporting program for cancer care as part of a learning health care system; and,Develop an ethically sound learning health care information technology system for cancer that enables real-time analysis of data from cancer patients in a variety of care settings. These recommendations underscore the need for independent national oversight, public-private collaboration, and substantial funding to create robust, patient-centered quality measurement and learning enterprises to improve the quality, accessibility, and affordability of cancer care in America.

Hospital factors and patient characteristics in the treatment of colorectal cancer: a population based study

BACKGROUND

The present study focuses on the analysis of social, clinical and hospital characteristics that can lead to disparities in the management and outcome of care. To that end, indicators of the quality of initial treatment delivered to newly-diagnosed colorectal cancer patients in a North-Western Region of Italy, were investigated using administrative data.

METHODS

The cohort includes all incident colorectal cancer patients (N = 24,187) selected by a validated algorithm from the Piedmont Hospital Discharge Record system over an 8-year period (2000-2007).Three indicators of quality of care in this population-based cohort were evaluated: the proportion of preoperative radiotherapy (RT) and of abdominoperineal (AP) resection in rectal cancer patients, and the proportion of postoperative in-hospital mortality in colorectal cancer patients.

RESULTS

Among rectal cancers, older patients were less likely to have preoperative RT, and more likely to receive an AP resection compared to younger patients. The probability of undergoing preoperative RT and AP resection was reduced in females compared to males (odds ratio (OR) 0.77, 95% confidence interval (CI) 0.64-0.93 and OR 0.78, 95%CI 0.69-0.89, respectively). However, there was a trend of increasing RT over time (p for trend <0.01). The probability of undergoing AP resection was increased in less-educated patients and in hospitals with a low caseload.A higher risk of postoperative in-hospital mortality was found among colorectal cancer patients who were older, male, (female versus male OR 0.71, 95%CI 0.60-0.84), unmarried (OR 1.32, 95%CI 1.09-1.59) or with unknown marital status.

CONCLUSIONS

The study provides evidence of the importance of social, clinical and hospital characteristics on the equity and quality of care in a Southern European country with an open-access public health care system.

Factors associated with satisfaction with prostate cancer care: results from Cancer of the Prostate Strategic Urologic Research Endeavor (CaPSURE)

OBJECTIVE

To evaluate the impact of demographic, clinical, treatment and patient-reported parameters on satisfaction with prostate cancer care. Despite the significant worldwide impact of prostate cancer, few data are available specifically addressing satisfaction with treatment-related care.

PATIENTS AND METHODS

CaPSURE comprises participants from 40 US sites who were monitored during and after their treatment course. Participants who were diagnosed with clinically localized prostate cancer after 1999 underwent radical prostatectomy, radiation therapy or primary androgen deprivation, and those who also completed the satisfaction questionnaire within 2 years of treatment were included in the present study. Satisfaction was measured using a validated instrument that assesses contact with providers, confidence in providers, communication skills, humanness and overall satisfaction. Multivariable linear regression analysis were performed to evaluate the independent relationships between demographic, clinical, treatment and patient-reported parameters and satisfaction.

RESULTS

Of the 3056 participants, 1927 (63%) were treated with radical prostatectomy, 843 (28%) were treated with radiation therapy and 286 (9%) were treated with primary androgen deprivation. Multivariable analysis showed that multiple patient-reported factors were independently associated with satisfaction, whereas clinical, demographic and treatment parameters were not. Baseline health-related quality of life, measured by the 36-item short-form health survey, baseline fear of cancer recurrence (all P < 0.01) and declines in the sexual (P = 0.03), urinary (P < 0.01) and bowel (P = 0.02) function domains of the University of California Los Angeles Prostate Cancer Index were all independently associated with satisfaction. Patient-reported outcomes were more strongly associated with satisfaction in the low-risk subgroup.

CONCLUSIONS

Patient-reported factors such as health-related quality of life and fear of cancer recurrence are independently associated with satisfaction with care. Pretreatment parameters should be used to identify populations at-risk for dissatisfaction to allow for intervention and/or incorporation into treatment decision-making.

Quality assessment in oncology

The movement to improve healthcare quality has led to a need for carefully designed quality indicators that accurately reflect the quality of care. Many different measures have been proposed and continue to be developed by governmental agencies and accrediting bodies. However, given the inherent differences in the delivery of care among medical specialties, the same indicators will not be valid across all of them. Specifically, oncology is a field in which it can be difficult to develop quality indicators, because the effectiveness of an oncologic intervention is often not immediately apparent, and the multidisciplinary nature of the field necessarily involves many different specialties. Existing and emerging comparative effectiveness data are helping to guide evidence-based practice, and the increasing availability of these data provides the opportunity to identify key structure and process measures that predict for quality outcomes. The increasing emphasis on quality and efficiency will continue to compel the medical profession to identify appropriate quality measures to facilitate quality improvement efforts and to guide accreditation, credentialing, and reimbursement. Given the wide-reaching implications of quality metrics, it is essential that they be developed and implemented with scientific rigor. The aims of the present report were to review the current state of quality assessment in oncology, identify existing indicators with the best evidence to support their implementation, and propose a framework for identifying and refining measures most indicative of true quality in oncologic care.

Prevalence, predictors, and patient outcomes associated with physician co-management: findings from the Los Angeles Women's Health Study

BACKGROUND

Physician co-management, representing joint participation in the planning, decision-making, and delivery of care, is often cited in association with coordination of care. Yet little is known about how physicians manage tasks and how their management style impacts patient outcomes.

OBJECTIVES

To describe physician practice style using breast cancer as a model. We characterize correlates and predictors of physician practice style for 10 clinical tasks, and then test for associations between physician practice style and patient ratings of care.

METHODS

We queried 347 breast cancer physicians identified by a population-based cohort of women with incident breast cancer regarding care using a clinical vignette about a hypothetical 65-year-old diabetic woman with incident breast cancer. To test the association between physician practice style and patient outcomes, we linked medical oncologists' responses to patient ratings of care (physician n=111; patient n=411).

RESULTS

After adjusting for physician and practice setting characteristics, physician practice style varied by physician specialty, practice setting, financial incentives, and barriers to referrals. Patients with medical oncologists who co-managed tasks had higher patient ratings of care.

CONCLUSION

Physician practice style for breast cancer is influenced by provider and practice setting characteristics, and it is an important predictor of patient ratings. We identify physician and practice setting factors associated with physician practice style and found associations between physician co-management and patient outcomes (e.g., patient ratings of care).

Variation in quality of care among older men with localized prostate cancer

BACKGROUND

The objective of this study was to assess the racial and ethnic disparities in outcomes and their association with process-of-care measures for elderly Medicare recipients with localized prostate cancer.

METHODS

The Surveillance, Epidemiology, and End Results-Medicare databases for the period from 1995 to 2003 were used to identify African-American men, non-Hispanic white men, and Hispanic men with localized prostate cancer, and data were obtained for the 1-year period before the diagnosis of prostate cancer and up to 8 years postdiagnosis. The short-term outcomes of interest were complications, emergency room visits, readmissions, and mortality; the long-term outcomes of interest were prostate cancer-specific mortality and all-cause mortality; and process-of-care measures of interest were treatment and time to treatment. Cox proportional hazards regression, logistic regression, and Poisson regression were used to study the racial and ethnic disparities in outcomes and their association with process-of-care measures.

RESULTS

Compared with non-Hispanic white patients, African-American patients (Hazard ration [HR], 1.43; 95% confidence interval [CE], 1.19-1.86) and Hispanic patients (HR=1.39; 95% CI, 1.03-1.84) had greater hazard of long term prostate specific mortality. African-American patients also had greater odds of emergency room visits (odds ratio, 1.4; 95% CI, 1.2-1.7) and greater all-cause mortality (HR, 1.39; 95% CI, 1.3-1.5) compared with white patients. The time to treatment was longer for African-American patients and was indicative of a greater hazard of all-cause, long-term mortality. Hispanic patients who underwent surgery or received radiation had a greater hazard of long-term prostate-specific mortality compared with white patients who received hormone therapy.

CONCLUSIONS

Racial and ethnic disparities in outcomes were associated with process-of-care measures (the type and time to treatment). The current results indicated that there is an opportunity to reduce these disparities by addressing these process-of-care measures.

Quality indicators for multiple sclerosis

Determining whether persons with multiple sclerosis (MS) receive appropriate, comprehensive healthcare requires tools for measuring quality. The objective of this study was to develop quality indicators for the care of persons with MS. We used a modified version of the RAND/UCLA Appropriateness Method in a two-stage process to identify relevant MS care domains and to assess the validity of indicators within high-ranking care domains. Based on a literature review, interviews with persons with MS, and discussions with MS providers, 25 MS symptom domains and 14 general health domains of MS care were identified. A multidisciplinary panel of 15 stakeholders of MS care, including 4 persons with MS, rated these 39 domains in a two-round modified Delphi process. The research team performed an expanded literature review for 26 highly ranked domains to draft 86 MS care indicators. Through another two-round modified Delphi process, a second panel of 18 stakeholders rated these indicators using a nine-point response scale. Indicators with a median rating in the highest tertile were considered valid. Among the most highly rated MS care domains were appropriateness and timeliness of the diagnostic work-up, bladder dysfunction, cognition dysfunction, depression, disease-modifying agent usage, fatigue, integration of care, and spasticity. Of the 86 preliminary indicators, 76 were rated highly enough to meet predetermined thresholds for validity. Following a widely accepted methodology, we developed a comprehensive set of quality indicators for MS care that can be used to assess quality of care and guide the design of interventions to improve care among persons with MS.

Psychosocial implications for the patient with a high-grade glioma

The purpose of this article was to explore the psychosocial implications of being diagnosed with a high-grade glioma, World Health Organization III/IV and IV/IV, to better inform healthcare providers and researchers of the patient experience. The information is the cumulative data collected from hundreds of patient interviews in a large metropolitan brain tumor clinic over a 7-year period. Three themes of loss emerged--loss of independence, loss of self, and loss of relationships. This information is presented on behalf of the patients for acknowledgement of their experience and for identification of the need for increased psychological and concrete services to better serve this population.

Coordinating cancer care: patient and practice management processes among surgeons who treat breast cancer

OBJECTIVES

The Institute of Medicine has called for more coordinated cancer care models that correspond to initiatives led by cancer providers and professional organizations. These initiatives parallel those underway to integrate the management of patients with chronic conditions.

METHODS

We developed 5 breast cancer patient and practice management process measures based on the Chronic Care Model. We then performed a survey to evaluate patterns and correlates of these measures among attending surgeons of a population-based sample of patients diagnosed with breast cancer between June 2005 and February 2007 in Los Angeles and Detroit (N = 312; response rate, 75.9%).

RESULTS

Surgeon practice specialization varied markedly with about half of the surgeons devoting 15% or less of their total practice to breast cancer, whereas 16.2% of surgeons devoted 50% or more. There was also large variation in the extent of the use of patient and practice management processes with most surgeons reporting low use. Patient and practice management process measures were positively associated with greater levels of surgeon specialization and the presence of a teaching program. Cancer program status was weakly associated with patient and practice management processes.

CONCLUSION

Low uptake of patient and practice management processes among surgeons who treat breast cancer patients may indicate that surgeons are not convinced that these processes matter, or that there are logistical and cost barriers to implementation. More research is needed to understand how large variations in patient and practice management processes might affect the quality of care for patients with breast cancer.

Use of interpreters by physicians treating limited English proficient women with breast cancer: results from the provider survey of the Los Angeles Women's Health Study

OBJECTIVE

Little is known about how cancer physicians communicate with limited English proficient (LEP) patients. We studied physician-reported use and availability of interpreters.

DATA SOURCES

A 2004 survey was fielded among physicians identified by a population-based sample of breast cancer patients. Three hundred and forty-eight physicians completed mailed surveys (response rate: 77 percent) regarding the structure and organization of care.

STUDY DESIGN AND SETTINGS

We used logistic regression to analyze use and availability of interpreters.

PRINCIPAL FINDINGS

Most physicians reported treating LEP patients. Among physicians using interpreters within the last 12 months, 42 percent reported using trained medical interpreters, 21 percent telephone interpreter services, and 75 percent reported using untrained interpreters to communicate with LEP patients. Only one-third of physicians reported good availability of trained medical interpreters or telephone interpreter services when needed. Compared with HMO physicians, physicians in solo practice and single-specialty medical groups were less likely to report using trained medical interpreters or telephone interpreter services, and they were less likely to report good availability of these services.

CONCLUSIONS

There were important practice setting differences predicting use and availability of trained medical interpreters and telephone interpretation services. These findings may have troubling implications for effective physician-patient communication critically needed during cancer treatment.

Outcome indicators in palliative care--how to assess quality and success. Focus group and nominal group technique in Germany

Purpose

The call for clinically relevant outcome criteria has been raised, as assessment of adequate quality of service providers is essential with increasing momentum in the development of palliative care in most European countries. The aim of this study is to investigate important dimensions and indicators for assessment and evaluation of palliative care from the perspective of multi-disciplinary German experts working over years in the field of palliative care.

Methods

A focus group, using the structured consensus method of the improved nominal group technique (INGT), with nine experts from different disciplines was conducted in Germany.

Results

An abundance of topics (16) were identified, pointing at the complexity of the issue. Main topics were: quality of life, needs assessments of patients and relatives, resource assessment, surveillance of decision-making processes, as well as spiritual well-being. The following properties were claimed as essential for outcome criteria sensitivity, without additional burden on patients, easy applicability, scientific validity, and helpful for communication within the team, ethical discussions as well as for quality management.

Conclusions

The study identified topics considered important by experts in clinical practise. The discussions exposed the diversity of demands on outcome assessment put up by different stakeholder groups. This and the high number of relevant items show the complexity for the agreement on a unique set of outcome criteria. Further research considering other perspectives is needed.

Quality of life and satisfaction with outcome among prostate-cancer survivors

BACKGROUND

We sought to identify determinants of health-related quality of life after primary treatment of prostate cancer and to measure the effects of such determinants on satisfaction with the outcome of treatment in patients and their spouses or partners.

METHODS

We prospectively measured outcomes reported by 1201 patients and 625 spouses or partners at multiple centers before and after radical prostatectomy, brachytherapy, or external-beam radiotherapy. We evaluated factors that were associated with changes in quality of life within study groups and determined the effects on satisfaction with the treatment outcome.

RESULTS

Adjuvant hormone therapy was associated with worse outcomes across multiple quality-of-life domains among patients receiving brachytherapy or radiotherapy. Patients in the brachytherapy group reported having long-lasting urinary irritation, bowel and sexual symptoms, and transient problems with vitality or hormonal function. Adverse effects of prostatectomy on sexual function were mitigated by nerve-sparing procedures. After prostatectomy, urinary incontinence was observed, but urinary irritation and obstruction improved, particularly in patients with large prostates. No treatment-related deaths occurred; serious adverse events were rare. Treatment-related symptoms were exacerbated by obesity, a large prostate size, a high prostate-specific antigen score, and older age. Black patients reported lower satisfaction with the degree of overall treatment outcomes. Changes in quality of life were significantly associated with the degree of outcome satisfaction among patients and their spouses or partners.

CONCLUSIONS

Each prostate-cancer treatment was associated with a distinct pattern of change in quality-of-life domains related to urinary, sexual, bowel, and hormonal function. These changes influenced satisfaction with treatment outcomes among patients and their spouses or partners.

Proposed quality measures for palliative care in the critically ill: a consensus from the Robert Wood Johnson Foundation Critical Care Workgroup

For critically ill patients and their loved ones, high-quality health care includes the provision of excellent palliative care. To achieve this goal, the healthcare system needs to identify, measure, and report specific targets for quality palliative care for critically ill or injured patients. Our objective was to use a consensus process to develop a preliminary set of quality measures to assess palliative care in the critically ill. We built on earlier and ongoing efforts of the Robert Wood Johnson Foundation Critical Care End-of-Life Peer Workgroup to propose specific measures of the structure and process of palliative care. We used an informal iterative consensus process to identify and refine a set of candidate quality measures. These candidate measures were developed by reviewing previous literature reviews, supplementing the evidence base with recently published systematic reviews and consensus statements, identifying existing indicators and measures, and adapting indicators from related fields for our objective. Among our primary sources, we identified existing measures from the Voluntary Hospital Association's Transformation of the ICU program and a government-sponsored systematic review performed by RAND Health to identify palliative care quality measures for cancer care. Our consensus group proposes 18 quality measures to assess the quality of palliative care for the critically ill and injured. A total of 14 of the proposed measures assess processes of care at the patient level, and four measures explore structural aspects of critical care delivery. Future research is needed to assess the relationship of these measures to desired health outcomes. Subsequent measure sets should also attempt to include outcome measures, such as patient or surrogate satisfaction, as the field develops the means to rigorously measure such outcomes. The proposed measures are intended to stimulate further discussion, testing, and refinement for quality of care measurement and enhancement.

Defining and measuring quality palliative and end-of-life care in the intensive care unit

Quality of health care is primarily concerned with the provision of health services that intend to lead to valued health outcomes and are based and driven by evidence. Among other desired health outcomes are patient-and-family-centered values consistent with proficient palliative and end-of-life care in the intensive care unit. The research in palliative and end-of-life care has elucidated important domains for quality care-in general, major targets for improvement are known. However, assessment of quality at local and national levels remains relevant as innovators select where to begin quality improvement efforts and the healthcare system evaluates the efficacy and potential harm from care delivery transformations. In this article, I endeavor to impart a practical framework for quality of end-of-life care assessment with the goal of guiding the selection of initiatives and evaluating cycles of innovation. I will ground this quality evaluation by reviewing palliative and end-of-life care and the known domains for quality palliative care. Although the field has identified candidate indicators for evaluating palliative and end-of-life care in the intensive care unit, future work is needed to operationalize assessment for important aspects of care with valid, reliable, acceptable, efficient, and responsive measures.

Towards using administrative databases to measure population-based indicators of quality of end-of-life care: testing the methodology

This study is concerned with methods to measure population-based indicators of quality end-of-life care. Using a retrospective cohort approach, we assessed the feasibility, validity and reliability of using administrative databases to measure quality indicators of end-of-life care in two Canadian provinces. The study sample consisted of all females who died of breast cancer between 1 January 1998 and 31 December 2002, in Nova Scotia or Ontario, Canada. From an initial list of 19 quality indicators selected from the literature, seven were determined to be fully measurable in both provinces. An additional seven indicators in one province and three in the other province were partially measurable. Tests comparing administrative and chart data show a high level of agreement with inter-rater reliability, confirming consistency in the chart abstraction process. Using administrative data is an efficient, population-based method to monitor quality of care which can compliment other methods, such as qualitative and purposefully collected clinical data.

Opportunities for disease state management in prostate cancer

In this paper, we examine how the management of prostate cancer lends itself to a disease state management (DSM)-based approach, and propose a framework that emphasizes the patient-provider-caregiver triad in managing the long-term implications of the condition. There is often no clearly superior approach to the management of patients with prostate cancer (eg, watchful waiting and hormonal therapy), and each option entails different trade-offs in quality of life. Ideally, the physician and patient discuss the options, issues, and patient preferences for treatment through the shared decision-making process. A family caregiver such as the spouse of the patient is often involved in the treatment decision and in the long-term management of the cancer experience. In order to develop a DSM program supporting both patient and caregiver, educational, psychosocial, and health care system support needs should be tailored to each phase of cancer treatment/management. To embrace the unique aspects of prostate cancer management, the proposed framework emphasizes communication among the patient-caregiver-provider triad, inclusion of family caregivers in the program, cancer phase-specific support, and psychosocial services as a basis for implementation and evaluation of a DSM program in prostate cancer.

Application of explicit process of care measurement to rheumatoid arthritis: Moving from evidence to practice

OBJECTIVE

To construct quality measures with measurement validity and meaning for clinicians.

METHODS

We conducted a prospective cohort study of rates of change in disease-modifying antirheumatic drug (DMARD) and/or systemic corticosteroid drug or dose for 568 patients with rheumatoid arthritis (RA) across 6,159 clinical encounters within 12 months to examine how changes in clinical specifications change adherence.

RESULTS

Rates of DMARD change were sensitive to specifications regarding the intensity of disease activity (severe or moderate), duration of specified disease activity, and length of the observation period. Over 12 months, the proportions of 377 patients with severe disease activity observed for 1-month, 2-month, and 3-month time blocks who had a change in DMARD drug or dose were 36%, 57%, and 74%, respectively. Over 12 months, a change in DMARD drug or dose was observed for 44%, 50%, and 68% of 377 patients with severe disease within 3 months, 6 months, and 12 months, respectively, of the patient meeting criteria for severe disease activity. A change in DMARD drug or dose was observed for 21%, 23%, and 34% of 149 patients with moderate disease activity within 3, 6, and 12 months, respectively, of the patient meeting criteria for moderate disease activity.

CONCLUSION

Rates of pharmacologic interventions for patients with moderate and severe RA disease activity vary substantially by intensity and duration of disease activity and by duration of period for observing change. Lack of precision in explicit process criteria could substantially mislead comparisons of quality of care across comparison groups.

Methodological challenges associated with patient responses to follow-up longitudinal surveys regarding quality of care

OBJECTIVE

To illustrate, using empirical data, methodological challenges associated with patient responses to longitudinal surveys regarding the quality of process of care and health status, including overall response rate, differential response rate, and stability of responses with time.

DATA SOURCES/STUDY SETTING

Primary patient self-report data were collected from 30,308 patients in 1996 and 13,438 patients in 1998 as part of a two-year longitudinal study of quality of care and health status of patients receiving care delivered by 63 physician organizations (physician groups) across three West Coast states.

STUDY DESIGN

We analyzed longitudinal, observational data collected by Pacific Business Group on Health (PBGH) from patients aged 18-70 using a four-page survey in 1996 and a similar survey in 1998 to assess health status, satisfaction, use of services, and self-reported process of care. A subset of patients with self-reported chronic disease in the 1996 study received an enriched survey in 1998 to more fully detail processes of care for patients with chronic disease.

DATA COLLECTION/EXTRACTION METHODS

We measured response rate overall and separately for patients with chronic disease. Logistic regression was used to assess the impact of 1996 predictors on response to the follow-up 1998 survey. We compared process of care scores without and with nonresponse weights. Additionally, we measured stability of patient responses over time using percent agreement and kappa statistics, and examined rates of gender inconsistencies reported across the 1996 and 1998 surveys.

PRINCIPAL FINDINGS

In 1998, response rates were 54 percent overall and 63 percent for patients with chronic disease. Patient demographics, health status, use of services, and satisfaction with care in 1996 were all significant predictors of response in 1998, highlighting the importance of analytic strategies (i.e., application of nonresponse weights) to minimize bias in estimates of care and outcomes associated with longitudinal quality of care and health outcome analyses. Process of care scores weighted for nonresponse differed from unweighted scores (p<.001). Stability of responses across time was moderate, but varied by survey item from fair to excellent.

CONCLUSIONS

Longitudinal analyses involving the collection of data from the same patients at two points in time provide opportunities for analysis of relationships between process and outcomes of care that cannot occur with cross-sectional data. We present empirical results documenting the scope of the problems and discuss options for responding to these challenges. With increasing emphasis in the United States on quality reporting and use of financial incentives for quality in the health care market, it is important to identify and address methodological challenges that potentially threaten the validity of quality-of-care assessments.