Recollected versus contemporary patient reports of pre-operative symptoms in men undergoing transurethral prostatic resection for benign disease

Agreement between retrospectively and contemporaneously collected patient-reported outcome measures (PROMs) in hip and knee replacement patients

Purpose

To investigate the relationship between retrospectively and contemporaneously collected patient-reported outcome measures (PROMs) and the influence on this relationship of patients’ age and socio-economic status and the length of time.

Methods

Patients undergoing hip or knee replacement in four hospitals who had completed a pre-operative questionnaire were invited to recall their pre-operative health status shortly after surgery. The questionnaires included a disease-specific (Oxford Hip Score; Oxford Knee Score) and generic (EQ-5D-3L) PROM. Consistency and absolute agreement between contemporary and retrospective reports were investigated using intraclass correlations (ICCs). Differences were visualised using Bland–Altman plots. Linear regression analysis explored whether retrospective can predict contemporary PROMs.

Results

Patients’ recalled health statuses were similar to their contemporaneous reports, with no significant systematic bias. Absolute agreement for disease-specific PROMs was very strong (ICC 0.82) and stronger than for the generic PROM (ICC 0.60, 0.62). Agreement was consistently strong across the range of severity of a patient’s condition, age and socio-economic status. Patients’ age and socio-economic status had no significant influence on size of difference and direction of recall, although reliability of recall was slightly worse among the over-75s versus under-60s for hips (Oxford Hip Score ICC 0.88 vs. 0.78). Mean retrospective PROMs for groups or populations of patients can reliably predict what mean contemporary reports of PROMs would have been.

Conclusion

Retrospective PROMs can be used to obtain a baseline assessment of health status when contemporary collection is not feasible or cost effective. Research is needed to determine the feasibility of retrospective PROMs in emergency admissions.

Retrospectively patient-reported pre-event health status showed strong association and agreement with contemporaneous reports

OBJECTIVE

The unpredictability of the occurrence of illnesses and injuries leading to most emergency admissions to hospital makes it impossible prospectively to collect preadmission patient-reported outcome measures (PROMs). Our aims were to review the evidence for using retrospective PROMs to determine pre-event health status and the validity of using general population norms instead of retrospective PROMs.

STUDY DESIGN AND SETTING

Searches of Medline, PsycINFO, Embase, Global Health, and Health Management information. Six studies met the inclusion criteria for the first aim, and 11 studies addressed the second aim. Narrative syntheses were conducted.

RESULTS

Strong associations were found between retrospective and contemporary PROMs in 21 of 30 comparisons (correlation coefficients over 0.68) and 20 of 24 showed strong agreement for continuous measures (intraclass correlations over 0.75). Categorical measures revealed only fair to moderate levels of agreement (kappa 0.3-0.6). Associations were stronger for indices than for individual items and for shorter time intervals. The direction of differences was inconsistent. Retrospective PROMs reported by elderly patients were similar to the general population but younger adults had been healthier.

CONCLUSION

Retrospective collection offers a means of assessing PROMs in unexpected emergency admissions. However, further research is needed to establish the best policy for their use.

The Incontinence Outcome Questionnaire: an instrument for assessing patient-reported outcomes after surgery for stress urinary incontinence

The aim of this study is to develop and psychometrically test a questionnaire (Incontinence Outcome Questionnaire, IOQ) for assessing quality of life (QOL) after surgery for stress urinary incontinence that can be used as a single measurement after the intervention. A total of 171 patients who underwent the tension-free vaginal tape (TVT/TVT-O) operation for stress urinary incontinence completed the King s Health Questionnaire (KHQ), the Short Form-12 (SF-12) and the IOQ. The internal consistency, internal and external validity and responsiveness of the IOQ were tested. The IOQ-QOL subscale showed good internal consistency (Cronbach's alpha=0.83) and significant correlations with the KHQ and the SF-12 scales (r=0.30-0.56). Partial correlations with objective parameters showed a significant relation for the IOQ-QOL subscale with objective continence/incontinence. The results of our study suggest that the IOQ is a valid and reliable instrument for assessing QOL after incontinence surgery and can be used if baseline or pre-operative data are unavailable.

Abnormal radiological findings and a decreased carbon monoxide transfer factor can persist long after the acute phase of Legionella pneumophila pneumonia

Pulmonary abnormalities may persist long after the acute phase of legionnaires disease (LD). In a cohort of 122 survivors of an outbreak of LD, 57% were still experiencing an increased number of symptoms associated with dyspnea at a mean of 16 months after recovery from acute-phase LD. For 86 of these patients, additional evaluation involving high-resolution computed tomography (HRCT) of the lung revealed pulmonary abnormalities in 21 (24%); abnormal HRCT findings generally presented as discrete and multiple radiodensities. Residual pulmonary abnormalities were associated with a mean reduction of 20% in the gas transport capacity of the lung. This latter sign could not be used to explain the increased symptoms of dyspnea reported by patients. Receipt of mechanical ventilation during the acute phase of LD, delayed initiation of adequate antibiotic therapy, and chronic obstructive pulmonary disease were identified as risk factors for the persistence of lung abnormalities.

Quality of Life Following Treatment for Early Prostate Cancer: Does Low Dose Rate (LDR) Brachytherapy Offer a Better Outcome? A Review

OBJECTIVE

Due to a lack of evidence from randomised studies, there is little agreement on the best form of treatment among men who require curative treatment for prostate cancer. The relative impact of the various treatments on symptoms and health-related quality of life is also controversial. We review the literature on quality of life changes following low dose rate brachytherapy (BXT) and compare BXT to other treatments for early prostate cancer.

METHODS

Systematic literature review 1988-2003 (Medline).

KEYWORDS

Brachytherapy; Radical prostatectomy; External beam radiotherapy; Quality of life; Symptoms.

RESULTS

Review of the current literature suggests that radical prostatectomy, external beam radiotherapy and BXT either alone or in combination with supplementary external beam radiotherapy offer good long-term health-related quality of life. However differences exist in the toxicity of treatment in terms of erectile function, voiding difficulty, incontinence and bowel function. These differences seem to persist for at least 3-5 years post-treatment though longer-term quality of life outcomes from modern techniques are unknown.

CONCLUSION

BXT offers a high probability of maintaining continence, potency and normal rectal function though both storage and voiding urinary symptoms have been reported. Addition of androgen deprivation and EBRT to BXT may increase urinary, bowel and sexual toxicity of treatment. Quality of life outcome following brachytherapy compares favourably with other radical treatment options for the management of early prostate cancer.

Prospective vs retrospective assessment of lower urinary tract symptoms in patients with advanced prostate cancer: the effect of ‘response shift’

OBJECTIVE

To compare prospectively obtained symptom scores (pre-tests) with retrospective assessment (then-tests) in patients with newly diagnosed advanced prostate cancer.

PATIENTS AND METHODS

Patients with newly diagnosed locally advanced or metastatic prostate cancer were recruited. They completed the International Prostate Symptom Score (IPSS) and Symptom Problem Index (SPI) before starting treatment. At 3 and 6 months after diagnosis they again completed these questionnaires, but also retrospectively reassessed their initial symptom level. Healthy age-matched controls were recruited from primary care and completed the same questionnaires; in all, 76 patients and 17 controls participated.

RESULTS

The IPSS and SPI scores decreased significantly over the 6 months of the study. Patients retrospectively rated their level of symptoms and symptom bother as higher than their contemporaneous assessments. This was not the case in the control group.

CONCLUSION

These results question the assumption that contemporaneously collected pre-test scores are interchangeable with retrospectively assessed then-tests. This suggests that caution is required when comparing the results of studies that use these two alternative techniques of data collection. The difference between then-test and pre-test scores may represent an example of a phenomenon termed 'response shift', in which, by adapting to their disease, patients changed the internal standards by which they assessed their symptoms.

Assessing symptoms before hysterectomy: is the medical record accurate?

OBJECTIVE

Our purpose was to evaluate the agreement between the documentation of symptoms leading to hysterectomy and the assessment of those symptoms by the patient.

STUDY DESIGN

A retrospective study was performed of 497 women in southern California who had hysterectomies. Sensitivity, specificity, and kappa statistics were calculated for the medical records and were compared with patient interviews for the presence and severity of symptoms.

RESULTS

The medical record was 93% sensitive and 61% specific for identifying bleeding and 79% sensitive and 55% specific for identifying pain. Overall agreement between physician records and patient interviews was moderate for bleeding (kappa, 0.55-0.58), fair for pain (kappa, 0.29-0.34), and poor for impairment as a result of bleeding or pain (kappa, 0.0-0.14).

CONCLUSIONS

Physician overestimation of symptoms could lead to overuse of hysterectomy, whereas underestimation could result in underuse. Our results suggest that both underestimation and overestimation occur for patients with abnormal bleeding, pain, or both. If physicians accurately assess symptoms but fail to document them, examinations of appropriateness will be faulty unless patients are interviewed.

Controlling for chance agreement in the validation of medical expert systems with no gold standard: PNEUMON-IA and RENOIR revisited

In the validation of medical expert systems, agreement among different human specialists on a random sample of cases may be taken as a substitute to a missing gold standard. Distance measures between pairs of experts, extensively described in previous studies, do not take into account the influence of chance-expected agreement. A weighted kappa index, with three different weighting schemes, is proposed as an alternative to be applied in the general situation of N cases assessed by E experts about K possible diagnoses, each of them qualified with one of G ordinal categories. A hierarchical cluster analysis, applied to the kappa matrices generated, allows for the classification of the expert system among clinical specialists, providing a relative assessment of its diagnostic ability. The above methodology is applied to the validation of two medical expert systems, PNEUMON-IA and RENOIR.

Accuracy of recall in health-related quality-of-life assessment among men treated for prostate cancer

PURPOSE

To determine the accuracy of patient recall of health-related quality of life (HRQOL) in men who have undergone radical prostatectomy for early-stage prostate cancer.

PATIENTS AND METHODS

Patients enrolled onto a longitudinal, observational cohort study of HRQOL after radical prostatectomy for early-stage prostate cancer were asked to assess their baseline HRQOL before surgery. They were later asked to recall their baseline HRQOL at intervals of 7 to 37 months after surgery. The two views of baseline HRQOL (actual and recall) were compared. HRQOL was measured with established instruments (the RAND 12-Item Short-Form Health Survey and a validated short form of the University of California Los Angeles Prostate Cancer Index) that addressed impairment in the physical, mental, urinary, bowel, and sexual domains.

RESULTS

Overall, recall was poor. Patients tended to remember their baseline HRQOL as being better than it actually was. This effect was particularly striking for urinary and sexual function. Greater education and younger age diminished this effect in some domains. The effect did not vary with time since surgery.

CONCLUSION

Men undergoing radical prostatectomy for early-stage prostate cancer do not accurately recall their pretreatment HRQOL when asked several months or years later. This recall bias is constant throughout a period of 6 months to 3 years after surgery. By collecting data before treatment and observing subjects longitudinally, investigators can ensure that HRQOL changes are analyzed in the context of any impairment that may have been present at baseline. If a longitudinal study is not feasible, then great caution must be used if patients are asked to recall their pretreatment HRQOL.

Development and validation of the Menorrhagia Outcomes Questionnaire

OBJECTIVE

To develop and evaluate the acceptability, reliability and validity of a short, patient-based questionnaire for assessing the outcomes of surgical treatment for menorrhagia due to benign disease.

DESIGN

A psychometric study by postal survey.

SETTING

Five hospitals in southeast England.

SAMPLE

One hundred and eleven women undergoing hysterectomy for menorrhagia due to benign disease.

METHODS

Data from a long research questionnaire used in the North West Thames Hysterectomy Study were analysed using standard psychometric methods to identify the subset of items which were the most scientifically sound indicators of outcome. The Menorrhagia Outcomes questionnaire is a 26-item questionnaire which covers symptoms, post-operative complications, quality of life, and women's satisfaction with outcome. The questionnaire was field tested for acceptability, reliability and validity by postal survey.

RESULTS

The Menorrhagia Outcomes Questionnaire was found to be highly acceptable to women and showed excellent internal consistency, test-retest reliability, criterion and construct validity.

CONCLUSION

The Menorrhagia Outcomes Questionnaire is a practical and scientifically sound measure of outcome from the woman's perspective following surgical treatment for menorrhagia due to benign disease. It takes less than five minutes to complete, is appropriate for use with different surgical treatments for menorrhagia (eg. hysterectomy, endometrial resection, laser ablation) and is feasible for routine monitoring of large numbers of women by postal survey. Most importantly, this questionnaire has been shown to perform well from a scientific point view, having met standard psychometric criteria for reliability and validity.

Development and validation of an audit instrument: the Prostate Outcomes Questionnaire

OBJECTIVE

To develop a short, patient-based questionnaire for auditing the outcomes of treatment for benign prostatic hyperplasia (BPH) and to evaluate the acceptability, reliability and validity of the measure.

PATIENTS AND METHODS

Data from a long research questionnaire used in the Oxford/North West Thames Prostatectomy Study were analysed to identify the subset of items which contained the most scientifically sound indicators of outcome. Items were selected on the basis of standard psychometric analyses to develop a short questionnaire, the Prostate Outcomes Questionnaire (POQ), a 27-item instrument covering urinary symptoms, complications after surgery, quality of life and patient satisfaction with outcome. The POQ was field tested for acceptability, reliability and validity in a postal survey of 125 men undergoing transurethral resection of the prostate for BPH from seven hospitals in south-east England.

RESULTS

The POQ was highly acceptable to patients, as indicated by a 95% response rate, the absence of 'floor' and 'ceiling' effects and a low proportion of missing data. It showed excellent internal consistency reliability (Cronbach's alpha of 0.82-0.93 for the five summary scales and a mean item-total correlation of 0.56) and test-retest reliability (test-retest correlations for items were 0.40-1.00, with a mean test-retest correlation of 0.85, and for summary scales of 0.91-0.95). Construct validity was confirmed by: high intercorrelations between the five summary scales and the total score (0.88-0.95), with a pattern of intercorrelations among specific subscales that showed item-convergent and discriminant validity; higher scores for patients who reported an improvement after surgery than in those who were not improved (P < 0.001); the expected gradient of scores for patients reporting different levels of symptom distress (P < 0.001); high correlations with the longer parent questionnaire (0.75-0.88); and low to moderate correlations with the Nottingham Health Profile and Activities of Daily Living scores (0.15-0.67), with the pattern of correlations providing evidence of scale convergent and discriminant validity. Correlations with age and social class were low, suggesting that responses were not biased by sociodemographic factors.

CONCLUSION

The POQ is a practical and scientifically sound patient-based measure of outcome after treatment for BPH which can be used for routine audit. It takes < 5 min to complete, is feasible for routine monitoring of large numbers of patients by postal survey, and is accompanied by a Users' Manual which provides practical help in conducting a local patient survey, and a computer program for scoring data. Most importantly, the POQ has been shown scientifically to perform well, having met standard psychometric criteria for reliability and validity.

The feasibility and cost of a large multicentre audit of process and outcome of prostatectomy

Objective--To determine the feasibility of performing multicentre process and outcome audits of common interventions taking prostatic procedures as an example. Design--Prospective, cohort study. Setting--All National Health Service and independent hospitals in Northern, Wessex, Mersey, and South West Thames health regions. Patients--5361 men undergoing prostatectomy identified by 103 of the 107 urologists and general surgeons performing prostatectomy in the study regions. Main measures-- Rates of participation by surgeons and patients; completeness of clinical data provided by surgeons; patient response rate and completeness of patient derived data; and cost. Results--Most surgeons (103,96%) agreed to participate. Overall, the proportion of eligible patients invited to take part was high (89%), although this was only measured in South West Thames, where dedicated data collectors were employed. Few men (80, 1.5%) declined to participate. Of those surviving for three months after surgery, 82.4% (4226) completed and returned the postal questionnaire. The response rate was higher in South West Thames (86.7%) than in the other regions (80.6%-80.8%). The audit was well received: 91% of patients found the questionnaire easy to complete and only 2.3% of them disapproved. Completeness of data was high with both the hospital and patient questionnaires. Missing data occurred in less than 5% of responses to most questions. The attributable cost was 34.50 pounds per patient identified or 44 pounds for patients in whom either the treatment outcome or vital status was known three months after their prostatectomy. Conclusions--This multicentre audit of process and outcome of prostatectomy proved feasible in terms of surgeon participation, patient identification, and the quantity and quality of data collection. Whether the cost was warranted will depend on how surgeons use the audit data to modify their practice.