Patients recall worse preoperative pain after shoulder arthroplasty than originally reported: a study of recall accuracy using the American Shoulder and Elbow Surgeons score

Do Patients Accurately Recall Their Preoperative Symptoms After Elective Orthopedic Procedures?

Patient-reported outcome measures are a frequent tool used to assess orthopedic surgical outcomes. However, recall bias is a potential limitation of these tools when used retrospectively, as they rely on patients to accurately recall their preoperative symptoms. A database search of Cochrane Library, PubMed, Medline Ovid, and Scopus until May 2021 was completed in duplicate by two reviewers. Studies considered eligible for inclusion were those which reported on patient recall bias associated with orthopedic surgery. The primary outcome of interest investigated was the accuracy of patient recollection of preoperative health status. Any factors that were identified as affecting patient recall were secondary outcomes of interest. Of the 4,065 studies initially screened, 20 studies with 3,454 patients were included in the final analysis. Overall, there were 2,371 (69%) knee and hip patients, 422 (12%) shoulder patients, 370 (11%) spine patients, 208 (6%) other upper extremity patients, and 83 (2%) foot and ankle patients. Out of the eight studies that evaluated patient recall within three months postoperatively, seven studies concluded that patient recall is accurate. Out of the 13 studies that evaluated patient recall beyond three months postoperatively, nine studies concluded that patient recall is inaccurate. The accuracy of patient recall of preoperative symptoms after elective orthopedic procedures is not reliable beyond three months postoperatively.

High recall bias in retrospective assessment of the pediatric International Knee Documentation Committee Questionnaire (Pedi-IKDC) in children with knee pathologies

PURPOSE

The increasing incidence of knee injuries among children is well known by sports physicians. Papers dealing with this topic have often collected patient-reported outcomes measures (PROMs) in a retrospective manner; this limitation could lead to a misinterpretation of the results, because pediatric patients might not remember their preoperative conditions adequately. This study aims to evaluate the reliability and the reproducibility of the IKDC pediatric score when administered retrospectively at a 12-month follow-up.

METHODS

From September 2018 and June 2019, all patients aged 7-18 scheduled for surgery due to different knee pathologies in a single center were considered eligible. Parents were contacted by phone for consent. An open-source platform was implemented to collect the responses: two surveys were created (Q1, Q2). They included general information and the Pedi-IKDC score. Q1 was completed prospectively, while Q2 was completed 12 months after surgery. The two questionnaires were identical, and patients were carefully advised to complete Q2 recalling their health status before surgery. ICC and the concordance correlation coefficient (ρ_c) were used to assess the reproducibility between the prospective and recalled scores.

RESULTS

Sixty-six patients responded to Q1 and Q2, and the mean age was 12.9 ± 2.2 years at Q1 and 14.1 ± 2.2 years at Q2. The mean time between Q1 and Q2 was 14.1 ± 2.1 months. Between prospective-IKDC and recall-IKDC, the ICC coefficient was "poor" at 0.32 (CI 0.09 to 0.5) and the ρ_c was "poor" at 0.4 (CI 0.29 to 0.51). Mean prospective-IKDC was 76.8 ± 23.52 mean recalled-IKDC was 60.4 ± 11.5 (P < 0.0001), while mean difference was -16.3 ± 2.09. Simple linear regression models showed that Δ-IKDC is independently associated with age at Q1 (R² = 0.2676; P0.0001)  and prospective-IKDC (R² = 0.653; P < 0.0001).

CONCLUSIONS

Retrospective collection of the Pedi-IKDC score is not reliable and has high recall bias. This should be avoided in children with knee conditions.

LEVEL OF EVIDENCE

III.

Using retrospective pretests to obtain subjective patient data: A case example

In an effort to expedite the publication of articles, AJHP is posting manuscripts online as soon as possible after acceptance. Accepted manuscripts have been peer-reviewed and copyedited, but are posted online before technical formatting and author proofing. These manuscripts are not the final version of record and will be replaced with the final article (formatted per AJHP style and proofed by the authors) at a later time.

Which Risk Factors Are Associated with Pain and Patient-reported Function in Patients with a Rotator Cuff Tear?

BACKGROUND

Patient-reported measures guide physicians in clinical decision making and therefore it is critical to determine what clinical factors are associated with these scores. Psychological and physical factors are commonly studied separately in patients with rotator cuff tears to determine their influence on outcomes. It is well established that psychological distress and scapular motion change in the presence of a symptomatic rotator cuff tear. However, these factors have not been studied simultaneously in a clinical setting to determine their association with shoulder outcome scores.

QUESTION/PURPOSE

After controlling for relevant confounding variables, what physical and psychological factors are associated with better (1) American Shoulder and Elbow Surgeons (ASES) scores for function, (2) ASES pain scores, and (3) total ASES scores?

METHODS

Fifty-nine patients with a potential symptomatic rotator cuff tear were recruited and agreed to participate in this cross-sectional study. Of those, 85% (50 of 59) met eligibility criteria for a primary diagnosis of an MRI-confirmed symptomatic partial-thickness or full-thickness rotator cuff tear without a history of shoulder surgery. Demographics, rotator cuff tear size, arm flexion, and clinical scapular motion during active arm flexion were evaluated by experienced examiners using standardized procedures. Patients completed the ASES questionnaire and the Optimal Screening for Prediction of Referral and Outcomes-Yellow Flag assessment form, which measures 11 different pain-related psychological distress symptoms. Three separate stepwise multiple linear regression analyses were performed for ASES pain, function, and total scores, with significance set at p < 0.05.

RESULTS

This model found that ASES function scores were associated with four factors: older age, increased arm flexion, increased percentage of scapular external rotation during arm flexion, and increased scores for acceptance of chronic pain (adjusted r2 = 0.67; p = 0.01). Those four factors appear to explain 67% of the observed variance in ASES function scores in patients with rotator cuff tears. Furthermore, increased percentage of scapular external rotation during arm flexion and decreased fear-avoidance beliefs related to physical activity scores (adjusted r2 = 0.36; p < 0.01) were associated with better ASES pain scores. And finally, better ASES total scores were associated with four factors: increased arm flexion, increased percentage of scapular upward rotation, increased scapular external rotation during arm flexion, and decreased fear-avoidance beliefs related to physical activity scores (adjusted r2 = 0.65; p < 0.001).

CONCLUSION

Our results favor adopting a comprehensive biopsychological clinical assessment for patients with rotator cuff tears that specifically includes humeral and scapular motion, fear-avoidance behaviors, and pain coping behaviors along with demographics. These particular physical and psychological variables were found to be associated with the ASES and, therefore, should be clinically examined simultaneously and targeted as part of a tailored treatment plan.

LEVEL OF EVIDENCE

Level II, prognostic study.

Potential problems in the use of patient reported outcome measures (PROMs) and reporting of PROM data in sports science

To use an inadequate patient reported outcome measure (PROM) or use a PROM in an inappropriate way potentially influences the quality of measurement. The objectives of this study were to define potential inadequate uses of PROMs in sports research studies and estimate how often they occur. A consensus group consisting of medical researchers, statisticians, and psychometricians identified and defined potentially irregular applications of PROMs. Occurrence of these in 349 consecutive articles in sports medicine in which PROMs were used as primary outcomes was reviewed. In all, 14 different potential problems were defined, and one or several occurred in 172 of the articles (49%). These were as follows: using a PROM that was developed for a different patient group (100 cases), using two or more PROMs with identical questions (94), aggregation of domain sum scores (82), combinations of subjective and objective measures (27), using a PROM to diagnose or evaluate the individual patient (7), using a PROM for a single limb (3), recall bias (3), exclusion of domains or items (3), construction of a PROM for a specific occasion (2), categorization of the scale (2), and mixing different versions of a PROM (1). Adaption of scale scores (e. g., to percentage) when results are reported (144) carries a risk of miscalculation and distorted impression of results. Data related to uncertainty about completing the PROM and the handling of missing data were not provided in the manuscripts. In conclusion, potential problems in the use and reporting of PROMs are common in sports research, and this can influence the validity of reported results.

Reverse shoulder replacement: a day-case procedure

Background and hypothesis

Reverse shoulder arthroplasty (RSA) is an increasingly popular treatment modality for glenohumeral joint arthritis in association with rotator cuff arthropathy. A prolonged hospital stay following joint arthroplasty risks increased complications for patients plus financial implications for institutions. We hypothesized that RSA could be safely and effectively carried out as an outpatient procedure with reduced risks to patients and institutional costs.

Methods

Patients attending our institution for RSA during March 2015 to August 2018 were reviewed preoperatively for consideration for RSA as an outpatient procedure. The inclusion criteria were arthritis of the shoulder having failed conservative management, age older than 50 years, and intact deltoid muscle function. Patients were excluded if they underwent RSA for trauma or for revision following previous total shoulder replacement or hemiarthroplasty. Overall health, social circumstances, and individual wishes were considered.

Results

A total of 21 patients underwent RSA as an outpatient procedure. The mean age was 74 years (range, 59-84 years). There were 8 male and 13 female patients. No overnight stays were required in patients in whom outpatient surgery was planned. The Oxford Shoulder Score increased from a mean of 16 (range, 4-30) preoperatively to a mean of 31 (range, 7-35) at 6 months postoperatively; it was a mean of 36 (range, 7-48) at 12 months postoperatively. Of the patients, 88% were “very satisfied” or “satisfied” with the service and 81% would undergo the surgical procedure again as a day-case procedure.

Conclusion

RSA as an outpatient procedure can be carried out effectively with high patient satisfaction rates in carefully selected patients.

A Multi-faceted Educational Approach for Pain Metric Recording Prior to Knee and Hip Arthroplasty: Effects on Documentation by an Acute Pain Service

Background

Despite the increased use of electronic medical records (EMRs) in past years, the recording of clinically useful baseline pain information may still be lacking. An educational effort targeted at the acute pain service and reinforced by electronic prompting may be an effective way to promote electronic documentation of relevant pain metrics. The objective of this study was to assess whether an educational effort with electronic prompting in the EMR promotes the documentation of baseline pain scores and preoperative opioid use by an acute pain service (APS).

Methods

A total of 98 patients were included in this study: 49 in the study group and 49 in the control group. The study group consisted of patients who underwent knee and hip arthroplasties after the institution of a multimodal analgesia educational program that also incorporated an electronic prompt to promote behavior change. Primary outcomes were the frequency of documentation of baseline pain scores and preoperative opioid use.

Results

After the implementation of the education initiative, 67% of the patients had baseline pain scores recorded in the preoperative APS documentation, compared to 20% in the control group (p = 0.0001). Preoperative opioid use was recorded in 24% of APS documentation within the control group, but this increased to 73% after the educational intervention (p = 0.0001). Documentation of resting pain scores on the day of surgery also increased from 59% to 87% (p = 0.0014).

Conclusions

The introduction of a multi-dimensional educational effort focused on baseline pain metric recording within the context of an analgesic change of practice increased assessment of both baseline pain and preoperative opioid use by APS. These results can be applied to other settings in which a focused change of practice is required and an electronic medical record already utilized.

Patients Undergoing Shoulder Stabilization Procedures Do Not Accurately Recall Their Preoperative Symptoms at Short- to Midterm Follow-up

Background:

A patient’s ability to recall symptoms is poor in some elderly populations, but we considered that the recall of younger patients may be more accurate. The accuracy of recall in younger patients after surgery has not been reported to date.

Purpose:

To assess younger patients’ abilities to recall their preoperative symptoms after having undergone shoulder stabilization surgery. We used 2 disease-specific, patient-reported outcome measures (PROMs)—the Western Ontario Shoulder Instability Index (WOSI) and the Melbourne Instability Shoulder Score (MISS)—at a period of up to 2 years postoperatively.

Study Design:

Cohort study (diagnosis); Level of evidence, 2.

Methods:

Participants (N = 119) were stratified into 2 groups: early recall (at 6-8 months postoperatively; n = 58) and late recall (at 9-24 months postoperatively; n = 61). All patients completed the PROMs with instructions to recall preoperative function. The mean and absolute differences between the preoperative scores and recalled scores for each PROM were compared using paired t tests. Correlations between the actual and recalled scores of the subsections for each PROM were calculated using an intraclass correlation coefficient (ICC). The number of individuals who recalled within the minimal detectable change (MDC) of each PROM was calculated.

Results:

Comparison between the means of the actual and recalled preoperative scores for both groups did not demonstrate significant differences (early recall differences, MISS 1.05 and WOSI –38.64; late recall differences, MISS –0.25 and WOSI –24.02). Evaluation of the absolute difference, however, revealed a significant difference between actual and recalled scores for both the late and early groups (early recall absolute differences, MISS 12.26 and WOSI 216.71; late recall absolute differences, MISS 12.84 and WOSI 290.08). Average absolute differences were above the MDC scores of both PROMs at both time points. Subsections of each PROM demonstrated weak to moderate correlations between actual and recalled scores (ICC range, 0.17-0.61). Total scores for the PROMs reached moderate agreement between actual and recalled scores.

Conclusion:

Individual recall after shoulder instability surgery was not accurate. However, the mean recalled PROM scores of each group were not significantly different from the actual scores collected preoperatively, and recall did not deteriorate significantly over 2 years. This suggests that recall of the individual, even in this younger group, cannot be considered accurate for research purposes.

Why is running a marathon like giving birth? The possible role of oxytocin in the underestimation of the memory of pain induced by labor and intense exercise

Pain can be overestimated, underestimated or reported accurately at recall. The way pain is remembered seems to depend on certain factors, including the type of pain or, in other words, its cause, the context, and the meaning it has for the person suffering from it. For instance, episodes of chronic pain, as well as pain related to surgery, are often overestimated at recall. Interestingly, research shows that pain induced by parturition or marathon running is often underestimated at recall despite the fact that both are not only physically grueling but also emotionally intense experiences. However, both processes can likewise be considered positive events, as opposed to most that involve pain. On the neurophysiological level, one of the similarities between giving birth and running a marathon is the particular involvement of the oxytocin system. Oxytocin is involved both in parturition and intense exercise, for various reasons. During labor, oxytocin mediates uterine contractions, while in the case of extensive running it might be involved in the maintenance of fluid balance. It also has well-documented analgesic properties and plays an important role in memory formation and recall. It has been suggested that oxytocin modulates the output of the central nucleus of the amygdala (CeA) during the fear recall. Moreover, it has been demonstrated that oxytocin can impair fear learning and influence the memory of both positive and negative emotionally salient stimuli. We propose that the reason for pain to be remembered in a more favorable light is the central action of oxytocin in the central nucleus of the amygdala, first and foremost during the encoding phase.

The Specific AC Score (SACS): a new and validated method of assessment of isolated acromioclavicular joint pathology

BACKGROUND

Acromioclavicular (AC) joint (ACJ) pathology is a common cause of shoulder dysfunction, and treatment recommendations vary. When the efficacy of treatment is evaluated, the ability to measure outcomes specific to the population is essential. The aim of the current research was to develop and validate a specific ACJ questionnaire.

METHODS

Items for the "Specific AC Score" (SACS) were generated through the use of an expert panel, existing questionnaires, and patient feedback. Preliminary data analysis identified redundancy of items resulting in the questionnaire being refined. The final SACS was evaluated in 125 patients requiring surgical intervention of the ACJ. Internal consistency (the Cronbach α and corrected item-total correlation), content validity, criterion validity, responsiveness, and test-retest reliability (intraclass correlation coefficient) were examined and compared with the Shoulder Pain and Disability Index, Oxford Shoulder Score, and American Shoulder and Elbow Surgeons Standardized Shoulder Assessment Form. The minimum detectable change score was calculated.

RESULTS

The Cronbach α for the total scale preoperatively and postoperatively was high (preoperatively = 0.91, postoperatively = 0.93). All 3 domains (Pain, Function, Quality of Life) demonstrated acceptable internal consistency (α > 0.70), and the correlation between items in each domain was satisfactory. The responsiveness was excellent (effect size, -2.32; standard response mean, -1.85) and was higher than the other general shoulder questionnaires. There were no relevant floor or ceiling effects. Reliability was high (intraclass correlation coefficient, 0.89) and the minimum detectable change was 6.5 points.

DISCUSSION

This new ACJ-specific questionnaire has been robustly developed, has good measurement properties, and has excellent responsiveness. The SACS is recommended for measuring outcomes in ACJ patients.

An observational study of pain self-management strategies and outcomes: does type of pain, age, or gender, matter?

Background and aims Acute pain is differentiated from chronic pain by its sudden onset and short duration; in contrast, chronic pain is characterized by a duration of at least several months, typically considered longer than normal healing time. Despite differences in definition, there is little information on how types of self-management strategies or outcomes differ when pain is chronic rather than acute. Additionally, age and gender are thought to be related to types of strategies used and outcomes. However, strategies used and outcomes can be influenced by level of education, socioeconomic status, occupation, and access to the health care system, which can confound associations to type of pain, age or gender. The purpose of this study was to examine the association of strategies used for pain self-management and outcomes with type of pain, acute or chronic, age, or gender in a socioeconomically homogenous population, pharmacists. Methods Pharmacists with acute or chronic pain and a valid email completed an on-line questionnaire on demographic characteristics, pain characteristics, pharmacological and non-pharmacological strategies for managing pain, and outcomes (e.g. pain intensity). Univariate analysis was conducted by stratifying on type of pain (acute or chronic), then stratifying on gender (men vs. women) and age (younger vs. older). The a priori alpha level was 0.05. Results A total of 366 pharmacists completed the questionnaire, 212 with acute pain (average age=44±12.1; 36% men) and 154 with chronic pain (average age=53±14.0; 48% men). The chronic pain group reported substantially higher levels of pain before treatment, level of post-treatment pain, level of pain at which sleep was possible, and goal pain levels (effect sizes [ES's]=0.37-0.61). The chronic pain group were substantially more likely to use prescription non-steroidal anti-inflammatory medications (NSAIDS), opioids, and non-prescription pain relievers (ES's=0.29-0.80), and non-medical strategies (ES's=0.56-0.77). Participants with chronic pain also were less confident (ES=0.54) and less satisfied (ES=0.52). In contrast, there were no differences within either the acute or chronic pain groups related to gender and outcomes. In the acute pain group, there also were no gender differences related to management strategies. However, younger age in the acute pain group was associated with use of herbal remedies and use of rest. Within the chronic pain group, men were more likely to use NSAIDS and women more likely to use hot/cold packs or massage while older participants were more likely to use massage. Variability in post-treatment level of pain and percent relief was high in all groups (coefficient of variation=25%-100%). Conclusions The differences between acute and chronic pain were substantial and included differences in demographic characteristics, pain characteristics, management strategies used, and outcomes. In contrast, few associations between age and gender with either management strategies or outcomes were identified, although the variability was high. Implications When managing or researching pain management, acute pain should be differentiated from chronic pain. Because of the substantial variability within the gender and age groups, an individual approach to pain management irrespective of age and gender may be most useful.