Do You Recall?: Results From a Within-Person Recall Study of the Patient-Reported Outcomes Measurement Information System (PROMIS) Short Form v2.0 - Physical Function 8c

OBJECTIVES

This study aimed to determine whether responses to Patient-Reported Outcomes Measurement Information System Short Form v2.0 - Physical Function 8c (PROMIS PF8c) items differed when the use of a 7-day recall period was compared with no specified recall period.

METHODS

Using a within-subject design, we surveyed 1810 individuals from the US general population, administering PROMIS PF8c at survey beginning and end. The order of measure presentation was randomly assigned. We calculated recall difference scores (RDSs) as no recall score minus 7-day recall score using both item response theory-based T scores and raw summed scores. We examined the distribution and created Bland-Altman plots for both RDS_Tscore and RDS_Raw. We also calculated correlations between no recall versus 7-day recall T score and raw scores. Finally, we determined whether differences in no recall versus 7-day recall scores were associated with patient-reported PF.

RESULTS

RDS_Tscore and RDS_Raw had means (root mean square differences) of 0.00 (5.43) and -0.04 (3.79), respectively. The vast majority (%) of RDS_Tscore and RDS_Raw values fell between the Bland-Altman limits of agreement (-10.65 to 10.66 and -7.46 to 7.38, respectively). Pearson's correlations between no recall and 7-day recall for T scores and raw scores were 0.88 and 0.87, respectively. Effect sizes for mean RDS_Tscore and RDS_Raw compared across level of Eastern Oncology Cooperative Group performance status, patient global impression of PF severity, and single PF items were near 0.

CONCLUSIONS

We did not find any significant recall period effect on PF8c responses. Therefore, we recommend the use of the PROMIS physical function standard, with no specified recall time period.

Development of Reliable and Valid Negative Mood Screening Tools for Orthopaedic Patients with Musculoskeletal Pain

BACKGROUND

Negative mood is an important risk factor for poor clinical outcomes among individuals with musculoskeletal pain. Screening for negative mood can aid in identifying those who may need additional psychological interventions. Limitations of current negative mood screening tools include (1) high response burden, (2) a focus on single dimensions of negative mood, (3) poor precision for identifying individuals with low or high negative mood levels, and/or (4) design not specific for use in populations with orthopaedic conditions and musculoskeletal pain.

QUESTIONS/PURPOSES

(1) Can item response theory methods be used to construct screening tools for negative mood (such as depression, anxiety, and anger) in patients undergoing physical therapy for orthopaedic conditions? (2) Do these tools demonstrate reliability and construct validity when used in a clinical setting?

METHODS

This was a cross-sectional study involving outpatients having physical therapy in tertiary-care settings. A total of 431 outpatients with neck (n = 93), shoulder (n = 108), low back (n = 119), or knee (n = 111) conditions were enrolled between December 2014 and December 2015, with 24% (103 of 431) seeking care after orthopaedic surgery. Participants completed three validated psychological questionnaires measuring negative mood, resulting in 39 candidate items for item response theory analysis. Factor analysis was used to identify the dimensions (factors) assessed by the candidate items and select items that loaded on the main factor of interest (negative mood), establishing a unidimensional item set. Unidimensionality of an item set suggests they are assessing one main factor or trait, allowing unbiased score estimates. The identified items were assessed for their fit to the graded item response theory model. This model allows for items to vary by the level of difficulty they represent and by their ability to discriminate between patients at different levels of the trait being assessed, in this case, negative mood. Finally, a hierarchical bifactor model where multiple subfactors are allowed to load on an overall factor was used to confirm that the items identified as representing a unidimensional item set explained the large majority of variance of the overall factor, providing additional support for essential unidimensionality. Using the final item bank, we constructed a computer adaptive test administration mode, and reduced item sets were selected to create short forms including items with the highest information (reliability) at targeted score levels of the trait being measured, while also considering clinical content.

RESULTS

We identified a 12-item bank for assessment of negative mood; eight-item and four-item short-form versions were developed to reduce administrative burden. Computer adaptive test administration used a mean ± SD of 8 ± 1 items. The item bank's reliability (0 = no reliability; 1 = perfect reliability) was 0.89 for the computer adaptive test administration, 0.86 for the eight-item short form, and 0.71 for the four-item short form. Reliability values equal to or greater than 0.7 are considered acceptable for group level measures. Construct validity sufficient for clinical practice was supported by more severe negative mood scores among individuals with a previous episode of pain in the involved anatomical region, pain and activity limitations during the past 3 months, a work-related injury, education less than a college degree, and income less than or equal to USD 50,000.

CONCLUSION

These newly derived tools include short-form and computer adaptive test options for reliable and valid negative mood assessment in outpatient orthopaedic populations. Future research should determine the responsiveness of these measures to change and establish score thresholds for clinical decision-making.

CLINICAL RELEVANCE

Orthopaedic providers can use these tools to inform prognosis, establish clinical benchmarks, and identify patients who may benefit from psychological and/or behavioral treatments.

Efficient Screening for Fear of Movement in Outpatient Settings: Short Form and Computer Adaptive Tests for Fear Avoidance and Negative Pain Coping

OBJECTIVE

The purpose of this study was to develop screening measures using item response theory (IRT) for 2 factors highly relevant to fear of movement (FoM): fear avoidance and negative pain coping.

METHODS

A total of 431 patients with neck (n = 93), shoulder (n = 108), low back (n = 119), or knee (n = 111) conditions seeking physical therapy completed 8 validated psychological questionnaires measuring fear avoidance and negative pain coping, resulting in 97 candidate items for IRT analysis. Unidimensionality and local independence were assessed using exploratory factor analyses followed by confirmatory factor analyses. Items were assessed for model fit to the graded response model for ordinal items. Using the final item bank, a computer adaptive test (CAT) administration mode was constructed, and reduced item sets were selected to create short forms (SFs), including items with highest information (reliability) at the different levels of the trait being measured while also considering clinical content.

RESULTS

The results supported a 28-item bank for fear avoidance and 16-item bank for negative pain coping. A 10-item and 8-item SF were developed for fear avoidance and negative pain coping, respectively. Additionally, 4-item form versions were created to provide options with lower administrative burden. CAT administration used a mean (median) of 7.7 (8) and 7.0 (7) items for fear avoidance and negative pain coping, respectively. All factors demonstrated construct validity by discriminating patient groups in expected clinical patterns.

CONCLUSION

These newly derived SFs and CAT administration modes provide reliable, valid, and efficient options to screen for fear avoidance and negative pain coping in populations with musculoskeletal pain.

IMPACT

These tools, collectively referred to as the Screening for Pain Vulnerability and Resilience tools, address a critical need for standard FoM screening processes that aid in clinical decision-making to identify who might benefit from psychologically informed approaches.

Prevalence of Traditional Asian Postpartum Practices at a Federally Qualified Health Center

To evaluate the knowledge of, participation in, attitudes towards, and experiences with "doing the month" (DTM), a traditional Chinese and Vietnamese postpartum practice, at a federally qualified health center that serves predominantly Asian immigrants. DTM practices revolve around the balance between yin and yang and include practices such as the mother remaining on bed rest for as long as possible, restricting diet to certain foods, and avoiding visitors and social activities. A cross-sectional survey in Chinese, Vietnamese, and English was developed to determine the prevalence of women who have heard of and participated in DTM. 154 respondents participated. The mean age of respondents was 40.1 years. Without prompting of what DTM was, 58 (37.7%) responded that they had heard of DTM. After an explanatory paragraph, this increased to 117 (76.6%) participants. Out of 107 patients who have children, 65 (60.7%) "did the month" after giving birth. Participation rates were highest for women who identified as Chinese or Vietnamese. Likert-type scale questions showed that respondents believed DTM was stressful but enjoyable and helpful for recovery from childbirth. In conclusion, DTM is a common practice that health providers should be aware of.

Upper Quadrant Edema Patient-Reported Outcome Measure Is Reliable, Valid, and Efficient for Patients With Lymphatic and Venous Disorders

OBJECTIVE

The main aims of this study were to (1) create a patient-reported outcome measure (PROM) item bank for measuring the impact of upper quadrant edema (UQE) on physical function by calibrating responses to newly developed items; and (2) assess reliability, validity, and administration efficiency of scores based on computerized adaptive test (CAT) and 10-item short-form (SF) administration modes.

METHODS

This was a retrospective study including data from patients treated in outpatient rehabilitation clinics for UQE that responded to all 27 candidate items at intake. Item response theory model assumptions of unidimensionality, local item independence, item fit, and presence of differential item functioning were evaluated. UQE-CAT- and UQE-SF-generated scores were assessed for reliability, validity, and administration efficiency.

RESULTS

The total cohort included 3486 patients (mean [SD] age = 61 [13] years; range = 14-89 years). After removing 2 items, a 25-item solution was supported for its unidimensionality and fit to the item response theory model with reliability estimates of more than 0.93 for scores based on both CAT and SF administration modes. No items demonstrated differential item functioning. Scores discriminated among multiple patient groups in clinically logical ways and were moderately responsive to change with negligible floor and acceptable ceiling effects. CAT scores were generated using an average of 5.6 items (median = 5).

CONCLUSION

Scores on the UQE PROM were reliable, valid, and efficient for assessing perceived physical function of patients with upper quadrant edema; thus, the measure is suitable for research and routine clinical administration.

IMPACT

The newly developed UQE PROM is reliable and valid and offers efficient administration modes for assessing perceived physical function of patients with UQE caused by lymphatic and venous disorders, both for research and routine clinical care in busy outpatient rehabilitation settings. As an item response theory-based measure, the UQE PROM allows administration of condition-specific functional questions with low response burden for patients. This study supports a transition to PROMs that are based on modern measurement approaches to achieve high accuracy and efficiency.

Graded Chronic Pain Scale: Validation of 1-Month Reference Frame

OBJECTIVES

The 1-month Graded Chronic Pain Scale (GCPS) commonly used in clinical studies has never been validated. This study compares the GCPS 1-month with the 6 months version for reliability and validity.

METHODS

The Validation Project included 521 participants with at least one temporomandibular disorder for cross-sectional data and 74 participants for test-retest data. Internal reliability, stability, and construct validity were used for testing the 1-month version. Comparisons were made between the 2 versions for characteristic pain intensity (CPI), interference, and chronic pain grade (CPG).

RESULTS

For GCPS 1-month, internal consistency for pain intensity and interference was high (Cronbach α=0.87 and 0.94, respectively), and temporal stability was high for CPI (intraclass correlation coefficient [ICC]=0.91), interference (ICC=0.85), and CPG (weighted κ=0.88). ICC or κ between the 2 versions was 0.78 (CPI), 0.66 (interference), and 0.69 (CPG); high-impact pain, in contrast, was 0.50. Construct validity exhibited higher correlations with predictor variables for 1-month version attributes of CPI, interference, and CPG. Modified Bland-Altman plots indicated that both versions measure CPI well.

DISCUSSION

Overall, reliability of the 1-month GCPS is equal to or better than the 6-months version for pain intensity, disability days, pain interference, CPG, and high-impact pain. However, consistency between versions is lower for measures of disability days and interference, and for the derived measures of CPG and high-impact pain; highly skewed distributions and increasing disagreement in reported status over the time periods affect the measures of function. Therefore, we recommend that GCPS-1 month only be used to calculate pain intensity and pain interference.

The Lower Extremity Physical Function Patient-Reported Outcome Measure Was Reliable, Valid, and Efficient for Patients With Musculoskeletal Impairments

OBJECTIVE

To calibrate the Lower Extremity Functional Scale (LEFS) items into a regional lower extremity physical function (LEPF) item bank and assess reliability, validity, and efficiency of computerized adaptive test (CAT) and short form (SF) administration modes.

DESIGN

Retrospective cohort.

SETTING

Data were collected from patients treated in outpatient rehabilitation clinics for musculoskeletal impairments of the hip, knee, foot, and ankle that responded to all 20 LEFS items at intake.

PARTICIPANTS

Patients aged 14 years or older who started an episode of care during January 2016-October 2019 and identified the lower extremity region as the source of a primary musculoskeletal complaint. Total cohort included 78,186 patients (mean age, 53±19y, range, 14-89y).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Item response theory (IRT) model assumptions of unidimensionality, local item independence, item fit, and presence of differential item functioning (DIF) were studied. LEPF-CAT- and LEPF-SF-generated scores were evaluated.

RESULTS

An 18-item solution was supported for its unidimensionality and fit to the IRT model, with reliability estimates >0.9 for all administration modes. No DIF impact on LEPF scores was identified. Scores discriminated between multiple patient groups in clinically logical ways and were highly responsive to change, with negligible floor or ceiling effects. CAT scores were generated using an average of 4.9 items (median, 4).

CONCLUSIONS

The LEPF scores were reliable, valid, and efficient for assessing perceived physical function of patients with musculoskeletal impairments of the hip, knee, foot, and ankle; thus, it was found suitable for research and routine clinical administration. These findings are limited to the type of patients included in this study, with further validation needed to assess their generalizability.

PROMIS® Pediatric Depressive Symptoms as a Harmonized Score Metric

OBJECTIVE

To conduct an evidence-based review of adolescent self-report depression measures and to demonstrate how various measures can be rescored onto a harmonized metric.

METHOD

Six widely used person-reported outcome measures (PROMs) were reviewed. Psychometric properties were evaluated using previously published guidance for PROMs. Next, two secondary data sources (from an outpatient behavioral health clinic and from the general population) were evaluated to harmonize scores across three of the measures. Both item response theory and equipercentile linking methods were used and compared.

RESULTS

All six PROMs demonstrated a high evidence base for widespread use depending on the purpose of the assessments. Adolescent involvement when developing the PROM for content validity and floor or ceiling effects were the least frequent available evidence. Three of the PROMs were linked to the PROMIS® Pediatric Depressive Symptoms v2.0 (PROMIS-PedDepSx) metric. The scales were highly correlated and essentially unidimensional when aggregated. All linking methods were broadly comparable. Group-level score conversions are recommended to minimize linking bias.

CONCLUSIONS

There are a number of strong, widely used PROMs for the evidence-based assessment (EBD) of adolescent depression. However, score comparability is a concern whenever there is a proliferation of measures. Harmonized score metrics support data aggregation and re-analysis. Using four PROMs, one of which served as the scoring metric, we demonstrated the possibility of harmonized depression scores. Future directions for EBD should evaluate whether harmonized PROMs for other pediatric health domains would be useful.

TBI-CareQOL military health care frustration in caregivers of service members/veterans with traumatic brain injury

PURPOSE

Caregivers of service members/veterans (SMVs) encounter a number of barriers when navigating the military health care system. The purpose of this study was to develop a new measure to assess potential caregiver frustration with the systems of care and benefits in the United States Departments of Defense and Veterans Affairs.

METHOD

The TBI-CareQOL Military Health Care Frustration measure was developed using data from 317 caregivers of SMVs with TBI who completed an item pool comprised of 64 questions pertaining to anger or frustration with accessing military health care services.

RESULTS

Exploratory and confirmatory factor analyses supported the retention of 58 items. Constrained graded response model (GRM) overall fit and item fit analyses and differential item functioning investigations of age and education factors supported the retention of 43 items in the final measure. Expert review and GRM item calibration products were used to inform the selection of two 6-item static short forms (TBI-CareQOL Military Health Care Frustration-Self; TBI-CareQOL Military Health Care Frustration-Person with TBI) and to program the TBI-CareQOL Military Health Care Frustration computer adaptive test (CAT). Preliminary data supported the reliability (i.e., internal consistency and test-retest reliability) as well as the validity (i.e., convergent, discriminant, and known-groups) of the new measure.

CONCLUSIONS

The new TBI-CareQOL Military Health Care Frustration measure can be used to examine caregiver perceptions of and experience with the military health care system, to target improvements. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Assessing vigilance in caregivers after traumatic brain injury: TBI-CareQOL Caregiver Vigilance

OBJECTIVE

Caregivers of individuals with traumatic brain injury (TBI) frequently experience anxiety related to the caregiver role. Often this is due to a caregiver's perceived need to avoid people and situations that might upset or "trigger" the care recipient. There are currently no self-report measures that capture these feelings; thus, this article describes the development and preliminary validation efforts for the TBI-Caregiver Quality of Life (CareQOL) Caregiver Vigilance item bank.

DESIGN

A sample of 532 caregivers of civilians (n = 218) or service members/veterans (SMVs; n = 314) with TBI completed 32 caregiver vigilance items, other measures of health-related quality of life (RAND-12, Patient-Reported Outcomes Measurement Information System [PROMIS] Depression, PROMIS Social Isolation, Caregiver Appraisal Scale), and the Mayo-Portland Adaptability Inventory-4.

RESULTS

The final item bank contains 18 items, as supported by exploratory and confirmatory factor analysis, item response theory graded response modeling (GRM), and differential item functioning investigations. Expert review and GRM calibration data informed the selection of a 6-item short form and programming of a computer adaptive test. Internal consistency reliability for the different administration formats were excellent (reliability coefficients ≥ .90). Three-week test-retest stability was supported (i.e., r ≥ .78). Correlations between vigilance and other self-report measures supported convergent and discriminant validity (0.01 ≤ r ≤ .69). Known-groups validity was also supported.

CONCLUSIONS

The new TBI-CareQOL Caregiver Vigilance computer adaptive test and corresponding 6-item short form were developed using established rigorous measurement development standards, providing the first self-report measure to evaluate caregiver vigilance. This development work indicates that this measure exhibits strong psychometric properties. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Retention in Care and Viral Load Improvement After Discharge Among Hospitalized Out-of-Care People With HIV Infection: A Post Hoc Analysis of a Randomized Controlled Trial

BACKGROUND

Understanding factors influencing retention in care (RIC) and viral load improvement (VLI) in people with HIV (PWH) who are out of care and hospitalized will assist in intervention development for this vulnerable population.

METHODS

The study was a post hoc analysis of prospectively collected data. Hospitalized participants were enrolled if they were newly diagnosed with HIV during the hospitalization or out of HIV care. Participants completed surveys at baseline and 6 months postenrollment and laboratory studies of viral load (VL). Outcomes were RIC (2 completed visits, 1 within 30 days of discharge) and VLI (VL <400 or at least a 1-log10 decrease) 6 months after discharge. Univariate and multivariate regression analyses were conducted examining the contributions of predisposing, enabling, and need factors to outcomes.

RESULTS

The study cohort included 417 participants enrolled between 2010 and 2013. The population was 73% male, 67% non-Hispanic black, 19% Hispanic, and 70% uninsured. Sixty-five percent had a baseline CD4 <200 cells/mm3, 79% had a VL >400 copies/mL or missing, and the population was generally poor with low educational attainment. After discharge from the hospital, 60% did not meet the definition for RIC, and 49% did not have VLI. Modifiable factors associated with the outcomes include drug use (including marijuana alone and other drugs), life instability (eg, housing, employment, and life chaos), and using avoidance coping strategies in coping with HIV.

CONCLUSIONS

Hospitalized out-of-care PWH in the United States are at high risk of poor re-engagement in care after discharge. Interventions for this population should focus on improving socioeconomic stability and coping with HIV and reducing drug use.

TBI-CareQOL family disruption: Family disruption in caregivers of persons with TBI

PURPOSE

Family disruption is often an indirect consequence of providing care for a person with traumatic brain injury (TBI). This article describes the development and preliminary validation of a Family Disruption scale designed for inclusion within the TBI-CareQOL measurement system.

METHOD/DESIGN

Five hundred thirty-four caregivers of persons with TBI (service member/veteran n = 316; civilian n = 218) completed the Family Disruption scale, alongside several other measures of caregiver strain and health-related quality of life. Classical test theory and item response theory (IRT)-based analyses were conducted to develop, and establish reliability and validity of, this scale.

RESULTS

Exploratory and confirmatory factor analysis, as well as Samejima's graded response model-related IRT fit analyses, supported the development of a 3-item scale. This final scale is scored on a T score metric (M = 50; SD = 10); higher scores are indicative of more family disruption. Reliability (internal consistency; test-retest stability) was supported for both caregiver groups, and average administration times were under 10 s. Convergent and discriminant validity were supported by strong correlations between Family Disruption and measures of caregiver burden, and smaller correlations with positive aspects of caregiving. As evidence of known-groups validity, caregivers of lower-functioning persons with TBI experienced more family disruption than caregivers of higher functioning individuals.

CONCLUSIONS

The TBI-CareQOL Family Disruption scale is a brief, reliable, and valid assessment of caregiver perceptions of how caring for an individual with a TBI interferes with family life. This measure is well-suited for inclusion in studies seeking to support family functioning in persons with TBI. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Reliability and validity data to support the clinical utility of the Traumatic Brain Injury Caregiver Quality of Life (TBI-CareQOL)

OBJECTIVE

The Traumatic Brain Injury Caregiver Quality of Life (TBI-CareQOL) is a patient-reported outcome measurement system that is specific to caregivers of civilians and service members/veterans (SMVs) with traumatic brain injury (TBI). This measurement system includes 26 item banks that represent both generic (i.e., borrowed from existing measurement systems) and caregiver-specific components of health-related quality of life (HRQOL). This report provides reliability and validity data for measures within the TBI-CareQOL that have not previously been reported (i.e., 4 caregiver-specific and 7 generic measures of HRQOL).

DESIGN

Three hundred eighty-five caregivers of persons with TBI completed caregiver-specific computer adaptive tests (CATs) for Feelings of Loss-Self, Caregiver Strain, Caregiver-Specific Anxiety, and Feeling Trapped, as well as generic measures of HRQOL from complementary measurement systems (i.e., Neuro-QoL Positive Affect and Well-Being; PROMIS Sleep-Related Impairment; NIH Toolbox Perceived Stress, General Life Satisfaction, and Self Efficacy; TBI-QOL Resilience and Grief/Loss). Caregivers also completed several additional measures to establish convergent and discriminant validity, as well as the Mayo Portland Adaptability Index, 4th ed.

RESULTS

Findings support the internal consistency reliability (all alphas > .85) and test-retest stability (all alphas >.73) of the TBI-CareQOL measures. Convergent validity was supported by moderate to high correlations between the TBI-CareQOL measures and related measures, whereas discriminant validity was supported by low correlations between the TBI-CareQOL measures and unrelated constructs. Known-groups validity was also supported.

CONCLUSIONS

Findings support the reliability and validity of the item banks that comprise the TBI-CareQOL Measurement System. These measures should be considered for any standardized assessment of HRQOL in caregivers of civilians and SMVs with TBI. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Does Animation Improve Comprehension of Risk Information in Patients with Low Health Literacy? A Randomized Trial

Introduction. Enhanced visual effects, like animation, have the potential to improve comprehension of probabilistic risk information, particularly for those with lower health literacy. We tested the effect of presentation format on comprehension of colorectal cancer (CRC) screening probabilities to identify optimal risk communication strategies. Methods. Participants from a community foodbank and a cancer prevention center were randomized to 1 of 3 CRC screening risk presentations. The presentations used identical content but varied in format: 1) video with animated pictographs, 2) video with static pictographs, and 3) audiobooklet with static pictographs. Participants completed pre- and postpresentation surveys. The primary outcome was knowledge of probability/risk information regarding CRC screening, calculated as total, verbatim, and gist scores. Results. In total, 187 participants completed the study and were included in this analysis. Median age was 58 years (interquartile range [IQR]: 14 years), most participants were women (63%), and almost half had a high school education or less (46%). Approximately one-quarter had inadequate health literacy (Short Test of Functional Health Literacy in Adults marginal/inadequate: 28%; Brief Health Literacy Screener low: 18%), and about half had low numeracy (Subjective Numeracy Scale low: 54%; Graphical Literacy Measure low: 50%). We found no significant differences in total, verbatim, or gist knowledge across presentation formats (all P > 0.05). Discussion. Use of an animated pictograph to communicate risk does not appear to augment or impede knowledge of risk information. Regardless of health literacy level, difficulty understanding pictographs presenting numerical information persists. There may be a benefit to teaching or priming individuals on how to interpret numerical information presented in pictographs before communicating risk using visual methods. Trial Registry: NCT02151032.

Does recall period matter? Comparing PROMIS® physical function with no recall, 24-hr recall, and 7-day recall

PURPOSE

To evaluate the influence of recall periods on the assessment of physical function, we compared, in cancer and general population samples, the standard administration of PROMIS Physical Function items without a recall period to administrations with 24-hour and 7-day recall periods.

METHODS

We administered 31 items from the PROMIS Physical Function v2.0 item bank to 2400 respondents (n = 1001 with cancer; n = 1399 from the general population). Respondents were randomly assigned to one of three recall conditions (no recall, 24-hours, or 7-days) and one of two "reminder" conditions (with recall periods presented only at the start of the survey or with every item). We assessed items for potential differential item functioning (DIF) by recall time period. We then tested recall and reminder effects with analysis of variance controlling for demographics, English fluency, and co-morbidities.

RESULTS

Based on conservative pre-set criteria, no items were flagged for recall time period-related DIF. Using analysis of variance, each condition was compared to the standard PROMIS administration for Physical Function (no recall period). There was no evidence of significant differences among groups in the cancer sample. In the general population sample, only the 24-hour recall condition with reminders was significantly different from the "no recall" PROMIS standard. At the item level, for both samples, the number of items with non-trivial effect size differences across conditions was minimal.

CONCLUSIONS

Compared to no recall, the use of a recall period has little to no effect upon PROMIS physical function responses or scores. We recommend that PROMIS Physical Function be administered with the standard PROMIS "no recall" period.

Measuring emotional suppression in caregivers of adults with traumatic brain injury

OBJECTIVE

Caregivers of individuals with traumatic brain injury (TBI) often feel pressure to maintain the appearance that they are emotionally well adjusted, despite feelings to the contrary. Because there are currently no measures examining this construct, this article focuses on the development of a new measure that is specific to caregivers of people with TBI.

DESIGN

A total of 533 caregivers of civilians with TBI (n = 218) or service members/veterans (SMVs) with TBI (n = 315) completed 43 emotional suppression items, as well as other patient-reported outcomes and an estimate of the functional ability of the person with TBI.

RESULTS

Exploratory and confirmatory factor analyses supported the retention of 25 items. Graded response model (GRM) analyses and differential item functioning (DIF) studies supported the retention of 21 items in the final measure. Expert review and GRM calibration data were used to develop a 6-item static short form (SF) and program a computer adaptive test (CAT). Internal consistency was excellent for both the CAT and SF (reliabilities ≥ 0.91); 3-week test-retest stability was good (all intraclass correlations ≥ 0.89). Convergent validity was supported by moderate associations between TBI-CareQOL Emotional Suppression and related measures (rs from 0.47 to 0.59); discriminant validity was supported by small correlations between Emotional Suppression and positive aspects of caregiving and physical health (rs from 0.14 to 0.28). Known-groups validity was also supported.

CONCLUSIONS

The new TBI-CareQOL Emotional Suppression CAT and 6-item short form is the first self-report measure of this construct in this population. Our findings suggest this new measure has strong psychometric properties. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Development and Initial Validation of the PROMIS®-Plus-HF Profile Measure

Background Bringing together generic and heart failure (HF)-specific items in a publicly available, patient-reported outcome measure may facilitate routine health status assessment for improving clinical care and shared decision-making, assessing quality of care, evaluating new interventions, and comparing groups with different conditions. Methods and Results We performed a mixed-methods study to develop and validate the PROMIS®-Plus-HF (Patient-Reported Outcomes Measurement Information System®-Plus-Heart Failure) profile measure-a HF-specific instrument based on the generic PROMIS. We conducted 8 focus groups with 61 patients with HF and phone interviews with 10 HF clinicians. The measure was developed via an iterative process of reviewing existing PROMIS items and developing and testing new HF items. In a 600-patient sample, we estimated reliability (internal consistency; test-retest, with n=100 participants). We conducted validity analyses using Pearson r and Spearman ρ correlations with Kansas City Cardiomyopathy Questionnaire subscores. In a longitudinal sample, we performed responsiveness testing (paired t tests) with 75 patients with HF receiving interventions with expected health status improvement. The PROMIS-Plus-HF measure comprises 86 items (64 existing; 22 new) across 18 domains. Internal consistency reliability (Cronbach α) coefficients ranged from 0.52 to 0.96, with α≥0.70 in 12 of 17 domains. Test-retest intraclass correlation coefficients were ≥0.90. Correlations with Kansas City Cardiomyopathy Questionnaire subscores supported expected convergent ( r/ρ>0.60) and divergent validity ( r/ρ<0.30). In the longitudinal sample, 10 of 18 domains had improved ( P<0.05) scores from baseline to follow-up. Conclusions The PROMIS-Plus-HF profile measure-a complete assessment of physical, mental, and social health-exhibited good psychometric characteristics and may facilitate patient-centered care and research. Subsets of domains and items can be used depending on the clinical or research purpose.

The Development of a New Computer Adaptive Test to Evaluate Feelings of Being Trapped in Caregivers of Individuals With Traumatic Brain Injury: TBI-CareQOL Feeling Trapped Item Bank

OBJECTIVE

To develop a new patient-reported outcome measure that captures feelings of being trapped that are commonly experienced by caregivers of individuals with traumatic brain injury (TBI).

DESIGN

Cross-sectional.

SETTING

Three TBI Model Systems rehabilitation hospitals, an academic medical center, and a military medical treatment facility.

PARTICIPANTS

Caregivers (N=560) of civilians with TBI (n=344) and caregivers of service members/veterans with TBI (n=216).

INTERVENTIONS

Not applicable.

OUTCOME MEASURES

Traumatic Brain Injury Caregiver Quality of Life (TBI-CareQOL) Feeling Trapped item bank.

RESULTS

From an initial item pool of 28 items, exploratory and confirmatory factor analyses supported the retention of 16 items. After graded response model (GRM) and differential item functioning analyses were conducted, 15 items were retained in the final measure. GRM calibration data, along with clinical expert input, were used to choose a 6-item, static short form (SF), and the calibration data were used for programming of the TBI-CareQOL Feeling Trapped computer adaptive test (CAT). CAT simulation analyses produced an r=0.99 correlation between CAT scores and the full item bank. Three-week short-form test-retest reliability was very good (r=0.84).

CONCLUSIONS

The new TBI-CareQOL Feeling Trapped item bank was developed to provide a sensitive and efficient examination of the effect that feelings of being trapped, due to the caregiver role, have on health-related quality of life for caregivers of individuals with TBI. Both the CAT and corresponding 6-item SF demonstrate excellent psychometric properties. Future work is needed to establish the responsiveness of this measure to clinical interventions for these caregivers.

Abstract 101: The Development and Initial Validation of PROMIS-Plus-HF Profile Measure

Background: Bringing together generic and heart failure (HF)-specific items in a publicly-available, patient-reported outcome measure may facilitate better health status comparisons across groups and within individuals longitudinally in learning health systems and clinical research studies.

Methods and Results: We performed a mixed-methods study to develop and validate the PROMIS ® -Plus-HF profile measure, a HF-specific instrument based on the generic The Patient-Reported Outcomes Measurement Information System (PROMIS). We conducted eight focus groups with 61 HF patients and phone interviews with 10 HF clinicians. The measure was developed via an iterative process of reviewing existing PROMIS items and developing and testing new HF items. In 600-patient sample, we estimated reliability (internal consistency; test-retest, with n=100 participants). We conducted validity analyses using Pearson r and Spearman rho correlations with Kansas City Cardiomyopathy Questionnaire (KCCQ) subscores. In a longitudinal sample, we performed responsiveness testing (paired t-tests) with 75 HF patients receiving interventions with expected health status improvement. The PROMIS-Plus-HF measure comprises 86 items (64 existing; 22 new) across 18 domains. Internal consistency reliability (Cronbach’s alpha) coefficients ranged from 0.52-0.96, with alpha≥0.70 in 12/17 domains. Test-retest intraclass correlation coefficients were ≥0.90. Correlations with KCCQ subscores supported expected convergent ( r/rho >0.60) and divergent validity ( r/rho <0.30). In the longitudinal sample, 10/18 domains had improved (P<0.05) scores from baseline to follow-up.

Conclusions: The PROMIS-Plus-HF profile measure—a complete assessment of physical, mental, and social health—exhibited good psychometric characteristics and may facilitate patient-centered care and research. Subsets of domains, or the entire measure, can be used, depending on the clinical or research purpose.

The Development of a New Computer-Adaptive Test to Evaluate Strain in Caregivers of Individuals With TBI: TBI-CareQOL Caregiver Strain

OBJECTIVE

To develop a new measure of caregiver strain for use in caregivers of individuals with traumatic brain injury (TBI), Traumatic Brain Injury Caregiver Quality of Life (TBI-CareQOL) Caregiver Strain.

DESIGN

Qualitative data, literature reviews, and cross-sectional survey study.

SETTING

Three TBI Model Systems rehabilitation hospitals, an academic medical center, and a military medical treatment facility.

PARTICIPANTS

Caregivers (N=560) of civilians (n=344) or service members/veterans (SMVs) with TBI (n=216).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURE

TBI-CareQOL Caregiver Strain Item Bank.

RESULTS

Exploratory and confirmatory factor analyses, a graded response model (GRM) and differential item functioning supported the retention of 33 items in the final measure. GRM calibration data was used to inform the selection of a 6-item static short form, and to program the TBI-CareQOL Caregiver Strain computer-adaptive test (CAT). CAT simulation analyses indicated a 0.97 correlation between the CAT scores and the full item-bank. Three-week test-retest reliability was strong (r=0.83).

CONCLUSIONS

The new TBI-CareQOL Caregiver Strain CAT and corresponding 6-item short form were developed using established rigorous measurement development standards; this is the first self-reported measure developed to evaluate caregiver strain in caregivers of individuals with TBI.

Understanding Health-related Quality of Life in Caregivers of Civilians and Service Members/Veterans With Traumatic Brain Injury: Establishing the Reliability and Validity of PROMIS Mental Health Measures

OBJECTIVE

To provide important reliability and validity data to support the use of the Patient-Reported Outcomes Measurement Information System (PROMIS) mental health measures in caregivers of civilians or service members/veterans (SMVs) with traumatic brain injury (TBI).

DESIGN

Patient-reported outcome surveys administered through an electronic data collection platform.

SETTING

Three TBI model systems rehabilitation hospitals, an academic medical center, and a military medical treatment facility.

PARTICIPANTS

Caregivers (N=560) of individuals with a documented TBI (344 civilians and 216 military).

INTERVENTION

Not applicable.

MAIN OUTCOME MEASURES

PROMIS anxiety, depression, and anger item banks.

RESULTS

Internal consistency for all the PROMIS Mental Health item banks was very good (all α>.86) and 3-week test-retest reliability was good to adequate (ranged from .65 to .85). Convergent validity and discriminant validity of the PROMIS measures were also supported. Caregivers of individuals who were low functioning had worse emotional health-related quality of life (HRQOL) (as measured by the 3 PROMIS measures) than caregivers of high-functioning individuals, supporting known groups validity. Finally, levels of distress, as measured by the PROMIS measures, were elevated for those caring for low-functioning individuals in both samples (rates ranged from 26.2% to 43.6% for caregivers of low-functioning individuals).

CONCLUSIONS

Results support the reliability and validity of the PROMIS anxiety, depression, and anger item banks in caregivers of civilians and SMVs with TBI. Ultimately, these measures can be used to provide a standardized assessment of HRQOL because it relates to mental health in these caregivers.

Examining the Patient-Reported Outcomes Measurement Information System versus the Scoliosis Research Society-22r in adult spinal deformity

OBJECTIVE

After using PROsetta Stone crosswalk tables to calculate Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) and Pain Interference (PI) scores, the authors sought to examine 1) correlations with Scoliosis Research Society-22r (SRS-22r) scores, 2) responsiveness to change, and 3) the relationship between baseline scores and 2-year follow-up scores in adult spinal deformity (ASD).

METHODS

PROsetta Stone crosswalk tables were used to converted SF-36 scores to PROMIS scores for pain and physical function in a cohort of ASD patients with 2-year follow-up. Spearman correlations were used to evaluate the relationship of PROMIS scores with SRS-22r scores. Effect size (ES) and adjusted standardized response mean (aSRM) were used to assess responsiveness to change. Linear regression was used to evaluate the association between baseline scores and 2-year follow-up scores.

RESULTS

In total, 425 (425/625, 68%) patients met inclusion criteria. Strong correlations (all |r| > 0.7, p < 0.001) were found between baseline and 2-year PROMIS values and corresponding SRS-22r domain scores. PROMIS-PI showed a large ES (1.09) and aSRM (0.88), indicating good responsiveness to change. PROMIS-PF showed a moderate ES (0.52) and moderate aSRM (0.69), indicating a moderate responsiveness to change. Patients with greater baseline pain complaints were associated with greater pain improvement at 2 years for both SRS-22r Pain (B = 0.39, p < 0.001) and PROMIS-PI (B = 0.45, p < 0.001). Higher functional scores at baseline were associated with greater average improvements in both SRS-22r Activity (B = 0.62, p < 0.001) and PROMIS-PF (B = 0.40, p < 0.001).

CONCLUSIONS

The authors found strong correlations between the SRS-22r Pain and Activity domains with corresponding PROMIS-PI and -PF scores. Pain measurements showed similar and strong ES and aSRM while the function measurements showed similar, moderate ES and aSRM at 2-year follow-up. These data support further exploration of the use of PROMIS-computer adaptive test instruments in ASD.

Mobile Phones May Not Bridge the Digital Divide: A Look at Mobile Phone Literacy in an Underserved Patient Population

Purpose: Mobile health (mHealth) has promise to improve patient access to disease prevention and health promotion services; however, historically underserved populations may have poor access to mobile phones or may not be aware of or comfortable using phone features. Our objectives were to assess mobile phone ownership and mobile phone literacy among low-income, predominately racial and ethnic minority patients.

Materials and methods: We conducted a cross-sectional survey of a convenience sample of primary care patients in a publicly-funded clinic in Houston, TX.

Results: Of 285 participants, 240 owned a mobile phone and 129 owned a smartphone. The most common uses of phones were talk (89%) and text messaging (65%). Only 28% of smartphone owners had health apps. Younger age was significantly associated with smartphone ownership and use of smartphones for Internet browsing, social media, and apps.

Conclusion: Our findings from a safety-net patient population represent trends in mobile phone ownership and literacy. Despite the single-site location of our study, the findings could be helpful to health promotion practitioners working with similar underserved populations. mHealth interventions should employ phone features that are accessible and familiar to the target audience to avoid denying intervention benefits to those with low mobile phone literacy and therefore widen health disparities.

1770. The Association of Unmet Needs With Subsequent Retention in Care and HIV Suppression Among Hospitalized Patients With HIV Who Are Out of Care

Background

Unmet needs among hospitalized patients with HIV may prevent engagement in HIV care leading to worse clinical outcomes. Our aim was to examine the role of unmet subsistence needs (e.g., housing, transportation, food) and medical needs (e.g., mental health, substance abuse treatment) as barriers for retention in HIV care and viral load (VL) suppression.

Methods

We utilized data from the Mentor Approach for Promoting Patients’ Self-Care intervention study, the enrolled hospitalized HIV-patients at a large publicly funded hospital between 2010 and 2013, who were out-of-care. We examined the effect of unmet needs on retention in HIV care (attended HIV appointments within 0–30 days and 30–180 days) and viral load suppression, 6 months after discharge.

Results

A total of 417 participants were enrolled, 78% reported having ≥1 unmet need at baseline, most commonly dental care (55%), financial (43%), or housing needs (34%). Participants with unmet needs at baseline, compared with those with no needs, were more likely to be African American, have an existing HIV diagnosis, and be uninsured. Among participants who completed a baseline and 3-month survey (n = 320), 45% reported a need for dental care, 42% reported financial needs, and 32% reported housing needs that were unmet at either time point (Figure 1). Having a dental care need at baseline that was met was significantly associated with higher odds of VL improvements at 6-month follow-up (OR: 2.2; 95% CI: 1.04–4.50, P = 0.03) and higher odds for retention in care (OR: 2.06; 95% CI: 1.05–4.07, P = 0.04). An unmet need for transportation was associated with lower odds of retention in care (OR: 0.5; 95% CI: 0.34–0.94, P = 0.03), even after adjusting for other factors. Compared with participants with no need, those who reported ≥3 unmet subsistence needs were less likely to demonstrate viral load improvement (OR: 0.51; 95% CI: 0.28–0.92; P = 0.03) and to be retained in care (OR: 0.52; 95% CI: 0.28–0.95; P = 0.03).

Conclusion

An important and novel finding in our study is that the number of unmet subsistence needs had a significant effect on retention in care and VL suppression. Broader access to programs that can assist in meeting subsistence needs among hospitalized patients could have significant individual and public health benefits.

Disclosures

All authors: No reported disclosures.