Measuring physical function in patients with complex medical and postsurgical conditions: a computer adaptive approach

Nested Cohort Study to Identify Characteristics That Predict Near-Term Disablement From Lung Cancer Brain Metastases

OBJECTIVE

To test whether the presence of patient- and imaging-level characteristics (1) are associated with clinically meaningful changes in mobility among patients with late-stage cancer with metastatic brain involvement, and (2) can predict their risk of near-term functional decline.

DESIGN

Prospective nested cohort study.

SETTING

Quaternary academic medical center.

PARTICIPANTS

The study population consisted of a nested cohort of the patients with imaging-confirmed brain metastases (n=66) among a larger cohort of patients with late-stage lung cancer (N=311).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Functional evaluations with the Activity Measure for Post-Acute Care Computer Adaptive Test (AM-PAC-CAT) and symptom intensity ratings were collected at monthly intervals for up to 2 years.

RESULTS

In exploratory univariate models, whole brain radiation therapy (WBRT) and imaging findings of cerebellar or brainstem involvement were associated with large AM-PAC-CAT score declines reflecting worsening mobility (-4.55, SE 1.12; -2.87, SE, 1.0; and -3.14, SE 1.47, respectively). Also in univariate models, participants with new neurologic signs or symptoms at imaging (-2.48; SE .99), new brain metastases (-2.14, SE .99), or new and expanding metastases (-2.64, SE 1.14) declined significantly. Multivariate exploratory mixed logistic models, including WBRT, cerebellar/brainstem location, presence of new and expanding metastases, and worst pain intensity, had excellent predictive capabilities for AM-PAC-CAT score declines of 7.5 and 10 points (C statistics ≥0.8).

CONCLUSIONS

Among patients with lung cancer and brain metastases, cerebellar/brainstem location, new and expanding metastases, and treatment with WBRT may predict severe, near-term mobility losses and indicate a need to consider rehabilitation services.

How Receptive Are Patients With Late Stage Cancer to Rehabilitation Services and What Are the Sources of Their Resistance?

OBJECTIVE

To describe the proportion and characteristics of patients with late stage cancer that are and are not receptive to receiving rehabilitation services, and the rationale for their level of interest.

DESIGN

Prospective mixed-methods study.

SETTING

Comprehensive cancer center in a quaternary medical center.

PARTICIPANTS

Adults with stage IIIC or IV non-small cell or extensive stage small cell lung cancer (N=311).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Telephone-acquired responses to the administration of (1) the Activity Measure for Post Acute Care Computer Adaptive Test (AM-PAC-CAT); (2) numerical rating scales for pain, dyspnea, fatigue, general emotional distress, and distress associated with functional limitations; (3) a query regarding receptivity to receipt of rehabilitation services, and (4) a query about rationale for nonreceptivity.

RESULTS

Overall, 99 (31.8%) of the study's 311 participants expressed interest in receiving rehabilitation services: 38 at the time of enrollment and an additional 61 during at least 1 subsequent contact. Participants expressing interest were more likely to have a child as primary caregiver (18.18% vs 9.91%, P=.04) and a musculoskeletal comorbidity (42.4% vs 31.6%, P=.05). Function-related distress was highly associated with receptivity, as were lower AM-PAC-CAT scores. Reasons provided for lack of interest in receiving services included a perception of their limited benefit, being too busy, and prioritization below more pressing tasks/concerns.

CONCLUSIONS

One-third of patients with late stage lung cancer are likely to be interested in receiving rehabilitation services despite high levels of disability and related distress. These findings suggest that patient misperception of the role of rehabilitation services may be a barrier to improved function and quality of life. Efforts to educate patients on the benefits of rehabilitation and to more formally integrate rehabilitation as part of comprehensive care may curb these missed opportunities.

Structural connectome disruption at baseline predicts 6-months post-stroke outcome

In this study, models based on quantitative imaging biomarkers of post-stroke structural connectome disruption were used to predict six-month outcomes in various domains. Demographic information and clinical MRIs were collected from 40 ischemic stroke subjects (age: 68.1 ± 13.2 years, 17 female, NIHSS: 6.8 ± 5.6). Diffusion-weighted images were used to create lesion masks, which were uploaded to the Network Modification (NeMo) Tool. The NeMo Tool, using only clinical MRIs, allows estimation of connectome disruption at three levels: whole brain, individual gray matter regions and between pairs of gray matter regions. Partial Least Squares Regression models were constructed for each level of connectome disruption and for each of the three six-month outcomes: applied cognitive, basic mobility and daily activity. Models based on lesion volume were created for comparison. Cross-validation, bootstrapping and multiple comparisons corrections were implemented to minimize over-fitting and Type I errors. The regional disconnection model best predicted applied cognitive (R(2)  = 0.56) and basic mobility outcomes (R(2)  = 0.70), while the pairwise disconnection model best predicted the daily activity measure (R(2)  = 0.72). These results demonstrate that models based on connectome disruption metrics were more accurate than ones based on lesion volume and that increasing anatomical specificity of disconnection metrics does not always increase model accuracy, likely due to statistical adjustments for concomitant increases in data dimensionality. This work establishes that the NeMo Tool's measures of baseline connectome disruption, acquired using only routinely collected MRI scans, can predict 6-month post-stroke outcomes in various functional domains including cognition, motor function and daily activities. Hum Brain Mapp, 2016. © 2016 Wiley Periodicals, Inc.

Imaging and Clinical Characteristics Predict Near-Term Disablement From Bone Metastases: Implications for Rehabilitation

OBJECTIVE

To distinguish which patients with bone metastases are at risk for near-term disablement in order to assist clinicians in assessing the appropriateness of referrals for rehabilitation services.

DESIGN

Prospective cohort study.

SETTING

National Cancer Institute-designated comprehensive cancer center imbedded in a tertiary medical center.

PARTICIPANTS

Data were collected from members (n=78) of a patient cohort (N=311) with stage IIIB or IV non-small-cell lung cancer or extensive-stage small-cell lung cancer who developed new or progressive imaging-confirmed bone metastases during the 2-year course of the study.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Functional capabilities were assessed at 3- to 4-week intervals over the study's 2-year duration with the Activity Measure for Post-Acute Care Computer Adaptive Testing.

RESULTS

Seventy-eight participants developed new or progressive bone metastases during the study. Most were men, and 83% had non-small-cell lung cancer. Metastases were most frequently located in the ribs (n=62), pelvis (n=49), or the thoracic (n=60) and lumbar spine (n=44). While neither the number of bone metastases nor their specific location was associated with near-term changes in patient mobility, their association with pain or a focal neurologic deficit was strongly associated with large declines in mobility. Similarly, patients whose imaging studies revealed new metastases and the expansion of established metastases were more likely to lose mobility.

CONCLUSIONS

The total burden, specific locations, and overall distribution of bone metastases did not predict disablement. Patients with lung cancer-associated bone metastases are at markedly increased risk for declining mobility when their metastases are expanding in size and increasing in number, or are associated with pain or with new neurologic deficits.

Validity of the AM-PAC "6-Clicks" inpatient daily activity and basic mobility short forms

BACKGROUND

Standardized assessment of patients' activity limitations in acute care settings can provide valuable information. Existing measures have not been widely implemented.

OBJECTIVES

The aim of this study was to provide evidence for validity of scores on Activity Measure for Post-Acute Care (AM-PAC) "6-Clicks" measures of basic mobility and daily activity in acute care.

DESIGN

A retrospective measurement study was conducted.

METHODS

The study used a database from one health system containing "6-Clicks" scores from first and last physical therapist and occupational therapist visits for 84,446 patients. Validity was analyzed by examining differences in "6-Clicks" scores across categories of patient characteristics; the ability of "6-Clicks" scores to predict patients' having more than one therapy visit; correlation of "6-Clicks" scores with Functional Independence Measure (FIM) scores; and internal responsiveness over the episode of care. Internal consistency reliability also was determined.

RESULTS

The "6-Clicks" scores differed across patients' age, preadmission living situation, and number of therapy visits. The areas under receiver operating characteristic curves derived using "6-Clicks" scores at the first visit to predict patients receiving more than one visit were 0.703 and 0.652 using basic mobility and daily activity scores, respectively. The "6-Clicks" scores at the final visit were correlated with scores on subscales of the FIM completed on admission to inpatient rehabilitation facilities (r=.65 and .69). Standardized response means were 1.06 and 0.95 and minimal detectable changes with 90% confidence level (MDC90) were 4.72 and 5.49 for basic mobility and daily activity scores, respectively. Internal consistency reliability of basic mobility and daily activity scores was .96 and .91, respectively.

LIMITATIONS

Using clinical databases for research purposes has limitations, including missing data, misclassifications, and selection bias. Rater reliability is not known.

CONCLUSIONS

This study provides evidence for the validity of "6-Clicks" scores for assessing patients' activity limitations in acute care settings.

Challenges in outcome measurement: clinical research perspective

Comparative effectiveness research evaluates treatments as actually delivered in routine clinical practice, shifting research focus from efficacy and internal validity to effectiveness and external validity ("generalizability"). Such research requires accurate assessments of the numbers of patients treated and the completeness of their followup, their clinical outcomes, and the setting in which their care was delivered. Choosing measures and methods for clinical outcome research to produce meaningful information that may be used to improve patient care presents a number of challenges. WHERE ARE WE NOW?: Orthopaedic surgery research has many stakeholders, including patients, providers, payers, and policy makers. A major challenge in orthopaedic surgery outcome measurement and clinical research is providing all of these users with valid information for their respective decision making. At present, no plan exists for capturing data on such a broad scale and scope. WHERE DO WE NEED TO GO?: Practical challenges include identifying and obtaining resources for widespread data collection and merging multiple data sources. Challenges of study design include sampling to obtain representative data, timing of data collection in the episode of care, and minimizing missing data and study dropout. HOW DO WE GET THERE?: Resource limitations may be addressed by repurposing existing clinical resources and capitalizing on technologic advances to increase efficiencies. Increasing use of rigorous, well-designed observational research designs can provide information that may be unattainable in clinical trials. Such study designs should incorporate methods to minimize missing data, to sample multiple providers, facilities, and patients, and to include evaluation of potential confounding variables to minimize bias and allow generalization to broad populations.

A home-based exercise program to improve function, fatigue, and sleep quality in patients with Stage IV lung and colorectal cancer: a randomized controlled trial

CONTEXT

Exercise benefits patients with cancer, but studies of home-based approaches, particularly among those with Stage IV disease, remain small and exploratory.

OBJECTIVES

To conduct an adequately powered trial of a home-based exercise intervention that can be facilely integrated into established delivery and reimbursement structures.

METHODS

Sixty-six adults with Stage IV lung or colorectal cancer were randomized, in an eight-week trial, to usual care or incremental walking and home-based strength training. The exercising participants were instructed during a single physiotherapy visit and subsequently exercised four days or more per week; training and step-count goals were advanced during bimonthly telephone calls. The primary outcome measure was mobility assessed with the Ambulatory Post Acute Care Basic Mobility Short Form. Secondary outcomes included ratings of pain and sleep quality as well as the ability to perform daily activities (Ambulatory Post Acute Care Daily Activities Short Form), quality of life (Functional Assessment of Cancer Therapy-General), and fatigue (Functional Assessment of Cancer Therapy-Fatigue).

RESULTS

Three participants dropped out and seven died (five in the intervention and two in the control group, P=0.28). At Week 8, the intervention group reported improved mobility (P=0.01), fatigue (P=0.02), and sleep quality (P=0.05) compared with the usual care group, but did not differ on the other measures.

CONCLUSION

A home-based exercise program seems capable of improving the mobility, fatigue, and sleep quality of patients with Stage IV lung and colorectal cancer.

Does postacute care site matter? A longitudinal study assessing functional recovery after a stroke

OBJECTIVE

To determine the impact of postacute care site on stroke outcomes.

DESIGN

Prospective cohort study.

SETTING

Four northern California hospitals that are part of a single health maintenance organization.

PARTICIPANTS

Patients with stroke (N=222) enrolled between February 2008 and July 2010.

INTERVENTION

Not applicable.

MAIN OUTCOME MEASURE

Baseline and 6-month assessments were performed using the Activity Measure for Post Acute Care (AM-PAC), a test of self-reported function in 3 domains: Basic Mobility, Daily Activities, and Applied Cognition.

RESULTS

Of the 222 patients analyzed, 36% went home with no treatment, 22% received home health/outpatient care, 30% included an inpatient rehabilitation facility (IRF) in their care trajectory, and 13% included a skilled nursing facility (but not IRF) in their care trajectory. At 6 months, after controlling for important variables such as age, functional status at acute care discharge, and total hours of rehabilitation, patients who went to an IRF had functional scores that were at least 8 points higher (twice the minimally detectable change for the AM-PAC) than those who went to a skilled nursing facility in all 3 domains and in 2 of 3 functional domains compared with those who received home health/outpatient care.

CONCLUSIONS

Patients with stroke may make more functional gains if their postacute care includes an IRF. This finding may have important implications as postacute care delivery is reshaped through health care reform.

Designing and implementing a system for tracking functional status after stroke: a feasibility study

OBJECTIVE

To determine the feasibility of tracking stroke patients' functional outcomes in an integrated health system across a care continuum using the computer version of the Activity Measure of Post-Acute Care (AM-PAC).

SETTING

A large integrated health care system in northern California.

PARTICIPANTS

A total of 222 stroke patients (aged ≥18 years) who were hospitalized after an acute cerebrovascular accident.

METHODS

An AM-PAC assessment was made at discharge from sites of care, including acute hospital, inpatient rehabilitation hospital, skilled nursing facility, home during home care, and outpatient settings. Assessments also were completed in the patient's home at 6 months. Data from the AM-PAC program were integrated with the health care system's databases.

MAIN OUTCOME MEASUREMENTS

(1) AM-PAC administration time at the various sites of care; (2) assessment of a floor or a ceiling effect; and (3) administrative burden of tracking participants.

RESULTS

AM-PAC assessment sessions averaged 7.9 minutes for data acquisition in 3 domains: Basic Mobility, Activities of Daily Living, and Applied Cognition. Participants answered, on average, 27 AM-PAC questions per session. A small ceiling effect was observed at 6 months, and there was a larger ceiling effect when the instrument was administered in an institution, ie, when the AM-PAC institutional item bank was used rather than the community item bank. It was feasible to track patients and to assess their function using the AM-PAC instrument from institutional to community settings. Implementation of the AM-PAC in clinical environments, and the success of the project, were influenced by instrumental, technological, operational, resource, and cultural factors.

CONCLUSIONS

This study demonstrates the feasibility of implementing a single functional outcome instrument in clinical and community settings to measure rehabilitation functional outcomes of stroke patients. Integrating the AM-PAC measurement system into clinical workflows and the electronic medical record could provide assistance to clinicians for medical decision making, functional prognostication, and discharge planning.

Performance of an item response theory-based computer adaptive test in identifying functional decline

OBJECTIVE

To achieve a low respondent burden and increase the responsiveness of functional measurement by using an item response theory-based computer adaptive test (CAT), the Activity Measure for Post-Acute Care (AM-PAC) CAT.

DESIGN

Two-year prospective cohort study.

SETTING

Telephonic assessments from a quaternary medical center.

PARTICIPANTS

Patients (N=311) with late-stage lung cancer (LC).

INTERVENTIONS

Monthly assessments for up to 2 years. Disease progression was determined via record abstraction. Anchor-based responsiveness techniques were used to compare AM-PAC-CAT score changes between global rating of change (GRC) question response levels, as well as between intervals when adverse clinical events or symptom worsening did and did not occur. Distribution-based responsiveness assessments included calculation of the standardized effect size (SES) and standardized response mean (SRM).

MAIN OUTCOME MEASURES

AM-PAC-CAT, symptom numerical rating scales, and a GRC.

RESULTS

Administration time averaged 112 seconds over 2543 interviews. AM-PAC-CAT score changes became more positive as GRC responses reflected more improved states: a lot worse (-11.62), a little worse (-1.92), the same (-.10), a little better (1.01), and a lot better (2.82). Score changes were negative when associated with adverse clinical events. The SES and SRM for score differences between 1 to 2 and 9 to 10 months prior to death were -.87 and -1.13, respectively. The minimally important difference estimate was defined by the mean CAT session SE at 2.0.

CONCLUSIONS

The AM-PAC-CAT imposes a low, <2-minute, respondent burden, and distribution- and anchor-based methods suggest that is moderately responsive in patients with late-stage LC.

Evaluation of patient and proxy responses on the activity measure for postacute care

BACKGROUND AND PURPOSE

Our objective was to examine the agreement between adult patients with stroke and family member or clinician proxies in activity measure for postacute care (AM-PAC) summary scores for daily activity, basic mobility, and applied cognitive function.

METHODS

This study involved 67 patients with stroke admitted to a hospital within the Kaiser Permanente of Northern California system and were participants in a parent study on stroke outcomes. Each participant and proxy respondent completed the AM-PAC by personal or telephone interview at the point of hospital discharge or during ≥1 transitions to different postacute care settings.

RESULTS

The results suggest that for patients with a stroke proxy, AM-PAC data are robust for family or clinician proxy assessment of basic mobility function and clinician proxy assessment of daily activity function, but less robust for family proxy assessment of daily activity function and for all proxy groups' assessments of applied cognitive function. The pattern of disagreement between patient and proxy was, on average, relatively small and random. There was little evidence of systematic bias between proxy and patient reports of their functional status. The degree of concordance between patient and proxy was similar for those with moderate to severe strokes compared with mild strokes.

CONCLUSIONS

Patient and proxy ratings on the AM-PAC achieved adequate agreement for use in stroke research when using proxy respondents could reduce sample selection bias. The AM-PAC data can be implemented across institutional as well as community care settings while achieving precision and reducing respondent burden.

Linking the activity measure for post acute care and the quality of life outcomes in neurological disorders

OBJECTIVE

To use item response theory (IRT) methods to link physical functioning items in the Activity Measure for Post Acute Care (AM-PAC) and the Quality of Life Outcomes in Neurological Disorders (Neuro-QOL).

DESIGN

Secondary data analysis of the physical functioning items of AM-PAC and Neuro-QOL. We used a nonequivalent group design with 36 core items common to both instruments and a test characteristic curve transformation method for linking AM-PAC and Neuro-QOL scores. Linking was conducted so that both raw and scaled AM-PAC and Neuro-QOL scores (mean ± SD converted-logit scores, 50 ± 10) could be compared.

SETTING

AM-PAC items were administered to rehabilitation patients in post-acute care (PAC) settings. Neuro-QOL items were administered to a community sample of adults through the Internet.

PARTICIPANTS

PAC patients (N=1041) for the AM-PAC sample and community-dwelling adults (N=549) for the Neuro-QOL sample.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Mobility (N=25) and activity of daily living (ADL) items (N=11) common to both instruments were included in analysis.

RESULTS

Neuro-QOL items were linked to the AM-PAC scale by using the generalized partial credit model. Mobility and ADL subscale scores from the 2 instruments were calibrated to the AM-PAC metric.

CONCLUSIONS

An IRT-based linking method placed AM-PAC and Neuro-QOL mobility and ADL scores on a common metric. This linking allowed estimation of AM-PAC mobility and ADL subscale scores based on Neuro-QOL mobility and ADL subscale scores and vice versa. The accuracy of these results should be validated in a future sample in which participants respond to both instruments.

Outcome measurement for COPD: reliability and validity of the Dyspnea Management Questionnaire

BACKGROUND

The Dyspnea Management Questionnaire (DMQ) is a measure of the psychosocial and behavioral responses to dyspnea for adults with COPD. The research objectives were to evaluate the reliability and validity of an expanded DMQ item pool, as a preliminary step for developing a computer adaptive test.

METHODS

The original 66 items of the DMQ were used for the analyses. The sample included 63 women and 44 men with COPD (n = 107) recruited from two urban medical centers. We used confirmatory factor analysis to test the factor structure of the DMQ and its underlying cognitive-behavioral theoretical base. The internal consistency and test-retest reliability, and breadth of coverage of the expanded DMQ item bank were also evaluated.

RESULTS

Five distinct dyspnea domains were confirmed using 56 original items of the DMQ: dyspnea intensity, dyspnea anxiety, activity avoidance, activity self-efficacy, and strategy satisfaction. Overall, the breadth of items was excellent with a good match between sample scores and item difficulty. The DMQ-56 showed good internal consistency reliability (α = 0.85-to 0.96) and good preliminary test-retest reliability over a 3-week interval (ICC = 0.69-0.92).

CONCLUSIONS

The DMQ demonstrated acceptable levels of reliability and validity for measuring multidimensional dyspnea outcomes after medical, psychological, and behavioral interventions for adults with COPD.

Development of symptom assessments utilising item response theory and computer-adaptive testing--a practical method based on a systematic review

Assessment of individual patients' distress is a cornerstone of clinical care for advanced cancer. Patients' ability to fill out lengthy questionnaires is compromised by many factors. Computer-adaptive tests (CAT) offer a promising approach to developing tailored instruments, that administer only items relevant to the individual patient. A systematic review of the literature about CATs in medical databases was conducted. Based on the results, a method for developing a CAT was designed that requires nine steps: (1) build an item pool; (2) administer the items to a predefined sample in a calibration study; (3) eliminate inappropriate items; (4) examine whether all items are influenced by a single dominant trait; (5) calibrate the items to the best-fitting item response theory (IRT) model; (6) evaluate items' parameter equivalence across subgroups; (7) build an item bank with the calibrated items; (8) develop the CAT; and (9) pilot test the developed CAT. CAT offers the chance to extend the usefulness of patient-reported outcome (PRO) measurements from clinical studies to daily clinical practice.

Functioning and validity of a Computerized Adaptive Test to measure anxiety (A-CAT)

BACKGROUND

The aim of this study was to evaluate the Computerized Adaptive Test to measure anxiety (A-CAT), a patient-reported outcome questionnaire that uses computerized adaptive testing to measure anxiety.

METHODS

The A-CAT builds on an item bank of 50 items that has been built using conventional item analyses and item response theory analyses. The A-CAT was administered on Personal Digital Assistants to n=357 patients diagnosed and treated at the department of Psychosomatic Medicine and Psychotherapy, Charité Berlin, Germany. For validation purposes, two subgroups of patients (n=110 and 125) answered the A-CAT along with established anxiety and depression questionnaires.

RESULTS

The A-CAT was fast to complete (on average in 2 min, 38 s) and a precise item response theory based CAT score (reliability>.9) could be estimated after 4-41 items. On average, the CAT displayed 6 items (SD=4.2). Convergent validity of the A-CAT was supported by correlations to existing tools (Hospital Anxiety and Depression Scale-A, Beck Anxiety Inventory, Berliner Stimmungs-Fragebogen A/D, and State Trait Anxiety Inventory: r=.56-.66); discriminant validity between diagnostic groups was higher for the A-CAT than for other anxiety measures.

CONCLUSIONS

The German A-CAT is an efficient, reliable, and valid tool for assessing anxiety in patients suffering from anxiety disorders and other conditions with significant potential for initial assessment and long-term treatment monitoring. Future research directions are to explore content balancing of the item selection algorithm of the CAT, to norm the tool to a healthy sample, and to develop practical cutoff scores.

Evaluation of a computer-adaptive test for the assessment of depression (D-CAT) in clinical application

In the past, a German Computerized Adaptive Test, based on Item Response Theory (IRT), was developed for purposes of assessing the construct depression [Computer-adaptive test for depression (D-CAT)]. This study aims at testing the feasibility and validity of the real computer-adaptive application.The D-CAT, supplied by a bank of 64 items, was administered on personal digital assistants (PDAs) to 423 consecutive patients suffering from psychosomatic and other medical conditions (78 with depression). Items were adaptively administered until a predetermined reliability (r > or = 0.90) was attained. For validation purposes, the Hospital Anxiety and Depression Scale (HADS), the Centre for Epidemiological Studies Depression (CES-D) scale, and the Beck Depression Inventory (BDI) were administered. Another sample of 114 patients was evaluated using standardized diagnostic interviews [Composite International Diagnostic Interview (CIDI)].The D-CAT was quickly completed (mean 74 seconds), well accepted by the patients and reliable after an average administration of only six items. In 95% of the cases, 10 items or less were needed for a reliable score estimate. Correlations between the D-CAT and the HADS, CES-D, and BDI ranged between r = 0.68 and r = 0.77. The D-CAT distinguished between diagnostic groups as well as established questionnaires do.The D-CAT proved an efficient, well accepted and reliable tool. Discriminative power was comparable to other depression measures, whereby the CAT is shorter and more precise. Item usage raises questions of balancing the item selection for content in the future.

Adaptive short forms for outpatient rehabilitation outcome assessment

OBJECTIVE

To develop outpatient Adaptive Short Forms for the Activity Measure for Post-Acute Care item bank for use in outpatient therapy settings.

DESIGN

A convenience sample of 11,809 adults with spine, lower limb, upper limb, and miscellaneous orthopedic impairments who received outpatient rehabilitation in 1 of 127 outpatient rehabilitation clinics in the United States. We identified optimal items for use in developing outpatient Adaptive Short Forms based on the Basic Mobility and Daily Activities domains of the Activity Measure for Post-Acute Care item bank. Patient scores were derived from the Activity Measure for Post-Acute Care computerized adaptive testing program. Items were selected for inclusion on the Adaptive Short Forms based on functional content, range of item coverage, measurement precision, item exposure rate, and data collection burden.

RESULTS

Two outpatient Adaptive Short Forms were developed: (1) an 18-item Basic Mobility Adaptive Short Form and (2) a 15-item Daily Activities Adaptive Short Form, derived from the same item bank used to develop the Activity Measure for Post-Acute Care computerized adaptive testing program. Both Adaptive Short Forms achieved acceptable psychometric properties.

CONCLUSIONS

In outpatient postacute care settings where computerized adaptive testing outcome applications are currently not feasible, item response theory-derived Adaptive Short Forms provide the efficient capability to monitor patients' functional outcomes. The development of Adaptive Short Form functional outcome instruments linked by a common, calibrated item bank has the potential to create a bridge to outcome monitoring across postacute care settings and can facilitate the eventual transformation from Adaptive Short Forms to computerized adaptive testing applications easier and more acceptable to the rehabilitation community.

Computerized adaptive testing for follow-up after discharge from inpatient rehabilitation: II. Participation outcomes

OBJECTIVES

To measure participation outcomes with a computerized adaptive test (CAT) and compare CAT and traditional fixed-length surveys in terms of score agreement, respondent burden, discriminant validity, and responsiveness.

DESIGN

Longitudinal, prospective cohort study of patients interviewed approximately 2 weeks after discharge from inpatient rehabilitation and 3 months later.

SETTING

Follow-up interviews conducted in patient's home setting.

PARTICIPANTS

Adults (N=94) with diagnoses of neurologic, orthopedic, or medically complex conditions.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Participation domains of mobility, domestic life, and community, social, & civic life, measured using a CAT version of the Participation Measure for Postacute Care (PM-PAC-CAT) and a 53-item fixed-length survey (PM-PAC-53).

RESULTS

The PM-PAC-CAT showed substantial agreement with PM-PAC-53 scores (intraclass correlation coefficient, model 3,1, .71-.81). On average, the PM-PAC-CAT was completed in 42% of the time and with only 48% of the items as compared with the PM-PAC-53. Both formats discriminated across functional severity groups. The PM-PAC-CAT had modest reductions in sensitivity and responsiveness to patient-reported change over a 3-month interval as compared with the PM-PAC-53.

CONCLUSIONS

Although continued evaluation is warranted, accurate estimates of participation status and responsiveness to change for group-level analyses can be obtained from CAT administrations, with a sizeable reduction in respondent burden.

Computerized adaptive testing for follow-up after discharge from inpatient rehabilitation: I. Activity outcomes

OBJECTIVE

To examine score agreement, precision, validity, efficiency, and responsiveness of a computerized adaptive testing (CAT) version of the Activity Measure for Post-Acute Care (AM-PAC-CAT) in a prospective, 3-month follow-up sample of inpatient rehabilitation patients recently discharged home.

DESIGN

Longitudinal, prospective 1-group cohort study of patients followed approximately 2 weeks after hospital discharge and then 3 months after the initial home visit.

SETTING

Follow-up visits conducted in patients' home setting.

PARTICIPANTS

Ninety-four adults who were recently discharged from inpatient rehabilitation, with diagnoses of neurologic, orthopedic, and medically complex conditions.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Summary scores from AM-PAC-CAT, including 3 activity domains of movement and physical, personal care and instrumental, and applied cognition were compared with scores from a traditional fixed-length version of the AM-PAC with 66 items (AM-PAC-66).

RESULTS

AM-PAC-CAT scores were in good agreement (intraclass correlation coefficient model 3,1 range, .77-.86) with scores from the AM-PAC-66. On average, the CAT programs required 43% of the time and 33% of the items compared with the AM-PAC-66. Both formats discriminated across functional severity groups. The standardized response mean (SRM) was greater for the movement and physical fixed form than the CAT; the effect size and SRM of the 2 other AM-PAC domains showed similar sensitivity between CAT and fixed formats. Using patients' own report as an anchor-based measure of change, the CAT and fixed length formats were comparable in responsiveness to patient-reported change over a 3-month interval.

CONCLUSIONS

Accurate estimates for functional activity group-level changes can be obtained from CAT administrations, with a considerable reduction in administration time.