Setting individualised goals for people living with dementia and their family carers: A systematic review of goal-setting outcome measures and their psychometric properties

BACKGROUND

Individualised goal-setting outcome measures can be a useful way of reflecting people living with dementia and family carers' differing priorities regarding quality-of-life domains in the highly heterogeneous symptomatology of the disease. Evaluating goal-setting measures is challenging, and there is limited evidence for their psychometric properties.

AIM

(1) To describe what goal-setting outcomes have been used in this population; (2) To evaluate their validity, reliability, and feasibility in RCTs.

METHOD

We systematically reviewed studies that utilised goal-setting outcome measures for people living dementia or their family carers. We adapted a risk of bias and quality rating system based on the COSMIN guidelines to evaluate the measurement properties of outcomes when used within RCTs.

RESULTS

Thirty studies meeting inclusion criteria used four different goal-setting outcome measures: Goal Attainment Scaling (GAS), Bangor Goal Setting Interview (BGSI), Canadian Occupational Performance Measure (COPM) and Individually Prioritized Problems Assessment (IPPA); other papers have reported study-specific goal-setting attainment systems. Only GAS has been used as an outcome over periods greater than 9 months (up to a year). Within RCTs there was moderate quality evidence for sufficient content validity and construct validity for GAS, COPM and the BGSI. Reliability was only assessed in one RCT (using BGSI); in which two raters reviewed interview transcripts to rate goals with excellent inter-rater reliability. Feasibility was reported as good across the measures with a low level of missing data.

CONCLUSION

We found moderate quality evidence for good content and construct validity and feasibility of GAS, BGSI and COPM. While more evidence of reliability of these measures is needed, we recommend that future trials consider using individualised goal setting measures, to report the effect of interventions on outcomes that are most meaningful to people living with dementia and their families.

An exploratory international survey of the assessments and interventions used by occupational therapists and physiotherapists during the hospitalization of people with Guillain-Barré syndrome

Guillain-Barré syndrome is a rare neurological condition. Although some people make a substantial functional recovery, almost half require intensive rehabilitation. Data were collected using a cross-sectional survey which investigated the assessments and interventions used by occupational therapists and physiotherapists for people with Guillain-Barré syndrome. Seventy valid responses were received from 10 countries. The survey highlighted four factors about current practice: (i) practitioners did not identify the use of formal clinical guidelines or protocols for Guillain-Barré Syndrome treatment of the upper limb; (ii) a range of standardized and non-standardized assessment and goal-setting tools are utilized; (iii) interventions include passive and active range of motion exercises, and the prescription of upper limb/hand splints; and (iv) interdisciplinary practice is common in the intensive care unit and during acute phases of Guillain-Barré syndrome, whereas discipline-specific work is more common during rehabilitation. A range of goal-setting and assessment tools are used by occupational therapists and physiotherapists during the hospitalization of people with Guillain-Barré syndrome. The type and duration of interventions vary and may reflect the lack of international protocols for Guillain-Barré syndrome rehabilitation.

The effect of applying the nursing process based on the Theory of Goal Attainment on activities of daily living and quality of life in persons with multiple sclerosis during COVID-19 pandemic: a clinical trial

BACKGROUND

The chronic nature of multiple sclerosis (MS) affects patient's activities of daily living (ADL) and quality of life (QOL). Nursing interventions based on patients' active participation in goal-setting can be beneficial in improving ADL and QOL.

AIMS

This study aimed to determine the effect of applying the nursing process based on King's Theory of Goal Attainment (TGA) on ADL and QOL of persons with multiple sclerosis (PwMS) during the COVID-19 pandemic.

METHODS

In this clinical trial, 70 patients referred to the MS Society of Hamadan, Iran, were recruited using the convenience sampling method and randomly assigned into 2 groups. A 4-stage TGA was developed and implemented for the intervention group for a month. Data were gathered by ADL, instrumental ADL (IADL), and QOL questionnaires, and Goal of Attainment Scale (GAS) before and 2 months after the intervention.

RESULTS

Intervention group achieved a higher number of prioritized goals (p < 0.001) and reported higher QOL (P < 0.001) and instrumental ADL (IADL; P = 0.002) than the control group.

CONCLUSIONS

Given the results, TGA could effectively promote mutual goal attainment, QOL, and IADL for PwMS during the COVID-19 pandemic.

TRIAL REGISTRATION

ClinicalTriasl.gov Identifier: IRCT20201210049668N1.

A person-centered approach to home and community-based services outcome measurement

In the United States, over 2.5 million people with disabilities are recipients of supports through the Center for Medicare and Medicaid Services (CMS) Home and Community-Based Services (HCBS) program. Recent decades have seen a growing focus on providing HCBS in a person-centered manner thereby supporting outcomes that are both important for and to the person. HCBS outcome measurement, however, has not kept pace with advancements in person-centered thinking as it relates to providing supports to people with disabilities. The concept of person-centered outcome measurement has been inadequately defined and is frequently misunderstood including by those in the measurement field. The authors first operationally define person-centered measurement and establish its importance within the context of HCBS and the recent CMS's Final Settings Rule. The important role that person-centered measurement has to play in quality improvement efforts in this area is then explored. A discussion is subsequently provided as to the challenges that are faced in person-centered measurement specific to the disability field. In addition to further conceptualizing and defining this form of measurement, recommendations are provided for moving the field forward.

Challenges and future directions in the measurement of evidence-based practice: Qualitative analysis of umbrella review findings

RATIONALE, AIMS AND OBJECTIVES: An important aspect of scholarly discussions about evidence-based practice (EBP) is how EBP is measured. Given the conceptual and empirical developments in the study of EBP over the last 3 decades, there is a need to better understand how to best measure EBP in educational and clinical contexts. The aim of this study was to identify and describe the main challenges, recommendations for practice, and areas of future research in the measurement of EBP across the health professions as reported by systematic reviews (SRs).

METHODS

We conducted a secondary analysis of qualitative data obtained in the context of a previously published umbrella review that aimed to compare SRs on EBP measures. Two reviewers independently extracted excerpts from the results and discussion/conclusion sections of the 10 included SRs that aligned with the three research aims. An iterative six-phase reflexive thematic analysis according to Braun and Clarke was conducted.

RESULTS

Our thematic analysis produced five themes describing the main challenges associated with measuring EBP, four themes outlining main recommendations for practice, and four themes representing areas of future research. Challenges include limited psychometric testing and validity evidence for existing EBP measures; limitations with the self-report format; lack of construct clarity of EBP measures; inability to capture the complexity of the EBP process and outcomes; and the context-specific nature of EBP measures. Reported recommendations for practice include acknowledging the multidimensionality of EBP; adapting EBP measures to the context and re-examining the validity argument; and considering the feasibility and acceptability of measures. Areas of future research included the development of comprehensive, multidimensional EBP measures and the need for expert consensus on the operationalization of EBP.

CONCLUSIONS

This study suggests that existing measures may be insufficient in capturing the multidimensional, contextual and dynamic nature of EBP. There is a need for a clear operationalization of EBP and an improved understanding and application of validity theory.

Goal attainment scaling as an outcome measure for randomised controlled trials: a scoping review

OBJECTIVES

(1) Identify the healthcare settings in which goal attainment scaling (GAS) has been used as an outcome measure in randomised controlled trials. (2) Describe how GAS has been implemented by researchers in those trials.

DESIGN

Scoping review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews approach.

DATA SOURCES

PubMed, CENTRAL, EMBASE and PsycINFO were searched through 28 February 2022.

ELIGIBILITY CRITERIA

English-language publications reporting on research where adults in healthcare settings were recruited to a randomised controlled trial where GAS was an outcome measure.

DATA EXTRACTION AND SYNTHESIS

Two independent reviewers completed data extraction. Data collected underwent descriptive statistics.

RESULTS

Of 1,838 articles screened, 38 studies were included. These studies were most frequently conducted in rehabilitation (58%) and geriatric medicine (24%) disciplines/populations. Sample sizes ranged from 8 to 468, with a median of 51 participants (IQR: 30-96). A number of studies did not report on implementation aspects such as the personnel involved (26%), the training provided (79%) and the calibration and review mechanisms (87%). Not all trials used the same scale, with 24% varying from the traditional five-point scale. Outcome attainment was scored in various manners (self-report: 21%; observed: 26%; both self-report and observed: 8%; and not reported: 45%), and the calculation of GAS scores differed between trials (raw score: 21%; T score: 47%; other: 21%; and not reported: 66%).

CONCLUSIONS

GAS has been used as an outcome measure across a wide range of disciplines and trial settings. However, there are inadequacies and inconsistencies in how it has been applied and implemented. Developing a cross-disciplinary practical guide to support a degree of standardisation in its implementation may be beneficial in increasing the reliability and comparability of trial results.

PROSPERO REGISTRATION NUMBER

CRD42021237541.

A THEORETICAL BASED PHYSIOTHERAPY GOAL SETTING MODEL FOR ANTERIOR CRUCIATE LIGAMENT REHABILITATION

BACKGROUND

Anterior Cruciate Ligament rehabilitation is a lengthy process and requires appropriate goal setting strategies to help optimize patient and athlete outcomes. From a global perspective, ACL injury incidences are continuing to rise, with Australia and the USA having one of the highest incidences of ACL injury rates in the athletic population. In addition, physiotherapists are expected by their professional regulatory body to effectively use goal setting practices.

DESIGN

Theoretical Goal Setting Model consisting of three phases: 1) Pre goal setting phase (empower); 2) goal implementation phase (strive); and 3) goal evaluation phase (attain).

DISCUSSION

This model provides physiotherapists with a useful process so that key aspects of setting goals are considered and incoporporated. This model showcases a necessary path a physiotherapist and patient must journey together in order to enhance rehabilitation outcomes. This model will also advance the  physiotherapists' awareness of the multi-stages of the patients goal desires, intentions and commitment to their rehabilitation.

CONCLUSION

This model is a preliminary attempt to guide both practice, teaching, and research to ensure that goal setting practices in ACL rehabilitation are given an appropriate rehabilitative platform. The next stage is to empirically validate the practical application of the model and how each phase manifests.

Goal Attainment Scaling: An Idiographic Measure Sensitive to Parent and Teacher Report of IEP Goal Outcome Assessment for Students with ASD

Young students with ASD have instructional needs in social, communication, and learning skills that should be reflected in their Individualized Education Program (IEP). Research suggests that many of these goal areas present a challenge for special educators because of problems with measurability. The current study utilized an idiographic approach called Goal attainment scaling (GAS) for measuring IEP progress of individualized skills. Cross-sectional analysis of the associations between GAS ratings from an independent observer were correlated against teacher and parent ratings of IEP progress at the end of the school year and with standardized measures of the Behavior Assessment System for Children and Vineland Adaptive Behavior Scales (VABS). GAS scores were associated with parent and teacher ratings, including the VABS.

Promoting Career Design in Youth and Young Adults with ASD: A Feasibility Study

Recent calls by transition researchers in postsecondary transition have advocated for new approaches to transition services focused on career design, which uses career-related experiences based on a person's interests to develop goal setting and problem-solving abilities. Youth and young adults with autism spectrum disorder (ASD), who often have limited opportunity for career-related experiences, could benefit from career design intervention. This study examined the feasibility of using the Self-Determined Career Design Model (SDCDM) to enhance transition-related outcomes for twenty-five youth and young adults with ASD. Statistically significant gains were seen in goal attainment and occupational performance. This study provides preliminary evidence that the SDCDM can feasibly enhance outcomes for youth and young adults with ASD.

Assessing Activity of Daily Living Task Performance Among Autistic Adults

Activities of daily living (ADLs) are activities that people engage in on a routine basis, such as brushing their teeth, preparing a meal, and caring for their child. Independence with ADLs is associated with better outcomes in independent living, education, employment, relationships, and mental health. Therefore, this perspective piece includes a review of the literature and assessment databases to identify and summarize ADL assessments for Autistic adults. These assessments were compared and analyzed using the neurodiversity paradigm. Specifically, we compared assessments using predetermined priorities the authors identified: (1) assessment type, (2) inclusivity, and (3) performance factors. We identified five unique norm-referenced measures, four performance-based measures, and a variety of checklists, surveys, questionnaires, and/or interviews used to assess ADL performance among Autistic adults. The authors present their perspectives regarding the challenges with the current assessments, including the high-frequency use of norm-referenced assessments, lack of inclusivity, and failure to consider performance factors (e.g., sensory, motor, and emotional), and the paucity of assessments designed specifically for Autistic adults older than 30 years. In response to these challenges, we recommend researchers partner with Autistic adults to develop a new assessment tool. If researchers or clinicians are using existing measures, we recommend that they utilize self-report over proxy-report and include methods to improve the accessibility of the assessment. We also recommend that clinicians and researchers offer breaks, comfort objects, or sensory modifications during the assessment to decrease anxiety; and ask follow-up questions to understand whether environment or emotional health are impacting one's ADL performance.

Lay summary

Why is this topic important?: Activity of daily living (ADL) assessments are used to determine what Autistics can and cannot do in their day-to-day life, what services they may be eligible for, and to monitor gains. However, we struggled to find an assessment that was useful and relevant from an Autistic point-of-view.What is the purpose of this article?: The purpose of this article was to review and evaluate current ADL assessments usefulness for Autistics and provide recommendations for improving the ADL assessment process.What is the perspective of the authors?: The first author is an Autistic social worker and the second author is an occupational therapist and postdoctoral fellow. The authors' perspective is based in the neurodiversity paradigm and social model of disability, which centers on respecting and acknowledging differences in the brain and their effects on Autistics' lives. We believe in strengths-based approaches versus deficit-based models.What did you find about this topic?: We found 17 measurement tools, some that compared Autistic ADL performance with neurotypical performance, a few that were observation-based meaning the researcher or clinician watched the Autistic person complete the ADLs, and many forms or guides that asked questions about ADL performance. Only six measures allowed Autistic people to respond to the questions themselves, whereas the rest of the measures had someone else respond for them. These measures did not include questions about how sensory differences (e.g., feeling upset by the feeling of jeans or the taste of minty toothpaste) or feeling sad or nervous may also impact ADL performance.What do the authors recommend?: We recommend that researchers partner with Autistic adults to make new ADL assessments. If researchers or clinicians are using previously made ADL assessments, we recommend that they use self-report and adapt the materials to make it easier to understand (e.g., using pictures). We also recommend that researchers and clinicians ask Autistics what they need or want to make the assessment easier and more comfortable for them. Finally, researchers and clinicians should ask follow-up questions about sensory differences and whether someone is feeling sad or nervous to know how this impacts their ability to do their ADL tasks.How will these recommendations help autistic adults now or in the future?: These recommendations will help Autistic adults be more involved in the evaluation process, which will make the assessments more trustworthy and relevant to Autistics. This also could help more Autistic people get services and supports that are useful to them. Finally, this may help researchers when monitoring if these supports or services actually work.

Goal Attainment Scaling: A Framework for Research and Practice in the Intellectual and Developmental Disabilities Field

Goal setting and attainment is often a targeted outcome in the intellectual and developmental disabilities field; however, standardizing the measurement of attainment of individualized goals is challenging. The purpose of this article is to introduce a four-domain framework that provides a series of questions to research and evaluation teams in planning for the use of goal attainment scaling (GAS) as an outcome measure at the individual or aggregate level. We intend to stimulate discussion and ongoing work to further systematize how GAS is used in (a) intervention research to establish evidence-based practices and (b) practice to assess the extent to which interventions and supports lead to intended outcomes. The goal is to promote a clear planning process to inform data collection on individualized goal attainment outcomes that are rooted in goals and outcomes valued by people with intellectual and developmental disabilities.

Fostering implementation of knowledge into health practice: study protocol for the validation and redevelopment of the Knowledge Uptake and Utilization Tool

Background

Measurement of what knowledge is taken-up and how that information is used to inform practice and policies can provide an understanding about the effectiveness of knowledge uptake and utilization processes. In 2007, the Knowledge Uptake and Utilization Tool (KUUT) was developed to evaluate the implementation of knowledge into practice. The KUUT has been used by numerous large health organizations despite limited validity evidence and a narrow understanding about how the tool is used in practice and interpreted by users. As such, the overall purpose of this protocol is to redevelop the KUUT and gather validity evidence to examine and support its use in various health-related organizations. This protocol paper outlines a validation and redevelopment procedure for the KUUT using the unitary view of validity.

Methods

The protocol outlined in this article proceeds through four phases, starting with redeveloping the tool, then evaluating validity evidence based on: test content, response processes and internal structure. The initial phase gathers information to redevelop the tool, and evaluates item content and response format. The second phase evaluates response process validity evidence by examining how a variety of users interact with the tool. In the third phase, the tool will be pilot tested with knowledge users and, in the final phase, psychometric properties of the tool will be examined and a final scoring structure will be determined. A knowledge translation plan described herein outlines where the final tool will be housed and how the information about the tool will be disseminated.

Discussion

This protocol outlines a procedure to gather different sources of validity evidence for the KUUT. By addressing limitations in the original KUUT, such as complexities with scoring, a redeveloped KUUT supporting validity evidence will enhance the ability of health-related organizations to effectively use this tool for its intended purpose.

Assessing Patient Motivation for Treatment: A Systematic Review of Available Tools, Their Measurement Properties, and Conceptual Definition

BACKGROUND AND PURPOSE

Motivation is often reported by clinicians and researchers as a key factor related to treatment and health outcomes. This systematic review aims to (a) Identify and critically appraise tools that measure patient motivation for treatment and (b) determine how these tools define and evaluate motivation.

METHODS

Library databases and the search engine Google Scholar were examined. Identified tools measuring patient motivation for treatment and reported measurement properties were selected.

RESULTS

14 peer-reviewed articles covering 12 different tools made the final selection. Quality was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and a new measure checklist. Reliability evidence was predominantly estimated using internal consistency; validity evidence was limited, and responsiveness was seldom examined. Overall, quality ratings were poor or inadequately reported and serious methodological limitations were identified. A lack of conceptual foundation quality ratings as tools did not apply a theory related to motivation or have a clear definition of the construct of patient motivation.

CONCLUSIONS

A significant gap exists of available tools with adequate measurement properties that use relevant theoretical frameworks.