Sensitivity of the evaluation of social interaction measures among people with and without neurologic or psychiatric disorders

Functional assessment in mental health: lessons from occupational therapy

Occupational therapists have been conducting functional assessments since World War I, and this accumulated experience has taught us several critical lessons. First, a comprehensive profile of a patient's functioning requires multiple assessment methods. Second, assessment content and measurement constructs must change with the times. Third, technology can enhance and extend functional assessment. Fourth, performance-based assessments of everyday activities can also be used to measure body functions/impairments. However, while deconstructing activities into body functions/impairments is possible, the results do not reflect patients' abilities to integrate the cognitive, motor, sensory and affective functions necessary to complete a complex activity. Finally, the differential complexity of everyday activities that a patient can master or successfully complete can also provide a ruler with which to measure progress.

Experiences of Veterans Transitioning to Postsecondary Education

An increasing number of U.S. military veterans are entering postsecondary education with problems attributed to deployed military service. The primary objective of this research was to describe the lived experiences of student veterans transitioning from active military service to postsecondary education. Phenomenological interviews were performed with 13 student veterans who had transitioned from military deployment to postsecondary education. An overall essential meaning of "emerging in college culture" was manifested from three themes, supported by rich textural and structural descriptions of student veterans' experiences: (1) repurposing military experiences for life as a student veteran, (2) reconstructing civilian identity, and (3) navigating postsecondary context and interactions. These findings highlight implications that may facilitate occupational therapists' efforts in supporting the needs of student veterans.

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review

Introduction

Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning.

Objective

To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults.

Methods

A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria.

Results

Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity.

Conclusions

The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments.

Occupational therapy evaluation: use of self-report and/or observation?

BACKGROUND

The Occupational Therapy Intervention Process Model (OTIPM) serves to guide occupational therapists in their professional reasoning. The OTIPM prescribes evaluation of task performance based on both self-report and observation. Although this approach seems ideal, many clinicians raise the issue that time to perform evaluations is limited. It is, therefore, relevant to examine whether similar information concerning task performance can be obtained using self-report or observation.

OBJECTIVE

The aims were to investigate what information can be obtained regarding the quality of ADL task performance based on self-report and observation, respectively, and to examine the relationship between measures of self-reported and observed quality of ADL task performance.

METHODS

The quality of ADL task performance among 20 adults with depression was evaluated using the ADL Interview (ADL-I) and the Assessment of Motor and Process Skills (AMPS).

RESULTS AND CONCLUSIONS

Results indicated that participants both reported and demonstrated increased effort and/or fatigue, increased use of time, need for assistance, and safety problems. However, little relationship was found between measures of self-reported and observed quality of ADL task performance, supporting the use of both self-report and observation as part of the evaluation phase outlined in the OTIPM.

Systematic Review of Studies on Measurement Properties of Instruments for Adults Published in the American Journal of Occupational Therapy, 2009–2013

OBJECTIVE. We describe the methodological quality of recent studies on instrument development and testing published in the American Journal of Occupational Therapy (AJOT).

METHOD. We conducted a systematic review using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist to appraise 48 articles on measurement properties of assessments for adults published in AJOT between 2009 and 2013.

RESULTS. Most studies had adequate methodological quality in design and statistical analysis. Common methodological limitations included that methods used to examine internal consistency were not consistently linked to the theoretical constructs underpinning assessments; participants in some test–retest reliability studies were not stable during the interim period; and in several studies of reliability and convergent validity, sample sizes were inadequate.

CONCLUSION. AJOT’s dissemination of psychometric research evidence has made important contributions to moving the profession toward the American Occupational Therapy Association’s Centennial Vision. This study’s results provide a benchmark by which to evaluate future accomplishments.

Five years of mental health research in the American Journal of Occupational Therapy, 2009-2013

In the past 5 years, the number of research articles on occupational therapy in mental health published in the American Journal of Occupational Therapy has steadily declined. This article identifies the strengths and limitations of this body of research and provides directions for practitioners and researchers to enhance the profession's role as a valued mental health service provider.