Validation of the Everyday Technology Use Questionnaire in a Japanese Context

The Revised American Occupational Therapy Association Fieldwork Performance Evaluations: Evaluation of Internal Structure, Response Processes, and Precision-Part 2

IMPORTANCE

There is an evidence-based need to assess the validity and reliability/precision of the revised American Occupational Therapy Association's Fieldwork Performance Evaluation (FWPE) items for the occupational therapy student (OTS) and the occupational therapy assistant student (OTAS).

OBJECTIVE

To evaluate evidence of validity in relation to response processes, internal structure, and precision of the FWPEs.

DESIGN

Cross-sectional study design.

SETTING

OTS and OTAS fieldwork practice settings, United States.

PARTICIPANTS

Two hundred sixty-seven fieldwork educators participated in total, providing 228 OTS evaluations and 39 OTAS evaluations.

OUTCOMES AND MEASURES

A Rasch model was used to evaluate aspects of validity and precision.

RESULTS

The rating scales provided evidence of the tools' overall validity. Thirty-two of 37 items on the FWPE for the OTS, and 27 of 31 items on the FWPE for the OTAS demonstrated acceptable fit, but the evidence of unidimensionality in the subscales and in the total scales was not fully supported. The total/reduced FWPE scales were able to separate students into at least four distinct groups of fieldwork performance. The relationships between the current and revised FWPEs indicate that the new scales measure different but related constructs of student fieldwork performance, compared with the current version.

CONCLUSIONS AND RELEVANCE

The findings support that the revised FWPEs for the OTS and OTAS demonstrate preliminary evidence of internal structure, response processes, and precision, supporting evidence-based practice in fieldwork evaluations. What This Article Adds: This article highlights evidence demonstrating the validity and precision of the revised American Occupational Therapy Association's Fieldwork Performance Evaluation items and supports academic and fieldwork settings for occupational therapy students and occupational therapy assistant students.

The perceived challenge of everyday technologies in Sweden, the United States and England: Exploring differential item functioning in the everyday technology use questionnaire

Background: The changing technological environment is reflected in regular updates made to the everyday technology (ET) use questionnaire (ETUQ). Newly added ETs may not present comparable challenges across countries and diagnoses.Aims: To identify whether country context, or dementia diagnosis, impact ETs' challenge level.Material and methods: 315 older adults from three countries were included; Sweden (n = 73), United States (n = 114), England (n = 128), and had a confirmed diagnosis of mild dementia (n = 99) or no known cognitive impairment (n = 216). Differential Items Functioning (DIF) analysis was performed on 88 ETs included in the ETUQ by country and diagnosis. The impact of DIF was evaluated in a Differential Test Functioning (DTF) analysis.Results: Nine items (10.2%) in the ETUQ showed statistically significant DIF between countries; five of which were public space ETs and none of which were information and communication technologies (ICTs). Three ICT items, and no others, showed significant DIF by diagnosis. The items' DIF was shown to have no impact upon person measures of ability to use ET in the DTF.Conclusions and significance: The utility of the ETUQ in occupational therapy practice and research internationally is highlighted through the stability of the challenge hierarchy and lack of impact on person measures.

The use of everyday information communication technologies in the lives of older adults living with and without dementia in Sweden

Background: Increasingly services and interventions involve everyday information communication technologies (EICTs) in provision, however, use of EICTs among people with dementia is little known. Therefore, this study aimed to investigate the relevance, use, and ability to use EICTs between a group of older adults with dementia and a comparison group with no known cognitive impairment. Method: Interviews with 35 people with dementia, 34 comparison participants using the standardized Everyday Technology Use Questionnaire. Variables were compared using descriptive statistics, t-tests and correlation analyses. Results: Median 7 EICTs (maximum 31) were relevant to the group with dementia; significantly less than the comparison group's 11 (p< .05, d= 0.64). The difference in use appeared more pronounced (group with dementia 5, comparison group 10.5; p< .001, d= 0.93). Large, significant relationships were evident between ability to use technology, and relevant or used EICTs in the group with dementia. No such relationships in the comparison group. Conclusion: Differences in the amounts of EICTs relevant and used among people with and without dementia are further reflected in the dementia group's ability to use technology. Accommodating the demands that EICTs place on users and harnessing the dominant EICT relevancies and abilities of people with dementia better contributes towards an inclusive, dementia-friendly society.

Effectiveness of using assistive technology for time orientation and memory, in older adults with or without dementia

AIMS

The purposes of this study were to reveal the effectiveness of an electric calendar, showing the date and schedule automatically for older people, and to prove the characteristics of appropriate users.

MATERIAL AND METHODS

The participants were 27 older adults with or without dementia (9 men and 18 women, mean age: 81.5 ± 6.9 years, range: 72-94 years). The study design was a cross-over randomized controlled trial, with 15 participants (55.6%) allocated to the first group to use the electric calendar, and 12 participants (44.4%) to the second intervention group. The outcome measures are daily behaviors and cognitive function assessed by the Mini-Mental State Examination and Neurobehavioral Cognitive Status Examination.

RESULTS

Participants showed significant increase in total Mini-Mental State Examination score (p = 0.020, a paired t-test) after intervention period, whereas there was no significant difference after no intervention. Daily activities related healthcare were improved. The participants with positive outcomes showed higher motivations, and around 18 points in Mini-Mental State Examination. Most healthy older adults mentioned that electric calendars were useful, but unnecessary.

CONCLUSION AND SIGNIFICANCE

Using the electric calendar was effective in improving global cognitive function and daily activities. The target users are older people, who (1) might have mild dementia, (2) have difficulties in daily activities, (3) can be supported by caregivers, and (4) have positive motivation to new technologies.IMPLICATIONS FOR REHABILITATIONAn electric calendar is effective on grovel cognitive function, and activities of daily living related to healthcare in older adults, as well as reality orientation therapy.The electric calendar can be useful for older people with mild dementia or mild cognitive impairment, having difficulties activities of daily living, supported by caregivers at regular intervals.

Inter-rater and test-retest reliability of the Danish version of the everyday technology use questionnaire

BACKGROUND

Everyday technologies are naturally integrated in people's daily life. For older adults and adults living with a chronic disease like chronic obstructive pulmonary disease (COPD), the ability to use technologies for health management has become increasingly important. The aim of this study was to investigate inter-rater and test-retest reliability of the Danish version of the Everyday Technology Use Questionnaire (ETUQ) in a sample of older adults with (n = 23) and without (n = 24) COPD.

MATERIAL AND METHOD

The ETUQ was initially translated in accordance with the dual panel approach and then administered to a sample of 47 participants. Svensson's method for paired ordinal data was utilized to calculate and analyze reliability.

RESULTS

Overall, inter-rater and test-retest reliability of the Danish version of the ETUQ demonstrated excellent percentage agreement (PA) (>75%), although for test-retest reliability, nine items demonstrated fair (53%) to good (73%) agreement.

CONCLUSION

This study supports the use of the Danish version of the ETUQ in a sample of older adults with or without COPD. Application to practice: The Danish version of the ETUQ is an evidence-based evaluation that can reliably contribute to clinical occupational therapy and research in Denmark focusing on everyday technology use.

Everyday technology use among older adults in Sweden and Portugal

BACKGROUND

Technology use is relevant for engaging in everyday occupations and aging in place and difficulties might limit participation.

AIM

The aim of the present study was two-fold: to investigate the internal scale validity of the Everyday Technology Use Questionnaire (ETUQ) in a matched Portuguese and a Swedish sample of older adults without known cognitive impairments and to compare everyday technology use (i.e., the relevance of Everyday Technology (ET) and perceived difficulty of using ET).

METHODS

The Rasch rating scale model was used to investigate the psychometric properties of the data from the two countries. Analyses were then used to compare the samples.

RESULTS

There is evidence of internal scale and person response validity in the Swedish and Portuguese ETUQ datasets. The Swedish sample demonstrated almost 25% more ETs to be relevant, as compared to the Portuguese sample (p < .05). The samples' means of perceived difficulty in using ETs were similar.

CONCLUSIONS

The results support that the ETUQ is a valid assessment for measuring the relevance of and perceived difficulty of ET use and is able to detect differences and similarities between older adults in these European countries in relation to ET use in the home and society.

Cross-cultural validity of the German version of the Pediatric Evaluation of Disability Inventory (PEDI-G)-a Rasch model application

AIM

The aim of this study was to evaluate the cross-cultural validity of the German version of the Pediatric Evaluation of Disability Inventory (PEDI-G) when used in Austria, Germany and Switzerland.

METHOD

A total of 118 girls and 144 boys participated in this study; 198 of the children (75.6%) had a developmental disability and 64 (24.4%) were without a known disability. The mean age was four years (range 11 months to 10 years and six months, SD 1.91). Item goodness of fit, differential item functioning (DIF) and differential test functioning (DTF) were evaluated by use of a Rasch model.

RESULTS

Twenty-four (11.6%) out of 206 items of the Functional Skills Scale and one (5%) out of 20 items of the Caregiver Assistance Scale demonstrated misfit according to the Rasch model. Thirty-four (16.5%) out of 206 items of the Functional Skills Scale and no item from the Caregiver Assistance Scale demonstrated DIF. Almost half (46%) of the items demonstrating misfit also demonstrated DIF, indicating an association between them. The DIF by country only demonstrated a minimal impact on the person measures of the PEDI-G.

INTERPRETATION

Even though some items did not meet the statistical and clinical criteria set, the PEDI-G can be used, on a preliminary basis as a valid tool to measure activities of daily living of children with and without a disability in these countries. Further larger studies are needed to evaluate more psychometric item properties of the PEDI-G in relation to context.