Internet-Enabled Behaviors in Older Adults During the Pandemic: Patterns of Use, Psychosocial Impacts, and Plans for Continued Utilization

Assessing the Quality of ChatGPT Responses to Dementia Caregivers' Questions: Qualitative Analysis

Background

Artificial intelligence (AI) such as ChatGPT by OpenAI holds great promise to improve the quality of life of patients with dementia and their caregivers by providing high-quality responses to their questions about typical dementia behaviors. So far, however, evidence on the quality of such ChatGPT responses is limited. A few recent publications have investigated the quality of ChatGPT responses in other health conditions. Our study is the first to assess ChatGPT using real-world questions asked by dementia caregivers themselves.

objectives

This pilot study examines the potential of ChatGPT-3.5 to provide high-quality information that may enhance dementia care and patient-caregiver education.

Methods

Our interprofessional team used a formal rating scale (scoring range: 0-5; the higher the score, the better the quality) to evaluate ChatGPT responses to real-world questions posed by dementia caregivers. We selected 60 posts by dementia caregivers from Reddit, a popular social media platform. These posts were verified by 3 interdisciplinary dementia clinicians as representing dementia caregivers' desire for information in the areas of memory loss and confusion, aggression, and driving. Word count for posts in the memory loss and confusion category ranged from 71 to 531 (mean 218; median 188), aggression posts ranged from 58 to 602 words (mean 254; median 200), and driving posts ranged from 93 to 550 words (mean 272; median 276).

Results

ChatGPT's response quality scores ranged from 3 to 5. Of the 60 responses, 26 (43%) received 5 points, 21 (35%) received 4 points, and 13 (22%) received 3 points, suggesting high quality. ChatGPT obtained consistently high scores in synthesizing information to provide follow-up recommendations (n=58, 96%), with the lowest scores in the area of comprehensiveness (n=38, 63%).

Conclusions

ChatGPT provided high-quality responses to complex questions posted by dementia caregivers, but it did have limitations. ChatGPT was unable to anticipate future problems that a human professional might recognize and address in a clinical encounter. At other times, ChatGPT recommended a strategy that the caregiver had already explicitly tried. This pilot study indicates the potential of AI to provide high-quality information to enhance dementia care and patient-caregiver education in tandem with information provided by licensed health care professionals. Evaluating the quality of responses is necessary to ensure that caregivers can make informed decisions. ChatGPT has the potential to transform health care practice by shaping how caregivers receive health information.

The impact of technology-based compensatory behaviors on subjective cognitive decline in older adults with a family history of dementia

The current study examined whether greater use of technology to help with daily tasks is associated with less subjective cognitive decline (SCD), especially in individuals with a family history of Alzheimer's disease (AD). Individuals over the age of 50 (n = 102; age range 50-85) completed surveys about their digital and analog approaches to daily tasks, physical activity, and SCD. Participants with and without family histories of AD were matched on age, education, sex, and family history of AD using the R package MatchIt. There was no main effect of technology-based behavioral strategies on SCD (p = 0.259). However, a family history of AD moderated the association between technology use and SCD even when controlling for another protective lifestyle factor, physical activity. In individuals with a family history of AD, more reliance on technology-based behavioral strategies was associated with less SCD (p = 0.018), but this relationship was not significant in individuals without family history of AD (p = 0.511). Our findings suggest that technology-based behavioral strategies are associated with less SCD in individuals with a family history of AD, independent of another protective lifestyle factor. Future recommendations provided by healthcare providers to address SCD in cognitively unimpaired older adults might include focusing on technological assistance.

Technology use and subjective cognitive concerns in older adults

OBJECTIVES

How technology impacts the day to day cognitive functioning of older adults is a matter of some debate. On the one hand, the use of technologies such as smartphones and social media, may lead to more subjective cognitive concerns (SCC) by promoting distractibility and reliance on devices to perform memory tasks. However, continued digital engagement in older adults may also be related to better cognitive functioning. Given these competing viewpoints, our study evaluated if frequency of digital device use was associated with greater or less subjective cognitive concerns.

METHOD

Participants were 219 adults over the age of 65 (mean age =75 years) who had internet access. Measures assessing frequency of digital device use along with SCC were administered. Hierarchical multiple regression was used to gage association between frequency of device use and SCC, controlling for relevant demographic and lifestyle factors.

RESULTS

Increased frequency of digital device use was associated with less SCC, over and above the influence of demographic factors, across cognitive (but especially in executive) domains. This effect was observed for general device usage, with no statistically significant associations were observed between texting/video call, social media use and SCC.

DISCUSSION

Results were broadly consistent with the technological reserve hypothesis in that digital engagement was associated with better experienced cognitive functioning in older adults. While device use may contribute to distractibility in certain cases, the current results add to a burgeoning literature that digital engagement may be a protective factor for cognitive changes with age.