Evaluation of artificial intelligence clinical applications: Detailed case analyses show value of healthcare ethics approach in identifying patient care issues

This paper is one of the first to analyse the ethical implications of specific healthcare artificial intelligence (AI) applications, and the first to provide a detailed analysis of AI-based systems for clinical decision support. AI is increasingly being deployed across multiple domains. In response, a plethora of ethical guidelines and principles for general AI use have been published, with some convergence about which ethical concepts are relevant to this new technology. However, few of these frameworks are healthcare-specific, and there has been limited examination of actual AI applications in healthcare. Our ethical evaluation identifies context- and case-specific healthcare ethical issues for two applications, and investigates the extent to which the general ethical principles for AI-assisted healthcare expressed in existing frameworks capture what is most ethically relevant from the perspective of healthcare ethics. We provide a detailed description and analysis of two AI-based systems for clinical decision support (Painchek^® and IDx-DR). Our results identify ethical challenges associated with potentially deceptive promissory claims, lack of patient and public involvement in healthcare AI development and deployment, and lack of attention to the impact of AIs on healthcare relationships. Our analysis also highlights the close connection between evaluation and technical development and reporting. Critical appraisal frameworks for healthcare AIs should include explicit ethical evaluation with benchmarks. However, each application will require scrutiny across the AI life-cycle to identify ethical issues specific to healthcare. This level of analysis requires more attention to detail than is suggested by current ethical guidance or frameworks.

Transportation challenges for persons aging with mobility disability: Qualitative insights and policy implications

BACKGROUND

Persons aging with mobility disability (PAwMD) experience transportation barriers, which can hinder their ability to fully participate in society. Despite a vast infrastructure of federal laws and programs designed to ensure access to transportation, PAwMD remain a transportation-disadvantaged population.

OBJECTIVES

This paper presents detailed insights on transportation challenges experienced by PAwMD along with recent Federal programmatic initiatives designed to enhance access and mobility for transportation for older adults and people with disabilities. To identify policy gaps and opportunities to improve transportation services, we compared individual-level challenges from PAwMD to national survey data about barriers associated with delivering transportation services at state and local levels.

METHODS

To assess individual-level transportation challenges, we conducted in-depth, structured interviews with sixty older adult participants with self-identified mobility disabilities for at least 10 years. We also conducted a content analysis of end-user transportation challenges and agency-level transportation coordination barriers to identify correspondences.

RESULTS

Participants reported challenges utilizing public and private modes of transportation, related to availability; accessibility; safety; advanced planning; as well as societal attitudes. Barriers to the availability, delivery, and coordination of access and mobility services are linked directly or indirectly to the PAwMD reports of experiencing a shortage of accessible transportation options.

CONCLUSIONS

Findings highlight the complexity of federal transportation policies and programmatic initiatives designed to support older adults and people with disabilities, which contribute to implementation barriers and transportation challenges. Results highlight the importance of integrating end-user and state and local provider input into transportation policy development and program implementation.

Activism and Bioethics: Taking a Stand on Things That Matter

The question of whether activism should be overtly embraced as part of the bioethicist's role deserves serious consideration. Like others, we agree that bioethics is inescapably partisan; bioethical deliberation is based on trying to determine morally relevant features of situations and morally justifiable outcomes. Where disagreement arises is over the degree to which bioethicists should be activists. Meyers argues for a somewhat circumscribed role, limited to action on ethically concerning institutional matters, for those who are financially independent of the institutions. We take a broader view, arguing that some issues are so morally egregious that there is a duty to take a stand against them, even if the prospects of success are dim. There is a need for further debate, sharing of experiences, and analysis of case studies, to support bioethicists who take a stand.

Modeling Task Scheduling Decisions of Emergency Department Physicians

OBJECTIVE

This study evaluated task-scheduling decisions in the context of emergency departments by comparing patterns of emergency physicians' task-scheduling models across levels of experience.

BACKGROUND

Task attributes (priority, difficulty, salience, and engagement) influence task-scheduling decisions. However, it is unclear how attributes interact to affect decisions, especially in complex contexts. An existing model of task scheduling, strategic task overload management-no priority (STOM-NP), found that an equal weighting of attributes can predict task-scheduling behavior. Alternatively, mathematical modeling estimated that priority alone could make similar predictions as STOM-NP in a parsimonious manner. Experience level may also influence scheduling decisions.

METHOD

An experimental design methodology shortened a judgment analysis approach to compare a priori task-scheduling decision strategies. Emergency physicians with two levels of experience rank-ordered 10 sets of 3 tasks varying on 4 task attributes in this complex environment.

RESULTS

Bayesian statistics were used to identify best-fit decision strategies. STOM-NP and priority-only provided the best model fits. STOM-NP fit the lower-experienced physicians best, whereas priority-only-using only one cue-fit the higher-experienced physicians best.

CONCLUSION

Models of decision strategies for task-scheduling decisions were extended to complex environments. Experts' level of experience influenced task-scheduling decisions, where the scheduling decisions of more-experienced experts was consistent with a more frugal decision process. Findings have implications for training and evaluation.

APPLICATION

We assessed models of cues that influence task-scheduling decisions, including a parsimonious model for task priority only. We provided a sample approach for shortening methods for understanding decisions.

A Framework for Design of Conversational Agents to Support Health Self-Care for Older Adults

OBJECTIVE

We examined the potential of conversational agents (CAs) to support older adults' self-care related to chronic illness in light of lessons learned from decades of pedagogical agent research, which investigates the impact and efficacy of CAs for a wide range of learners.

BACKGROUND

The role of CAs in education (i.e., pedagogical agents) has been long studied, but their potential for supporting self-care has received less attention, especially for older adults.

METHODS

We reviewed work on pedagogical agents and considered how it informs the design of CAs for older adults. We propose a framework for designing CAs to support older adult self-care, which organizes a review of work in this area and integration with the pedagogical agent literature.

RESULTS

Our review of the pedagogical agent literature revealed an evolution from teaching machines to interactive, social systems that influence student motivational as well as learning outcomes. To integrate this review with work on CAs and self-care, we developed a framework that specifies how self-care goals evolve with stages of an illness, communication goals that support self-care at each stage, patient needs, and requirements for CAs to support these needs. The review identified an agenda for future research on CA functions and features that help older adults accept need for self-care, establish self-care, and sustain self-care over time.

CONCLUSIONS

Integrating insights from the pedagogical agent literature with research on developing CAs for self-care defines an agenda for developing and evaluating CAs to help older adults manage illness.

Acute effects of aerobic exercise and relaxation training on fatigue in breast cancer survivors: A feasibility trial

OBJECTIVE

This three-armed randomized controlled feasibility trial tested the acceptability and acute effects of aerobic exercise and technology-guided mindfulness training (relative to standalone interventions) on cancer-related fatigue among breast cancer survivors (BCS).

METHODS

BCS recruited from Central Illinois completed pre- and post-testing using established measures and were randomized to one of three groups (combined aerobic exercise with guided-mindfulness relaxation, aerobic exercise only, and relaxation only), conducted in three 90 min sessions over the course of 7 days in a fitness room and research office on a university campus.

RESULTS

We enrolled 40 BCS (M_age = 57.33 ± 8.75), M_BMI = 27.38 ± 5.27, M_fatigue = 4.56 ± 1.81 as measured by the Piper Fatigue Scale. More favorable post-intervention evaluations were reported by the combined group, compared to aerobic exercise or relaxation only (p < 0.05). Reductions in fatigue favoring the combined group (p = 0.05) showed a modest effect size (Cohen's d = 0.91) compared to aerobic exercise only.

CONCLUSIONS

These findings provide preliminary evidence for the feasibility of combining evidence-based techniques to address fatigue among BCS. The combined approach, incorporating mobile health technology, presents an efficacious and well-received design. If replicated in longer trials, the approach could provide a promising opportunity to deliver broad-reaching interventions for improved outcomes in BCS. Preregistered-ClinicalTrials NCT03702712.

Against the use and publication of contemporary unethical research: the case of Chinese transplant research

Recent calls for retraction of a large body of Chinese transplant research and of Dr Jiankui He's gene editing research has led to renewed interest in the question of publication, retraction and use of unethical biomedical research. In Part 1 of this paper, we briefly review the now well-established consequentialist and deontological arguments for and against the use of unethical research. We argue that, while there are potentially compelling justifications for use under some circumstances, these justifications fail when unethical practices are ongoing-as in the case of research involving transplantations in which organs have been procured unethically from executed prisoners. Use of such research displays a lack of respect and concern for the victims and undermines efforts to deter unethical practices. Such use also creates moral taint and renders those who use the research complicit in continuing harm. In Part 2, we distinguish three dimensions of 'non-use' of unethical research: non-use of published unethical research, non-publication, and retraction and argue that all three types of non-use should be upheld in the case of Chinese transplant research. Publishers have responsibilities to not publish contemporary unethical biomedical research, and where this has occurred, to retract publications. Failure to retract the papers implicitly condones the research, while uptake of the research through citations rewards researchers and ongoing circulation of the data in the literature facilitates subsequent use by researchers, policymakers and clinicians.

Revisiting the equity debate in COVID-19: ICU is no panacea

Throughout March and April 2020, debate raged about how best to allocate limited intensive care unit (ICU) resources in the face of a growing COVID-19 pandemic. The debate was dominated by utility-based arguments for saving the most lives or life-years. These arguments were tempered by equity-based concerns that triage based solely on prognosis would exacerbate existing health inequities, leaving disadvantaged patients worse off. Central to this debate was the assumption that ICU admission is a valuable but scarce resource in the pandemic context.In this paper, we argue that the concern about achieving equity in ICU triage is problematic for two reasons. First, ICU can be futile and prolong or exacerbate suffering rather than ameliorate it. This may be especially true in patients with COVID-19 with emerging data showing that most who receive access to a ventilator will still die. There is no value in admitting patients with poor prognostic indicators to ICU to meet an equity target when intensive critical care is contrary to their best interests. Second, the focus on ICU admission shifts focus away from important aspects of COVID-19 care where there is greater opportunity for mitigating suffering and enhancing equitable care.We propose that the focus on equity concerns during the pandemic should broaden to include providing all people who need it with access to the highest possible standard of end-of-life care. This requires attention to culturally safe care in the following interlinked areas: palliative care, communication and decision support and advanced care planning.

Design guidance for video chat system to support social engagement for older adults with and without mild cognitive impairment

Background

Social engagement technologies offer an opportunity to reduce social isolation. However, there are barriers to adoption among older adults with and without Mild Cognitive Impairment (MCI). Technology designed to meet the needs of those users may improve the acceptability, adoption, and benefits of social engagement technology.

Objective

The goal was to assess older adults' needs and preferences for using video chat systems. We used the Technology Acceptance Model as a framework for evaluating and optimizing usability of a web-based video chat system for older adults with and without MCI.

Methods

Mixed methods (qualitative and quantitative) were used to achieve this objective. We developed questionnaires and interviews to identify experiences with video chat, and preferences and attitudes towards a web-based video chat system. We conducted heuristic analysis to evaluate and improve the usability of the system.

Results

Participants reportedly used video chat less than other social network tools (e.g., Email). They were open to using a web-based video chat system to meet new people of all ages with shared interests. Their favorite topics of conversation were books, health, family, and exercise. Their ideal group size for a video chat session was 3 to 6 people. Overall, participants' attitudes toward the system were positive and they perceived the system as easy to use and useful for social engagement. Their evaluations indicated high usability of the system. However, individuals with MCI might require additional assistance to use the system. Usability issues were identified, such as technical terminology, small font size, and potentially confusing icons that were addressed in the redesign.

Conclusion

Older adults, with and without MCI, were interested in using a social engagement technology to interact with previously unfamiliar individuals with shared interests. They provided valuable insights for the design of the systems. Our findings provide guidance for the design of social engagement technologies. Our research approach serves as a case study for the assessment of other technology platforms.

Defining Aging in Place: The Intersectionality of Space, Person, and Time

Aging in place (AIP) is a term that is commonly used and defined in a plethora of ways. Multiple disciplines take a different stance on the definition of AIP, and its definition has evolved over time. Such diverse ways to define AIP could be a barrier to reach a shared expectation among multiple stakeholders when formulating research studies, making policy decisions, developing care plans, or designing technology tools to support older adults. We conducted a scoping review for the term AIP to understand specifically how it has been defined across time and disciplines. We collected exemplary definitions of AIP from 7 databases that represent different fields of study; namely, AgeLine, Anthropology Plus, Art and Architecture Source, CINAHL, PsycINFO, PubMed, and SocINDEX. We conducted a thematic analysis to identify the common concepts that emerged across the definitions identified in the scoping review. We developed 3 main categories from the themes: space, person, and time to illustrate the root of meaning across the definitions. Intersectionality across the categories yielded a comprehensive understanding of AIP, which does not constrain its definition to a place-related phenomenon. We propose that AIP be defined as "One's journey to maintain independence in one's place of residence as well as to participate in one's community." With this shared understanding of the term AIP, policymakers, researchers, technology designers, and caregivers can better support those who aim to age in the place of their choice.

Aging Concerns, Challenges, and Everyday Solution Strategies (ACCESS) for adults aging with a long-term mobility disability

BACKGROUND

There are growing numbers of adults aging with long-term mobility disabilities. Very little is known about the challenges this population experiences with everyday activities, and such challenges are likely to be greater and more complex than those of older adults who experience mobility declines later in life.

OBJECTIVES

The current manuscript presents in-depth insights on the specific activity challenges experienced by older adults with long-term mobility disabilities, and the response strategies they employ to overcome those challenges.

METHODS

In-depth, structured interviews designed to assess challenges and response strategies for a range of daily activities were conducted with sixty older adult participants (ages 60-79) who self-identified as having a mobility disability for a minimum of 10 years. A coding scheme was developed to classify emerging themes. We identify the most common challenges and responses reported across all 6 broad categories as well as for a single activity category as an exemplar of an in-depth activity analysis.

RESULTS

A needs taxonomy revealed challenges and response themes in relation to the most difficult activities identified by the participants. Frequently reported challenges included physical limitations and accessibility challenges. Common response strategies (e.g., utilizing tools or technologies, obtaining assistance from others, or modifying the approach to the task) were successfully mapped onto the Selection, Optimization, and Compensation model.

CONCLUSIONS

Findings reveal the unique challenges individuals face when engaging in everyday activities, and the potential of affordable and effective supports to promote aging-in-place, functional independence, and community engagement for adults aging with long-term mobility disability.

The TechSAge Minimum Battery: A multidimensional and holistic assessment of individuals aging with long-term disabilities

BACKGROUND

People with disabilities acquired in early to mid-life are living longer, contributing to growing numbers of older adults who are aging with disability, an understudied population likely to be underserved.

OBJECTIVES

This paper demonstrates the usefulness of the TechSAge Minimum Battery as a holistic assessment of health for people aging with disabilities.

METHODS

Survey data of socio-demographic and health characteristics were collected from 176 older adults with long-term vision, hearing, and/or mobility disabilities. A series of descriptive and bivariate analyses were conducted to illustrate the heterogeneity of the sample. An in-depth analysis of the subsample with vision difficulty was conducted to highlight the tool's value in assessing detailed contextual information for a specific disability.

RESULTS

Prevalence of health conditions (M = 4.1; SD = 2.5), prescription medications (M = 4.1; SD = 3.9), and serious functional difficulties (M = 1.6; SD = 0.85) indicated a fair degree of comorbidity, but with considerable variation in number and type among individuals. Subjective health ratings were high overall, but lower scores were correlated with additional comorbidities (r = -0.31-0.40, p =<.001). Analyses of the subsample with vision difficulty demonstrated heterogeneity in functional capacity, degree of impairment, duration, and use of supportive aids.

CONCLUSIONS

Findings highlighted the heterogeneity among people aging with disability and demonstrated the importance of capturing multi-dimensional factors inclusive of an individual's capacity, context, and personal factors, which the Minimum Battery provides in an integrated assessment. Potential healthcare applications of the tool are discussed with implications for bridging aging and disability services.

Depressive Symptoms as a Predictor of Memory Complaints in the PRISM Sample

Objectives

The current study investigated baseline and longitudinal relationships between memory complaints, depressive symptoms, and cognition in older adults.

Method

Using the sample from the Personal Reminder Information and Social Management trial, we generated path models predicting self-rated memory complaints measured by the Memory Functioning Questionnaire (MFQ).

Results

Our baseline models showed that more depressive symptoms were associated with reporting more frequent forgetting incidents and a greater decline in memory function. The baseline models also revealed that higher scores in a latent cognitive function were associated with reporting a greater decline in memory functioning and a greater use of mnemonics. However, cognitive predictors did not mediate the baseline associations between the MFQ measures and depressive symptoms. Further, these predictors were not able to directly predict the 12-month MFQ measures over and above the baseline effects. Including personality traits (neuroticism and conscientiousness) did not significantly affect the models.

Discussion

Our results suggest that memory complaints about frequency of forgetting can be the most reliable indicator of depression risk among the four factors in the MFQ. We discuss theoretical implications for longitudinal relationships between memory complaints, depressive symptoms, and cognitive function in older adults.

EXPLORING VIDEO CHAT FOR SOCIAL ENGAGEMENT IN OLDER ADULTS WITH AND WITHOUT COGNITIVE IMPAIRMENT

Social engagement technologies have the potential to benefit health and quality of life in older adults with and without mild cognitive impairment (MCI). However, technologies are rarely designed to accommodate the interests, capabilities, and limitations of these populations. In the current study, we focused on examining the potential of video chat to socially engage older adults with and without MCI by providing opportunities to link people with shared interests. Eight cognitively normal older adults (Mage: 73.3 years) and five with MCI (Mage: 70.0 years) completed a four-week experiential field trial using a novel online video chat platform called OneClick. System Usability Scale scores at both pre- and post-assessment revealed that OneClick was easy to use for older adults with and without MCI, however individuals with MCI experienced more technical issues and required additional assistance to use the system. Pre- to post- comparisons of questionnaire data revealed positive changes for the Quality of Life, Friendship/Social Isolation, and Loneliness scales in both groups. Of the 13 participants, five cognitively normal and four individuals with MCI reported that they would be interested in continuing to use the video chat system at home to connect with family and friends or to discuss topics of mutual interests. Overall, all participants enjoyed using the video chat system as a means for social engagement and showed trends for social health and quality of life benefits. This field trial illustrates the potential for video chat to provide social engagement opportunities for older adults with and without cognitive impairment.

UNDERSTANDING ACCEPTANCE OF HEALTHCARE TECHNOLOGY BY OLDER ADULTS: IMPLICATIONS FOR ADOPTION

Healthcare Technology (HCT) can support older adults as it is not uncommon for them to be managing one or more chronic diseases at a time. Thus, understanding older adults’ willingness to use HCTs can guide introduction of new technologies to help with their health management. The purpose of the research is to understand what influential factors emerged when older adults considered using new HCTs and how well current models of technology acceptance represented these factors. Twenty-three older adults (age 65-84) with hypertension completed a semi-structured interview to gain insight into these factors. During the interview, participants were first presented with a scenario to imagine and one of three HCTs (blood pressure monitor, electronic pillbox, and multifunctional healthcare robot) to consider. The qualitative coding identified: (a) facilitators: perceived advantages, easy to use, familiar, useful, and advice acceptance from a healthcare provider; (b) barriers: good for others, not good for me, disadvantages, and unfamiliar; and (c) transition factors that can lead to acceptance: with advice acceptance from a healthcare provider. These findings provide recommendations which can inform dissemination of new HCTs. Recommendations include: highlight the facilitators when introducing new HCT, understand the barriers and transition factors to give support where needed, and include the care network (i.e., people knowledgeable about the HTC and health conditions) to recommend the technology.

SMART HOME TECHNOLOGY FOR OLDER ADULTS WITH MOBILITY DISABILITIES: POTENTIAL AND CHALLENGES

Recently, there has been a significant expansion in the number of smart and connected technologies for assisting individuals with a variety of tasks within the home. Examples include digital home assistants (e.g., Amazon Echo), smart lights, smart plugs, robotic vacuums, as well as a multitude of other devices. Such technologies hold the potential to support independence for older adults with long-term mobility disabilities, as they may experience challenges engaging in daily activities. The aim of the current study was to utilize a comprehensive approach with an interdisciplinary team to improve understanding of how to integrate smart technology into older adults’ homes. We focused on identifying functionality that would be useful to them, understanding their perceptions, and developing instructional support. We conducted interviews among older adults with, and without, long-term mobility disabilities to better understand their attitudes towards digital assistants, identify needs for instructional support, and test the usability of our instructional protocol. The overall goal of this research is to improve understanding of older adults’ perceptions of these technologies and identify usability challenges within the home. The instructional protocol offers support by reducing the identified barriers to initial adoption and continued use to promote aging-in-place and improving overall quality of life for older adults with long-term mobility disabilities.

IDENTIFYING COMMUNITY PARTICIPATION CHALLENGES FOR ADULTS AGING WITH MOBILITY AND VISION DISABILITIES

There are growing numbers of older adults with mobility and vision disabilities acquired in early to mid-life who are a part of a population described as “aging with disability”. For these individuals, the addition of normative age-related declines (e.g., vision loss, arthritis) on top of a long-term disability can create extensive barriers to community participation. We present findings on activity challenges with community participation among older adults with long-term vision and mobility disabilities (N=120) from the Aging Concerns, Challenges, and Everyday Solution Strategies (ACCESS) interview study. Results provide detailed insights on the specific task-based challenges experienced when engaging in one’s community (e.g., going to entertainment events, doing activities with a group or organization, and participating in religious services and activities) as well as the solutions and strategies employed to overcome those challenges. Findings provide guidance for the design of supportive technologies that promote participation and independence for this understudied population.

A New Approach to Defining Disease

In this paper, we examine recent critiques of the debate about defining disease, which claim that its use of conceptual analysis embeds the problematic assumption that the concept is classically structured. These critiques suggest, instead, developing plural stipulative definitions. Although we substantially agree with these critiques, we resist their implication that no general definition of "disease" is possible. We offer an alternative, inductive argument that disease cannot be classically defined and that the best explanation for this is that the concept is structured as a cluster. We further argue that we do not need to reject the possibility of defining the general concept "disease" to legitimate developing stipulative definitions of disease that are relative to particular purposes. A cluster definition of disease is compatible with contextually motivated definitions, which may be considered précisifications of the more general cluster concept.

Effects of Extended Use of an Age-friendly Computer System on Assessments of Computer Proficiency, Attitudes, and Usability by Older Non--Computer Users

This study examined the impact of use of a computer software application designed specifically for older people known as PRISM—a Personal Reminder Information and Social Management system—which was installed on a computer that was placed in the homes of adults aged 65 to 98 years, who were at risk for social isolation and had minimal or no computer skills and no computers in their homes. Participants received face-to-face training on the system in their homes over several days and a variety of measures were collected at baseline and at 12 months. A growth mixture model applied to participants’ usage of the system over the course of 12 months revealed two distinct subpopulations of users—less-frequent users and more-frequent users—who after one year of exposure to the system differed in computer proficiency, attitudes toward computers, and ratings of system usability. These two groups did not differ on computer proficiency and computer attitude measures at baseline. The more-frequent user group, however, had significantly higher fluid cognitive abilities. Additional analytical models were used to further examine the relationships among the study measures. The implications of the findings are discussed in terms of the importance of usability for promoting initial engagement with a system and that increased engagement with the system can instill beliefs in these older adults that they can successfully transition to other computer-based technologies and applications. The results also underscore the importance of the user-centered design approach and designing highly usable systems for older adults with low technology proficiency.

Understanding the use and non-use of social communication technologies by older adults: A qualitative test and extension of the UTAUT model

Technology has the ability to foster social engagement, but a sizable divide exists between older and younger adults in the use of social communication technologies. The goal of the current study was to gain a better understanding of older adults' perspectives on social communication technologies, including those with higher adoption rates such as email and those with lower adoption rates such as social networking sites (e.g., Facebook, Instagram). Semi-structured group interviews were conducted with either users or non-users of social networking sites to gain insight into issues of adoption and non-adoption of social communication technologies. The Unified Theory of Acceptance and Use of Technology model (UTAUT) was adapted and used to categorize the interview content. We found support for a benefit-driven account of social communication technology acceptance and usage, with participants most frequently discussing the degree social communication technologies would or would not help them attain gains in social connectedness, entertainment, and/or information sharing. However, the UTAUT was not sufficient in fully capturing the group-interview content, with additional categories being necessary. For instance, trust in social networking sites (privacy and security concerns) was frequently discussed by both users and non-users. The current results broaden theories of technology acceptance by identifying facilitators and barriers to technology use in the older adult population.

Perceptions of Digital Assistants From Early Adopters Aged 55+

Voice-activated digital assistants have the potential to assist adults aging-in-place with a variety of everyday tasks and leisure activities. To understand this potential, semi-structured interviews were conducted to explore perceptions and attitudes from current adult users based on the models of the unified theory of acceptance and use of technology model. Several model factors were identified as influential in the initial and continued use of the digital assistants. Results indicate the need for an effective instructional protocol to promote successful interactions during the learning phase and for continued engagement with novel abilities of the digital assistants.