Making conversations with chatbots more personalized

Is AI chatbot recommendation convincing customer? An analytical response based on the elaboration likelihood model

The integration of artificial intelligence (AI) technology in e-commerce has currently stimulated scholarly attention, however studies on AI and e-commerce generally relatively few. The current study aims to evaluate how artificial intelligence (AI) chatbots persuade users to consider chatbot recommendations in a web-based buying situation. Employing the theory of elaboration likelihood, the current study presents an analytical framework for identifying factors and internal mechanisms of consumers' readiness to adopt AI chatbot recommendations. The authors evaluated the model employing questionnaire responses from 411 Chinese AI chatbot consumers. The findings of present study indicated that chatbot recommendation reliability and accuracy is positively related to AI technology trust and have negative effect on perceived self-threat. In addition, AI technology trust is positively related to intention to adopt chatbot decision whereas perceived self-threat negatively related to intention to adopt chatbot decision. The perceived dialogue strengthens the significant relationship between AI-tech trust and intention to adopt chatbot decision and weakens the negative relationship between perceived self-threat and intention to adopt AI chatbot decisions.

The SoCAP (Social Communication, Affiliation, and Presence) Taxonomy of Social Features: Scoping Review of Commercially Available eHealth Apps

BACKGROUND

eHealth interventions have proven to be valuable resources for users with diverse mental and behavioral health concerns. As these technologies continue to proliferate, both academic researchers and commercial app creators are leveraging the use of features that foster a sense of social connection on these digital platforms. Yet, the literature often insufficiently represents the functionality of these key social features, resulting in a lack of understanding of how they are being implemented.

OBJECTIVE

This study aimed to conduct a methodical review of commercially available eHealth apps to establish the SoCAP (social communication, affiliation, and presence) taxonomy of social features in eHealth apps. Our goal was to examine what types of social features are being used in eHealth apps and how they are implemented.

METHODS

A scoping review of commercially available eHealth apps was conducted to develop a taxonomy of social features. First, a shortlist of the 20 highest-rated eHealth apps was derived from One Mind PsyberGuide, a nonprofit organization with trained researchers who rate apps based on their (1) credibility, (2) user experience, and (3) transparency. Next, both mobile- and web-based versions of each app were double-coded by 2 trained raters to derive a list of social features. Subsequently, the social features were organized by category and tested on other apps to ensure their completeness.

RESULTS

Four main categories of social features emerged: (1) communication features (videoconferencing, discussion boards, etc), (2) social presence features (chatbots, reminders, etc), (3) affiliation and identity features (avatars, profiles, etc), and (4) other social integrations (social network and other app integrations). Our review shows that eHealth apps frequently use resource-intensive interactions (eg, videoconferencing with a clinician and phone calls from a facilitator), which may be helpful for participants with high support needs. Furthermore, among commercially available eHealth apps, there is a strong reliance on automated features (eg, avatars, personalized multimedia, and tailored content) that enhance a sense of social presence without requiring a high level of input from a clinician or staff member.

CONCLUSIONS

The SoCAP taxonomy includes a comprehensive list of social features and brief descriptions of how these features work. This classification system will provide academic and commercial eHealth app creators with an understanding of the various social features that are commonly implemented, which will allow them to apply these features to enhance their own apps. Future research may include comparing the synergistic effects of various combinations of these social features.

Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study

BACKGROUND

Health outcomes are significantly influenced by unmet social needs. Although screening for social needs has become common in health care settings, there is often poor linkage to resources after needs are identified. The structural barriers (eg, staffing, time, and space) to helping address social needs could be overcome by a technology-based solution.

OBJECTIVE

This study aims to present the design and evaluation of a chatbot, DAPHNE (Dialog-Based Assistant Platform for Healthcare and Needs Ecosystem), which screens for social needs and links patients and families to resources.

METHODS

This research used a three-stage study approach: (1) an end-user survey to understand unmet needs and perception toward chatbots, (2) iterative design with interdisciplinary stakeholder groups, and (3) a feasibility and usability assessment. In study 1, a web-based survey was conducted with low-income US resident households (n=201). Following that, in study 2, web-based sessions were held with an interdisciplinary group of stakeholders (n=10) using thematic and content analysis to inform the chatbot's design and development. Finally, in study 3, the assessment on feasibility and usability was completed via a mix of a web-based survey and focus group interviews following scenario-based usability testing with community health workers (family advocates; n=4) and social workers (n=9). We reported descriptive statistics and chi-square test results for the household survey. Content analysis and thematic analysis were used to analyze qualitative data. Usability score was descriptively reported.

RESULTS

Among the survey participants, employed and younger individuals reported a higher likelihood of using a chatbot to address social needs, in contrast to the oldest age group. Regarding designing the chatbot, the stakeholders emphasized the importance of provider-technology collaboration, inclusive conversational design, and user education. The participants found that the chatbot's capabilities met expectations and that the chatbot was easy to use (System Usability Scale score=72/100). However, there were common concerns about the accuracy of suggested resources, electronic health record integration, and trust with a chatbot.

CONCLUSIONS

Chatbots can provide personalized feedback for families to identify and meet social needs. Our study highlights the importance of user-centered iterative design and development of chatbots for social needs. Future research should examine the efficacy, cost-effectiveness, and scalability of chatbot interventions to address social needs.

Effects of ChatGPT's AI capabilities and human-like traits on spreading information in work environments

The rapid proliferation and integration of AI chatbots in office environments, specifically the advanced AI model ChatGPT, prompts an examination of how its features and updates impact knowledge processes, satisfaction, and word-of-mouth (WOM) among office workers. This study investigates the determinants of WOM among office workers who are users of ChatGPT. We adopted a quantitative approach, utilizing a stratified random sampling technique to collect data from a diverse group of office workers experienced in using ChatGPT. The hypotheses were rigorously tested through Structural Equation Modeling (SEM) using the SmartPLS 4. The results revealed that system updates, memorability, and non-language barrier attributes of ChatGPT significantly enhanced knowledge acquisition and application. Additionally, the human-like personality traits of ChatGPT significantly increased both utilitarian value and satisfaction. Furthermore, the study showed that knowledge acquisition and application led to a significant increase in utilitarian value and satisfaction, which subsequently increased WOM. Age had a positive influence on WOM, while gender had no significant impact. The findings provide theoretical contributions by expanding our understanding of AI chatbots' role in knowledge processes, satisfaction, and WOM, particularly among office workers.

HG-PerCon: Cross-view contrastive learning for personality prediction

Personality prediction task not only helps us to better understand personal needs and preferences but also is essential for many fields such as psychology and behavioral economics. Current personality prediction primarily focuses on discovering personality traits through user posts. Additionally, there are also methods that utilize psychological information to uncover certain underlying personality traits. Although significant progress has been made in personality prediction, we believe that current solutions still overlook the long-term sustainability of personality and are constrained by the challenge of capturing consistent personality-related clues across different views in a simple and efficient manner. To this end, we propose HG-PerCon, which utilizes user representations based on historical semantic information and psychological knowledge for cross-view contrastive learning. Specifically, we design a transformer-based module to obtain user representations with long-lasting personality-related information from their historical posts. We leverage a psychological knowledge graph which incorporates language styles to generate user representations guided by psychological knowledge. Additionally, we employ contrastive learning to capture the consistency of user personality-related clues across views. To evaluate the effectiveness of our model, and our approach achieved a reduction of 2%, 4%, and 6% in RMSE compared to the second-best baseline method.

Qualitative analysis of mental health conversational agents messages about autism spectrum disorder: a call for action

Background

Conversational agents (CA's) have shown promise in increasing accessibility to mental health resources. This study aimed to identify common themes of messages sent to a mental health CA (Wysa) related to ASD by general users and users that identify as having ASD.

Methods

This study utilized retrospective data. Two thematic analyses were conducted, one focusing on user messages including the keywords (e.g., ASD, autism, Asperger), and the second one with messages from users who self-identified as having ASD.

Results

For the sample of general users, the most frequent themes were "others having ASD," "ASD diagnosis," and "seeking help." For the users that self-identified as having ASD (n = 277), the most frequent themes were "ASD diagnosis or symptoms," "negative reaction from others," and "positive comments." There were 3,725 emotion words mentioned by users who self-identified as having ASD. The majority had negative valence (80.3%), and few were positive (14.8%) or ambivalent (4.9%).

Conclusion

Users shared their experiences and emotions surrounding ASD with a mental health CA. Users asked about the ASD diagnosis, sought help, and reported negative reactions from others. CA's have the potential to become a source of support for those interested in ASD and/or identify as having ASD.

Acceptability of a Pain History Assessment and Education Chatbot (Dolores) Across Age Groups in Populations With Chronic Pain: Development and Pilot Testing

BACKGROUND

The delivery of education on pain neuroscience and the evidence for different treatment approaches has become a key component of contemporary persistent pain management. Chatbots, or more formally conversation agents, are increasingly being used in health care settings due to their versatility in providing interactive and individualized approaches to both capture and deliver information. Research focused on the acceptability of diverse chatbot formats can assist in developing a better understanding of the educational needs of target populations.

OBJECTIVE

This study aims to detail the development and initial pilot testing of a multimodality pain education chatbot (Dolores) that can be used across different age groups and investigate whether acceptability and feedback were comparable across age groups following pilot testing.

METHODS

Following an initial design phase involving software engineers (n=2) and expert clinicians (n=6), a total of 60 individuals with chronic pain who attended an outpatient clinic at 1 of 2 pain centers in Australia were recruited for pilot testing. The 60 individuals consisted of 20 (33%) adolescents (aged 10-18 years), 20 (33%) young adults (aged 19-35 years), and 20 (33%) adults (aged >35 years) with persistent pain. Participants spent 20 to 30 minutes completing interactive chatbot activities that enabled the Dolores app to gather a pain history and provide education about pain and pain treatments. After the chatbot activities, participants completed a custom-made feedback questionnaire measuring the acceptability constructs pertaining to health education chatbots. To determine the effect of age group on the acceptability ratings and feedback provided, a series of binomial logistic regression models and cumulative odds ordinal logistic regression models with proportional odds were generated.

RESULTS

Overall, acceptability was high for the following constructs: engagement, perceived value, usability, accuracy, responsiveness, adoption intention, esthetics, and overall quality. The effect of age group on all acceptability ratings was small and not statistically significant. An analysis of open-ended question responses revealed that major frustrations with the app were related to Dolores' speech, which was explored further through a comparative analysis. With respect to providing negative feedback about Dolores' speech, a logistic regression model showed that the effect of age group was statistically significant (χ22=11.7; P=.003) and explained 27.1% of the variance (Nagelkerke R2). Adults and young adults were less likely to comment on Dolores' speech compared with adolescent participants (odds ratio 0.20, 95% CI 0.05-0.84 and odds ratio 0.05, 95% CI 0.01-0.43, respectively). Comments were related to both speech rate (too slow) and quality (unpleasant and robotic).

CONCLUSIONS

This study provides support for the acceptability of pain history and education chatbots across different age groups. Chatbot acceptability for adolescent cohorts may be improved by enabling the self-selection of speech characteristics such as rate and personable tone.

Reminders, reflections, and relationships: insights from the design of a chatbot for college advising

Purpose

In the USA, 22–40% of youth who have been accepted to college do not enroll. Researchers call this phenomenon summer melt, which disproportionately affects students from disadvantaged backgrounds. A major challenge is providing enough mentorship with the limited number of available college counselors. The purpose of this study is to present a case study of a design and user study of a chatbot (Lilo), designed to provide college advising interactions.

Design/methodology/approach

This study adopted four primary data sources to capture aspects of user experience: daily diary entries; in-depth, semi-structured interviews; user logs of interactions with the chatbot; and daily user surveys. User study was conducted with nine participants who represent a range of college experiences.

Findings

Participants illuminated the types of interactions designs that would be particularly impactful for chatbots for college advising including setting reminders, brokering social connections and prompting deeper introspection that build efficacy and identity toward college-going.

Originality/value

As a growing body of human-computer interaction research delves into the design of chatbots for different social interactions, this study illuminates key design needs for continued work in this domain. The study explores the implications for a specific domain to improve college enrollment: providing college advising to youth.

User experience with a parenting chatbot micro intervention

Background

The use of chatbots to address mental health conditions have become increasingly popular in recent years. However, few studies aimed to teach parenting skills through chatbots, and there are no reports on parental user experience. Aim: This study aimed to assess the user experience of a parenting chatbot micro intervention to teach how to praise children in a Spanish-speaking country.

Methods

A sample of 89 parents were assigned to the chatbot micro intervention as part of a randomized controlled trial study. Completion rates, engagement, satisfaction, net promoter score, and acceptability were analyzed.

Results

66.3% of the participants completed the intervention. Participants exchanged an average of 49.8 messages (SD = 1.53), provided an average satisfaction score of 4.19 (SD = .79), and reported that they would recommend the chatbot to other parents (net promoter score = 4.63/5; SD = .66). Acceptability level was high (ease of use = 4.66 [SD = .73]; comfortability = 4.76 [SD = .46]; lack of technical problems = 4.69 [SD = .59]; interactivity = 4.51 [SD = .77]; usefulness for everyday life = 4.75 [SD = .54]).

Conclusions

Overall, users completed the intervention at a high rate, engaged with the chatbot, were satisfied, would recommend it to others, and reported a high level of acceptability. Chatbots have the potential to teach parenting skills however research on the efficacy of parenting chatbot interventions is needed.

Use of chatbots for customer service in MSMEs

Purpose

This research work aims to arise from developing new communication channels for customer service in micro, small and medium enterprises (MSMEs), such as chatbots. In particular, the results of the usability testing of three chatbots implemented in MSMEs are presented.

Design/methodology/approach

The methodology employed includes participants, chatbot development platform, research methodology, software development methodology and usability test to contextualize the study's results.

Findings

Based on the results obtained from the System Usability Scale (SUS) and considering the accuracy of the chatbot's responses, it is concluded that the level of satisfaction in using chatbots is high; therefore, if the chatbot is well integrated with the communication systems/channels of the MSMEs, the client receives an excellent, fast and efficient service.

Originality/value

The paper analyzes chatbots for customer service and presents the usability testing results of three chatbots implemented in MSMEs.

Interacting with a Chatbot-Based Advising System: Understanding the Effect of Chatbot Personality and User Gender on Behavior

Chatbots with personality have been shown to affect engagement and user subjective satisfaction. Yet, the design of most chatbots focuses on functionality and accuracy rather than an interpersonal communication style. Existing studies on personality-imbued chatbots have mostly assessed the effect of chatbot personality on user preference and satisfaction. However, the influence of chatbot personality on behavioral qualities, such as users’ trust, engagement, and perceived authenticity of the chatbots, is largely unexplored. To bridge this gap, this study contributes: (1) A detailed design of a personality-imbued chatbot used in academic advising. (2) Empirical findings of an experiment with students who interacted with three different versions of the chatbot. Each version, vetted by psychology experts, represents one of the three dominant traits, agreeableness, conscientiousness, and extraversion. The experiment focused on the effect of chatbot personality on trust, authenticity, engagement, and intention to use the chatbot. Furthermore, we assessed whether gender plays a role in students’ perception of the personality-imbued chatbots. Our findings show a positive impact of chatbot personality on perceived chatbot authenticity and intended engagement, while student gender does not play a significant role in the students’ perception of chatbots.

Impact of Digital Assistant Attributes on Millennials' Purchasing Intentions: A Multi-Group Analysis using PLS-SEM, Artificial Neural Network and fsQCA

The rising population of millennials, coupled with Digital Assistants (DA) and online purchasing trends among consumers have gained increasing attention by global marketers. The study evaluates the influence of DA attributes on the purchasing intention (PUI) of millennials. A combined approach of PLS-SEM, Artificial Neural Network (ANN) and Fuzzy-set Qualitative Comparative Analysis (fsQCA) is used to predict the PUI of 345 millennials. Also, multi-group analysis is employed to uncover the influence of gender on the relationship between PUI and DA attributes. The findings suggest that DA attributes may amplify purchasing intention among millennials, especially through perceived interactivity and anthropomorphism. Further, the moderating role of gender was found significant on the inter-relationship of perceived interactivity and PUI. This research is a pioneer study in the area of artificial intelligence, conversational commerce, DA and AI-powered chatbots. This study will help marketers and practitioners to predict millennial purchasing intentions. An evaluation of this paper may help them to foster immersive and effective engagement through DA.

Enhancing customer satisfaction with chatbots: The influence of communication styles and consumer attachment anxiety

Chatbots are increasingly occupying the online retailing landscape, and the volume of consumer-chatbot service interactions is exploding. Even so, it still remains unclear how chatbots should communicate with consumers to ensure positive customer service experiences and, in particular, to improve their satisfaction. A fundamental decision in this regard is the choice of a communication style, specifically, whether a social-oriented or a task-oriented communication style should be best used for chatbots. In this paper, we investigate how using a social-oriented versus task-oriented communication style can improve customer satisfaction. Two experimental studies reveal that using a social-oriented communication style boosts customer satisfaction. Warmth perception of the chatbot mediates this effect, while consumer attachment anxiety moderates these effects. Our results indicate that social-oriented communication style can be beneficial in enhancing service satisfaction for highly anxiously attached customers, but it does not work for the lowly anxiously attached. This study provides theoretical and practical implications about how to implement chatbots in service encounters.

The Effects of Chatbot Service Recovery With Emotion Words on Customer Satisfaction, Repurchase Intention, and Positive Word-Of-Mouth

This study sought to examine the effect of the quality of chatbot services on customer satisfaction, repurchase intention, and positive word-of-mouth by comparing two groups, namely chatbots with and without emotion words. An online survey was conducted for 2 weeks in May 2021. A total of 380 responses were collected and analyzed using structural equation modeling to test the hypothesis. The theoretical basis of the study was the SERVQUAL theory, which is widely used in measuring and managing service quality in various industries. The results showed that the assurance and reliability of chatbots positively impact customer satisfaction for both groups. However, empathy and interactivity positively affect customer satisfaction only for chatbots with emotion words. Responsiveness did not have an impact on customer satisfaction for both groups. Customer satisfaction positively impacts repurchase intention and positive word-of-mouth for both groups. The findings of this study can serve as a priori research to empirically prove the effectiveness of chatbots with emotion words.

Evaluating the Therapeutic Alliance With a Free-Text CBT Conversational Agent (Wysa): A Mixed-Methods Study

The present study aims to examine whether users perceive a therapeutic alliance with an AI conversational agent (Wysa) and observe changes in the t‘herapeutic alliance over a brief time period. A sample of users who screened positively on the PHQ-4 for anxiety or depression symptoms (N = 1,205) of the digital mental health application (app) Wysa were administered the WAI-SR within 5 days of installing the app and gave a second assessment on the same measure after 3 days (N = 226). The anonymised transcripts of user's conversations with Wysa were also examined through content analysis for unprompted elements of bonding between the user and Wysa (N = 950). Within 5 days of initial app use, the mean WAI-SR score was 3.64 (SD 0.81) and the mean bond subscale score was 3.98 (SD 0.94). Three days later, the mean WAI-SR score increased to 3.75 (SD 0.80) and the mean bond subscale score increased to 4.05 (SD 0.91). There was no significant difference in the alliance scores between Assessment 1 and Assessment 2.These mean bond subscale scores were found to be comparable to the scores obtained in recent literature on traditional, outpatient-individual CBT, internet CBT and group CBT. Content analysis of the transcripts of user conversations with the CA (Wysa) also revealed elements of bonding such as gratitude, self-disclosed impact, and personification. The user's therapeutic alliance scores improved over time and were comparable to ratings from previous studies on alliance in human-delivered face-to-face psychotherapy with clinical populations. This study provides critical support for the utilization of digital mental health services, based on the evidence of the establishment of an alliance.

Artificially intelligent chatbots in digital mental health interventions: a review

INTRODUCTION

Increasing demand for mental health services and the expanding capabilities of artificial intelligence (AI) in recent years has driven the development of digital mental health interventions (DMHIs). To date, AI-based chatbots have been integrated into DMHIs to support diagnostics and screening, symptom management and behavior change, and content delivery.

AREAS COVERED

We summarize the current landscape of DMHIs, with a focus on AI-based chatbots. Happify Health's AI chatbot, Anna, serves as a case study for discussion of potential challenges and how these might be addressed, and demonstrates the promise of chatbots as effective, usable, and adoptable within DMHIs. Finally, we discuss ways in which future research can advance the field, addressing topics including perceptions of AI, the impact of individual differences, and implications for privacy and ethics.

EXPERT OPINION

Our discussion concludes with a speculative viewpoint on the future of AI in DMHIs, including the use of chatbots, the evolution of AI, dynamic mental health systems, hyper-personalization, and human-like intervention delivery.

Bonding With Bot: User Feedback on a Chatbot for Social Isolation

Social isolation has affected people globally during the COVID-19 pandemic and had a major impact on older adult's well-being. Chatbot interventions may be a way to provide support to address loneliness and social isolation in older adults. The aims of the current study were to (1) understand the distribution of a chatbot's net promoter scores, (2) conduct a thematic analysis on qualitative elaborations to the net promoter scores, (3) understand the distribution of net promoter scores per theme, and (4) conduct a single word analysis to understand the frequency of words present in the qualitative feedback. A total of 7,099 adults and older adults consented to participate in a chatbot intervention on reducing social isolation and loneliness. The average net promoter score (NPS) was 8.67 out of 10. Qualitative feedback was provided by 766 (10.79%) participants which amounted to 898 total responses. Most themes were rated as positive (517), followed by neutral (311) and a minor portion as negative (70). The following five themes were found across the qualitative responses: positive outcome (277, 30.8%), user did not address question (262, 29.2%), bonding with the chatbot (240, 26.7%), negative technical aspects (70, 7.8%), and ambiguous outcome (49, 5.5%). Themes with a positive valence were found to be associated with a higher NPS. The word "help" and it's variations were found to be the most frequently used words, which is consistent with the thematic analysis. These results show that a chatbot for social isolation and loneliness was perceived positively by most participants. More specifically, users were likely to personify the chatbot (e.g., "Cause I feel like I have a new friend!") and perceive positive personality features such as being non-judgmental, caring, and open to listen. A minor portion of the users reported dissatisfaction with chatting with a machine. Implications will be discussed.