1
|
Lange M, Lowe A, Kayser I, Schaller A. Approaches for the use of Artificial Intelligence in workplace health promotion and prevention: A systematic scoping review. JMIR AI 2024. [PMID: 38989904 DOI: 10.2196/53506] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/12/2024]
Abstract
BACKGROUND Artificial intelligence (AI) is an umbrella term for various algorithms and rapidly emerging technologies with huge potential for workplace health promotion and prevention (WHPP). WHPP interventions aim to improve people's health and well-being through behavioral and organizational measures or by minimizing the burden of workplace-related diseases and associated risk factors. While AI has been the focus of research in other health-related fields, such as Public Health or biomedicine, the transition of AI into WHPP research has yet to be systematically investigated. OBJECTIVE The systematic scoping review aims to comprehensively assess an overview of the current use of AI in WHPP. The results will be then used to point to future research directions. The following research questions were derived: (1) what are the study characteristics of studies on AI algorithms and technologies in the context of WHPP, (2) what specific WHPP fields (prevention, behavioral, and organizational approaches) were addressed by the AI algorithms and technologies, and (3) what kind of interventions lead to which outcomes? METHODS A systematic scoping literature review (PRISMA-ScR) was conducted in the three academic databases PubMed, IEEE, and ACM in July 2023, searching for articles published between January 2000 and December 2023. Studies needed to be 1) peer-reviewed, 2) written in English, and 3) focused on any AI-based algorithm or technology that (4) were conducted in the context of WHPP or (5) an associated field. Information on study design, AI algorithms and technologies, WHPP fields, and the PICO framework were extracted blindly with Rayyan and summarized. RESULTS A total of ten studies were included. Risk prevention and modeling were the most identified WHPP fields (n=6), followed by behavioral health promotion (n=4) and organizational health promotion (n=1). Four studies focused on mental health. Most AI algorithms were machine learning-based, and three studies used combined deep learning algorithms. AI algorithms and technologies were primarily implemented in smartphone applications (eg, in the form of a Chatbot) or used the smartphone as a data source (eg, GPS). Behavioral approaches ranged from 8 to 12 weeks and were compared to control groups. Three studies evaluated the robustness and accuracy of an AI model or framework. CONCLUSIONS Although AI has caught increasing attention in health-related research, the review reveals that AI in WHPP is marginally investigated. Our results indicate that AI is promising for individualization and risk prediction in WHPP, but current research does not cover the scope of WHPP. Beyond that, future research will profit from an extended range of research in all fields of WHPP, longitudinal data, and reporting guidelines. CLINICALTRIAL Registered on 5th July 2023 at Open Science Framework [1].
Collapse
Affiliation(s)
- Martin Lange
- Department of Fitness & Health, IST University of Applied Science, Erkrather Straße 220a-c, Duesseldorf, DE
| | - Alexandra Lowe
- Department of Fitness & Health, IST University of Applied Science, Erkrather Straße 220a-c, Duesseldorf, DE
| | - Ina Kayser
- Department of Communication & Business, IST University of Applied Science, Duesseldorf, DE
| | - Andrea Schaller
- Institute of Sport Science, Department of Human Sciences, University of the Bundeswehr Munich, Munich, DE
| |
Collapse
|
2
|
Ding H, Simmich J, Vaezipour A, Andrews N, Russell T. Evaluation framework for conversational agents with artificial intelligence in health interventions: a systematic scoping review. J Am Med Inform Assoc 2024; 31:746-761. [PMID: 38070173 PMCID: PMC10873847 DOI: 10.1093/jamia/ocad222] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Revised: 11/04/2023] [Accepted: 11/24/2023] [Indexed: 02/18/2024] Open
Abstract
OBJECTIVES Conversational agents (CAs) with emerging artificial intelligence present new opportunities to assist in health interventions but are difficult to evaluate, deterring their applications in the real world. We aimed to synthesize existing evidence and knowledge and outline an evaluation framework for CA interventions. MATERIALS AND METHODS We conducted a systematic scoping review to investigate designs and outcome measures used in the studies that evaluated CAs for health interventions. We then nested the results into an overarching digital health framework proposed by the World Health Organization (WHO). RESULTS The review included 81 studies evaluating CAs in experimental (n = 59), observational (n = 15) trials, and other research designs (n = 7). Most studies (n = 72, 89%) were published in the past 5 years. The proposed CA-evaluation framework includes 4 evaluation stages: (1) feasibility/usability, (2) efficacy, (3) effectiveness, and (4) implementation, aligning with WHO's stepwise evaluation strategy. Across these stages, this article presents the essential evidence of different study designs (n = 8), sample sizes, and main evaluation categories (n = 7) with subcategories (n = 40). The main evaluation categories included (1) functionality, (2) safety and information quality, (3) user experience, (4) clinical and health outcomes, (5) costs and cost benefits, (6) usage, adherence, and uptake, and (7) user characteristics for implementation research. Furthermore, the framework highlighted the essential evaluation areas (potential primary outcomes) and gaps across the evaluation stages. DISCUSSION AND CONCLUSION This review presents a new framework with practical design details to support the evaluation of CA interventions in healthcare research. PROTOCOL REGISTRATION The Open Science Framework (https://osf.io/9hq2v) on March 22, 2021.
Collapse
Affiliation(s)
- Hang Ding
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
| | - Joshua Simmich
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
| | - Atiyeh Vaezipour
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
| | - Nicole Andrews
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
- The Tess Cramond Pain and Research Centre, Metro North Hospital and Health Service, Brisbane, QLD, Australia
- The Occupational Therapy Department, The Royal Brisbane and Women’s Hospital, Metro North Hospital and Health Service, Brisbane, QLD, Australia
| | - Trevor Russell
- RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, QLD, Australia
| |
Collapse
|
3
|
Arnold A, Kolody S, Comeau A, Miguel Cruz A. What does the literature say about the use of personal voice assistants in older adults? A scoping review. Disabil Rehabil Assist Technol 2024; 19:100-111. [PMID: 35459429 DOI: 10.1080/17483107.2022.2065369] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Accepted: 04/08/2022] [Indexed: 10/18/2022]
Abstract
PURPOSE With ageing, people may experience loss of function which may be compensated for by using technology. This review aims to examine the range and extent of personal voice assistants used for older adults living in the community, their technology readiness level, associated outcomes, and the strength of evidence. METHODS This study complies with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist. The CINAHL, EMBASE, IEEE Xplore, MEDLINE, APA PsycInfo, Scopus, and Web of Science databases were used to identify studies that explored the use of personal voice assistant technology with older adults living in the community. RESULTS The search yielded 499 studies, 22 of which were included for final analysis. Consumer technologies (e.g., Amazon Alexa) were evaluated in 18 studies, while four studies evaluated novel technologies. Most of the studies exploring the use of personal voice assistants with older adults evaluated technology usability and acceptance. Personal voice assistants were most commonly used by older adults for setting up reminders, searching for information, and checking the weather. None of the included studies evaluated the effectiveness of the technologies' ability to improve the management of health conditions or to facilitate the functional capacity of older adults. CONCLUSIONS More research is needed to determine the possible impact of using personal voice assistants for older adults living in the community. IMPLICATIONS FOR REHABILITATIONThe TRL for personal voice assistants is high.Personal voice assistants are currently being used by older adults for a range of activities including setting up reminders, searching for information, and checking the weather.Whether personal voice assistants can support older adults' ability to age in place is still unknown.The use of personal voice assistants in older adults is ripe for future enquiry and intervention-based research.
Collapse
Affiliation(s)
- Anneliese Arnold
- Department of Occupational Therapy, Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, Canada
| | - Stephanie Kolody
- Department of Occupational Therapy, Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, Canada
| | - Aidan Comeau
- Department of Occupational Therapy, Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, Canada
| | - Antonio Miguel Cruz
- Department of Occupational Therapy, Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, Canada
- Innovation & Technology (GRRIT) Hub, Glenrose Rehabilitation Hospital, Edmonton, Canada
- Faculty of Health, School of Public Health, University of Waterloo, Waterloo, Canada
| |
Collapse
|
4
|
Maia E, Vieira P, Praça I. Empowering Preventive Care with GECA Chatbot. Healthcare (Basel) 2023; 11:2532. [PMID: 37761729 PMCID: PMC10531007 DOI: 10.3390/healthcare11182532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 09/05/2023] [Accepted: 09/08/2023] [Indexed: 09/29/2023] Open
Abstract
Chatbots have become increasingly popular in the healthcare industry. In the area of preventive care, chatbots can provide personalized and timely solutions that aid individuals in maintaining their well-being and forestalling the development of chronic conditions. This paper presents GECA, a chatbot designed specifically for preventive care, that offers information, advice, and monitoring to patients who are undergoing home treatment, providing a cost-effective, personalized, and engaging solution. Moreover, its adaptable architecture enables extension to other diseases and conditions seamlessly. The chatbot's bilingual capabilities enhance accessibility for a wider range of users, including those with reading or writing difficulties, thereby improving the overall user experience. GECA's ability to connect with external resources offers a higher degree of personalization, which is a crucial aspect in engaging users effectively. The integration of standards and security protocols in these connections allows patient privacy, security and smooth adaptation to emerging healthcare information sources. GECA has demonstrated a remarkable level of accuracy and precision in its interactions with the diverse features, boasting an impressive 97% success rate in delivering accurate responses. Presently, preparations are underway for a pilot project at a Portuguese hospital that will conduct exhaustive testing and evaluate GECA, encompassing aspects such as its effectiveness, efficiency, quality, goal achievability, and user satisfaction.
Collapse
Affiliation(s)
- Eva Maia
- GECAD—Research Group on Intelligent Engineering and Computing for Advanced Innovation and Development, School of Engineering of the Polytechnic of Porto (ISEP), 4249-015 Porto, Portugal
| | - Pedro Vieira
- GECAD—Research Group on Intelligent Engineering and Computing for Advanced Innovation and Development, School of Engineering of the Polytechnic of Porto (ISEP), 4249-015 Porto, Portugal
| | - Isabel Praça
- GECAD—Research Group on Intelligent Engineering and Computing for Advanced Innovation and Development, School of Engineering of the Polytechnic of Porto (ISEP), 4249-015 Porto, Portugal
| |
Collapse
|
5
|
Mancone S, Diotaiuti P, Valente G, Corrado S, Bellizzi F, Vilarino GT, Andrade A. The Use of Voice Assistant for Psychological Assessment Elicits Empathy and Engagement While Maintaining Good Psychometric Properties. Behav Sci (Basel) 2023; 13:550. [PMID: 37503997 PMCID: PMC10376154 DOI: 10.3390/bs13070550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 06/20/2023] [Accepted: 06/28/2023] [Indexed: 07/29/2023] Open
Abstract
This study aimed to use the Alexa vocal assistant as an administerer of psychometric tests, assessing the efficiency and validity of this measurement. A total of 300 participants were administered the Interpersonal Reactivity Index (IRI). After a week, the administration was repeated, but the participants were randomly divided into groups of 100 participants each. In the first, the test was administered by means of a paper version; in the second, the questionnaire was read to the participants in person, and the operator contemporaneously recorded the answers declared by the participants; in the third group, the questionnaire was directly administered by the Alexa voice device, after specific reprogramming. The third group was also administered, as a post-session survey, the Engagement and Perceptions of the Bot Scale (EPVS), a short version of the Communication Styles Inventory (CSI), the Marlowe-Crowne Social Desirability Scale (MCSDS), and an additional six items to measure degrees of concentration, ease, and perceived pressure at the beginning and at the end of the administration. The results confirmed that the IRI did keep measurement invariance within the three conditions. The administration through vocal assistant showed an empathic activation effect significantly superior to the conditions of pencil-paper and operator-in-presence. The results indicated an engagement and positive evaluation of the interactive experience, with reported perceptions of closeness, warmth, competence, and human-likeness associated with higher values of empathetic activation and lower values of personal discomfort.
Collapse
Affiliation(s)
- Stefania Mancone
- Department of Human Sciences, Society and Health, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| | - Pierluigi Diotaiuti
- Department of Human Sciences, Society and Health, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| | - Giuseppe Valente
- Department of Human Sciences, Society and Health, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| | - Stefano Corrado
- Department of Human Sciences, Society and Health, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| | - Fernando Bellizzi
- Department of Human Sciences, Society and Health, University of Cassino and Southern Lazio, 03043 Cassino, Italy
| | - Guilherme Torres Vilarino
- Health and Sports Science Center, Department of Physical Education, Santa Catarina State University, Florianópolis 88035-901, Brazil
| | - Alexandro Andrade
- Health and Sports Science Center, Department of Physical Education, Santa Catarina State University, Florianópolis 88035-901, Brazil
| |
Collapse
|
6
|
Park MS, Upama PB, Anik AA, Ahamed SI, Luo J, Tian S, Rabbani M, Oh H. A Survey of Conversational Agents and Their Applications for Self-Management of Chronic Conditions. PROCEEDINGS : ANNUAL INTERNATIONAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE. COMPSAC 2023; 2023:1064-1075. [PMID: 37750107 PMCID: PMC10519706 DOI: 10.1109/compsac57700.2023.00162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/27/2023]
Abstract
Conversational agents have gained their ground in our daily life and various domains including healthcare. Chronic condition self-management is one of the promising healthcare areas in which conversational agents demonstrate significant potential to contribute to alleviating healthcare burdens from chronic conditions. This survey paper introduces and outlines types of conversational agents, their generic architecture and workflow, the implemented technologies, and their application to chronic condition self-management.
Collapse
Affiliation(s)
- Min Sook Park
- School of Information Studies, University of Wisconsin-Milwaukee, WI, U.S.A
| | - Paramita Basak Upama
- Department of Computer Science, Ubicomp Lab, Marquette University, Milwaukee, WI, U.S.A
| | - Adib Ahmed Anik
- Department of Computer Science, Ubicomp Lab, Marquette University, Milwaukee, WI, U.S.A
| | - Sheikh Iqbal Ahamed
- Department of Computer Science, Ubicomp Lab, Marquette University, Milwaukee, WI, U.S.A
| | - Jake Luo
- College of Health Sciences, University of Wisconsin-Milwaukee, WI, U.S.A
| | - Shiyu Tian
- Department of Computer Science, Ubicomp Lab, Marquette University, Milwaukee, WI, U.S.A
| | - Masud Rabbani
- Department of Computer Science, Ubicomp Lab, Marquette University, Milwaukee, WI, U.S.A
| | - Hyungkyoung Oh
- College of Nursing, University of Wisconsin-Milwaukee, WI, U.S.A
| |
Collapse
|
7
|
Vázquez A, López Zorrilla A, Olaso JM, Torres MI. Dialogue Management and Language Generation for a Robust Conversational Virtual Coach: Validation and User Study. SENSORS (BASEL, SWITZERLAND) 2023; 23:1423. [PMID: 36772464 PMCID: PMC9919213 DOI: 10.3390/s23031423] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 01/13/2023] [Accepted: 01/19/2023] [Indexed: 06/18/2023]
Abstract
Designing human-machine interactive systems requires cooperation between different disciplines is required. In this work, we present a Dialogue Manager and a Language Generator that are the core modules of a Voice-based Spoken Dialogue System (SDS) capable of carrying out challenging, long and complex coaching conversations. We also develop an efficient integration procedure of the whole system that will act as an intelligent and robust Virtual Coach. The coaching task significantly differs from the classical applications of SDSs, resulting in a much higher degree of complexity and difficulty. The Virtual Coach has been successfully tested and validated in a user study with independent elderly, in three different countries with three different languages and cultures: Spain, France and Norway.
Collapse
|
8
|
Polignano M, Lops P, de Gemmis M, Semeraro G. HELENA: An intelligent digital assistant based on a Lifelong Health User Model. Inf Process Manag 2023. [DOI: 10.1016/j.ipm.2022.103124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
9
|
A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions. SENSORS 2022; 22:s22072625. [PMID: 35408238 PMCID: PMC9003264 DOI: 10.3390/s22072625] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 03/12/2022] [Accepted: 03/24/2022] [Indexed: 02/06/2023]
Abstract
This paper reviews different types of conversational agents used in health care for chronic conditions, examining their underlying communication technology, evaluation measures, and AI methods. A systematic search was performed in February 2021 on PubMed Medline, EMBASE, PsycINFO, CINAHL, Web of Science, and ACM Digital Library. Studies were included if they focused on consumers, caregivers, or healthcare professionals in the prevention, treatment, or rehabilitation of chronic diseases, involved conversational agents, and tested the system with human users. The search retrieved 1087 articles. Twenty-six studies met the inclusion criteria. Out of 26 conversational agents (CAs), 16 were chatbots, seven were embodied conversational agents (ECA), one was a conversational agent in a robot, and another was a relational agent. One agent was not specified. Based on this review, the overall acceptance of CAs by users for the self-management of their chronic conditions is promising. Users’ feedback shows helpfulness, satisfaction, and ease of use in more than half of included studies. Although many users in the studies appear to feel more comfortable with CAs, there is still a lack of reliable and comparable evidence to determine the efficacy of AI-enabled CAs for chronic health conditions due to the insufficient reporting of technical implementation details.
Collapse
|
10
|
Bassi G, Donadello I, Gabrielli S, Salcuni S, Giuliano C, Forti S. Early Development of a Virtual Coach for Healthy Coping Interventions in Type 2 Diabetes Mellitus: Validation Study. JMIR Form Res 2022; 6:e27500. [PMID: 35147505 PMCID: PMC8881774 DOI: 10.2196/27500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Revised: 04/27/2021] [Accepted: 12/20/2021] [Indexed: 11/15/2022] Open
Abstract
Background Mobile health solutions aimed at monitoring tasks among people with diabetes mellitus (DM) have been broadly applied. However, virtual coaches (VCs), embedded or not in mobile health, are considered valuable means of improving patients’ health-related quality of life and ensuring adherence to self-care recommendations in diabetes management. Despite the growing need for effective, healthy coping digital interventions to support patients’ self-care and self-management, the design of psychological digital interventions that are acceptable, usable, and engaging for the target users still represents the main challenge, especially from a psychosocial perspective. Objective This study primarily aims to test VC interventions based on psychoeducational and counseling approaches to support and promote healthy coping behaviors in adults with DM. As a preliminary study, university students have participated in it and have played the standardized patients’ (SPs) role with the aim of improving the quality of the intervention protocol in terms of user acceptability, experience, and engagement. The accuracy of users’ role-playing is further analyzed. Methods This preliminary study is based on the Obesity-Related Behavioral Intervention Trial model, with a specific focus on its early phases. The healthy coping intervention protocol was initially designed together with a team of psychologists following the main guidelines and recommendations for psychoeducational interventions for healthy coping in the context of DM. The protocol was refined with the support of 3 experts in the design of behavioral intervention technologies for mental health and well-being, who role-played 3 SPs’ profiles receiving the virtual coaching intervention in a Wizard of Oz setting via WhatsApp. A refined version of the healthy coping protocol was then iteratively tested with a sample of 18 university students (mean age 23.61, SD 1.975 years) in a slightly different Wizard of Oz evaluation setting. Participants provided quantitative and qualitative postintervention feedback by reporting their experiences with the VC. Clustering techniques on the logged interactions and dialogs between the VC and users were collected and analyzed to identify additional refinements for future VC development. Results Both quantitative and qualitative analyses showed that the digital healthy coping intervention was perceived as supportive, motivating, and able to trigger self-reflection on coping strategies. Analyses of the logged dialogs showed that most of the participants accurately played the SPs’ profile assigned, confirming the validity and usefulness of this testing approach in preliminary assessments of behavioral digital interventions and protocols. Conclusions This study outlined an original approach to the early development and iterative testing of digital healthy coping interventions for type 2 DM. Indeed, the intervention was well-accepted and proved its effectiveness in the definition and refinement of the initial protocol and of the user experience with a VC before directly involving real patients in its subsequent use and testing.
Collapse
Affiliation(s)
- Giulia Bassi
- Department of Developmental and Socialization Psychology, University of Padova, Padova, Italy.,Centre Digital Health & Wellbeing, Fondazione Bruno Kessler, Trento, Italy
| | - Ivan Donadello
- KRDB Research Centre, Free University of Bozen-Bolzano, Bolzano, Italy
| | - Silvia Gabrielli
- Centre Digital Health & Wellbeing, Fondazione Bruno Kessler, Trento, Italy
| | - Silvia Salcuni
- Department of Developmental and Socialization Psychology, University of Padova, Padova, Italy
| | - Claudio Giuliano
- Centre Digital Health & Wellbeing, Fondazione Bruno Kessler, Trento, Italy
| | - Stefano Forti
- Centre Digital Health & Wellbeing, Fondazione Bruno Kessler, Trento, Italy
| |
Collapse
|
11
|
Alloatti F, Bosca A, Di Caro L, Pieraccini F. Diabetes and conversational agents: the AIDA project case study. DISCOVER ARTIFICIAL INTELLIGENCE 2021. [PMCID: PMC8456073 DOI: 10.1007/s44163-021-00005-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
One of the key aspects in the process of caring for people with diabetes is Therapeutic Education (TE). TE is a teaching process for training patients so that they can self-manage their care plan. Alongside traditional methods of providing educational content, there are now alternative forms of delivery thanks to the implementation of advanced Information Technologies systems such as conversational agents (CAs). In this context, we present the AIDA project: an ensemble of two different CAs intended to provide a TE tool for people with diabetes. The Artificial Intelligence Diabetes Assistant (AIDA) consists of a text-based chatbot and a speech-based dialog system. Their content has been created and validated by a scientific board. AIDA Chatbot—the text-based agent—provides a broad spectrum of information about diabetes, while AIDA Cookbot—the voice-based agent—presents recipes compliant with a diabetic patient’s diet. We provide a thorough description of the development process for both agents, the technology employed and their usage by the general public. AIDA Chatbot and AIDA Cookbot are freely available and they represent the first example of conversational agents in Italian to support diabetes patients, clinicians and caregivers.
Collapse
|
12
|
Bérubé C, Schachner T, Keller R, Fleisch E, V Wangenheim F, Barata F, Kowatsch T. Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review. J Med Internet Res 2021; 23:e25933. [PMID: 33658174 PMCID: PMC8042539 DOI: 10.2196/25933] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 02/10/2021] [Accepted: 03/03/2021] [Indexed: 01/04/2023] Open
Abstract
Background Chronic and mental health conditions are increasingly prevalent worldwide. As devices in our everyday lives offer more and more voice-based self-service, voice-based conversational agents (VCAs) have the potential to support the prevention and management of these conditions in a scalable manner. However, evidence on VCAs dedicated to the prevention and management of chronic and mental health conditions is unclear. Objective This study provides a better understanding of the current methods used in the evaluation of health interventions for the prevention and management of chronic and mental health conditions delivered through VCAs. Methods We conducted a systematic literature review using PubMed MEDLINE, Embase, PsycINFO, Scopus, and Web of Science databases. We included primary research involving the prevention or management of chronic or mental health conditions through a VCA and reporting an empirical evaluation of the system either in terms of system accuracy, technology acceptance, or both. A total of 2 independent reviewers conducted the screening and data extraction, and agreement between them was measured using Cohen kappa. A narrative approach was used to synthesize the selected records. Results Of 7170 prescreened papers, 12 met the inclusion criteria. All studies were nonexperimental. The VCAs provided behavioral support (n=5), health monitoring services (n=3), or both (n=4). The interventions were delivered via smartphones (n=5), tablets (n=2), or smart speakers (n=3). In 2 cases, no device was specified. A total of 3 VCAs targeted cancer, whereas 2 VCAs targeted diabetes and heart failure. The other VCAs targeted hearing impairment, asthma, Parkinson disease, dementia, autism, intellectual disability, and depression. The majority of the studies (n=7) assessed technology acceptance, but only few studies (n=3) used validated instruments. Half of the studies (n=6) reported either performance measures on speech recognition or on the ability of VCAs to respond to health-related queries. Only a minority of the studies (n=2) reported behavioral measures or a measure of attitudes toward intervention-targeted health behavior. Moreover, only a minority of studies (n=4) reported controlling for participants’ previous experience with technology. Finally, risk bias varied markedly. Conclusions The heterogeneity in the methods, the limited number of studies identified, and the high risk of bias show that research on VCAs for chronic and mental health conditions is still in its infancy. Although the results of system accuracy and technology acceptance are encouraging, there is still a need to establish more conclusive evidence on the efficacy of VCAs for the prevention and management of chronic and mental health conditions, both in absolute terms and in comparison with standard health care.
Collapse
Affiliation(s)
- Caterina Bérubé
- Center for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
| | - Theresa Schachner
- Center for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
| | - Roman Keller
- Future Health Technologies Programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore, Singapore
| | - Elgar Fleisch
- Center for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland.,Future Health Technologies Programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore, Singapore.,Center for Digital Health Interventions, Institute of Technology Management, University of St. Gallen, St. Gallen, Switzerland
| | - Florian V Wangenheim
- Center for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland.,Future Health Technologies Programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore, Singapore
| | - Filipe Barata
- Center for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
| | - Tobias Kowatsch
- Center for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland.,Future Health Technologies Programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore, Singapore.,Center for Digital Health Interventions, Institute of Technology Management, University of St. Gallen, St. Gallen, Switzerland.,Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore
| |
Collapse
|
13
|
Bogdan R, Tatu A, Crisan-Vida MM, Popa M, Stoicu-Tivadar L. A Practical Experience on the Amazon Alexa Integration in Smart Offices. SENSORS (BASEL, SWITZERLAND) 2021; 21:734. [PMID: 33499092 PMCID: PMC7866152 DOI: 10.3390/s21030734] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Revised: 01/19/2021] [Accepted: 01/19/2021] [Indexed: 12/03/2022]
Abstract
Smart offices are dynamically evolving spaces meant to enhance employees' efficiency, but also to create a healthy and proactive working environment. In a competitive business world, the challenge of providing a balance between the efficiency and wellbeing of employees may be supported with new technologies. This paper presents the work undertaken to build the architecture needed to integrate voice assistants into smart offices in order to support employees in their daily activities, like ambient control, attendance system and reporting, but also interacting with project management services used for planning, issue tracking, and reporting. Our research tries to understand what are the most accepted tasks to be performed with the help of voice assistants in a smart office environment, by analyzing the system based on task completion and sentiment analysis. For the experimental setup, different test cases were developed in order to interact with the office environment formed by specific devices, as well as with the project management tool tasks. The obtained results demonstrated that the interaction with the voice assistant is reasonable, especially for easy and moderate utterances.
Collapse
Affiliation(s)
- Răzvan Bogdan
- Department of Computers and Information Technology, “Politehnica” University of Timisoara, 300006 Timișoara, Romania; (A.T.); (M.P.)
| | - Alin Tatu
- Department of Computers and Information Technology, “Politehnica” University of Timisoara, 300006 Timișoara, Romania; (A.T.); (M.P.)
- 4SH France, 6 Rue des Satellites Bâtiment C, 33185 Le Haillan, France
| | - Mihaela Marcella Crisan-Vida
- Department of Automation and Applied Informatics, “Politehnica” University of Timisoara, 300006 Timișoara, Romania; (M.M.C.-V.); (L.S.-T.)
| | - Mircea Popa
- Department of Computers and Information Technology, “Politehnica” University of Timisoara, 300006 Timișoara, Romania; (A.T.); (M.P.)
| | - Lăcrămioara Stoicu-Tivadar
- Department of Automation and Applied Informatics, “Politehnica” University of Timisoara, 300006 Timișoara, Romania; (M.M.C.-V.); (L.S.-T.)
| |
Collapse
|
14
|
Schachner T, Keller R, V Wangenheim F. Artificial Intelligence-Based Conversational Agents for Chronic Conditions: Systematic Literature Review. J Med Internet Res 2020; 22:e20701. [PMID: 32924957 PMCID: PMC7522733 DOI: 10.2196/20701] [Citation(s) in RCA: 57] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2020] [Revised: 07/15/2020] [Accepted: 07/26/2020] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND A rising number of conversational agents or chatbots are equipped with artificial intelligence (AI) architecture. They are increasingly prevalent in health care applications such as those providing education and support to patients with chronic diseases, one of the leading causes of death in the 21st century. AI-based chatbots enable more effective and frequent interactions with such patients. OBJECTIVE The goal of this systematic literature review is to review the characteristics, health care conditions, and AI architectures of AI-based conversational agents designed specifically for chronic diseases. METHODS We conducted a systematic literature review using PubMed MEDLINE, EMBASE, PyscInfo, CINAHL, ACM Digital Library, ScienceDirect, and Web of Science. We applied a predefined search strategy using the terms "conversational agent," "healthcare," "artificial intelligence," and their synonyms. We updated the search results using Google alerts, and screened reference lists for other relevant articles. We included primary research studies that involved the prevention, treatment, or rehabilitation of chronic diseases, involved a conversational agent, and included any kind of AI architecture. Two independent reviewers conducted screening and data extraction, and Cohen kappa was used to measure interrater agreement.A narrative approach was applied for data synthesis. RESULTS The literature search found 2052 articles, out of which 10 papers met the inclusion criteria. The small number of identified studies together with the prevalence of quasi-experimental studies (n=7) and prevailing prototype nature of the chatbots (n=7) revealed the immaturity of the field. The reported chatbots addressed a broad variety of chronic diseases (n=6), showcasing a tendency to develop specialized conversational agents for individual chronic conditions. However, there lacks comparison of these chatbots within and between chronic diseases. In addition, the reported evaluation measures were not standardized, and the addressed health goals showed a large range. Together, these study characteristics complicated comparability and open room for future research. While natural language processing represented the most used AI technique (n=7) and the majority of conversational agents allowed for multimodal interaction (n=6), the identified studies demonstrated broad heterogeneity, lack of depth of reported AI techniques and systems, and inconsistent usage of taxonomy of the underlying AI software, further aggravating comparability and generalizability of study results. CONCLUSIONS The literature on AI-based conversational agents for chronic conditions is scarce and mostly consists of quasi-experimental studies with chatbots in prototype stage that use natural language processing and allow for multimodal user interaction. Future research could profit from evidence-based evaluation of the AI-based conversational agents and comparison thereof within and between different chronic health conditions. Besides increased comparability, the quality of chatbots developed for specific chronic conditions and their subsequent impact on the target patients could be enhanced by more structured development and standardized evaluation processes.
Collapse
Affiliation(s)
- Theresa Schachner
- Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
| | - Roman Keller
- Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
- Future Health Technologies programme, Campus for Research Excellence and Technological Enterprise, Singapore-ETH Centre, Singapore
| | - Florian V Wangenheim
- Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
- Future Health Technologies programme, Campus for Research Excellence and Technological Enterprise, Singapore-ETH Centre, Singapore
| |
Collapse
|