1
|
MacNeill AL, MacNeill L, Yi S, Goudreau A, Luke A, Doucet S. Depiction of conversational agents as health professionals: a scoping review. JBI Evid Synth 2024; 22:831-855. [PMID: 38482610 DOI: 10.11124/jbies-23-00029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/09/2024]
Abstract
OBJECTIVE The purpose of this scoping review was to examine the depiction of conversational agents as health professionals. We identified the professional characteristics that are used with these depictions and determined the prevalence of these characteristics among conversational agents that are used for health care. INTRODUCTION The depiction of conversational agents as health professionals has implications for both the users and the developers of these programs. For this reason, it is important to know more about these depictions and how they are implemented in practical settings. INCLUSION CRITERIA This review included scholarly literature on conversational agents that are used for health care. It focused on conversational agents designed for patients and health seekers, not health professionals or trainees. Conversational agents that address physical and/or mental health care were considered, as were programs that promote healthy behaviors. METHODS This review was conducted in accordance with JBI methodology for scoping reviews. The databases searched included MEDLINE (PubMed), Embase, CINAHL with Full Text (EBSCOhost), Scopus, Web of Science, ACM Guide to Computing Literature (Association for Computing Machinery Digital Library), and IEEE Xplore (IEEE). The main database search was conducted in June 2021, and an updated search was conducted in January 2022. Extracted data included characteristics of the report, basic characteristics of the conversational agent, and professional characteristics of the conversational agent. Extracted data were summarized using descriptive statistics. Results are presented in a narrative summary and accompanying tables. RESULTS A total of 38 health-related conversational agents were identified across 41 reports. Six of these conversational agents (15.8%) had professional characteristics. Four conversational agents (10.5%) had a professional appearance in which they displayed the clothing and accessories of health professionals and appeared in professional settings. One conversational agent (2.6%) had a professional title (Dr), and 4 conversational agents (10.5%) were described as having professional roles. Professional characteristics were more common among embodied vs disembodied conversational agents. CONCLUSIONS The results of this review show that the depiction of conversational agents as health professionals is not particularly common, although it does occur. More discussion is needed on the potential ethical and legal issues surrounding the depiction of conversational agents as health professionals. Future research should examine the impact of these depictions, as well as people's attitudes toward them, to better inform recommendations for practice.
Collapse
Affiliation(s)
- A Luke MacNeill
- Centre for Research in Integrated Care, University of New Brunswick, Saint John, NB, Canada
- Department of Nursing and Health Sciences, University of New Brunswick, Saint John, NB, Canada
| | - Lillian MacNeill
- Centre for Research in Integrated Care, University of New Brunswick, Saint John, NB, Canada
- Department of Nursing and Health Sciences, University of New Brunswick, Saint John, NB, Canada
| | - Sungmin Yi
- Centre for Research in Integrated Care, University of New Brunswick, Saint John, NB, Canada
- College of Pharmacy, Dalhousie University, Halifax, NS, Canada
| | - Alex Goudreau
- University of New Brunswick Libraries, Saint John, NB, Canada
- The University of New Brunswick (UNB) Saint John Collaboration for Evidence-Informed Healthcare: A JBI Centre of Excellence, Saint John, NB, Canada
| | - Alison Luke
- Centre for Research in Integrated Care, University of New Brunswick, Saint John, NB, Canada
- Department of Nursing and Health Sciences, University of New Brunswick, Saint John, NB, Canada
- The University of New Brunswick (UNB) Saint John Collaboration for Evidence-Informed Healthcare: A JBI Centre of Excellence, Saint John, NB, Canada
| | - Shelley Doucet
- Centre for Research in Integrated Care, University of New Brunswick, Saint John, NB, Canada
- Department of Nursing and Health Sciences, University of New Brunswick, Saint John, NB, Canada
- The University of New Brunswick (UNB) Saint John Collaboration for Evidence-Informed Healthcare: A JBI Centre of Excellence, Saint John, NB, Canada
| |
Collapse
|
2
|
Nkabane-Nkholongo E, Mpata-Mokgatle M, Jack BW, Julce C, Bickmore T. Usability and Acceptability of a Conversational Agent Health Education App (Nthabi) for Young Women in Lesotho: Quantitative Study. JMIR Hum Factors 2024; 11:e52048. [PMID: 38470460 DOI: 10.2196/52048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Revised: 12/08/2023] [Accepted: 12/11/2023] [Indexed: 03/13/2024] Open
Abstract
BACKGROUND Young women in Lesotho face myriad sexual and reproductive health problems. There is little time to provide health education to women in low-resource settings with critical shortages of human resources for health. OBJECTIVE This study aims to determine the acceptability and usability of a conversational agent system, the Nthabi health promotion app, which was culturally adapted for use in Lesotho. METHODS We conducted a descriptive quantitative study, using a 22-item Likert scale survey to assess the perceptions of the usability and acceptability of 172 young women aged 18-28 years in rural districts of Lesotho, who used the system on either smartphones or tablets for up to 6 weeks. Descriptive statistics were used to calculate the averages and frequencies of the variables. χ2 tests were used to determine any associations among variables. RESULTS A total of 138 participants were enrolled and completed the survey. The mean age was 22 years, most were unmarried, 56 (40.6%) participants had completed high school, 39 (28.3%) participants were unemployed, and 88 (63.8%) participants were students. Respondents believed the app was helpful, with 134 (97.1%) participants strongly agreeing or agreeing that the app was "effective in helping them make decisions" and "could quickly improve health education and counselling." In addition, 136 (98.5%) participants strongly agreed or agreed that the app was "simple to use," 130 (94.2 %) participants reported that Nthabi could "easily repeat words that were not well understood," and 128 (92.7%) participants reported that the app "could quickly load the information on the screen." Respondents were generally satisfied with the app, with 132 (95.6%) participants strongly agreeing or agreeing that the health education content delivered by the app was "well organised and delivered in a timely way," while 133 (96.4%) participants "enjoyed using the interface." They were satisfied with the cultural adaptation, with 133 (96.4%) participants strongly agreeing or agreeing that the app was "culturally appropriate and that it could be easily shared with a family or community members." They also reported that Nthabi was worthwhile, with 127 (92%) participants reporting that they strongly agreed or agreed that they were "satisfied with the application and intended to continue using it," while 135 (97.8%) participants would "encourage others to use it." Participants aged 18-24 years (vs those aged 25-28 years) agreed that the "Nthabi app was simple to use" (106/106, 100% vs 30/32, 98.8%; P=.01), and agreed that "the educational content was well organised and delivered in a timely way" (104/106, 98.1% vs 28/32, 87.5%; P=.01). CONCLUSIONS These results support further study of conversational agent systems as alternatives to traditional face-to-face provision of health education services in Lesotho, where there are critical shortages of human resources for health. TRIAL REGISTRATION ClinicalTrials.gov NCT04354168; https://www.clinicaltrials.gov/study/NCT04354168.
Collapse
Affiliation(s)
| | | | - Brian W Jack
- Chobanian & Avedisian School of Medicine, Boston University, Boston, MA, United States
| | - Clevanne Julce
- Umass Chan Medical School, University of Massachusetts, Worcester, MA, United States
| | - Timothy Bickmore
- Khoury College of Computer Sciences, Northeastern University, Boston, MA, United States
| |
Collapse
|
3
|
Saxena SG, Godfrey T. India's Opportunity to Address Human Resource Challenges in Healthcare. Cureus 2023; 15:e40274. [PMID: 37448434 PMCID: PMC10336366 DOI: 10.7759/cureus.40274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/11/2023] [Indexed: 07/15/2023] Open
Abstract
India's health indicators have improved in recent times but continue to lag behind those of its peer nations. The country with a population of 1.3 billion, has an estimated active health workers density of doctors and nurses/midwives of 5.0 and 6.0 respectively, for 10,000 persons, which is much lower than the WHO threshold of 44.5 doctors, nurses, and midwives per 10,000 population. The issue is compounded by the skewed inter-state, urban-rural, and public-private sector divide. Calls to urgently augment the skilled health workforce reinforce the central role human resources have in healthcare, which has evolved into a complex multifactorial issue. The paucity of skilled personnel must be addressed if India is to accelerate its progress toward achieving universal health coverage and its sustainable development goals (SDGs). The recent increase in the federal health budget offers an unprecedented opportunity to do this. This article utilizes the ready materials, extract and analyze data, distill findings (READ) approach to adding to the authors' experiential learning to analyze the health system in India. The growing divide between the public and the burgeoning private health sector systems, with the latter's booming medical tourism industry and medical schools, are analyzed along with the newly minted National Medical Council, to recommend policies that would help India achieve its SDGs.
Collapse
Affiliation(s)
| | - Thomas Godfrey
- Public Health Sciences, Penn State College of Medicine, Hershey, USA
| |
Collapse
|
4
|
Chaudhry BM, Islam A. A Mobile Application-Based Relational Agent as a Health Professional for COVID-19 Patients: Design, Approach, and Implications. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:13794. [PMID: 36360674 PMCID: PMC9656668 DOI: 10.3390/ijerph192113794] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Revised: 10/19/2022] [Accepted: 10/20/2022] [Indexed: 06/16/2023]
Abstract
Relational Agents' (RAs) ability to maintain socio-emotional relationships with users can be an asset to COVID-19 patients. The goal of this research was to identify principles for designing an RA that can act as a health professional for a COVID-19 patient. We first identified tasks that such an RA can provide by interviewing 33 individuals, who had recovered from COVID-19. The transcribed interviews were analyzed using qualitative thematic analysis. Based on the findings, four sets of hypothetical conversations were handcrafted to illustrate how the proposed RA will execute the identified tasks. These conversations were then evaluated by 43 healthcare professionals in a qualitative study. Thematic analysis was again used to identify characteristics that would be suitable for the proposed RA. The results suggest that the RA must: model clinical protocols; incorporate evidence-based interventions; inform, educate, and remind patients; build trusting relationships, and support their socio-emotional needs. The findings have implications for designing RAs for other healthcare contexts beyond the pandemic.
Collapse
|
5
|
Islam A, Chaudhry BM. A Relational Agent for the COVID-19 Patients: Design, Approach, and Implications. JMIR Hum Factors 2022. [PMID: 36098997 DOI: 10.2196/37734] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023] Open
Abstract
BACKGROUND Relational agents (RAs) have shown effectiveness in various health interventions with and without doctors and hospital facilities. We suggest that in situations such as a pandemic like the COVID-19 when healthcare professionals (HCPs) and facilities are unable to cope with increased demands, RAs can play a major role in ameliorating the situation. OBJECTIVE The goal of this research was to seek design validation on a prototypical RA to address healthcare needs of the COVID-19 patients. METHODS Therefore, RAs can deliver health interventions during COVID-19 pandemic, but they have not been well-explored in this domain. To address this gap, a prototypical RA is iteratively designed and developed in collaboration with infected patients (n=21) and two groups of HCPs (n=19 and n=16 respectively) to aid COVID-19 patients at various stages by performing four main tasks: testing guidance, support during self-isolation, handling emergency situations, and promoting post-recovery mental well-being. RESULTS A survey with 98 individuals was used to evaluate the usability of the prototype by system usability scale (SUS) and it received an average score of 58.82. Moreover, participants indicated perceived usefulness and acceptability of the system on Likert Scales where 89.65% perceived it to be helpful, 68.97% accepted it as a viable alternative to HCPs. CONCLUSIONS The prototypical RA received favorable feedback from the participants and they were inclined to accept it as an alternative to HCPs in non-life-threatening scenarios despite the usability rating falling below the acceptable threshold. Based on participants' feedback, we recommend further development of the RA with improved automation and emotional support, ability to provide information, tracking, and specific recommendations.
Collapse
Affiliation(s)
- Ashraful Islam
- University of Louisiana at Lafayette, 104 East University Avenue, Lafayette, US
| | | |
Collapse
|
6
|
Ruan Y, Luo J, Lin H. Why Do Patients Seek Diagnose Dis-accordance With Hierarchical Medical System Related Policies in Tertiary Hospitals? A Qualitative Study in Shanghai From the Perspective of Physicians. Front Public Health 2022; 10:841196. [PMID: 35400060 PMCID: PMC8990090 DOI: 10.3389/fpubh.2022.841196] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Accepted: 03/07/2022] [Indexed: 11/13/2022] Open
Abstract
BackgroundAlthough the Hierarchical Medical System has been utilized in China for many years, it is inadequate for guiding patients in adopting appropriate diagnose-seeking behaviors in accordance with related policies. This study examined how patients' diagnose-seeking behavior in tertiary hospitals that is dis-accordance with Hierarchical Medical System related policy (“DSB-dis-accordance”) arise and ways to guide patients away from such behaviors, both from the perspective of physicians.MethodsA qualitative study based on a mixed method including in-depth interviews and grounded theory. Twenty-seven physicians with more than 2 years of experience serving in tertiary hospitals of Shanghai were involved after reviewing the related purposes and requirements. Patients' “DSB-dis-accordance” was studied from the perspective of physicians.ResultsPatient-related factors (habits, trust, and knowledge), physician-related factors (conservative preference, risk avoidance), and system-related factors (accessibility, operability) affected patients' diagnose-seeking behavior.ConclusionsPatient-related, physician-related, and system-related factors affecting patients' diagnose-seeking behaviors in tertiary hospitals should be addressed by investing more health resources in lower-level hospitals, enhancing dissemination of health-related and policy-related knowledge, refining the classification of diseases, incentivizing physicians, and developing appropriate follow-up measures. Physicians could then become more involved in guiding patients' “DSB-dis-accordance,” thereby benefitting development of the Hierarchical Medical System in China.
Collapse
Affiliation(s)
- Yuhui Ruan
- School of Politics and Public Administration, Soochow University, Suzhou, China
- Institute of Public Health, Soochow University, Suzhou, China
- School of International and Public Affairs, Shanghai Jiao Tong University, Shanghai, China
- Institute of Health Yangtze River Delta, Shanghai Jiao Tong University, Shanghai, China
- *Correspondence: Yuhui Ruan
| | - Jin Luo
- School of International and Public Affairs, Shanghai Jiao Tong University, Shanghai, China
- Institute of Health Yangtze River Delta, Shanghai Jiao Tong University, Shanghai, China
- Jin Luo
| | - Hong Lin
- Department of Orthopaedic Surgery, Zhongshan Hospital, Fudan University, Shanghai, China
- Institute of Medical Science Popularization, Fudan University, Shanghai, China
| |
Collapse
|
7
|
MacNeill AL, MacNeill L, Doucet S, Luke A. The professional representation of conversational agents for health care: a scoping review protocol. JBI Evid Synth 2021; 20:666-673. [PMID: 34374689 DOI: 10.11124/jbies-20-00589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
OBJECTIVE The purpose of this scoping review is to examine the professional representation of conversational agents that are used for health care. Professional characteristics associated with these agents will be identified, and the prevalence of these characteristics will be determined. INTRODUCTION Conversational agents that are used for health care lack the qualifications and capabilities of real health professionals, but this fact may not be clear to some patients and health seekers. This problem may be exacerbated when conversational agents are described as health professionals or are given professional titles or appearances. To date, the professional representation of conversational agents that are used for health care has received little attention in the literature. INCLUSION CRITERIA This review will include scholarly publications on conversational agents that are used for health care, particularly descriptive/developmental case studies and intervention/evaluation studies. This review will consider conversational agents designed for patients and health seekers, but not health professionals or trainees. Agents addressing physical and/or mental health will be considered. METHODS This review will be conducted in accordance with JBI methodology for scoping reviews. The databases to be searched will include MEDLINE (PubMed), Embase (Elsevier), CINAHL with Full Text (EBSCO), Scopus (Elsevier), Web of Science (Clarivate), ACM Guide to Computing Literature (ACM Digital Library), and IEEE Xplore (IEEE). The extracted data will include study characteristics, basic characteristics of the conversational agent, and characteristics relating to the professional representation of the conversational agent. The extracted data will be presented in tabular form and summarized using frequency analysis. These results will be accompanied by a narrative summary.
Collapse
Affiliation(s)
- A Luke MacNeill
- Centre for Research in Integrated Care, University of New Brunswick, Saint John, NB, Canada Department of Nursing and Health Sciences, University of New Brunswick, Saint John, NB, Canada The University of New Brunswick (UNB) Saint John Collaboration for Evidence-Informed Healthcare: A JBI Centre of Excellence, Saint John, NB, Canada
| | | | | | | |
Collapse
|
8
|
Ruan Y, Zhuang C, Chen W, Xie J, Zhao Y, Zhang L, Lin H. Limited knowledge and distrust are important social factors of out-patient' s 'inappropriate diagnosed seeking behaviour': a qualitative research in Shanghai. Int J Health Plann Manage 2021; 36:847-865. [PMID: 33615549 DOI: 10.1002/hpm.3134] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Revised: 01/05/2021] [Accepted: 01/29/2021] [Indexed: 11/09/2022] Open
Abstract
AIMS This study is designed to present out-patient's 'inappropriate diagnosed seeking behaviour' in tertiary hospitals and interpret its association with some potential social factors. METHODS A qualitative study based on grounded theory was designed in this paper. The participates were recruited by a two-stage process. The field observation and in-depth interview were adopted for data collection. Multi-round (five rounds) sampling and continuing data analysis were adopted as well. RESULTS Totally 26 out-patients from three tertiary hospitals in Shanghai were involved. Four focused codes, including 'limited policy-related knowledge', 'limited health-related knowledge', 'distrust on related policy' and 'distrust on medical networks', were identified. Then, a theoretical model about the association of out-patient's 'limited knowledge' with 'distrust' and its relationship with 'inappropriate first-diagnosed seeking behaviour' in tertiary hospitals was developed. CONCLUSION 'Inappropriate first-diagnosed seeking behaviour' of the out-patients in tertiary hospitals is closely associated with their limited knowledge and related distrust. Great effort on improving publics' knowledge and rebuilding a benign trust relationship with out-patients and the medical networks is found to be essential for guiding publics' appropriate first-diagnosed health behaviour in various levels of medical institutions.
Collapse
Affiliation(s)
- Yuhui Ruan
- School of International and Public Affairs, Shanghai Jiao Tong University, Shanghai, China.,Institute of Health Yangtze River Delta, Shanghai Jiao Tong University, Shanghai, China
| | - Chenyang Zhuang
- Department of Orthopaedic Surgery, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Weisin Chen
- Department of Orthopaedic Surgery, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Jinyu Xie
- Huashan Hospital, Affiliated to Shanghai Fudan University, Shanghai, China
| | - Yaodong Zhao
- Department of Neurosurgery, Shanghai General Hospital, Shanghai Jiaotong University School of Medicine, Shanghai, China
| | - Lufa Zhang
- School of International and Public Affairs, Shanghai Jiao Tong University, Shanghai, China.,Institute of Health Yangtze River Delta, Shanghai Jiao Tong University, Shanghai, China
| | - Hong Lin
- Department of Orthopaedic Surgery, Zhongshan Hospital, Fudan University, Shanghai, China.,Institute of Medical Science Popularization, Fudan University, Shanghai, China
| |
Collapse
|