2
|
Anmella G, Sanabra M, Primé-Tous M, Segú X, Cavero M, Morilla I, Ruiz V, Grande I, Mas A, Martín-Villalba I, Caballo A, Esteva JP, Rodríguez-Rey A, Piazza F, Valdesoiro FJ, Rodriguez-Torrella C, Espinosa M, Sorroche C, Virgili G, Ruiz A, Solanes A, Radua J, Also MA, Sant E, Murgui S, Sans-Corrales M, H Young A, Vicens V, Blanch J, Caballeria E, López-Pelayo H, López C, Olivé V, Pujol L, Quesada S, Solé B, Martínez-Aran A, Torrent C, Guarch J, Navinés R, Murru A, Fico G, De Prisco M, Oliva V, Pio C, Amoretti S, Fernández-Canseco M, Villegas M, Vieta E, Hidalgo-Mazzei D. Vickybot, a chatbot for anxiety-depressive symptoms and work-related burnout in primary care and healthcare professionals: development, feasibility, and potential effectiveness studies. J Med Internet Res 2023; 25:e43293. [PMID: 36719325 PMCID: PMC10131622 DOI: 10.2196/43293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Revised: 12/19/2022] [Accepted: 01/31/2023] [Indexed: 02/01/2023] Open
Abstract
BACKGROUND A significant proportion of people attending Primary Care (PC) have anxiety-depressive symptoms and work-related burnout compounded by a lack of resources to meet their needs. The COVID-19 pandemic has exacerbated this problem and digital tools have been proposed as a solution. OBJECTIVE We present the development, feasibility, and potential effectiveness studies of Vickybot, a chatbot aimed at screening, monitoring, and reducing anxiety-depressive symptoms and work-related burnout in PC patients and healthcare workers. METHODS User-centered development strategies were adopted. Main functions included self-assessments, psychological modules, and emergency alerts. Healthy controls (HCs) tested Vickybot for reliability. (1) Simulation: HCs used Vickybot for 2 weeks to simulate different clinical situations. (2) Feasibility and effectiveness study: People consulting PC or healthcare workers with mental health problems were offered to use Vickybot for one month. Self-assessments for anxiety (GAD-7) and depression (PHQ-9) symptoms, and work-related burnout (based on the Maslach Burnout Inventory) were administered at baseline and every two weeks. Feasibility was determined from both subjective and objective user-engagement Indicators (UEIs). Potential effectiveness was measured using paired t-tests or the Wilcoxon signed-rank test for the change in self-assessment scores. RESULTS 40 HCs tested Vickybot simultaneously, and data was transmitted and registered reliably. (1) Simulation: 17 HCs (73% female; mean age=36.5±9.7) received 98.8% of the expected modules according to each simulation. Suicidal alerts were correctly received. (2) Feasibility and potential effectiveness study: 34 patients (15 from PC and 19 healthcare workers; 77% female; mean age=35.3±10.1) completed the first self-assessments, with 34 (100%) presenting anxiety symptoms, 32 (94%) depressive symptoms, and 22 (64.7%) work-related burnout. Nine (26.5%) patients completed the second self-assessments after two weeks of use. No significant differences were found between the scores of the first and second self-assessments for anxiety [t(8) = 1.000, P = .34] or depressive [t(8) = .40, P = .70] symptoms. However, work-related burnout scores were moderately reduced (Z = -2.07, P = 0.038, r = .32). There was a non-significant trend towards higher reduction in anxiety-depressive symptoms and work-related burnout with greater use of the chatbot. Three patients (8.8%) activated the suicide alert, and the research team intervened promptly with successful outcomes. Vickybot showed high subjective-UEIs, but low objective-UEIs (completion, adherence, compliance, and engagement). Feasibility was moderate. CONCLUSIONS The chatbot was useful in screening for the presence and severity of anxiety and depressive symptoms, and detecting suicidal risk. Potential effectiveness was shown in reducing work-related burnout, but not anxiety or depressive symptoms. Subjective perceptions of use contrasted with low objective-use metrics. Our results are promising but suggest the need to adapt and enhance the smartphone-based solution in order to improve engagement. Consensus on how to report UEIs and validate digital solutions, especially for chatbots, are required. CLINICALTRIAL
Collapse
Affiliation(s)
- Gerard Anmella
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Miriam Sanabra
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Mireia Primé-Tous
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Xavier Segú
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Myriam Cavero
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Ivette Morilla
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Victoria Ruiz
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Iria Grande
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Ariadna Mas
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Inés Martín-Villalba
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Alejandro Caballo
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Julia-Parisad Esteva
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Arturo Rodríguez-Rey
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Flavia Piazza
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Francisco José Valdesoiro
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Claudia Rodriguez-Torrella
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Marta Espinosa
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Carlota Sorroche
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Giulia Virgili
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Alicia Ruiz
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Aleix Solanes
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, ES
| | - Joaquim Radua
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, ES
| | - María Antonieta Also
- CAP Casanova, Consorci Atenció primaria de Salut Barcelona Esquerra (CAPSBE), Barcelona, ES
| | - Elisenda Sant
- CAP Casanova, Consorci Atenció primaria de Salut Barcelona Esquerra (CAPSBE), Barcelona, ES
| | - Sandra Murgui
- CAP Borrell, Consorci d'Atenció primaria de Salut Barcelona Esquerra (CAPSBE), Barcelona, ES
| | - Mireia Sans-Corrales
- CAP Borrell, Consorci d'Atenció primaria de Salut Barcelona Esquerra (CAPSBE), Barcelona, ES
| | - Allan H Young
- Centre for Affective Disorders, Institute of Psychiatry, Psychology & Neuroscience, King's College, London, GB
| | - Victor Vicens
- Chief Medical Officer and co-founder of Abi Global Health, Barcelona, ES
| | - Jordi Blanch
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Elsa Caballeria
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Hugo López-Pelayo
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Clara López
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Victoria Olivé
- Hospital Clínic de Barcelona, Occupational Health Department, barcelona, ES
| | - Laura Pujol
- Hospital Clínic de Barcelona, Occupational Health Department, barcelona, ES
| | - Sebastiana Quesada
- Hospital Clínic de Barcelona, Occupational Health Department, barcelona, ES
| | - Brisa Solé
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Anabel Martínez-Aran
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Carla Torrent
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Joana Guarch
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Ricard Navinés
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Andrea Murru
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Giovanna Fico
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Michele De Prisco
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Vicenzo Oliva
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Casimiro Pio
- Barcelona Supercomputing Center (BSC). Text Mining Technologies in the Health Domain, Barcelona, ES
| | - Silvia Amoretti
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - María Fernández-Canseco
- Barcelona Supercomputing Center (BSC). Text Mining Technologies in the Health Domain, Barcelona, ES
| | - Marta Villegas
- Barcelona Supercomputing Center (BSC). Text Mining Technologies in the Health Domain, Barcelona, ES
| | - Eduard Vieta
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| | - Diego Hidalgo-Mazzei
- Hospital Clínic de Barcelona, Department of Psychiatry and Psychology, Institute of Neuroscience, C. de Villarroel, 170, 08036, Barcelona, ES
| |
Collapse
|