1
|
Dergaa I, Fekih-Romdhane F, Hallit S, Loch AA, Glenn JM, Fessi MS, Ben Aissa M, Souissi N, Guelmami N, Swed S, El Omri A, Bragazzi NL, Ben Saad H. ChatGPT is not ready yet for use in providing mental health assessment and interventions. Front Psychiatry 2024; 14:1277756. [PMID: 38239905 PMCID: PMC10794665 DOI: 10.3389/fpsyt.2023.1277756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Accepted: 11/17/2023] [Indexed: 01/22/2024] Open
Abstract
Background Psychiatry is a specialized field of medicine that focuses on the diagnosis, treatment, and prevention of mental health disorders. With advancements in technology and the rise of artificial intelligence (AI), there has been a growing interest in exploring the potential of AI language models systems, such as Chat Generative Pre-training Transformer (ChatGPT), to assist in the field of psychiatry. Objective Our study aimed to evaluates the effectiveness, reliability and safeness of ChatGPT in assisting patients with mental health problems, and to assess its potential as a collaborative tool for mental health professionals through a simulated interaction with three distinct imaginary patients. Methods Three imaginary patient scenarios (cases A, B, and C) were created, representing different mental health problems. All three patients present with, and seek to eliminate, the same chief complaint (i.e., difficulty falling asleep and waking up frequently during the night in the last 2°weeks). ChatGPT was engaged as a virtual psychiatric assistant to provide responses and treatment recommendations. Results In case A, the recommendations were relatively appropriate (albeit non-specific), and could potentially be beneficial for both users and clinicians. However, as complexity of clinical cases increased (cases B and C), the information and recommendations generated by ChatGPT became inappropriate, even dangerous; and the limitations of the program became more glaring. The main strengths of ChatGPT lie in its ability to provide quick responses to user queries and to simulate empathy. One notable limitation is ChatGPT inability to interact with users to collect further information relevant to the diagnosis and management of a patient's clinical condition. Another serious limitation is ChatGPT inability to use critical thinking and clinical judgment to drive patient's management. Conclusion As for July 2023, ChatGPT failed to give the simple medical advice given certain clinical scenarios. This supports that the quality of ChatGPT-generated content is still far from being a guide for users and professionals to provide accurate mental health information. It remains, therefore, premature to conclude on the usefulness and safety of ChatGPT in mental health practice.
Collapse
Affiliation(s)
- Ismail Dergaa
- Primary Health Care Corporation (PHCC), Doha, Qatar
- Research Unit Physical Activity, Sport, and Health, UR18JS01, National Observatory of Sport, Tunis, Tunisia
- High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia
| | - Feten Fekih-Romdhane
- The Tunisian Center of Early Intervention in Psychosis, Department of Psychiatry “Ibn Omrane”, Razi Hospital, Manouba, Tunisia
- Faculty of Medicine of Tunis, Tunis El Manar University, Tunis, Tunisia
| | - Souheil Hallit
- School of Medicine and Medical Sciences, Holy Spirit University of Kaslik, Jounieh, Lebanon
- Psychology Department, College of Humanities, Effat University, Jeddah, Saudi Arabia
- Applied Science Research Center, Applied Science Private University, Amman, Jordan
| | - Alexandre Andrade Loch
- Laboratorio de Neurociencias (LIM 27), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Instituto de Psiquiatria, Universidade de Sao Paulo, São Paulo, Brazil
- Instituto Nacional de Biomarcadores em Neuropsiquiatria (INBION), Conselho Nacional de Desenvolvimento Científico e Tecnológico, São Paulo, Brazil
| | | | | | - Mohamed Ben Aissa
- Department of Human and Social Sciences, Higher Institute of Sport and Physical Education of Kef, University of Jendouba, Jendouba, Tunisia
| | - Nizar Souissi
- Research Unit Physical Activity, Sport, and Health, UR18JS01, National Observatory of Sport, Tunis, Tunisia
| | - Noomen Guelmami
- Department of Health Sciences (DISSAL), Postgraduate School of Public Health, University of Genoa, Genoa, Italy
| | - Sarya Swed
- Faculty of Medicine, Aleppo University, Aleppo, Syria
| | - Abdelfatteh El Omri
- Surgical Research Section, Department of Surgery, Hamad Medical Corporation, Doha, Qatar
| | - Nicola Luigi Bragazzi
- Laboratory for Industrial and Applied Mathematics, Department of Mathematics and Statistics, York University, Toronto, ON, Canada
| | - Helmi Ben Saad
- Service of Physiology and Functional Explorations, Farhat HACHED Hospital, University of Sousse, Sousse, Tunisia
- Heart Failure (LR12SP09) Research Laboratory, Farhat HACHED Hospital, University of Sousse, Sousse, Tunisia
| |
Collapse
|
2
|
Samartzis L, Talias MA. Assessing and Improving the Quality in Mental Health Services. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2019; 17:ijerph17010249. [PMID: 31905840 PMCID: PMC6982221 DOI: 10.3390/ijerph17010249] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Revised: 12/21/2019] [Accepted: 12/23/2019] [Indexed: 11/16/2022]
Abstract
Background: The mental health of the population consists of the three essential pillars of quality of life, economy, and society. Mental health services take care of the prevention and treatment of mental disorders and through them maintain, improve, and restore the mental health of the population. The purpose of this study is to describe the methodology for qualitative and quantitative evaluation and improvement of the mental health service system. Methods: This is a narrative review study that searches the literature to provide criteria, indicators, and methodology for evaluating and improving the quality of mental health services and the related qualitative and quantitative indicators. The bibliography was searched in popular databases PubMed, Google Scholar, CINAHL, using the keywords “mental”, “health”, “quality”, “indicators”, alone or in combinations thereof. Results: Important quality indicators of mental health services have been collected and presented, and modified where appropriate. The definition of each indicator is presented here, alongside its method of calculation and importance. Each indicator belongs to one of the eight dimensions of quality assessment: (1) Suitability of services, (2) Accessibility of patients to services, (3) Acceptance of services by patients, (4) Ability of healthcare professionals to provide services, (5) Efficiency of health professionals and providers, (6) Continuity of service over time (ensuring therapeutic continuity), (7) Efficiency of health professionals and services, (8) Safety (for patients and for health professionals). Discussion/Conclusions: Accessibility and acceptability of service indicators are important for the attractiveness of services related to their use by the population. Profitability indicators are important economic indicators that affect the viability and sustainability of services, factors that are now taken into account in any health policy. All of the indicators mentioned are related to public health, affecting the quality of life, morbidity, mortality, and life expectancy, directly or indirectly. The systematic measurement and monitoring of indicators and the measurement and quantification of quality through them, are the basis for evidence-based health policy for improvement of the quality of mental health services.
Collapse
Affiliation(s)
- Lampros Samartzis
- Faculty of Economics and Management, Open University of Cyprus, Latsia, Nicosia, Cyprus
- Department of Psychiatry, Medical School, University of Cyprus, Nicosia, Cyprus
- Mental Health Services, Athalassa Psychiatric Hospital, Nicosia, Cyprus
| | - Michael A. Talias
- Faculty of Economics and Management, Open University of Cyprus, Latsia, Nicosia, Cyprus
- Correspondence:
| |
Collapse
|