1
|
Tai AMY, Kim JJ, Schmeckenbecher J, Kitchin V, Wang J, Kazemi A, Masoudi R, Fadakar H, Iorfino F, Krausz RM. Clinical decision support systems in addiction and concurrent disorders: A systematic review and meta-analysis. J Eval Clin Pract 2024. [PMID: 38979849 DOI: 10.1111/jep.14069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Revised: 06/03/2024] [Accepted: 06/06/2024] [Indexed: 07/10/2024]
Abstract
INTRODUCTION This review aims to synthesise the literature on the efficacy, evolution, and challenges of implementing Clincian Decision Support Systems (CDSS) in the realm of mental health, addiction, and concurrent disorders. METHODS Following PRISMA guidelines, a systematic review and meta-analysis were performed. Searches conducted in databases such as MEDLINE, Embase, CINAHL, PsycINFO, and Web of Science through 25 May 2023, yielded 27,344 records. After necessary exclusions, 69 records were allocated for detailed synthesis. In the examination of patient outcomes with a focus on metrics such as therapeutic efficacy, patient satisfaction, and treatment acceptance, meta-analytic techniques were employed to synthesise data from randomised controlled trials. RESULTS A total of 69 studies were included, revealing a shift from knowledge-based models pre-2017 to a rise in data-driven models post-2017. The majority of models were found to be in Stage 2 or 4 of maturity. The meta-analysis showed an effect size of -0.11 for addiction-related outcomes and a stronger effect size of -0.50 for patient satisfaction and acceptance of CDSS. DISCUSSION The results indicate a shift from knowledge-based to data-driven CDSS approaches, aligned with advances in machine learning and big data. Although the immediate impact on addiction outcomes is modest, higher patient satisfaction suggests promise for wider CDSS use. Identified challenges include alert fatigue and opaque AI models. CONCLUSION CDSS shows promise in mental health and addiction treatment but requires a nuanced approach for effective and ethical implementation. The results emphasise the need for continued research to ensure optimised and equitable use in healthcare settings.
Collapse
Affiliation(s)
- Andy Man Yeung Tai
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Jane J Kim
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Jim Schmeckenbecher
- Department of Psychiatry and Psychotherapy, Medical University of Vienna, Wien, Austria
| | - Vanessa Kitchin
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Johnston Wang
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Alireza Kazemi
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Raha Masoudi
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Hasti Fadakar
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Frank Iorfino
- Brain and Mind Centre, The University of Sydney, Sydney, Australia
| | - Reinhard Michael Krausz
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
2
|
Perlman K, Mehltretter J, Benrimoh D, Armstrong C, Fratila R, Popescu C, Tunteng JF, Williams J, Rollins C, Golden G, Turecki G. Development of a differential treatment selection model for depression on consolidated and transformed clinical trial datasets. Transl Psychiatry 2024; 14:263. [PMID: 38906883 PMCID: PMC11192904 DOI: 10.1038/s41398-024-02970-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 05/09/2024] [Accepted: 05/29/2024] [Indexed: 06/23/2024] Open
Abstract
Major depressive disorder (MDD) is the leading cause of disability worldwide, yet treatment selection still proceeds via "trial and error". Given the varied presentation of MDD and heterogeneity of treatment response, the use of machine learning to understand complex, non-linear relationships in data may be key for treatment personalization. Well-organized, structured data from clinical trials with standardized outcome measures is useful for training machine learning models; however, combining data across trials poses numerous challenges. There is also persistent concern that machine learning models can propagate harmful biases. We have created a methodology for organizing and preprocessing depression clinical trial data such that transformed variables harmonized across disparate datasets can be used as input for feature selection. Using Bayesian optimization, we identified an optimal multi-layer dense neural network that used data from 21 clinical and sociodemographic features as input in order to perform differential treatment benefit prediction. With this combined dataset of 5032 individuals and 6 drugs, we created a differential treatment benefit prediction model. Our model generalized well to the held-out test set and produced similar accuracy metrics in the test and validation set with an AUC of 0.7 when predicting binary remission. To address the potential for bias propagation, we used a bias testing performance metric to evaluate the model for harmful biases related to ethnicity, age, or sex. We present a full pipeline from data preprocessing to model validation that was employed to create the first differential treatment benefit prediction model for MDD containing 6 treatment options.
Collapse
Affiliation(s)
- Kelly Perlman
- Douglas Mental Health University Institute, Montreal, QC, Canada.
- McGill University, Montreal, QC, Canada.
- Aifred Health Inc., Montreal, QC, Canada.
| | | | - David Benrimoh
- Douglas Mental Health University Institute, Montreal, QC, Canada
- McGill University, Montreal, QC, Canada
- Aifred Health Inc., Montreal, QC, Canada
| | | | | | - Christina Popescu
- Aifred Health Inc., Montreal, QC, Canada
- University of Alberta, Edmonton, AB, Canada
| | - Jingla-Fri Tunteng
- McGill University, Montreal, QC, Canada
- Aifred Health Inc., Montreal, QC, Canada
| | - Jerome Williams
- McGill University, Montreal, QC, Canada
- Aifred Health Inc., Montreal, QC, Canada
| | - Colleen Rollins
- McGill University, Montreal, QC, Canada
- University of Cambridge, Cambridge, UK
| | - Grace Golden
- Aifred Health Inc., Montreal, QC, Canada
- University of Waterloo, Waterloo, ON, Canada
| | - Gustavo Turecki
- Douglas Mental Health University Institute, Montreal, QC, Canada
- McGill University, Montreal, QC, Canada
| |
Collapse
|
3
|
Evans RP, Bryant LD, Russell G, Absolom K. Trust and acceptability of data-driven clinical recommendations in everyday practice: A scoping review. Int J Med Inform 2024; 183:105342. [PMID: 38266426 DOI: 10.1016/j.ijmedinf.2024.105342] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Revised: 12/08/2023] [Accepted: 01/14/2024] [Indexed: 01/26/2024]
Abstract
BACKGROUND Increasing attention is being given to the analysis of large health datasets to derive new clinical decision support systems (CDSS). However, few data-driven CDSS are being adopted into clinical practice. Trust in these tools is believed to be fundamental for acceptance and uptake but to date little attention has been given to defining or evaluating trust in clinical settings. OBJECTIVES A scoping review was conducted to explore how and where acceptability and trustworthiness of data-driven CDSS have been assessed from the health professional's perspective. METHODS Medline, Embase, PsycInfo, Web of Science, Scopus, ACM Digital, IEEE Xplore and Google Scholar were searched in March 2022 using terms expanded from: "data-driven" AND "clinical decision support" AND "acceptability". Included studies focused on healthcare practitioner-facing data-driven CDSS, relating directly to clinical care. They included trust or a proxy as an outcome, or in the discussion. The preferred reporting items for systematic reviews and meta-analyses extension for scoping reviews (PRISMA-ScR) is followed in the reporting of this review. RESULTS 3291 papers were screened, with 85 primary research studies eligible for inclusion. Studies covered a diverse range of clinical specialisms and intended contexts, but hypothetical systems (24) outnumbered those in clinical use (18). Twenty-five studies measured trust, via a wide variety of quantitative, qualitative and mixed methods. A further 24 discussed themes of trust without it being explicitly evaluated, and from these, themes of transparency, explainability, and supporting evidence were identified as factors influencing healthcare practitioner trust in data-driven CDSS. CONCLUSION There is a growing body of research on data-driven CDSS, but few studies have explored stakeholder perceptions in depth, with limited focused research on trustworthiness. Further research on healthcare practitioner acceptance, including requirements for transparency and explainability, should inform clinical implementation.
Collapse
Affiliation(s)
- Ruth P Evans
- University of Leeds, Woodhouse Lane, Leeds LS2 9JT, UK.
| | | | - Gregor Russell
- Bradford District Care Trust, Bradford, New Mill, Victoria Rd, BD18 3LD, UK.
| | - Kate Absolom
- University of Leeds, Woodhouse Lane, Leeds LS2 9JT, UK.
| |
Collapse
|
4
|
Benrimoh D, Kleinerman A, Furukawa TA, Iii CFR, Lenze EJ, Karp J, Mulsant B, Armstrong C, Mehltretter J, Fratila R, Perlman K, Israel S, Popescu C, Golden G, Qassim S, Anacleto A, Tanguay-Sela M, Kapelner A, Rosenfeld A, Turecki G. Towards Outcome-Driven Patient Subgroups: A Machine Learning Analysis Across Six Depression Treatment Studies. Am J Geriatr Psychiatry 2024; 32:280-292. [PMID: 37839909 DOI: 10.1016/j.jagp.2023.09.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Accepted: 09/08/2023] [Indexed: 10/17/2023]
Abstract
BACKGROUND Major depressive disorder (MDD) is a heterogeneous condition; multiple underlying neurobiological and behavioral substrates are associated with treatment response variability. Understanding the sources of this variability and predicting outcomes has been elusive. Machine learning (ML) shows promise in predicting treatment response in MDD, but its application is limited by challenges to the clinical interpretability of ML models, and clinicians often lack confidence in model results. In order to improve the interpretability of ML models in clinical practice, our goal was to demonstrate the derivation of treatment-relevant patient profiles comprised of clinical and demographic information using a novel ML approach. METHODS We analyzed data from six clinical trials of pharmacological treatment for depression (total n = 5438) using the Differential Prototypes Neural Network (DPNN), a ML model that derives patient prototypes which can be used to derive treatment-relevant patient clusters while learning to generate probabilities for differential treatment response. A model classifying remission and outputting individual remission probabilities for five first-line monotherapies and three combination treatments was trained using clinical and demographic data. Prototypes were evaluated for interpretability by assessing differences in feature distributions (e.g. age, sex, symptom severity) and treatment-specific outcomes. RESULTS A 3-prototype model achieved an area under the receiver operating curve of 0.66 and an expected absolute improvement in remission rate for those receiving the best predicted treatment of 6.5% (relative improvement of 15.6%) compared to the population remission rate. We identified three treatment-relevant patient clusters. Cluster A patients tended to be younger, to have increased levels of fatigue, and more severe symptoms. Cluster B patients tended to be older, female, have less severe symptoms, and the highest remission rates. Cluster C patients had more severe symptoms, lower remission rates, more psychomotor agitation, more intense suicidal ideation, and more somatic genital symptoms. CONCLUSION It is possible to produce novel treatment-relevant patient profiles using ML models; doing so may improve interpretability of ML models and the quality of precision medicine treatments for MDD.
Collapse
Affiliation(s)
- David Benrimoh
- Department of Psychiatry (DB, KP, GT), McGill University, Montreal, Canada; Department of Psychiatry (DB), Stanford University, Stanford, CA; Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada.
| | | | - Toshi A Furukawa
- Department of Health Promotion and Human Behavior (TAF), Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan
| | - Charles F Reynolds Iii
- Department of Psychiatry (CFR), University of Pittsburgh School of Medicine, Pittsburgh, PA; Department of Psychiatry (CFR), Tufts University School of Medicine, Medford, MA
| | - Eric J Lenze
- Department of Psychiatry (EJL), Washington University School of Medicine, St. Louis, MS
| | - Jordan Karp
- Department of Psychiatry (JK), University of Arizona, Tucson, AZ
| | - Benoit Mulsant
- Department of Psychiatry (BM), University of Toronto, Toronto, ON, Canada
| | - Caitrin Armstrong
- Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Joseph Mehltretter
- Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Robert Fratila
- Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Kelly Perlman
- Department of Psychiatry (DB, KP, GT), McGill University, Montreal, Canada; Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Sonia Israel
- Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Christina Popescu
- Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Grace Golden
- Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Sabrina Qassim
- Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Alexandra Anacleto
- Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Myriam Tanguay-Sela
- Aifred Health (DB, CA, JM, RF, KP, SI, CP, GG, SQ, AA, MTS), Montreal, Canada
| | - Adam Kapelner
- Department of Mathematics (AK), Queens College, CUNY, New York, NY
| | | | - Gustavo Turecki
- Department of Psychiatry (DB, KP, GT), McGill University, Montreal, Canada
| |
Collapse
|
5
|
Giddings R, Joseph A, Callender T, Janes SM, van der Schaar M, Sheringham J, Navani N. Factors influencing clinician and patient interaction with machine learning-based risk prediction models: a systematic review. Lancet Digit Health 2024; 6:e131-e144. [PMID: 38278615 DOI: 10.1016/s2589-7500(23)00241-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Revised: 10/20/2023] [Accepted: 11/14/2023] [Indexed: 01/28/2024]
Abstract
Machine learning (ML)-based risk prediction models hold the potential to support the health-care setting in several ways; however, use of such models is scarce. We aimed to review health-care professional (HCP) and patient perceptions of ML risk prediction models in published literature, to inform future risk prediction model development. Following database and citation searches, we identified 41 articles suitable for inclusion. Article quality varied with qualitative studies performing strongest. Overall, perceptions of ML risk prediction models were positive. HCPs and patients considered that models have the potential to add benefit in the health-care setting. However, reservations remain; for example, concerns regarding data quality for model development and fears of unintended consequences following ML model use. We identified that public views regarding these models might be more negative than HCPs and that concerns (eg, extra demands on workload) were not always borne out in practice. Conclusions are tempered by the low number of patient and public studies, the absence of participant ethnic diversity, and variation in article quality. We identified gaps in knowledge (particularly views from under-represented groups) and optimum methods for model explanation and alerts, which require future research.
Collapse
Affiliation(s)
- Rebecca Giddings
- Lungs for Living Research Centre, UCL Respiratory, University College London, London, UK.
| | - Anabel Joseph
- Lungs for Living Research Centre, UCL Respiratory, University College London, London, UK
| | - Thomas Callender
- Lungs for Living Research Centre, UCL Respiratory, University College London, London, UK
| | - Sam M Janes
- Lungs for Living Research Centre, UCL Respiratory, University College London, London, UK
| | - Mihaela van der Schaar
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK; The Alan Turing Institute, London, UK
| | - Jessica Sheringham
- Department of Applied Health Research, University College London, London, UK
| | - Neal Navani
- Lungs for Living Research Centre, UCL Respiratory, University College London, London, UK
| |
Collapse
|
6
|
Sehrawat O, Noseworthy PA, Siontis KC, Haddad TC, Halamka JD, Liu H. Data-Driven and Technology-Enabled Trial Innovations Toward Decentralization of Clinical Trials: Opportunities and Considerations. Mayo Clin Proc 2023; 98:1404-1421. [PMID: 37661149 DOI: 10.1016/j.mayocp.2023.02.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 01/25/2023] [Accepted: 02/08/2023] [Indexed: 09/05/2023]
Abstract
Traditional trial designs have well-recognized inefficiencies and logistical barriers to participation. Decentralized trials and digital health solutions have been suggested as potential solutions and have certainly risen to the challenge during the pandemic. Clinical trial designs are now increasingly data driven. The use of distributed clinical data networks and digitization has helped to fundamentally upgrade existing research systems. A trial design may vary anywhere from fully decentralized to hybrid to traditional on-site. Various decentralization components are available for stakeholders to increase the reach and pace of their trials, such as electronic informed consent, remote interviews, administration, outcome assessment, monitoring, and laboratory and imaging modalities. Furthermore, digital health technologies can be included to enrich study conduct. However, careful consideration is warranted, including assessing verification and validity through usability studies and having various contingencies in place through dedicated risk assessment. Selecting the right combination depends not just on the ability to handle patient care and the medical know-how but also on the availability of appropriate technologic infrastructure, skills, and human resources. Throughout this process, quality of evidence generation and physician-patient relation must not be undermined. Here we also address some knowledge gaps, cost considerations, and potential impact of decentralization and digitization on inclusivity, recruitment, engagement, and retention. Last, we mention some future directions that may help drive the necessary change in the right direction.
Collapse
Affiliation(s)
- Ojasav Sehrawat
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN.
| | | | | | | | - John D Halamka
- Department of Emergency Medicine, Mayo Clinic, Rochester, MN
| | - Hongfang Liu
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN.
| |
Collapse
|
7
|
Magrabi F, Lyell D, Coiera E. Automation in Contemporary Clinical Information Systems: a Survey of AI in Healthcare Settings. Yearb Med Inform 2023; 32:115-126. [PMID: 38147855 PMCID: PMC10751141 DOI: 10.1055/s-0043-1768733] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2023] Open
Abstract
AIMS AND OBJECTIVES To examine the nature and use of automation in contemporary clinical information systems by reviewing studies reporting the implementation and evaluation of artificial intelligence (AI) technologies in healthcare settings. METHOD PubMed/MEDLINE, Web of Science, EMBASE, the tables of contents of major informatics journals, and the bibliographies of articles were searched for studies reporting evaluation of AI in clinical settings from January 2021 to December 2022. We documented the clinical application areas and tasks supported, and the level of system autonomy. Reported effects on user experience, decision-making, care delivery and outcomes were summarised. RESULTS AI technologies are being applied in a wide variety of clinical areas. Most contemporary systems utilise deep learning, use routinely collected data, support diagnosis and triage, are assistive (requiring users to confirm or approve AI provided information or decisions), and are used by doctors in acute care settings in high-income nations. AI systems are integrated and used within existing clinical information systems including electronic medical records. There is limited support for One Health goals. Evaluation is largely based on quantitative methods measuring effects on decision-making. CONCLUSION AI systems are being implemented and evaluated in many clinical areas. There remain many opportunities to understand patterns of routine use and evaluate effects on decision-making, care delivery and patient outcomes using mixed-methods. Support for One Health including integrating data about environmental factors and social determinants needs further exploration.
Collapse
Affiliation(s)
- Farah Magrabi
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - David Lyell
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Enrico Coiera
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| |
Collapse
|
8
|
Bellón JA, Rodríguez-Morejón A, Conejo-Cerón S, Campos-Paíno H, Rodríguez-Bayón A, Ballesta-Rodríguez MI, Rodríguez-Sánchez E, Mendive JM, López del Hoyo Y, Luna JD, Tamayo-Morales O, Moreno-Peral P. A personalized intervention to prevent depression in primary care based on risk predictive algorithms and decision support systems: protocol of the e-predictD study. Front Psychiatry 2023; 14:1163800. [PMID: 37333911 PMCID: PMC10275079 DOI: 10.3389/fpsyt.2023.1163800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2023] [Accepted: 05/02/2023] [Indexed: 06/20/2023] Open
Abstract
The predictD is an intervention implemented by general practitioners (GPs) to prevent depression, which reduced the incidence of depression-anxiety and was cost-effective. The e-predictD study aims to design, develop, and evaluate an evolved predictD intervention to prevent the onset of major depression in primary care based on Information and Communication Technologies, predictive risk algorithms, decision support systems (DSSs), and personalized prevention plans (PPPs). A multicenter cluster randomized trial with GPs randomly assigned to the e-predictD intervention + care-as-usual (CAU) group or the active-control + CAU group and 1-year follow-up is being conducted. The required sample size is 720 non-depressed patients (aged 18-55 years), with moderate-to-high depression risk, under the care of 72 GPs in six Spanish cities. The GPs assigned to the e-predictD-intervention group receive brief training, and those assigned to the control group do not. Recruited patients of the GPs allocated to the e-predictD group download the e-predictD app, which incorporates validated risk algorithms to predict depression, monitoring systems, and DSSs. Integrating all inputs, the DSS automatically proposes to the patients a PPP for depression based on eight intervention modules: physical exercise, social relationships, improving sleep, problem-solving, communication skills, decision-making, assertiveness, and working with thoughts. This PPP is discussed in a 15-min semi-structured GP-patient interview. Patients then choose one or more of the intervention modules proposed by the DSS to be self-implemented over the next 3 months. This process will be reformulated at 3, 6, and 9 months but without the GP-patient interview. Recruited patients of the GPs allocated to the control-group+CAU download another version of the e-predictD app, but the only intervention that they receive via the app is weekly brief psychoeducational messages (active-control group). The primary outcome is the cumulative incidence of major depression measured by the Composite International Diagnostic Interview at 6 and 12 months. Other outcomes include depressive symptoms (PHQ-9) and anxiety symptoms (GAD-7), depression risk (predictD risk algorithm), mental and physical quality of life (SF-12), and acceptability and satisfaction ('e-Health Impact' questionnaire) with the intervention. Patients are evaluated at baseline and 3, 6, 9, and 12 months. An economic evaluation will also be performed (cost-effectiveness and cost-utility analysis) from two perspectives, societal and health systems. Trial registration ClinicalTrials.gov, identifier: NCT03990792.
Collapse
Affiliation(s)
- Juan A. Bellón
- Biomedical Research Institute of Malaga (IBIMA Plataforma Bionand), Málaga, Spain
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- ‘El Palo' Health Centre, Servicio Andaluz de Salud (SAS), Málaga, Spain
- Department of Public Health and Psychiatry, University of Málaga (UMA), Málaga, Spain
| | - Alberto Rodríguez-Morejón
- Biomedical Research Institute of Malaga (IBIMA Plataforma Bionand), Málaga, Spain
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- Department of Personality, Evaluation and Psychological Treatment, University of Málaga (UMA), Málaga, Spain
| | - Sonia Conejo-Cerón
- Biomedical Research Institute of Malaga (IBIMA Plataforma Bionand), Málaga, Spain
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
| | - Henar Campos-Paíno
- Biomedical Research Institute of Malaga (IBIMA Plataforma Bionand), Málaga, Spain
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
| | - Antonina Rodríguez-Bayón
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- Centro de Salud San José, Distrito Sanitario Jaén Norte, Servicio Andaluz de Salud (SAS), Linares, Jaén, Spain
| | - María I. Ballesta-Rodríguez
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- Centro de Salud Federico del Castillo, Distrito Sanitario Jaén, Servicio Andaluz de Salud (SAS), Jaén, Spain
| | - Emiliano Rodríguez-Sánchez
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- Unidad de Investigación de Atención Primaria de Salamanca (APISAL), Gerencia de Atención Primaria de Salamanca, Instituto de Investigación Biomédica de Salamanca (IBSAL), Salamanca, Spain
- Department of Medicine, University of Salamanca (USAL), Salamanca, Spain
| | - Juan M. Mendive
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- ‘La Mina' Health Centre, Institut Català de la Salut (ICS), Barcelona, Spain
| | - Yolanda López del Hoyo
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- Instituto de Investigación Sanitaria de Aragón (IISA), Universidad de Zaragoza (UNIZAR), Zaragoza, Spain
| | - Juan D. Luna
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- Department of Statistics and Operational Research, University of Granada (UGR), Granada, Spain
| | - Olaya Tamayo-Morales
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- Unidad de Investigación de Atención Primaria de Salamanca (APISAL), Gerencia de Atención Primaria de Salamanca, Instituto de Investigación Biomédica de Salamanca (IBSAL), Salamanca, Spain
| | - Patricia Moreno-Peral
- Biomedical Research Institute of Malaga (IBIMA Plataforma Bionand), Málaga, Spain
- Prevention and Health Promotion Research Network (redIAPP), ISCIII, Madrid, Spain
- Network for Research on Chronicity, Primary Care, and Prevention and Health Promotion (RICAPPS), ISCIII, Madrid, Spain
- Department of Personality, Evaluation and Psychological Treatment, University of Málaga (UMA), Málaga, Spain
| |
Collapse
|
9
|
Benrimoh D, Fisher V, Mourgues C, Sheldon AD, Smith R, Powers AR. Barriers and solutions to the adoption of translational tools for computational psychiatry. Mol Psychiatry 2023; 28:2189-2196. [PMID: 37280282 PMCID: PMC10611570 DOI: 10.1038/s41380-023-02114-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Revised: 04/25/2023] [Accepted: 05/05/2023] [Indexed: 06/08/2023]
Abstract
Computational psychiatry is a field aimed at developing formal models of information processing in the human brain, and how alterations in this processing can lead to clinical phenomena. There has been significant progress in the development of tasks and how to model them, presenting an opportunity to incorporate computational psychiatry methodologies into large- scale research projects or into clinical practice. In this viewpoint, we explore some of the barriers to incorporation of computational psychiatry tasks and models into wider mainstream research directions. These barriers include the time required for participants to complete tasks, test-retest reliability, limited ecological validity, as well as practical concerns, such as lack of computational expertise and the expense and large sample sizes traditionally required to validate tasks and models. We then discuss solutions, such as the redesigning of tasks with a view toward feasibility, and the integration of tasks into more ecologically valid and standardized game platforms that can be more easily disseminated. Finally, we provide an example of how one task, the conditioned hallucinations task, might be translated into such a game. It is our hope that interest in the creation of more accessible and feasible computational tasks will help computational methods make more positive impacts on research as well as, eventually, clinical practice.
Collapse
Affiliation(s)
- David Benrimoh
- McGill University School of Medicine, Montreal, QC, Canada
| | - Victoria Fisher
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, USA
| | - Catalina Mourgues
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, USA
| | - Andrew D Sheldon
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, USA
| | - Ryan Smith
- Laureate Institute for Brain Research, Tulsa, OK, USA
| | - Albert R Powers
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, USA.
| |
Collapse
|
10
|
Higgins O, Short BL, Chalup SK, Wilson RL. Artificial intelligence (AI) and machine learning (ML) based decision support systems in mental health: An integrative review. Int J Ment Health Nurs 2023. [PMID: 36744684 DOI: 10.1111/inm.13114] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 12/28/2022] [Indexed: 02/07/2023]
Abstract
An integrative review investigating the incorporation of artificial intelligence (AI) and machine learning (ML) based decision support systems in mental health care settings was undertaken of published literature between 2016 and 2021 across six databases. Four studies met the research question and the inclusion criteria. The primary theme identified was trust and confidence. To date, there is limited research regarding the use of AI-based decision support systems in mental health. Our review found that significant barriers exist regarding its incorporation into practice primarily arising from uncertainty related to clinician's trust and confidence, end-user acceptance and system transparency. More research is needed to understand the role of AI in assisting treatment and identifying missed care. Researchers and developers must focus on establishing trust and confidence with clinical staff before true clinical impact can be determined. Finally, further research is required to understand the attitudes and beliefs surrounding the use of AI and related impacts for the wellbeing of the end-users of care. This review highlights the necessity of involving clinicians in all stages of research, development and implementation of artificial intelligence in care delivery. Earning the trust and confidence of clinicians should be foremost in consideration in implementation of any AI-based decision support system. Clinicians should be motivated to actively embrace the opportunity to contribute to the development and implementation of new health technologies and digital tools that assist all health care professionals to identify missed care, before it occurs as a matter of importance for public safety and ethical implementation. AI-basesd decision support tools in mental health settings show most promise as trust and confidence of clinicians is achieved.
Collapse
Affiliation(s)
- Oliver Higgins
- School of Nursing and Midwifery, University of Newcastle, Newcastle, New South Wales, Australia.,Central Coast Local Health District, Gosford, New South Wales, Australia
| | - Brooke L Short
- School of Medicine and Public Health (Medicine), University of Newcastle, Newcastle, New South Wales, Australia.,St Vincent's Hospital, Sydney, New South Wales, Australia
| | - Stephan K Chalup
- School of Information and Physical Sciences (Computer Science and Software Engineering), University of Newcastle, Newcastle, New South Wales, Australia
| | - Rhonda L Wilson
- School of Nursing and Midwifery, University of Newcastle, Newcastle, New South Wales, Australia.,Massey University, Wellington, New Zealand
| |
Collapse
|
11
|
Tanguay-Sela M, Rollins C, Perez T, Qiang V, Golden G, Tunteng JF, Perlman K, Simard J, Benrimoh D, Margolese HC. A systematic meta-review of patient-level predictors of psychological therapy outcome in major depressive disorder. J Affect Disord 2022; 317:307-318. [PMID: 36029877 DOI: 10.1016/j.jad.2022.08.041] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Revised: 08/16/2022] [Accepted: 08/19/2022] [Indexed: 10/31/2022]
Abstract
BACKGROUND Psychological therapies are effective for treating major depressive disorder, but current clinical guidelines do not provide guidance on the personalization of treatment choice. Established predictors of psychotherapy treatment response could help inform machine learning models aimed at predicting individual patient responses to different therapy options. Here we sought to comprehensively identify known predictors. METHODS EMBASE, Medline, PubMed, PsycINFO were searched for systematic reviews with or without meta-analysis published until June 2020 to identify individual patient-level predictors of response to psychological treatments. 3113 abstracts were identified and 300 articles assessed. We qualitatively synthesized our findings by predictor category (sociodemographic; symptom profile; social support; personality features; affective, cognitive, and behavioural; comorbidities; neuroimaging; genetics) and treatment type. We used the AMSTAR 2 to evaluate the quality of included reviews. RESULTS Following screening and full-text assessment, 27 systematic reviews including 12 meta-analyses were eligible for inclusion. 74 predictors emerged for various psychological treatments, primarily cognitive behavioural therapy, interpersonal therapy, and mindfulness-based cognitive therapy. LIMITATIONS A paucity of studies examining predictors of psychological treatment outcome, as well as methodological heterogeneities and publication biases limit the strength of the identified predictors. CONCLUSIONS The synthesized predictors could be used to supplement clinical decision-making in selecting psychological therapies based on individual patient characteristics. These predictors could also be used as a priori input features for machine learning models aimed at predicting a given patient's likelihood of response to different treatment options for depression, and may contribute toward the development of patient-specific treatment recommendations in clinical guidelines.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Jade Simard
- Université du Québec à Montréal, Montreal, Quebec, Canada
| | | | | |
Collapse
|