1
|
Maekawa E, Jensen E, van de Ven P, Mathiasen K. Choosing the right treatment - combining clinicians' expert knowledge with data-driven predictions. Front Psychiatry 2024; 15:1422587. [PMID: 39290309 PMCID: PMC11406075 DOI: 10.3389/fpsyt.2024.1422587] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Accepted: 08/19/2024] [Indexed: 09/19/2024] Open
Abstract
Context This study proposes a Bayesian network model to aid mental health specialists making data-driven decisions on suitable treatments. The aim is to create a probabilistic machine learning model to assist psychologists in selecting the most suitable treatment for individuals for four potential mental disorders: Depression, Panic Disorder, Social Phobia, or Specific Phobia. Methods This study utilized a dataset from 1,094 individuals in Denmark containing socio-demographic details and mental health information. A Bayesian network was initially employed in a purely data-driven approach and was later refined with expert knowledge, referred to as a hybrid model. The model outputted probabilities for each disorder, with the highest probability indicating the most suitable disorder for treatment. Results By incorporating expert knowledge, the model demonstrated enhanced performance compared to a strictly data-driven approach. Specifically, it achieved an AUC score of 0.85 vs 0.80 on the test data. Furthermore, we evaluated some cases where the predictions of the model did not match the actual treatment. The symptom questionnaires indicated that these participants likely had comorbid disorders, with the actual treatment being proposed by the model with the second highest probability. Conclusions In 90.1% of cases, the hybrid model ranked the actual disorder treated as either the highest (67.3%) or second-highest (22.8%) on the test data. This emphasizes that instead of suggesting a single disorder to be treated, the model can offer the probabilities for multiple disorders. This allows individuals seeking treatment or their therapists to incorporate this information as an additional data-driven factor when collectively deciding on which treatment to prioritize.
Collapse
Affiliation(s)
- Eduardo Maekawa
- Department of Electronic and Computer Engineering, University of Limerick, Limerick, Ireland
- Health Research Institute, University of Limerick, Limerick, Ireland
| | - Esben Jensen
- Research Unit for Digital Psychiatry, Centre for Digital Psychiatry, Mental Health Services of Southern Denmark, Odense, Denmark
- Department for Psychology, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Pepijn van de Ven
- Department of Electronic and Computer Engineering, University of Limerick, Limerick, Ireland
- Health Research Institute, University of Limerick, Limerick, Ireland
| | - Kim Mathiasen
- Research Unit for Digital Psychiatry, Centre for Digital Psychiatry, Mental Health Services of Southern Denmark, Odense, Denmark
- Department of Clinical Research, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
2
|
Pietrabissa G, Semonella M, Marchesi G, Mannarini S, Castelnuovo G, Andersson G, Rossi AA. Validation of the Italian Version of the Web Screening Questionnaire for Common Mental Disorders. J Clin Med 2024; 13:1170. [PMID: 38398481 PMCID: PMC10889998 DOI: 10.3390/jcm13041170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Revised: 02/14/2024] [Accepted: 02/16/2024] [Indexed: 02/25/2024] Open
Abstract
BACKGROUND The ever-increasing spread of Internet-based systems for common mental disorders has generated the need for brief online screening methods. This study aims to test the psychometric properties of the Web Screening Questionnaire (WSQ) to examine its suitability for screening for common mental health problems among a community sample of Italian adults. METHODS A total of 1282 subjects (F = 819; mean age = 42.05) answered the WSQ. Its discriminant characteristics were examined with other validated selected scales for measuring mental health widely used in the Italian population using sensitivity, specificity, and area under the curve (AUC), as well as positive (PPV) and negative predictive values (NPV). RESULTS Most of the WSQ subscales exhibited moderate to high specificity values. Specifically, the scales of 'agoraphobia' (0.947; 95%CI [0.934, 0.960]), 'anxiety' (0.959; 95%CI [0.946, 0.970]), and 'panic disorder' (0.973; 95%CI [0.964, 0.981]) showed the highest values whilst the 'obsessive-compulsive' dimension had the lowest value at 0.838, 95%CI [0.815, 0.861]. With exceptions observed for 'depression' (0.716; 95%CI [642, 798]) and 'alcohol abuse' (0.760; 95%CI [560, 920]), instead, the WSQ demonstrated critical sensitivity values (<0.6) in all dimensions. CONCLUSIONS The WSQ was appropriate for discriminating between people with and without a psychiatric condition, as it helps to confirm the absence of disorders. However, further diagnostic procedures are required, in case of a positive WSQ screening result.
Collapse
Affiliation(s)
- Giada Pietrabissa
- Dipartimento di Psicologia, Università Cattolica del Sacro Cuore, 20123 Milano, Italy; (G.M.); (G.C.)
- Clinical Psychology Research Laboratory, IRCCS Istituto Auxologico Italiano, 20149 Milano, Italy
| | | | - Gloria Marchesi
- Dipartimento di Psicologia, Università Cattolica del Sacro Cuore, 20123 Milano, Italy; (G.M.); (G.C.)
| | - Stefania Mannarini
- Department of Philosophy, Sociology, Education, and Applied Psychology, Section of Applied Psychology, University of Padova, 35131 Padova, Italy; (S.M.); (A.A.R.)
- Center for Intervention and Research Studies on the Family, University of Padova, 35131 Padova, Italy
| | - Gianluca Castelnuovo
- Dipartimento di Psicologia, Università Cattolica del Sacro Cuore, 20123 Milano, Italy; (G.M.); (G.C.)
- Clinical Psychology Research Laboratory, IRCCS Istituto Auxologico Italiano, 20149 Milano, Italy
| | - Gerhard Andersson
- Department of Behavioural Science and Learning, Linköping University, 58183 Linköping, Sweden;
- Department of Clinical Neuroscience, Karolinska Institute, 17177 Solna, Sweden
| | - Alessandro Alberto Rossi
- Department of Philosophy, Sociology, Education, and Applied Psychology, Section of Applied Psychology, University of Padova, 35131 Padova, Italy; (S.M.); (A.A.R.)
- Center for Intervention and Research Studies on the Family, University of Padova, 35131 Padova, Italy
| |
Collapse
|
3
|
Etzelmueller A, Heber E, Horvath H, Radkovsky A, Lehr D, Ebert DD. The Evaluation of the GET.ON Nationwide Web-Only Treatment Service for Depression- and Stress-Related Symptoms: Naturalistic Trial. J Med Internet Res 2024; 26:e42976. [PMID: 38300701 PMCID: PMC10870208 DOI: 10.2196/42976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Revised: 04/27/2023] [Accepted: 05/03/2023] [Indexed: 02/02/2024] Open
Abstract
BACKGROUND GET.ON (HelloBetter) treatment interventions have been shown to be efficacious in multiple randomized controlled trials. OBJECTIVE This study evaluated the effectiveness of 2 GET.ON interventions, GET.ON Mood Enhancer and GET.ON Stress, in a national digital mental health service implemented across Germany. METHODS Following an initial web-based questionnaire, participants were allocated to either intervention based on their baseline symptom severity and personal choice and received a semistandardized guided, feedback-on-demand guided, or self-guided version of the treatment. Uncontrolled routine care data from 851 participants were analyzed using a pretest-posttest design. Half of the participants (461/851, 54.2%) were allocated to the stress intervention (189/461, 41% semistandardized; 240/461, 52% feedback on demand; and 32/461, 6.9% self-guided), and almost all participants in the mood intervention (349/352, 99.2%) received semistandardized guidance. RESULTS Results on depression-related symptom severity indicated a reduction in reported symptoms, with a large effect size of d=-0.92 (95% CI -1.21 to -0.63). Results on perceived stress and insomnia indicated a reduction in symptom severity, with large effect sizes of d=1.02 (95% CI -1.46 to -0.58) and d=-0.75 (95% CI -1.10 to -0.40), respectively. A small percentage of participants experienced deterioration in depression-related symptoms (11/289, 3.8%), perceived stress (6/296, 2%), and insomnia (5/252, 2%). After completing treatment, 51.9% (150/289) of participants showed a clinically reliable change in depression-related symptoms, whereas 20.4% (59/289) achieved a close to symptom-free status. Similar improvements were observed in perceived stress and insomnia severity. Guidance moderated the effectiveness of and adherence to the interventions in reducing depressive symptom severity. Effect sizes on depression-related symptom severity were d=-1.20 (95% CI -1.45 to -0.93) for the semistandardized group, d=-0.36 (95% CI -0.68 to -0.04) for the feedback-on-demand group, and d=-0.83 (95% CI -1.03 to -0.63) for the self-guided group. Furthermore, 47.6% (405/851) of the participants completed all modules of the intervention. Participant satisfaction was high across all patient groups and both interventions; 89.3% (242/271) of participants would recommend it to a friend in need of similar help. Limitations include the assignment to treatments and guidance formats based on symptom severity. Furthermore, part of the differences in symptom change between groups must be assumed to be due to this baseline difference in the measures. CONCLUSIONS Future digital health implementation and routine care research should focus on monitoring symptom deterioration and other negative effects, as well as possible predictors of deterioration and the investigation of individual patient trajectories. In conclusion, this study supports the effectiveness of tailored digital mental health services in routine care for depression- and stress-related symptoms in Germany. The results highlight the importance of guidance in delivering internet-based cognitive behavioral therapy interventions and provide further evidence for its potential delivered as web-only solutions for increasing access to and use of psychological treatments.
Collapse
Affiliation(s)
- Anne Etzelmueller
- Department of Sports and Health Sciences, Professorship Psychology and Digital Mental Health Care, Technical University of Munich, Munich, Germany
- HelloBetter, GET.ON Institut für Online Gesundheitstrainings GmbH, Hamburg / Berlin, Germany
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology, Friedrich-Alexander-University of Erlangen-Nürnberg, Erlangen, Germany
| | - Elena Heber
- HelloBetter, GET.ON Institut für Online Gesundheitstrainings GmbH, Hamburg / Berlin, Germany
| | - Hanne Horvath
- HelloBetter, GET.ON Institut für Online Gesundheitstrainings GmbH, Hamburg / Berlin, Germany
| | - Anna Radkovsky
- Department of Psychology, Philipps University Marburg, Marburg, Germany
| | - Dirk Lehr
- Department of Health Psychology, Institute of Psychology, Leuphana University Lüneburg, Lüneburg, Germany
| | - David Daniel Ebert
- Department of Sports and Health Sciences, Professorship Psychology and Digital Mental Health Care, Technical University of Munich, Munich, Germany
- HelloBetter, GET.ON Institut für Online Gesundheitstrainings GmbH, Hamburg / Berlin, Germany
| |
Collapse
|
4
|
Semonella M, Marchesi G, Castelnuovo G, Andersson G, Pietrabissa G. Internet-delivered emotional self-management program for the general population during the COVID-19 pandemic: Usability testing. Digit Health 2024; 10:20552076241258419. [PMID: 39314812 PMCID: PMC11418310 DOI: 10.1177/20552076241258419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Accepted: 05/14/2024] [Indexed: 09/25/2024] Open
Abstract
Introduction Internet-based self-help interventions have the potential to help people address their emotional needs at relatively low costs. However, if the system does not offer optimal functions, it could reduce end-user adherence and satisfaction with treatment and compromise the effectiveness of the program. This study evaluated the usability of an Internet-based self-help intervention for emotional self-management among the general population of Italy during the COVID-19 pandemic. Methods A balanced sex-age sample of 10 individuals who met the inclusion criteria were consecutively recruited online. The think-aloud testing method, the system usability scale and an ad hoc semi-structured interview were used to determine the overall system usability.Quantitative data were analyzed using descriptive statistics and qualitative data were analyzed using thematic analysis. Results The participants were mostly satisfied with the usability of the program. However, older users (<45 years) encountered some problems, which took longer, made more mistakes, and needed more help in performing the tasks than their younger counterparts. The analysis of the interviews revealed three central themes: general thoughts about the platform, weaknesses of the platform and difficulties encountered while navigating and completing tasks, and strengths of the platform. Discussion Based on the results of this study, important improvements will be made before the RinasciMENTE program is tested under real-world conditions. Conducting usability testing is a crucial step at an early stage of the development process of an Internet-based self-help intervention to identify potential usability problems with the system.
Collapse
Affiliation(s)
| | - Gloria Marchesi
- Department of Psychology, Catholic University of Milan, Milan, Italy
| | - Gianluca Castelnuovo
- Department of Psychology, Catholic University of Milan, Milan, Italy
- Psychology Research Laboratory, IRCCS Istituto Auxologico Italiano, Milan, Italy
| | - Gerhard Andersson
- Department of Behavioural Science and Learning, Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden
- Department of Clinical Neuroscience, Karolinska Institute, Stockholm, Sweden
| | - Giada Pietrabissa
- Department of Psychology, Catholic University of Milan, Milan, Italy
- Psychology Research Laboratory, IRCCS Istituto Auxologico Italiano, Milan, Italy
| |
Collapse
|
5
|
Duffy D, Richards D, Earley C, Timulak L. Implementing internet-delivered cognitive behavioral therapy in healthcare services: a qualitative exploration of stakeholder experience. Front Digit Health 2023; 5:1139125. [PMID: 37822855 PMCID: PMC10562631 DOI: 10.3389/fdgth.2023.1139125] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Accepted: 09/11/2023] [Indexed: 10/13/2023] Open
Abstract
Background This study consisted of a qualitative exploration of stakeholder experience regarding the implementation of internet-delivered cognitive behavioral therapy (iCBT) as part of routine service provision within the UK's Improving Access to Psychological Therapies program. Methods Stakeholder groups included service providers (n = 6), commercial iCBT representatives (n = 6) and patients who received a course of iCBT as part of treatment at the service (n = 7). Participants took part in a semi-structured interview over the telephone, and subsequent data were qualitatively analyzed using the descriptive-interpretive approach. Results Service providers highlighted the importance of effective leadership and management, training initiatives, the provision of feedback to commercial iCBT representatives and creating work structures around iCBT to facilitate iCBT supporting staff in their use of it. Commercial iCBT representatives similarly reported the importance of training clinicians in iCBT use, identifying the appropriate individuals at all levels of the service to drive iCBT implementation, and the importance of being responsive to any problems or needs that arise from the service. Patients reported an overall positive experience of receiving iCBT but highlighted a need for more information from their supporter and the intervention to better structure their usage. Contextual factors, in terms of barriers and facilitators, were also highlighted by service provider and commercial participants; citing negative clinician attitudes and technological issues/bugs as barriers to implementation, and the exposure to iCBT created by COVID-19 and perseverance in using iCBT over time as facilitators. Discussion The findings contribute to a growing field of literature that seeks to understand the experience of relevant stakeholders who are involved with and contribute to iCBT implementation, including commercial iCBT representatives who, to our knowledge, have not been accounted for as part of published research to date.
Collapse
Affiliation(s)
- Daniel Duffy
- SilverCloud Science, SilverCloud Health, Dublin, Ireland
- School of Psychology, Trinity College Dublin, Dublin, Ireland
| | - Derek Richards
- SilverCloud Science, SilverCloud Health, Dublin, Ireland
- School of Psychology, Trinity College Dublin, Dublin, Ireland
| | | | | |
Collapse
|
6
|
Haller K, Becker P, Niemeyer H, Boettcher J. Who benefits from guided internet-based interventions? A systematic review of predictors and moderators of treatment outcome. Internet Interv 2023; 33:100635. [PMID: 37449052 PMCID: PMC10336165 DOI: 10.1016/j.invent.2023.100635] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 05/23/2023] [Accepted: 06/07/2023] [Indexed: 07/18/2023] Open
Abstract
To our knowledge, no systematic review has been conducted on predictors or moderators of treatment outcome across diagnoses in guided internet-based interventions (IBIs) for adults. To identify who benefits from this specific format and therein inform future research on improving patient-treatment fit, we aimed to aggregate results of relevant studies. 2100 articles, identified by searching the databases PsycInfo, Ovid Medline, and Pubmed and through snowballing, were screened in April/May 2021 and October 2022. Risk of bias and intra- and interrater reliability were assessed. Variables were grouped by predictor category, then synthesized using vote counting based on direction of effect. N = 60 articles were included in the review. Grouping resulted in 88 predictors/moderators, of which adherence, baseline symptoms, education, age, and gender were most frequently assessed. Better adherence, treatment credibility, and working alliance emerged as conclusive predictors/moderators for better outcome, whereas higher baseline scores predicted more reliable change but higher post-treatment symptoms. Results of all other predictors/moderators were inconclusive or lacked data. Our review highlights that it is currently difficult to predict, across diagnoses, who will benefit from guided IBIs. Further rigorous research is needed to identify predictors and moderators based on a sufficient number of studies. PROSPERO registration: CRD42021242305.
Collapse
Affiliation(s)
- Katrin Haller
- Clinical Psychological Interventions, Freie Universität Berlin, Berlin, Germany
- Clinical Psychology and Psychotherapy, Psychologische Hochschule Berlin, Berlin, Germany
| | - Pauline Becker
- Clinical Psychology and Psychotherapy, Psychologische Hochschule Berlin, Berlin, Germany
| | - Helen Niemeyer
- Clinical Psychological Interventions, Freie Universität Berlin, Berlin, Germany
| | - Johanna Boettcher
- Clinical Psychology and Psychotherapy, Psychologische Hochschule Berlin, Berlin, Germany
| |
Collapse
|
7
|
Bai P. Application and Mechanisms of Internet-Based Cognitive Behavioral Therapy (iCBT) in Improving Psychological State in Cancer Patients. J Cancer 2023; 14:1981-2000. [PMID: 37497400 PMCID: PMC10367931 DOI: 10.7150/jca.82632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 04/18/2023] [Indexed: 07/28/2023] Open
Abstract
This review article is an overview of the effectiveness of internet-based cognitive behavioral therapy (iCBT) in Improving Psychological State in Cancer Patients. iCBT's effectiveness has been investigated in treating and managing conditions like depression, psychiatric disorders, generalized anxiety disorder (GAD), panic disorder, obsessive compulsive disorder (OCD), post-traumatic stress disorder (PTSD), adjustment disorder, bipolar disorder, chronic pain, and phobias. iCBT's role in the treatment of medical conditions such as diabetes mellitus with comorbid psychiatric illnesses was also explored. We conducted a thorough literature search using PubMed, Embase, Google Scholar, and Wanfang with no restrictions on the date. iCBT's role in treating and controlling psychiatric illnesses in cancer patients has been established in the literature. Development and popularization of iCBT, treament forms of iCBT, platforms for iCBT, application of iCBT, strategies and efficacy of iCBT for insomnia in cancer patients, current status of iCBT application, and genetic researches on iCBT for anxiety disorders were all reviewed and discussed in this review. From the data compiled, we conclude that iCBT is useful in treating or improving psychological state in cancer patients.
Collapse
Affiliation(s)
- Ping Bai
- Department of Operating Rooms, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
- Department of Operating Rooms, National Cancer Center/National Clinical Research Center for Cancer/Hebei Cancer Hospital, Chinese Academy of Medical Sciences, Langfang, 065001, China
| |
Collapse
|
8
|
Tarp K, Nielsen SL, Holmberg TT, Dalsgaard CH, Borkner S, Skaarnes H, Jensen EK, Piera-Jiménez J, Vis C, Mathiasen K. Therapist perceptions of the implementation of a new screening procedure using the ItFits-toolkit in an iCBT routine care clinic: A mixed-methods study using the consolidated framework for implementation research. Front Psychiatry 2023; 14:1104301. [PMID: 37091699 PMCID: PMC10117952 DOI: 10.3389/fpsyt.2023.1104301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 03/09/2023] [Indexed: 04/25/2023] Open
Abstract
Introduction This study investigates the implementation of a new, more automated screening procedure using the ItFits-toolkit in the online clinic, Internet Psychiatry (iPsych) (www.internetpsykiatrien.dk), delivering guided iCBT for mild to moderate anxiety and depressive disorders. The study focuses on how the therapists experienced the process. Methods Qualitative data were collected from semi-structured individual interviews with seven therapists from iPsych. The interviews were conducted using an interview guide with questions based on the Consolidated Framework for Implementation Research (CFIR). Quantitative data on the perceived level of normalization were collected from iPsych therapists, administrative staff, and off-site professionals in contact with the target demographic at 10-time points throughout the implementation. Results The therapists experienced an improvement in the intake procedure. They reported having more relevant information about the patients to be used during the assessment and the treatment; they liked the new design better; there was a better alignment of expectations between patients and therapists; the patient group was generally a better fit for treatment after implementation; and more of the assessed patients were included in the program. The quantitative data support the interview data and describe a process of normalization that increases over time. Discussion The ItFits-toolkit appears to have been an effective mediator of the implementation process. The therapists were aided in the process of change, resulting in an enhanced ability to target the patients who can benefit from the treatment program, less expenditure of time on the wrong population, and more satisfied therapists.
Collapse
Affiliation(s)
- Kristine Tarp
- Research Unit for Digital Psychiatry, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Centre for Digital Psychiatry, Mental Health Services in the Region of Southern Denmark, Odense, Denmark
- *Correspondence: Kristine Tarp
| | - Søren Lange Nielsen
- Centre for Digital Psychiatry, Mental Health Services in the Region of Southern Denmark, Odense, Denmark
| | - Trine Theresa Holmberg
- Centre for Digital Psychiatry, Mental Health Services in the Region of Southern Denmark, Odense, Denmark
| | - Caroline Høier Dalsgaard
- Centre for Digital Psychiatry, Mental Health Services in the Region of Southern Denmark, Odense, Denmark
| | - Simone Borkner
- Centre for Digital Psychiatry, Mental Health Services in the Region of Southern Denmark, Odense, Denmark
| | - Helene Skaarnes
- Centre for Digital Psychiatry, Mental Health Services in the Region of Southern Denmark, Odense, Denmark
| | - Esben Kjems Jensen
- Research Unit for Digital Psychiatry, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Centre for Digital Psychiatry, Mental Health Services in the Region of Southern Denmark, Odense, Denmark
| | - Jordi Piera-Jiménez
- Catalan Health Service, Barcelona, Spain
- Digitalization for the Sustainability of the Healthcare System DS3-IDIBELL, L'Hospitalet de Llobregat, Barcelona, Spain
- Faculty of Informatics, Multimedia and Telecommunications, Universitat Oberta de Catalunya, Barcelona, Spain
| | - Christiaan Vis
- Clinical, Neuro- & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Amsterdam, Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, Netherlands
- Section for Research-Based Innovation, Division of Psychiatry, Haukeland University Hospital, Bergen, Norway
| | - Kim Mathiasen
- Research Unit for Digital Psychiatry, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Centre for Digital Psychiatry, Mental Health Services in the Region of Southern Denmark, Odense, Denmark
| |
Collapse
|
9
|
Factors Associated With Treatment Response in an Internet-Based Intervention for Prolonged Grief Disorder After Cancer Bereavement. Behav Ther 2023; 54:119-131. [PMID: 36608969 DOI: 10.1016/j.beth.2022.07.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Revised: 06/01/2022] [Accepted: 07/24/2022] [Indexed: 01/11/2023]
Abstract
Internet-based psychological interventions have proven effective in the treatment of prolonged grief disorder (PGD). Yet, some patients do not benefit from treatment in a clinically significant way. We aimed to examine predictors of symptom reduction in an Internet-based intervention for PGD after cancer bereavement, in order to identify possible treatment mechanisms and discern directions for future intervention design. A secondary analysis of data from a randomized wait-list controlled trial on an Internet-based intervention for PGD after cancer bereavement was conducted. Multiple regression models were used (1) to test for the influence of pretreatment PGD, working alliance, avoidance and gender on PGD symptom reduction; and (2) to explore further predictors of treatment success with a best subset selection protocol. The regression models explained 18% (Model 1) and 34% (Model 2) of variance in symptom reduction. Participants with more favorable symptom change had more severe pretreatment PGD scores and better working alliance. Those with lower social support and less posttraumatic growth experienced more PGD symptom change. In conclusion, therapeutic alliance is an important factor that should be monitored and fostered. Findings regarding social support and posttraumatic growth need further replication and clarification.
Collapse
|
10
|
Predictors of prolonged grief in an internet-based grief therapy for people bereaved by suicide. J Psychiatr Res 2022; 149:162-167. [PMID: 35278780 DOI: 10.1016/j.jpsychires.2022.02.023] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 02/07/2022] [Accepted: 02/28/2022] [Indexed: 11/21/2022]
Abstract
Internet-based cognitive-behavioural grief therapy (ICBGT) has proven to be effective for people bereaved by suicide, however the extent to which patients can benefit from therapy seems to differ. This study investigates predictors of initial grief as well as change in grief severity following treatment in an ICBGT for people bereaved by suicide. Data was gathered from a randomized control trial including 57 people participating in a 5-week intervention. Change in grief symptoms was calculated using absolute change scores of grief. In order to examine best overall combination of independent variables, best subset regressions were conducted. Higher levels of pre-test grief were associated with worse sleep quality (β = 0.32, p = .002), lower self-esteem (β = -0.37, p = .002), lower support seeking (β = -0.38, p = .006), and a higher need for social support (β = 0.28, p = .028). A greater reduction in grief severity was associated with higher self-efficacy (β = -0.49, p = .001), higher attachment anxiety (β = -0.31, p = .017) and higher pre-test grief symptoms (β = -0.39, p = .006). Attention should be paid to the intensity of grief, the attachment style and a positive self-image, as these variables seem to influence the extent, to which patients' symptoms of PGD subside following ICBGT. To specifically target factors of patients that require improvement, further studies are needed.
Collapse
|
11
|
Hagström J, Woodford J, von Essen A, Lähteenmäki P, von Essen L. Opt-out rates and reasons for non-participation in a single-arm feasibility trial (ENGAGE) of a guided internet-administered CBT-based intervention for parents of children treated for cancer: a nested cross-sectional survey. BMJ Open 2022; 12:e056758. [PMID: 35365530 PMCID: PMC8977820 DOI: 10.1136/bmjopen-2021-056758] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Accepted: 03/10/2022] [Indexed: 11/24/2022] Open
Abstract
OBJECTIVES Difficulties with recruitment into clinical trials are common. An opt-out recruitment strategy, whereby potential participants can decline further contact about a study (opt-out), and non-responders are contacted, may facilitate participation. Primary objectives examined opt-out and consent rates, mode and time point of opt-out, and sociodemographic characteristics of those who opted out versus those who chose to participate in a single-arm feasibility trial (ENGAGE) of a guided, internet-administered, cognitive-behavioural therapy-based intervention for parents of children treated for cancer. Secondary objectives examined reasons for non-participation. DESIGN A cross-sectional survey nested within the ENGAGE feasibility trial. SETTING The intervention was delivered from Uppsala University, with parents located throughout Sweden. PARTICIPANTS Potential participants were recruited 3 months-5 years following their child ending treatment for cancer and were identified via their personal identification number (via the Swedish Childhood Cancer Registry and Swedish Tax Agency) and invited via postal invitation packs and could opt out via post, online, telephone or email. Those who did not opt out or consent, within 4 weeks, received up to five telephone calls and/or one postal reminder. RESULTS Of 509 invited, 164 (32.2%) opted out, 78 (47.6%) via post, 53 (32.3%) via telephone, 24 (14.6%) online, and 6 (3.7%) via email, 88 (53.7%) opted out after at least one telephone call and/or postal reminder. There was a trend for parents with lower educational levels to opt out. No need of psychological support, lack of time, and no interest in internet-administered self-help were frequently reported reasons for non-participation. CONCLUSIONS Results emphasise the importance of using different opt-out modes and suggest future research should consider how to widen study participation for parents with lower education levels. Self-identifying a need for psychological support and the acceptability of internet-administered self-help are important factors for participation and should be considered in future research to increase recruitment. TRIAL REGISTRATION NUMBER ISRCTN57233429.
Collapse
Affiliation(s)
- Josefin Hagström
- Healthcare Sciences and e-Health, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| | - Joanne Woodford
- Healthcare Sciences and e-Health, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| | - Agnes von Essen
- Healthcare Sciences and e-Health, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| | - Päivi Lähteenmäki
- Department of Paediatrics and Adolescent Medicine, TYKS Turku University Hospital, Turku, Finland
- Pediatric Oncology and Pediatric Surgery, Department of Women's and Children's Health, Karolinska Institute, Stockholm, Sweden
| | - Louise von Essen
- Healthcare Sciences and e-Health, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| |
Collapse
|
12
|
Hwang H, Kim SM, Netterstrøm B, Han DH. The Efficacy of a Smartphone-Based App on Stress Reduction: Randomized Controlled Trial. J Med Internet Res 2022; 24:e28703. [PMID: 35166687 PMCID: PMC8889477 DOI: 10.2196/28703] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Revised: 06/12/2021] [Accepted: 12/29/2021] [Indexed: 12/05/2022] Open
Abstract
Background Stress management in the workplace is essential for a healthy mental and physical state. Due to technological advancements, individually tailored therapy and online cognitive behavioral therapy (CBT) are on the rise. Objective This study analyzed the efficacy of a smartphone app based on third-wave CBT tailored to an individual. Methods A randomized controlled trial was conducted with 126 participants who were divided into 2 groups. The intervention group used the smartphone app BetterLife for 10 weeks, while the control group was placed on a waiting list for the same duration. The Perceived Stress Scale–10 (PSS), Korean Utrecht Work Engagement Scale–9 (UWES), World Health Organization Quality of Life Assessment (WHOQOL), Beck Depression Inventory–II (BDI), and Beck Anxiety Inventory (BAI) were administered at baseline and after 10 weeks to both groups. Results Of the 126 participants, 11 dropped out during the trial. A 2-way repeated measure analysis of covariance was conducted, controlling for baseline BDI. There were greater improvements in PSS (F=24.33, P<.001, η2=0.17) and UWESK scores (F=8.32, P=.0046, η2=0.06) in the intervention group than in the control group. WHOQOL scores exhibited statistically significant improvement in the intervention group in the overall quality of life (F=8.19, P=.0049, η2=0.06), physical health (F=8.87, P=.003, η2=0.07), psychological health (F=13.32, P<.001, η2=0.10), social relationships (F=19.43, P<.001, η2=0.14), and environmental domains (F=10.14, P=.002, η2=0.08) but not overall health (F=1.68, P=.20). BDI (F=7.17, P=.008, η2=0.06) and BAI (F=6.00, P=.02, η2=0.05) showed a statistically significant improvement in the intervention group, but this significance did not survive the Bonferroni correction (P<.005). Conclusions These results provide evidence that smartphone-based CBT is a viable option for reducing stress in the workplace. Trial Registration Clinical Research Information Service KCT0003231; https://cris.nih.go.kr/cris/search/detailSearch.do/15137
Collapse
Affiliation(s)
- Hyunchan Hwang
- Department of Psychiatry, College of Medicine, Chung-Ang University, Seoul, Republic of Korea
| | - Sun Mi Kim
- Department of Psychiatry, College of Medicine, Chung-Ang University, Seoul, Republic of Korea
| | - Bo Netterstrøm
- Department of Occupational and Environmental Medicine, Bispebjerg University Hospital, Copenhagen, Denmark
| | - Doug Hyun Han
- Department of Psychiatry, College of Medicine, Chung-Ang University, Seoul, Republic of Korea
| |
Collapse
|
13
|
Hadjistavropoulos H, Peynenburg V, Thiessen D, Nugent M, Karin E, Dear B, Titov N. A randomized factorial trial of internet-delivered cognitive behavioural therapy: An 8-week program with or without extended support and booster lesson. Internet Interv 2022; 27:100499. [PMID: 35198410 PMCID: PMC8844810 DOI: 10.1016/j.invent.2022.100499] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 01/29/2022] [Accepted: 02/01/2022] [Indexed: 11/25/2022] Open
Abstract
While internet-delivered cognitive behavioural therapy (ICBT) is effective, some patients suggest extended support post-treatment could improve care. In this randomized factorial trial, we examined the benefits of an 8-week therapist-assisted ICBT program offered with or without an optional 4-week extension of support (Factor 1) and with or without an optional booster lesson (Factor 2). Patients screened for ICBT for depression and/or anxiety were randomly assigned to the conditions (N = 434) and we examined the use of the extension and booster, differences between those who did or did not use extension or booster, and the impact of the extension or booster on outcomes, engagement, and satisfaction at 26-weeks post-enrollment. Therapists recorded time and observations with offering support during the extension and booster. In the extension group, 54.4% (n = 56) requested the extension, while in the booster group 50.9% (n = 56) accessed the booster, and in the combined group, 41.6% (n = 47) requested the extension and 51.3% (n = 58) accessed the booster. Those who requested the extension were older, and more likely to report medication and mental health service use and severe mental health-related disability at pre-treatment; they also reported putting less effort into ICBT and finding skills more difficult. The booster was more often used among those with lower symptom severity, and those who put more effort into and had more positive experiences with ICBT. As expected, those assigned to extension sent more messages to their therapist, and those assigned to booster logged in more often. Therapists also took more time to deliver ICBT with an extension (>18 min) or booster (>13 min) compared to the 8-week program, and perceived extension and booster as beneficial for some, but not all patients. Treatment satisfaction was high across conditions, and effect sizes were large from pre-treatment to 26-week follow-up on most measures. No significant group differences were found in this study. Lack of group differences, however, could reflect low use of the extension and booster. Results provide helpful information about the demand for extensions and boosters, and provide directions for future research.
Collapse
Affiliation(s)
- H.D. Hadjistavropoulos
- 3737 Wascana Parkway, Department of Psychology, University of Regina, Regina, SK S4S 0A2, Canada,Corresponding author.
| | - V. Peynenburg
- 3737 Wascana Parkway, Department of Psychology, University of Regina, Regina, SK S4S 0A2, Canada
| | - D.L. Thiessen
- 3737 Wascana Parkway, Department of Mathematics & Statistics, University of Regina, Regina, SK S4S 0A2, Canada
| | - M. Nugent
- 3737 Wascana Parkway, Department of Psychology, University of Regina, Regina, SK S4S 0A2, Canada
| | - E. Karin
- eCentreClinic, Department of Psychology, Macquarie University, Sydney, NSW 2109, Australia
| | - B.F. Dear
- eCentreClinic, Department of Psychology, Macquarie University, Sydney, NSW 2109, Australia
| | - N. Titov
- MindSpot Clinic, Australian Hearing Hub Building, eCentreClinic, Department of Psychology, Macquarie University, Sydney, NSW 2109, Australia
| |
Collapse
|
14
|
Mathiasen K, Andersen TE, Lichtenstein MB, Ehlers LH, Riper H, Kleiboer A, Roessler KK. Clinical Effectiveness of Blended CBT Compared vs Face-to-Face CBT for adult depression: a Randomised Controlled Non-Inferiority Trial (Preprint). J Med Internet Res 2022; 24:e36577. [PMID: 36069798 PMCID: PMC9543221 DOI: 10.2196/36577] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Revised: 03/02/2022] [Accepted: 06/15/2022] [Indexed: 11/13/2022] Open
Abstract
Background Internet-based cognitive behavioral therapy (iCBT) has been demonstrated to be cost- and clinically effective. There is a need, however, for increased therapist contact for some patient groups. Combining iCBT with traditional face-to-face (FtF) consultations in a blended format may produce a new treatment format (B-CBT) with multiple benefits from both traditional CBT and iCBT, such as individual adaptation, lower costs than traditional therapy, wide geographical and temporal availability, and possibly lower threshold to implementation. Objective The primary aim of this study is to compare directly the clinical effectiveness of B-CBT with FtF-CBT for adult major depressive disorder. Methods A 2-arm randomized controlled noninferiority trial compared B-CBT for adult depression with treatment as usual (TAU). The trial was researcher blinded (unblinded for participants and clinicians). B-CBT comprised 6 sessions of FtF-CBT alternated with 6-8 web-based CBT self-help modules. TAU comprised 12 sessions of FtF-CBT. All participants were aged 18 or older and met the diagnostic criteria for major depressive disorder and were recruited via a national iCBT clinic. The primary outcome was change in depression severity on the 9-item Patient Health Questionnaire (PHQ-9). Secondary analyses included client satisfaction (8-item Client Satisfaction Questionnaire [CSQ-8]), patient expectancy (Credibility and Expectancy Questionnaire [CEQ]), and working (Working Alliance Inventory [WAI] and Technical Alliance Inventory [TAI]). The primary outcome was analyzed by a mixed effects model including all available data from baseline, weekly measures, 3-, 6, and 12-month follow-up. Results A total of 76 individuals were randomized, with 38 allocated to each treatment group. Age ranged from 18 to 71 years (SD 13.96) with 56 (74%) females. Attrition rate was 20% (n=15), which was less in the FtF-CBT group (n=6, 16%) than in the B-CBT group (n=9, 24%). As many as 53 (70%) completed 9 or more sessions almost equally distributed between the groups (nFtF-CBT=27, 71%; nB-CBT=26, 68%). PHQ-9 reduced 11.38 points in the FtF-CBT group and 8.10 in the B-CBT group. At 6 months, the mean difference was a mere 0.17 points. The primary analyses confirmed large and significant within-group reductions in both groups (FtF-CBT: β=–.03; standard error [SE] 0.00; P<.001 and B-CBT: β=–.02; SE 0.00; P<.001). A small but significant interaction effect was observed between groups (β=.01; SE 0.00; P=.03). Employment status influenced the outcome differently between groups, where the B-CBT group was seen to profit more from not being full-time employed than the FtF group. Conclusions With large within-group effects in both treatment arms, the study demonstrated feasibility of B-CBT in Denmark. At 6 months’ follow-up, there appeared to be no difference between the 2 treatment formats, with a small but nonsignificant difference at 12 months. The study seems to demonstrate that B-CBT is capable of producing treatment effects that are close to FtF-CBT and that completion rates and satisfaction rates were comparable between groups. However, the study was limited by small sample size and should be interpreted with caution. Trial Registration ClinicalTrials.gov NCT02796573; https://clinicaltrials.gov/ct2/show/NCT02796573 International Registered Report Identifier (IRRID) RR2-10.1186/s12888-016-1140-y
Collapse
Affiliation(s)
- Kim Mathiasen
- Research Unit for Telepsychiatry and E-Mental Health, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
| | - Tonny E Andersen
- Department of Psychology, University of Southern Denmark, Odense, Denmark
| | - Mia Beck Lichtenstein
- Research Unit for Telepsychiatry and E-Mental Health, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
| | - Lars Holger Ehlers
- Danish Center for Healthcare Improvements, Aalborg University, Aalborg, Denmark
- Nordic Institute of Health Economics, Aarhus, Denmark
| | - Heleen Riper
- Department of Clinical, Neuro and Developmental Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Annet Kleiboer
- Department of Clinical, Neuro and Developmental Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Kirsten K Roessler
- Department of Psychology, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
15
|
Ying Y, Ji Y, Kong F, Chen Q, Lv Y, Hou Y, Zhu L, Miao P, Yu L, Li L, Kuang W, Jiang L, Zhu X, Liu X, Xu L, Mi Y, Lou Z, Ruan L. Internet-based cognitive behavioral therapy for psychological distress in older adults without cognitive impairment living in nursing homes during the COVID-19 pandemic: A feasibility study. Internet Interv 2021; 26:100461. [PMID: 34631432 PMCID: PMC8487764 DOI: 10.1016/j.invent.2021.100461] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/06/2021] [Revised: 09/17/2021] [Accepted: 09/26/2021] [Indexed: 12/20/2022] Open
Abstract
BACKGROUND The COVID-19 pandemic has had a detrimental effect on the mental health of older adults living in nursing homes. Very few studies have examined the effects of Internet-based Cognitive Behavioral Therapy (ICBT) on older adults living in nursing homes during the pandemic. We conducted a feasibility study using a single-group design, to explore the effectiveness of ICBT on psychological distress in 137 older adults (without cognitive impairment) from 8 nursing homes in 4 southeast cities in China, between January and March 2020. METHODS Symptoms of depression, anxiety, general psychological distress, and functional disability were measured at baseline, post-treatment (5 weeks) and at a 1-month follow-up. Mixed-effects model was used to assess the effects of ICBT. RESULTS Statistically significant changes with large effect sizes were observed from pre- to post-treatment on the PHQ-9 (p < .001, Cohen's d = 1.74), GAD-7 (p < .001, d = 1.71), GDS (p < .001, d = 1.30), K-10 (p < .001, d = 1.93), and SDS (p < .001, d = 2.03). Furthermore, improvements in treatment outcomes were sustained at 1-month follow-up, and high levels of adherence and satisfaction were indicated. CONCLUSION ICBT was effective in reducing psychological distress in older adults without cognitive impairments living in nursing homes during the COVID-19 pandemic. Thus, it could be applied in improving the mental health of this vulnerable group during the pandemic.
Collapse
Key Words
- CBT, cognitive behavioral therapy
- CIs, confidence intervals
- COVID-19
- DSM-IV, The Diagnostic and Statistical Manual of Mental Disorders-4th edition
- Feasibility study
- GAD-7, Generalized Anxiety Disorder 7-item
- GDS, Geriatric Depression Scale
- ICBT, Internet-based cognitive behavioral therapy
- ITT, intention-to-treat
- Internet-based cognitive behavioral therapy
- K-10, 10-item Kessler Psychological Distress Scale
- LOCF, last observation carried forward
- MMRM, mixed-effects model for repeated measure
- Mental health
- Older adults
- PHQ-9, Patient Health Questionnaire 9-item
- Psychological distress
- RCT, randomized controlled trials
- REML, restricted maximum likelihood
- SD, standard deviation
- SDS, Sheehan Disability Scales
- UN, unstructured
Collapse
Affiliation(s)
- Yuchen Ying
- Department of Psychosomatic Medicine, Ningbo First Hospital, Ningbo Hospital of Zhejiang University, Ningbo, Zhejiang, PR China
- Department of Elderly Health Care and Management, School of Health Services and Management, Ningbo College of Health Sciences, Ningbo, Zhejiang, PR China
- School of Medicine, Ningbo University, Ningbo, Zhejiang, PR China
| | - Yunxin Ji
- Department of Psychosomatic Medicine, Ningbo First Hospital, Ningbo Hospital of Zhejiang University, Ningbo, Zhejiang, PR China
| | - Fanqian Kong
- Department of Medical Record and Statistics, Ningbo Medical Center Lihuili Hospital, Ningbo, Zhejiang, PR China
| | - Qiqi Chen
- Department of Elderly Health Care and Management, School of Health Services and Management, Ningbo College of Health Sciences, Ningbo, Zhejiang, PR China
| | - Yueer Lv
- Department of Elderly Health Care and Management, School of Health Services and Management, Ningbo College of Health Sciences, Ningbo, Zhejiang, PR China
| | - Yanbin Hou
- Department of Psychosomatic Medicine, Ningbo First Hospital, Ningbo Hospital of Zhejiang University, Ningbo, Zhejiang, PR China
| | - Lijie Zhu
- Department of Statistics and Programming, Jiangsu Hengrui Pharmaceuticals Co. Ltd, Shanghai, PR China
| | - Pingping Miao
- Department of Psychosomatic Medicine, Ningbo First Hospital, Ningbo Hospital of Zhejiang University, Ningbo, Zhejiang, PR China
| | - Libo Yu
- Department of Elderly Health Care and Management, School of Health Services and Management, Ningbo College of Health Sciences, Ningbo, Zhejiang, PR China
| | - Laiyou Li
- Department of Elderly Health Care and Management, School of Health Services and Management, Ningbo College of Health Sciences, Ningbo, Zhejiang, PR China
| | - Wei Kuang
- Department of Elderly Health Care and Management, School of Health Services and Management, Ningbo College of Health Sciences, Ningbo, Zhejiang, PR China
| | - Lingli Jiang
- Department of Elderly Health Care and Management, School of Health Services and Management, Ningbo College of Health Sciences, Ningbo, Zhejiang, PR China
| | - Xiaozhuo Zhu
- Department of Elderly Health Care and Management, School of Health Services and Management, Ningbo College of Health Sciences, Ningbo, Zhejiang, PR China
| | - Xiaozhuang Liu
- Department of Elderly Health Care and Management, School of Health Services and Management, Ningbo College of Health Sciences, Ningbo, Zhejiang, PR China
| | - Le Xu
- School of Medicine, Ningbo University, Ningbo, Zhejiang, PR China
| | - Yuwei Mi
- School of Medicine, Ningbo University, Ningbo, Zhejiang, PR China
| | - Zhongze Lou
- Department of Psychosomatic Medicine, Ningbo First Hospital, Ningbo Hospital of Zhejiang University, Ningbo, Zhejiang, PR China
- Central Laboratory of the Medical Research Center, Ningbo First Hospital, Ningbo, Zhejiang, PR China
- Corresponding authors at: Department of Psychosomatic Medicine, Ningbo First Hospital, Ningbo Hospital of Zhejiang University, 59 Liuting Street, Haishu District, Ningbo, Zhejiang 315211, PR China.
| | - Liemin Ruan
- Department of Psychosomatic Medicine, Ningbo First Hospital, Ningbo Hospital of Zhejiang University, Ningbo, Zhejiang, PR China
- Corresponding authors at: Department of Psychosomatic Medicine, Ningbo First Hospital, Ningbo Hospital of Zhejiang University, 59 Liuting Street, Haishu District, Ningbo, Zhejiang 315211, PR China.
| |
Collapse
|
16
|
The working alliance in blended versus face-to-face cognitive therapy for depression: A secondary analysis of a randomized controlled trial. Internet Interv 2021; 25:100404. [PMID: 34401364 PMCID: PMC8350587 DOI: 10.1016/j.invent.2021.100404] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 05/06/2021] [Accepted: 05/18/2021] [Indexed: 11/23/2022] Open
Abstract
INTRODUCTION We explored the working alliance as measured by both clients and therapists. The working alliance has been known to predict the outcome of psychotherapy and is often considered an important common factor. This study raised the question of how to conceptualize the working alliance in the blended format. METHODS This was an exploratory study derived from a randomized controlled trial comparing bCBT and face-to-face cognitive behavioural therapy (ftf CBT) on depression. The change in depressive symptoms was measured with the Patient Health Questionnaire (PHQ-9) and the working alliance was measured using the Working Alliance Inventory. ANALYSES Correlation coefficients were calculated for the working alliance as reported by clients and therapists, working alliance was then examined at item and dimension level (task, bond, goal). Linear regression models were applied to investigate the predictive value of the working alliance on treatment outcome. Interaction between the level of working alliance and treatment condition was also considered. RESULTS Client and therapist working alliance ratings correlated at r = 0.44 and clients rated the working alliance higher than therapists (x̄ clients = 48.6, x̄ therapists = 44.6). ftf CBT and bCBT had comparable joint working alliance ratings (x̄ ftf = 46.4, x̄ bCBT = 46.8). Items had little deviation apart from item 4 with high positive values. The level of working alliance from the total sample did not significantly predict outcome based on the client's perspective. Contrarily, seen from the therapist's perspective, it did (b = 0.00, p = .044). Using the mean from these predictors as a composite variable, was also significant (b = 0.00, p = .039, R2 adj = 0.07). There was no significant interaction with treatment condition. DISCUSSION Clients and therapists may lay emphasis on different aspects of the working alliance. The finding that therapist-rated working alliance was better than client working alliance at predicting outcome went against common findings; this pattern may be specific to bCBT. CONCLUSION Clients rated the working alliance slightly higher than therapists on average. Clients and therapists as well as treatment conditions had different profiles on dimension deviations. Therapist ratings of the working alliance appeared to better predict treatment outcome than client ratings. Joint working alliance predicted outcome using client and therapist composite means. The working alliance was equally strong in ftf CBT and bCBT. The absence of interaction with treatment condition indicated that the working alliance was equally predictive of outcome in ftf CBT as in bCBT.
Collapse
|
17
|
Niles AN, Axelsson E, Andersson E, Hedman-Lagerlöf E, Carlbring P, Andersson G, Johansson R, Widén S, Driessen J, Santoft F, Ljótsson B. Internet-based cognitive behavior therapy for depression, social anxiety disorder, and panic disorder: Effectiveness and predictors of response in a teaching clinic. Behav Res Ther 2021; 136:103767. [DOI: 10.1016/j.brat.2020.103767] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2019] [Revised: 10/21/2020] [Accepted: 10/23/2020] [Indexed: 12/11/2022]
|
18
|
Etzelmueller A, Vis C, Karyotaki E, Baumeister H, Titov N, Berking M, Cuijpers P, Riper H, Ebert DD. Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis. J Med Internet Res 2020; 22:e18100. [PMID: 32865497 PMCID: PMC7490682 DOI: 10.2196/18100] [Citation(s) in RCA: 143] [Impact Index Per Article: 35.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2020] [Revised: 05/06/2020] [Accepted: 06/03/2020] [Indexed: 01/23/2023] Open
Abstract
BACKGROUND Although there is evidence for the efficacy of internet-based cognitive behavioral therapy (iCBT), the generalizability of results to routine care is limited. OBJECTIVE This study systematically reviews effectiveness studies of guided iCBT interventions for the treatment of depression or anxiety. METHODS The acceptability (uptake, participants' characteristics, adherence, and satisfaction), effectiveness, and negative effects (deterioration) of nonrandomized pre-post designs conducted under routine care conditions were synthesized using systematic review and meta-analytic approaches. RESULTS A total of 19 studies including 30 groups were included in the analysis. Despite high heterogeneity, individual effect sizes of investigated studies indicate clinically relevant changes, with effect sizes ranging from Hedges' g=0.42-1.88, with a pooled effect of 1.78 for depression and 0.94 for anxiety studies. Uptake, participants' characteristics, adherence, and satisfaction indicate a moderate to high acceptability of the interventions. The average deterioration across studies was 2.9%. CONCLUSIONS This study provides evidence supporting the acceptability and effectiveness of guided iCBT for the treatment of depression and anxiety in routine care. Given the high heterogeneity between interventions and contexts, health care providers should select interventions that have been proven in randomized controlled clinical trials. The successful application of iCBT may be an effective way of increasing health care in multiple contexts.
Collapse
Affiliation(s)
- Anne Etzelmueller
- Department of Clinical Psychology and Psychotherapy, Friedrich-Alexander University Erlangen-Nuremberg, Erlangen, Germany
- GET.ON Institute GmbH, Hamburg, Germany
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Amsterdam, Netherlands
- Amsterdam Public Health Research Institute, Mental Health, Amsterdam, Netherlands
| | - Christiaan Vis
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Amsterdam, Netherlands
- Amsterdam Public Health Research Institute, Mental Health, Amsterdam, Netherlands
| | - Eirini Karyotaki
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Amsterdam, Netherlands
- Department of Global Health and Social Medicine, Harvard Medical School, USA, Boston, MA, United States
| | - Harald Baumeister
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, Ulm University, Ulm, Germany
| | - Nickolai Titov
- eCentre Clinic Department of Psychology, Macquarie University, Sydney, Australia
| | - Matthias Berking
- Department of Clinical Psychology and Psychotherapy, Friedrich-Alexander University Erlangen-Nuremberg, Erlangen, Germany
| | - Pim Cuijpers
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Amsterdam, Netherlands
- Amsterdam Public Health Research Institute, Mental Health, Amsterdam, Netherlands
| | - Heleen Riper
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Amsterdam, Netherlands
- Amsterdam Public Health Research Institute, Mental Health, Amsterdam, Netherlands
- Community Mental Health Centre GGZ inGeest, Amsterdam, Netherlands
| | - David Daniel Ebert
- Department of Clinical Psychology and Psychotherapy, Friedrich-Alexander University Erlangen-Nuremberg, Erlangen, Germany
- GET.ON Institute GmbH, Hamburg, Germany
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
19
|
Internet-based CBT for patients with depressive disorders in primary and psychiatric care: Is it effective and does comorbidity affect outcome? Internet Interv 2019; 19:100303. [PMID: 32055451 PMCID: PMC7005448 DOI: 10.1016/j.invent.2019.100303] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/12/2019] [Revised: 12/12/2019] [Accepted: 12/14/2019] [Indexed: 02/05/2023] Open
Abstract
Internet-based cognitive behavior therapy (ICBT) has proved effective in reducing mild to moderate depressive symptoms. However, only a few studies have been conducted in a regular healthcare setting which limits the generalizability of the results. The influence of psychiatric comorbidity on outcome is not well understood. In the current study, patients with mild to moderate depressive symptoms in primary and psychiatric care were interviewed using the SCID-I and SCID-II to assess psychiatric diagnoses. Those included were randomly allocated to ICBT (n = 48) or to an active control condition (n = 47). Both groups received therapist support. At post-treatment, ICBT had reduced depressive symptoms on the BDI-II more than the active control intervention (p = .021). However, the difference between groups was no longer significant at the 6-, 12- or 24-month follow-ups. The within-group effect size after ICBT (BDI-II) was large (d = 1.4). A comorbid anxiety disorder didn't moderate the outcome, while the presence of a personality disorder predicted significantly less improvement in depressive symptoms. ICBT had a large effect on depressive symptoms in a sample from regular healthcare. It is possible to obtain a large effect from ICBT despite comorbid anxiety, however, including patients with a comorbid personality disorder in the current form of ICBT seems questionable.
Collapse
|
20
|
Titov N, Rock D, Bezuidenhout G, Webb N, Kayrouz R, Nielssen O, Williams L, Purtell C, Dear BF, Staples LG. Evaluation of The Practitioner Online Referral and Treatment Service (PORTS): the first 18 months of a state-wide digital service for adults with anxiety, depression, or substance use problems. Cogn Behav Ther 2019; 49:307-326. [PMID: 31553266 DOI: 10.1080/16506073.2019.1666162] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
The Practitioner Online Referral and Treatment Service (PORTS) is a new digital mental health service (DMHS) providing assessment, treatment, and consultation across Western Australia, for adults with anxiety, depression, or substance use problems, and experiencing financial hardship or geographical disadvantage. From July 2017 to December 2018, a total of 2,527 individuals were referred to PORTS. Of these, 150 (6%) did not give consent for their results to be analysed. Of the remaining 2,377 patients, 615 (26%) could not be contacted to confirm the referral, 596 (25%) received assessment or information from PORTS, 427 (18%) were referred to another service, and 739 (31%) commenced treatment at PORTS. Almost half (47%) of patients were from areas with significant socio-economic disadvantage. Those referred by another mental health service were more likely to engage in treatment than those referred by a General Practitioner (GP). Overall outcomes were excellent, with large effect sizes (Cohen's d: 1.1-1.4), from assessment to post-treatment and 3-month follow-up, reliable deterioration was low, and GP and patient satisfaction was high. These results indicate that the PORTS DMHS model is a promising method for engaging primary care patients with anxiety and depression, including those experiencing financial and geographical disadvantage.
Collapse
Affiliation(s)
- Nickolai Titov
- MindSpot Clinic, Macquarie University , Sydney, Australia
| | - Daniel Rock
- West Australian Primary Health Alliance (WAPHA) , Perth, Australia.,Psychiatry, Medical School, University of Western Australia , Perth, Australia
| | | | - Nick Webb
- MindSpot Clinic, Macquarie University , Sydney, Australia
| | - Rony Kayrouz
- MindSpot Clinic, Macquarie University , Sydney, Australia
| | - Olav Nielssen
- MindSpot Clinic, Macquarie University , Sydney, Australia
| | - Linda Williams
- MindSpot Clinic, Macquarie University , Sydney, Australia
| | - Carol Purtell
- MindSpot Clinic, Macquarie University , Sydney, Australia
| | - Blake F Dear
- MindSpot Clinic, Macquarie University , Sydney, Australia.,eCentreClinic, Department of Psychology, Macquarie University , Sydney, Australia
| | | |
Collapse
|
21
|
Mariano TY, Wan L, Edwards RR, Jamison RN. Online teletherapy for chronic pain: A systematic review. J Telemed Telecare 2019; 27:195-208. [PMID: 31488004 DOI: 10.1177/1357633x19871746] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
OBJECTIVE A systematic review designed to evaluate the benefits of remote group pain management for persons with chronic pain was performed. METHODS PubMed, EMBASE and PsychINFO databases were searched in April 2019. Eligible studies evaluated teletherapy for chronic pain based on set inclusion and exclusion criteria. Two reviewers independently screened eligible studies, assessed risk of bias and extracted data. Each study design was rated and study quality was assessed using an 11-point scale of methodological quality. RESULTS Comprehensive searches identified 12 studies that met all inclusion/exclusion criteria and each study was assessed for type of technology, study design, outcome measures, study findings and limitations. No published studies investigated synchronous teletherapy for groups of chronic pain patients. Methods of assessment varied considerably across studies. Strength of evidence was moderate and many of the selected studies had issues with treatment compliance/adherence and selection bias. Teletherapy strategies for persons with chronic pain were shown to improve pain, mood, disability and catastrophising, however half of the studies selected did not meet the criteria for acceptable standards for internal validity. Those trials with limited therapist involvement appeared to be less beneficial and tended to report lower adherence than those which had higher levels of therapist guidance or peer support. CONCLUSIONS Preliminary findings suggest that teletherapy and remote online cognitive behavioural therapy strategies can be effective in improving quality of life among persons with chronic pain, although the overall quality of evidence is moderate. Controlled trials are needed to assess live remote teletherapy for chronic pain.
Collapse
Affiliation(s)
- Timothy Y Mariano
- Department of Psychiatry, Brigham and Women's Hospital, USA.,Harvard Medical School, USA.,Butler Hospital, USA.,Providence Veterans Affairs Medical Center, USA
| | - Limeng Wan
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, USA
| | - Robert R Edwards
- Department of Psychiatry, Brigham and Women's Hospital, USA.,Harvard Medical School, USA.,Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, USA
| | - Robert N Jamison
- Department of Psychiatry, Brigham and Women's Hospital, USA.,Harvard Medical School, USA.,Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, USA
| |
Collapse
|
22
|
Nordgreen T, Blom K, Andersson G, Carlbring P, Havik OE. Effectiveness of guided Internet-delivered treatment for major depression in routine mental healthcare - An open study. Internet Interv 2019; 18:100274. [PMID: 31890623 PMCID: PMC6926287 DOI: 10.1016/j.invent.2019.100274] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2019] [Revised: 08/21/2019] [Accepted: 08/21/2019] [Indexed: 01/15/2023] Open
Abstract
Depression is one of the most prevalent mental health disorders and is estimated to become the leading cause of disability worldwide by 2030. Increasing access to effective treatment for depression is a major societal challenge. In this context, the increasing use of computers in the form of laptops or smartphones has made it feasible to increase access to mental healthcare through digital technology. In this study, we examined the effectiveness of a 14-week therapist-guided Internet-delivered program for patients with major depression undergoing routine care. From 2015 to 2018, 105 patients were included in the study. For depressive symptoms, we identified significant within-group effect sizes (post-treatment: d = 0.96; 6-month follow-up: d = 1.21). We also found significant effects on secondary anxiety and insomnia symptoms (d = 0.55-0.92). Clinically reliable improvement was reported by 48% of those undergoing the main parts of the treatment, whereas 5% of the participants reported a clinically significant deterioration. However, a large proportion of patients showed no clinically reliable change. In summary, the study identified large treatment effects, but also highlighted room for improvement in the usability of the treatment.
Collapse
Affiliation(s)
- Tine Nordgreen
- Division of Psychiatry, Haukeland University Hospital, Norway,Department of Clinical Psychology, Faculty of Psychology, University of Bergen, Norway,Corresponding author at: Division of Psychiatry, Haukeland University Hospital, Norway.
| | - Kerstin Blom
- Division of Psychiatry, Haukeland University Hospital, Norway,Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, SE-141 86 Stockholm, Sweden,Stockholm Health Care Services, Stockholm County Council, M58, Karolinska University Hospital Huddinge, SE-141 86 Stockholm, Sweden
| | - Gerhard Andersson
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden,Department of Clinical Neuroscience, Karolinska Institute, Stockholm, Sweden
| | - Per Carlbring
- Department of Psychology, Stockholm University, Stockholm, Sweden,Department of Psychology, University of Southern Denmark, Denmark
| | - Odd E. Havik
- Department of Clinical Psychology, Faculty of Psychology, University of Bergen, Norway
| |
Collapse
|
23
|
Mariano TY, Wan L, Edwards RR, Lazaridou A, Ross EL, Jamison RN. Online group pain management for chronic pain: Preliminary results of a novel treatment approach to teletherapy. J Telemed Telecare 2019; 27:209-216. [PMID: 31431133 DOI: 10.1177/1357633x19870369] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
OBJECTIVE This pilot study was designed to determine the feasibility, tolerability, safety, and efficacy of group teletherapy for persons with chronic pain. The aim was to present preliminary outcomes of an open trial of group cognitive behavioural therapy (CBT) teletherapy compared with an in-person chronic pain patient group. METHODS We recruited 47 chronic pain patients to participate in an 8-session, 2-hour-per-week, online, structured, CBT-oriented pain management group using WebEx and compared them with 46 subjects who participated in a parallel, content-matched, in-person, weekly group. Both groups included goal setting, skills training, relaxation exercises, group discussion, and practice assignments. All subjects completed baseline measures, which were repeated post-treatment. Those in the online group participated in weekly telephone interviews and rated the perceived helpfulness of the remote group. RESULTS The average age of the online group participants was 54.5 ( ± 14.3) years and 70.2% were female, compared with 59.7 ( ± 13.0) years of age and 57.8% females among the in-person group members. On follow-up, both CBT groups showed modest improvements on the outcome measures. Results of this preliminary investigation comparing online teletherapy with in-person CBT suggest similar benefit. Many participants in the online group rated their experience as very helpful (62.5%; 7-10/10) and most would recommend this programme to others (93.7%; 7-10/10). DISCUSSION Preliminary findings suggest that online group CBT may be as effective in improving coping among persons with chronic pain as in-person groups. More rigorous controlled trials are needed to adequately assess the outcome benefit of online teletherapy for chronic pain.
Collapse
Affiliation(s)
- Timothy Y Mariano
- Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA.,Butler Hospital, Providence, RI, USA.,Providence Veterans Affairs Medical Center, Providence, RI, USA
| | - Limeng Wan
- Harvard Medical School, Boston, MA, USA.,Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA
| | - Robert R Edwards
- Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA.,Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA
| | - Asimina Lazaridou
- Harvard Medical School, Boston, MA, USA.,Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA
| | - Edgar L Ross
- Harvard Medical School, Boston, MA, USA.,Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA
| | - Robert N Jamison
- Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA.,Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA
| |
Collapse
|
24
|
Romijn G, Batelaan N, Kok R, Koning J, van Balkom A, Titov N, Riper H. Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis. J Med Internet Res 2019; 21:e11706. [PMID: 30994462 PMCID: PMC6492068 DOI: 10.2196/11706] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2018] [Revised: 01/31/2019] [Accepted: 03/24/2019] [Indexed: 12/11/2022] Open
Abstract
BACKGROUND Ample studies have shown the effectiveness of internet-delivered cognitive behavioral therapy (iCBT) for anxiety disorders. These studies recruited their participants mainly from the community and, to a lesser extent, from within routine care services. Little is known about whether different recruitment strategies lead to different treatment effects. OBJECTIVE This meta-analysis compared clinical results obtained in trials with recruitment from the community versus results obtained in trials with clinical service recruitment and explored factors that may mediate differences in treatment outcome. METHODS We included randomized controlled trials in which the clinical effects of iCBT for anxiety disorders were compared with a control condition (waitlist controls or face-to-face cognitive behavioral therapy). We classified trials as open recruitment trials (recruitment from the community) or clinical service recruitment trials (recruitment through outpatient clinics). Pooled effect sizes based on measures examining anxiety symptoms, depressive symptoms, and quality of life were computed for each type of trial. Subgroup analyses examined whether clinical results from open recruitment trials differed from those obtained in clinical service recruitment trials. Additional analyses explored which demographic, clinical, and treatment-related factors contributed to differences in effect sizes of open recruitment versus clinical service recruitment trials. RESULTS We included 42 studies with 53 comparisons (43 open recruitment comparisons and 10 clinical recruitment comparisons). Analyses of anxiety measures revealed, first, that iCBT open recruitment studies with waitlist control comparators showed a significantly higher effect size for decrease in anxiety symptoms than did those with clinical recruitment (Q=10.09; P=.001). This association between recruitment method and effect size was no longer significant in a multivariate metaregression with treatment adherence and exclusion of patients with depressive symptoms entered as additional predictors of effect size. Second, effect size for decrease in anxiety symptoms did not differ significantly between clinical recruitment and open recruitment studies with face-to-face cognitive behavioral therapy comparators. The effects of open recruitment trials and clinical recruitment trials did not differ significantly for the secondary outcomes, compared with face-to-face cognitive behavioral therapy and waitlist controls. CONCLUSIONS iCBT was effective in samples recruited in clinical practice, but effect sizes were smaller than those found in trials with an open recruitment method for studies with waitlist control comparators. Hence, for patients with anxiety disorders in routine care, the impact of iCBT may not be as positive as for study participants recruited from the community. The difference between open recruitment trials and clinical service recruitment trials might be partly explained by patients' greater therapy adherence in open recruitment trials and the stricter exclusion of patients with severe depressive symptoms in these studies. Since most trials in this meta-analysis applied an open recruitment method, more studies with routine care populations are needed to further validate these findings.
Collapse
Affiliation(s)
- Geke Romijn
- Department of Clinical, Neuro and Developmental Psychology, VU University, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
- Altrecht Academic Anxiety Centre, Utrecht, Netherlands
| | - Neeltje Batelaan
- Department of Psychiatry, VU University Medical Centre, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Robin Kok
- Department of Clinical, Neuro and Developmental Psychology, VU University, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
- Department of Psychology, University of Southern Denmark, Odense, Denmark
- Centre for Innovative Medical Technology, Odense University Hospital, Odense, Denmark
| | | | - Anton van Balkom
- Department of Psychiatry, VU University Medical Centre, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Nickolai Titov
- Mindspot, Department of Psychology, Macquarie University, Sydney, Australia
| | - Heleen Riper
- Department of Clinical, Neuro and Developmental Psychology, VU University, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
- Centre for Telepsychiatry, Mental Health Services of Southern Denmark, Odense, Denmark
| |
Collapse
|
25
|
Vis C, Ruwaard J, Finch T, Rapley T, de Beurs D, van Stel H, van Lettow B, Mol M, Kleiboer A, Riper H, Smit J. Toward an Objective Assessment of Implementation Processes for Innovations in Health Care: Psychometric Evaluation of the Normalization Measure Development (NoMAD) Questionnaire Among Mental Health Care Professionals. J Med Internet Res 2019; 21:e12376. [PMID: 30785402 PMCID: PMC6401675 DOI: 10.2196/12376] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2018] [Revised: 12/21/2018] [Accepted: 01/20/2019] [Indexed: 11/13/2022] Open
Abstract
Background Successfully implementing eMental health (eMH) interventions in routine mental health care constitutes a major challenge. Reliable instruments to assess implementation progress are essential. The Normalization MeAsure Development (NoMAD) study developed a brief self-report questionnaire that could be helpful in measuring implementation progress. Based on the Normalization Process Theory, this instrument focuses on 4 generative mechanisms involved in implementation processes: coherence, cognitive participation, collective action, and reflexive monitoring. Objective The aim of this study was to translate the NoMAD questionnaire to Dutch and to confirm the factor structure in Dutch mental health care settings. Methods Dutch mental health care professionals involved in eMH implementation were invited to complete the translated NoMAD questionnaire. Confirmatory factor analysis (CFA) was conducted to verify interpretability of scale scores for 3 models: (1) the theoretical 4-factor structure, (2) a unidimensional model, and (3) a hierarchical model. Potential improvements were explored, and correlated scale scores with 3 control questions were used to assess convergent validity. Results A total of 262 professionals from mental health care settings in the Netherlands completed the questionnaire (female: 81.7%; mean age: 45 [SD=11]). The internal consistency of the 20-item questionnaire was acceptable (.62≤alpha≤.85). The theorized 4-factor model fitted the data slightly better in the CFA than the hierarchical model (Comparative Fit Index=0.90, Tucker Lewis Index=0.88, Root Mean Square Error of Approximation=0.10, Standardized Root Mean Square Residual=0.12, χ22=22.5, P≤.05). However, the difference is small and possibly not outweighing the practical relevance of a total score and subscale scores combined in one hierarchical model. One item was identified as weak (λCA.2=0.10). A moderate-to-strong convergent validity with 3 control questions was found for the Collective Participation scale (.47≤r≤.54, P≤.05). Conclusions NoMAD’s theoretical factor structure was confirmed in Dutch mental health settings to acceptable standards but with room for improvement. The hierarchical model might prove useful in increasing the practical utility of the NoMAD questionnaire by combining a total score with information on the 4 generative mechanisms. Future research should assess the predictive value and responsiveness over time and elucidate the conceptual interpretability of NoMAD in eMH implementation practices.
Collapse
Affiliation(s)
- Christiaan Vis
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Mental Health, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Jeroen Ruwaard
- Amsterdam UMC, Vrije Universiteit, Psychiatry, Amsterdam Public Health Research Institute, Amsterdam, Netherlands.,Research and Innovation, GGZ inGeest Specialized Mental Healthcare, Amsterdam, Netherlands
| | - Tracy Finch
- Department of Nursing, Midwifery & Health, Northumbria University, Northumbria, United Kingdom
| | - Tim Rapley
- Department of Social Work, Education & Community Wellbeing, Northumbria University, Northumbria, United Kingdom
| | - Derek de Beurs
- Mental Health, Netherlands Institute For Health Services Research (NIVEL), Utrecht, Netherlands
| | - Henk van Stel
- Julius Center Research Program Methodology, Department of Public Health, Healthcare Innovation & Evaluation and Medical Humanities, University Medical Center Utrecht, Utrecht, Netherlands
| | | | - Mayke Mol
- Amsterdam UMC, Vrije Universiteit, Psychiatry, Amsterdam Public Health Research Institute, Amsterdam, Netherlands.,Research and Innovation, GGZ inGeest Specialized Mental Healthcare, Amsterdam, Netherlands
| | - Annet Kleiboer
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Mental Health, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Heleen Riper
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Mental Health, Amsterdam Public Health Research Institute, Amsterdam, Netherlands.,Research and Innovation, GGZ inGeest Specialized Mental Healthcare, Amsterdam, Netherlands
| | - Jan Smit
- Amsterdam UMC, Vrije Universiteit, Psychiatry, Amsterdam Public Health Research Institute, Amsterdam, Netherlands.,Research and Innovation, GGZ inGeest Specialized Mental Healthcare, Amsterdam, Netherlands
| |
Collapse
|