1
|
Berardi C, Antonini M, Jordan Z, Wechtler H, Paolucci F, Hinwood M. Barriers and facilitators to the implementation of digital technologies in mental health systems: a qualitative systematic review to inform a policy framework. BMC Health Serv Res 2024; 24:243. [PMID: 38408938 PMCID: PMC10898174 DOI: 10.1186/s12913-023-10536-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2023] [Accepted: 12/28/2023] [Indexed: 02/28/2024] Open
Abstract
BACKGROUND Despite the potential for improved population mental health and wellbeing, the integration of mental health digital interventions has been difficult to achieve. In this qualitative systematic review, we aimed to identify barriers and facilitators to the implementation of digital technologies in mental healthcare systems, and map these to an implementation framework to inform policy development. METHODS We searched Medline, Embase, Scopus, PsycInfo, Web of Science, and Google Scholar for primary research articles published between January 2010 and 2022. Studies were considered eligible if they reported barriers and/or facilitators to the integration of any digital mental healthcare technologies. Data were extracted using EPPI-Reviewer Web and analysed thematically via inductive and deductive cycles. RESULTS Of 12,525 references identified initially, 81 studies were included in the final analysis. Barriers and facilitators were grouped within an implementation (evidence-practice gap) framework across six domains, organised by four levels of mental healthcare systems. Broadly, implementation was hindered by the perception of digital technologies as impersonal tools that add additional burden of care onto both providers and patients, and change relational power asymmetries; an absence of resources; and regulatory complexities that impede access to universal coverage. Facilitators included person-cantered approaches that consider patients' intersectional features e.g., gender, class, disability, illness severity; evidence-based training for providers; collaboration among colleagues; appropriate investment in human and financial resources; and policy reforms that tackle universal access to digital health. CONCLUSION It is important to consider the complex and interrelated nature of barriers across different domains and levels of the mental health system. To facilitate the equitable, sustainable, and long-term digital transition of mental health systems, policymakers should consider a systemic approach to collaboration between public and private sectors to inform evidence-based planning and strengthen mental health systems. PROTOCOL REGISTRATION The protocol is registered on PROSPERO, CRD42021276838.
Collapse
Affiliation(s)
- Chiara Berardi
- Newcastle Business School, The University of Newcastle, Hunter St & Auckland St, 2300, Newcastle, NSW, Australia.
| | - Marcello Antonini
- School of Medicine and Public Health, The University of Newcastle, Callaghan, NSW, Australia
- Department of Health Policy, London School of Economics and Political Science, London, WC2A 2AE, UK
| | - Zephanie Jordan
- Newcastle Business School, The University of Newcastle, Hunter St & Auckland St, 2300, Newcastle, NSW, Australia
| | - Heidi Wechtler
- Newcastle Business School, The University of Newcastle, Hunter St & Auckland St, 2300, Newcastle, NSW, Australia
| | - Francesco Paolucci
- Newcastle Business School, The University of Newcastle, Hunter St & Auckland St, 2300, Newcastle, NSW, Australia
| | - Madeleine Hinwood
- School of Medicine and Public Health, The University of Newcastle, Callaghan, NSW, Australia
- Hunter Medical Research Institute, New Lambton Heights, NSW, Australia
| |
Collapse
|
2
|
Abi Ramia J, Abi Hana R, Noun P, Cuijpers P, Carswell K, van't Hof E, Heim E, Zoghbi E, Sijbrandij M, El Chammay R. Feasibility and uptake of a digital mental health intervention for depression among Lebanese and Syrian displaced people in Lebanon: a qualitative study. Front Public Health 2024; 11:1293187. [PMID: 38317685 PMCID: PMC10840138 DOI: 10.3389/fpubh.2023.1293187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 12/22/2023] [Indexed: 02/07/2024] Open
Abstract
Introduction Digital interventions are increasingly regarded as a potential solution for the inaccessibility of mental health treatment across low-and-middle-income settings, especially for common mental disorders. Step-by-Step (SbS) is a digital, guided self-help intervention for depression found effective in two Randomized Controlled Trials (RCTs) in Lebanon. For research implementation and further scale-up, this paper reports the results of a qualitative evaluation of SbS among the Lebanese and others and displaced Syrians in Lebanon. Methods Thirty-four Key Informant Interviews (KIIs) were executed with participants of the RCTs, SbS staff members, and external stakeholders. Questions garnered feedback about the feasibility, acceptability, enabling factors, and barriers to adhering to the research, implementation, and the SbS intervention. A thematic analysis was conducted using NVivo, and key themes, topics, and recommendations, on research methods and the intervention itself, were generated and reported. Results Results showed a high level of acceptability of SbS among Lebanese and Syrians and identified sub-groups for whom acceptance or use might be lower, such as older adults and people with limited access to the internet or smartphones. Furthermore, interviews identified the main enabling factors and barriers to adherence related to the research design, content, and delivery approach. Barriers related to feasibility included lengthy assessments as part of the RCTs, and mistrust related to delays in study compensations. Other common challenges were forgetting login credentials, poor internet connection, being busy and competing needs. Enabling factors and best practices included motivating participants to use the intervention through the weekly support provided by helpers, setting an oral contract for commitment, and dividing the compensations into several installments as part of the RCTs. Recommendations regarding sustainability were given. Discussion The findings show that overall, SbS is feasible, acceptable, and much needed in Lebanon among the Lebanese and Syrians. This assessment identifies reasons for low adherence to the research and the intervention and presents improvement solutions. Recommendations generated in this paper inform the upscale of SbS and the planning, design, and implementation of future digital interventions in research and service provision settings in the mental health field.
Collapse
Affiliation(s)
- Jinane Abi Ramia
- Department of Clinical, Neuro and Developmental Psychology, World Health Organization (WHO) Collaborating Center for Research and Dissemination of Psychological Interventions, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- National Mental Health Programme, Ministry of Public Health of Lebanon, Beirut, Lebanon
| | - Racha Abi Hana
- Department of Clinical, Neuro and Developmental Psychology, World Health Organization (WHO) Collaborating Center for Research and Dissemination of Psychological Interventions, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- National Mental Health Programme, Ministry of Public Health of Lebanon, Beirut, Lebanon
| | - Philip Noun
- National Mental Health Programme, Ministry of Public Health of Lebanon, Beirut, Lebanon
| | - Pim Cuijpers
- Department of Clinical, Neuro and Developmental Psychology, World Health Organization (WHO) Collaborating Center for Research and Dissemination of Psychological Interventions, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- International Institute for Psychotherapy, Babeş-Bolyai University, Cluj-Napoca, Romania
| | - Kenneth Carswell
- Department of Mental Health and Substance Use, World Health Organization, Geneva, Switzerland
| | - Edith van't Hof
- Department of Mental Health and Substance Use, World Health Organization, Geneva, Switzerland
| | - Eva Heim
- Institute of Psychology, University of Lausanne, Lausanne, Switzerland
- Department of Psychology, University of Zurich, Zurich, Switzerland
| | - Edwina Zoghbi
- Country Office for Lebanon, World Health Organization, Beirut, Lebanon
| | - Marit Sijbrandij
- Department of Clinical, Neuro and Developmental Psychology, World Health Organization (WHO) Collaborating Center for Research and Dissemination of Psychological Interventions, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Rabih El Chammay
- National Mental Health Programme, Ministry of Public Health of Lebanon, Beirut, Lebanon
- Psychiatry Department, Faculty of Medicine, Saint Joseph University, Beirut, Lebanon
| |
Collapse
|
3
|
O’Sullivan K, Downes C, Monahan M, Morrissey J, Byrne G, Farrell G, Gibbons P, Higgins A. Operationalising a Recovery-Oriented Support and Information Programme Online: The EOLAS Programme. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:4417. [PMID: 36901424 PMCID: PMC10002363 DOI: 10.3390/ijerph20054417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Revised: 02/14/2023] [Accepted: 02/23/2023] [Indexed: 06/18/2023]
Abstract
Evidence demonstrates that psychoeducation interventions have clinical and recovery-related benefits for people experiencing psychosis and their family members. The EOLAS programmes are one example of recovery-oriented psychoeducation programmes for psychosis. They differ from other programmes in that they are co-designed and co-facilitated (peer and clinician) group programmes. Due to the COVID-19 pandemic, EOLAS went online using a videoconferencing platform. The study examined the feasibility, acceptability and usefulness of EOLAS-Online and explored whether some of the positive recovery outcomes reported by attendees regarding the in-person programmes were replicated online. Data were collected through an online survey and semi-structured interviews. Quantitative data were analysed using descriptive statistics. Thematic analysis was used for qualitative data. Fifteen attendees (40% of attendees) completed the surveys and eight participated in interviews. A total of 80% were satisfied/very satisfied with the programme. The programme was rated highly for increased knowledge of mental health, coping strategies, and engaging with peers. The use of technology was mostly unproblematic, although some audio and video-related challenges were identified. Engaging with the online programme was experienced positively, including facilitator support to engage. The overall findings indicate that EOLAS-Online is feasible, acceptable and useful in supporting attendees' recovery journeys.
Collapse
Affiliation(s)
- Karin O’Sullivan
- School of Nursing and Midwifery, Trinity College Dublin, D02 T283 Dublin, Ireland
| | - Carmel Downes
- School of Nursing and Midwifery, Trinity College Dublin, D02 T283 Dublin, Ireland
| | - Mark Monahan
- School of Nursing and Midwifery, Trinity College Dublin, D02 T283 Dublin, Ireland
| | - Jean Morrissey
- School of Nursing and Midwifery, Trinity College Dublin, D02 T283 Dublin, Ireland
| | - Gobnait Byrne
- Trinity Centre for Practice and Healthcare Innovation, School of Nursing & Midwifery, Trinity College Dublin, D02 T283 Dublin, Ireland
| | - Gerard Farrell
- School of Nursing and Midwifery, Trinity College Dublin, D02 T283 Dublin, Ireland
| | - Patrick Gibbons
- Kildare/West Wicklow Mental Health Service, Lakeview Unit, Naas Hospital, Craddockstown Rd., Naas, W91 AE76 Kildare, Ireland
| | - Agnes Higgins
- Trinity Centre for Practice and Healthcare Innovation, School of Nursing & Midwifery, Trinity College Dublin, D02 T283 Dublin, Ireland
| |
Collapse
|
4
|
Yu E, Xu B, Sequeira L. Determinants of e-Mental Health Use During COVID-19: Cross-sectional Canadian Study. J Med Internet Res 2022; 24:e39662. [DOI: 10.2196/39662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 08/30/2022] [Accepted: 10/01/2022] [Indexed: 11/17/2022] Open
Abstract
Background
Access to mental health treatment across Canada remains a challenge, with many reporting unmet care needs. National and provincial e-Mental health (eMH) programs have been developed over the past decade across Canada, with many more emerging during COVID-19 in an attempt to reduce barriers related to geography, isolation, transportation, physical disability, and availability.
Objective
The aim of this study was to identify factors associated with the utilization of eMH services across Canada during the COVID-19 pandemic using Andersen and Newman’s framework of health service utilization.
Methods
This study used data gathered from the 2021 Canadian Digital Health Survey, a cross-sectional, web-based survey of 12,052 Canadians aged 16 years and older with internet access. Bivariate associations between the use of eMH services and health service utilization factors (predisposing, enabling, illness level) of survey respondents were assessed using χ2 tests for categorical variables and t tests for the continuous variable. Logistic regression was used to predict the probability of using eMH services given the respondents’ predisposing, enabling, and illness-level factors while adjusting for respondents’ age and gender.
Results
The proportion of eMH service users among survey respondents was small (883/12,052, 7.33%). Results from the logistic regression suggest that users of eMH services were likely to be those with regular family physician access (odds ratio [OR] 1.57, P=.02), living in nonrural communities (OR 1.08, P<.001), having undergraduate (OR 1.40, P=.001) or postgraduate (OR 1.48, P=.003) education, and being eHealth literate (OR 1.05, P<.001). Those with lower eMH usage were less likely to speak English at home (OR 0.06, P<.001).
Conclusions
Our study provides empirical evidence on the impact of individual health utilization factors on the use of eMH among Canadians during the COVID-19 pandemic. Given the opportunities and promise of eMH services in increasing access to care, future digital interventions should both tailor themselves toward users of these services and consider awareness campaigns to reach nonusers. Future research should also focus on understanding the reasons behind the use and nonuse of eMH services.
Collapse
|
5
|
Rahman J, Cheung G, Lyndon MP, Lawrence M, Ma'u E, Chen Y, Ramalho R. Prioritising a culturally safe e-Mental Health research agenda in Aotearoa New Zealand: A sector survey report. Australas Psychiatry 2022; 30:619-623. [PMID: 35592907 DOI: 10.1177/10398562221101794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
OBJECTIVE To collect mental health and addiction service providers' opinions about priorities for an e-Mental Health (eMH) research agenda focused on delivering culturally safe eMH in Aotearoa New Zealand. METHOD Service providers were recruited to participate in an anonymous online survey, which asked participants to rate the importance of potential research domains and items on a continuous scale from 1 to 10. The mean values of each item were normalised to develop a priority index. RESULTS 48 participants rated at least one of the listed research items. The highest-rated items were (i) identifying strategies to improve access; co-developing eMH with the community (ii) a set of competencies required for delivering culturally safe care, (iii) a set of meaningful clinical outcomes that can be achieved via eMH, (iv) guidelines for the delivery of eMH services and (v) investigating the extent to which eMH could meet the mental health needs of these communities. 'Standards and guidelines' was the domain with the highest priority index. CONCLUSIONS Mental health and addiction service providers in Aotearoa New Zealand prioritised an eMH research agenda that is focused on pro-equity outcomes and incorporating the voices and experiences of the communities they seek to serve.
Collapse
Affiliation(s)
- Juma Rahman
- Department of Social and Community Health, School of Population Health, 56382University of Auckland, Auckland, New Zealand
| | - Gary Cheung
- Department of Psychological Medicine, School of Medicine, 56382University of Auckland, Auckland, New Zealand
| | - Mataroria P Lyndon
- Centre for Medical and Health Sciences Education, School of Medicine, 56382University of Auckland, Auckland, New Zealand
| | - Mark Lawrence
- Department of Psychological Medicine, School of Medicine, 56382University of Auckland, Auckland, New Zealand
| | - Etuini Ma'u
- Department of Psychological Medicine, School of Medicine, 56382University of Auckland, Auckland, New Zealand
| | - Yan Chen
- Centre for Medical and Health Sciences Education, School of Medicine, 56382University of Auckland, Auckland, New Zealand
| | - Rodrigo Ramalho
- Department of Social and Community Health, School of Population Health, 56382University of Auckland, Auckland, New Zealand
| |
Collapse
|
6
|
Vis C, Kleiboer A, Mol M, Pedersen CD, Finch T, Smit J, Riper H. Organisational implementation climate in implementing internet-based cognitive behaviour therapy for depression. BMC Health Serv Res 2022; 22:720. [PMID: 35641927 PMCID: PMC9153170 DOI: 10.1186/s12913-022-08041-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2020] [Accepted: 05/05/2022] [Indexed: 11/10/2022] Open
Abstract
Background Internet-based Cognitive Behaviour Therapy (iCBT) for depression have been implemented in routine care across Europe in varying ways, at various scales and with varying success. This study aimed to advance our understanding of organisational implementation climate from the perspectives of implementers and mental health service deliverers. Methods Qualitative and quantitative methods were combined to study the concept of organisational implementation climate in mental health care settings. Based on concept mapping, a qualitative workshop with implementers was used to conceptualise organisational implementation climate for optimizing iCBT use in routine practice. Service deliverers involved in the provision of iCBT were invited to participate in an explorative cross-sectional survey assessing levels of satisfaction and usability of iCBT, and organisational implementation climate in implementing iCBT. The two methods were applied independently to study viewpoints of implementers as well as service deliverers. Corresponding to the explorative nature of the study, inductive reasoning was applied to identify patterns and develop a reasonable explanation of the observations made. Correlative associations between satisfaction, usability and implementation climate were explored. Results Sixteen implementers representing fourteen service delivery organisations across Europe participated in the workshop. The top-three characteristics of a supportive organisational implementation climate included: (1) clear roles and skills of implementers, (2) feasible implementation targets, and (3) a dedicated implementation team. The top-three tools for creating a supportive implementation climate included: (1) feedback on job performance, (2) progress monitoring in achieving implementation targets, and (3) guidelines for assessing the impact of iCBT. The survey (n=111) indicated that service providers generally regarded their organisational implementation climate as supportive in implementing iCBT services. Organisational implementation climate was weakly associated with perceived usability and moderately with satisfaction with iCBT services. Conclusions Organisational implementation climate is a relevant factor to implementers and service deliverers in implementing iCBT in routine care. It is not only an inherent characteristic of the context in which implementation takes place, it can also be shaped to improve implementation of iCBT services. Future research should further theorise organisational implementation climate and empirically validate the measurement instruments such as used in this study. Supplementary Information The online version contains supplementary material available at 10.1186/s12913-022-08041-y.
Collapse
Affiliation(s)
- Christiaan Vis
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Van der Boechorststraat 7, Amsterdam, 1081 BT, The Netherlands. .,Amsterdam Public Health Research Institute - Mental Health, Amsterdam, Netherlands. .,World Health Organization (WHO) Collaborating Centre for Research and Dissemination of Psychological Interventions, Amsterdam, Netherlands.
| | - Annet Kleiboer
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Van der Boechorststraat 7, Amsterdam, 1081 BT, The Netherlands.,Amsterdam Public Health Research Institute - Mental Health, Amsterdam, Netherlands
| | - Mayke Mol
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Van der Boechorststraat 7, Amsterdam, 1081 BT, The Netherlands.,Amsterdam Public Health Research Institute - Mental Health, Amsterdam, Netherlands.,Dept. of Psychiatry, Amsterdam University Medical Centre (VUmc), Amsterdam, The Netherlands
| | | | - Tracy Finch
- Department of Nursing, Midwifery & Health, Northumbria University, Northumbria, United Kingdom
| | - Jan Smit
- Amsterdam Public Health Research Institute - Mental Health, Amsterdam, Netherlands.,Dept. of Psychiatry, Amsterdam University Medical Centre (VUmc), Amsterdam, The Netherlands
| | - Heleen Riper
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, VU Amsterdam, Van der Boechorststraat 7, Amsterdam, 1081 BT, The Netherlands.,Amsterdam Public Health Research Institute - Mental Health, Amsterdam, Netherlands.,Dept. of Psychiatry, Amsterdam University Medical Centre (VUmc), Amsterdam, The Netherlands
| | | |
Collapse
|
7
|
Ahmad NA, Mat Ludin AF, Shahar S, Mohd Noah SA, Mohd Tohit N. Willingness, perceived barriers and motivators in adopting mobile applications for health-related interventions among older adults: a scoping review. BMJ Open 2022; 12:e054561. [PMID: 35264349 PMCID: PMC8915330 DOI: 10.1136/bmjopen-2021-054561] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
OBJECTIVES This scoping review aims to identify the level of willingness, the existing barriers, and motivators among older adults in using mobile applications to monitor and manage their health conditions. The secondary aim of this paper is to categorise these willingness, barriers and motivators using the Theoretical Domains Framework (TDF). DESIGN Scoping review. DATA SOURCE PubMed, Embase, CINAHL, Cochrane Library, Google Scholar and Science Direct (January 2009-December 2020). STUDY SELECTION Studies that describe older adults' perspectives with regard to their willingness, barriers or motivators towards the use of mobile applications in monitoring and managing their health condition were included. DATA EXTRACTION Titles and abstracts were initially screened by two reviewers. Articles agreed by both reviewers were proceeded to full-text screening. One reviewer extracted the data, which were verified by a second reviewer. Findings were further classified according to the 14 TDF domains by two researchers. RESULTS Six studies were included in the final scoping review. Barriers to adopting mobile applications for health-related interventions among older adults were the most common topic identified in the included studies. Barriers included being unaware of the existence of mobile health applications, lack of technological skills, lack of perceived ability and time, absence of professional involvements, and violation of trust and privacy. With regard to willingness, older adults are willing to use mobile applications if the apps incorporated features from a trusted source and have valid credentials. Motivators included continuous improvements of mobile applications' design interface and personalised features tailored to older adults' needs. CONCLUSIONS With the constant research for more diversified technology, the development of mobile applications to help older adults to manage and monitor health is seen as feasible, but barriers have to be addressed. The most prominent barriers linked to TDF domains were: (1) technological skills, (2) belief about consequences, and (3) memory, attention and decision process. Future interventions should use behaviour change techniques that target these three TDF domains in order to improve the ability to engage older adults with mobile technology.
Collapse
Affiliation(s)
- Nurul Asilah Ahmad
- Center for Healthy Ageing and Wellness, National University of Malaysia, Faculty of Health Sciences, Kuala Lumpur, Wilayah Persekutuan, Malaysia
| | - Arimi Fitri Mat Ludin
- Center for Healthy Ageing and Wellness, National University of Malaysia, Faculty of Health Sciences, Kuala Lumpur, Wilayah Persekutuan, Malaysia
- Biomedical Science Programme, Universiti Kebangsaan Malaysia Faculty of Health Sciences, Kuala Lumpur, Malaysia
| | - Suzana Shahar
- Center for Healthy Ageing and Wellness, National University of Malaysia, Faculty of Health Sciences, Kuala Lumpur, Wilayah Persekutuan, Malaysia
| | - Shahrul Azman Mohd Noah
- Faculty of Information, Science and Technology, Universiti Kebangsaan Malaysia, Bangi, Selangor, Malaysia
| | - Noorlaili Mohd Tohit
- Department of Family Medicine, Universiti Kebangsaan Malaysia, Bangi, Selangor, Malaysia
| |
Collapse
|
8
|
García-Estela A, Cantillo J, Angarita-Osorio N, Mur-Milà E, Anmella G, Pérez V, Vieta E, Hidalgo-Mazzei D, Colom F. Real-world Implementation of a Smartphone-Based Psychoeducation Program for Bipolar Disorder: Observational Ecological Study. J Med Internet Res 2022; 24:e31565. [PMID: 35107440 PMCID: PMC8851334 DOI: 10.2196/31565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Revised: 09/16/2021] [Accepted: 10/29/2021] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND SIMPLe is an internet-delivered self-management mobile app for bipolar disorder (BD) designed to combine technology with evidence-based interventions and facilitate access to psychoeducational content. The SIMPLe app was launched to the real world to make it available worldwide within the context of BD treatment. OBJECTIVE The main aims of this study are as follows: to describe app use, engagement, and retention rates based on server data; to identify patterns of user retention over the first 6-month follow-up of use; and to explore potential factors contributing to discontinuation of app use. METHODS This was an observational ecological study in which we pooled available data from a real-world implementation of the SIMPLe app. Participation was open on the project website, and the data-collection sources were a web-based questionnaire on clinical data and treatment history administered at inclusion and at 6 months, subjective data gathered through continuous app use, and the use patterns captured by the app server. Characteristics and engagement of regular users, occasional users, and no users were compared using 2-tailed t tests or analysis of variance or their nonparametric equivalent. Survival analysis and risk functions were applied to regular users' data to examine and compare use and user retention. In addition, a user evaluation analysis was performed based on satisfaction, perceived usefulness, and reasons to discontinue app use. RESULTS We included 503 participants with data collected between 2016 and 2018, of whom 77.5% (n=390) used the app. Among the app users, 44.4% (173/390) completed the follow-up assessment, and data from these participants were used in our analyses. Engagement declined gradually over the first 6 months of use. The probability of retention of the regular users after 1 month of app use was 67.4% (263/390; 95% CI 62.7%-72.4%). Age (P=.002), time passed since illness onset (P<.001), and years since diagnosis of BD (P=.048) correlate with retention duration. In addition, participants who had been diagnosed with BD for longer used the app on more days (mean 97.73, SD 69.15 days; P=.002) than those who had had a more recent onset (mean 66.49, SD 66.18 days; P=.002) or those who had been diagnosed more recently (mean 73.45, SD 66 days; P=.01). CONCLUSIONS The user retention rate of the app decreased rapidly after each month until reaching only one-third of the users at 6 months. There exists a strong association between age and app engagement of individuals with BD. Other variables such as years lived with BD, diagnosis of an anxiety disorder, and taking antipsychotics seem relevant as well. Understanding these associations can help in the definition of the most suitable user profiles for predicting trends of engagement, optimization of app prescription, and management.
Collapse
Affiliation(s)
- Aitana García-Estela
- Mental Health Research Group, Hospital del Mar Medical Research Institute (IMIM), Barcelona, Spain.,Department of Psychiatry and Forensic Medicine, School of Medicine, Universitat Autònoma de Barcelona, Barcelona, Spain
| | | | - Natalia Angarita-Osorio
- Mental Health Research Group, Hospital del Mar Medical Research Institute (IMIM), Barcelona, Spain.,Department of Psychiatry and Forensic Medicine, School of Medicine, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Estanislao Mur-Milà
- Mental Health Research Group, Hospital del Mar Medical Research Institute (IMIM), Barcelona, Spain.,Department of Psychiatry and Forensic Medicine, School of Medicine, Universitat Autònoma de Barcelona, Barcelona, Spain.,Institute of Neuropsychiatry and Addictions, Hospital del Mar, Parc de Salut Mar, Barcelona, Spain
| | - Gerard Anmella
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic, Universitat de Barcelona, Barcelona, Spain.,Centre for Biomedical Research in Mental Health Network (CIBERSAM), Madrid, Spain
| | - Víctor Pérez
- Mental Health Research Group, Hospital del Mar Medical Research Institute (IMIM), Barcelona, Spain.,Department of Psychiatry and Forensic Medicine, School of Medicine, Universitat Autònoma de Barcelona, Barcelona, Spain.,Institute of Neuropsychiatry and Addictions, Hospital del Mar, Parc de Salut Mar, Barcelona, Spain.,Centre for Biomedical Research in Mental Health Network (CIBERSAM), Madrid, Spain
| | - Eduard Vieta
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic, Universitat de Barcelona, Barcelona, Spain.,Centre for Biomedical Research in Mental Health Network (CIBERSAM), Madrid, Spain
| | - Diego Hidalgo-Mazzei
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic, Universitat de Barcelona, Barcelona, Spain.,Centre for Biomedical Research in Mental Health Network (CIBERSAM), Madrid, Spain.,Centre for Affective Disorders, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom
| | - Francesc Colom
- Mental Health Research Group, Hospital del Mar Medical Research Institute (IMIM), Barcelona, Spain.,Institute of Neuropsychiatry and Addictions, Hospital del Mar, Parc de Salut Mar, Barcelona, Spain.,Centre for Biomedical Research in Mental Health Network (CIBERSAM), Madrid, Spain.,Department of Basic, Evolutive and Education Psychology, Faculty of Psychology, Universitat Autònoma de Barcelona, Barcelona, Spain
| |
Collapse
|
9
|
Neher M, Nygårdh A, Broström A, Lundgren J, Johansson P. Perspectives of Policy Makers and Service Users Concerning the Implementation of eHealth in Sweden: Interview Study. J Med Internet Res 2022; 24:e28870. [PMID: 35089139 PMCID: PMC8838545 DOI: 10.2196/28870] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2021] [Revised: 10/01/2021] [Accepted: 10/14/2021] [Indexed: 12/20/2022] Open
Abstract
Background Increasing life spans of populations and a growing demand for more advanced care make effective and cost-efficient provision of health care necessary. eHealth technology is often proposed, although research on barriers to and facilitators of the implementation of eHealth technology is still scarce and fragmented. Objective The aim of this study is to explore the perceptions concerning barriers to and facilitators of the implementation of eHealth among policy makers and service users and explore the ways in which their perceptions converge and differ. Methods This study used interview data from policy makers at different levels of health care (n=7) and service users enrolled in eHealth interventions (n=25). The analysis included separate qualitative content analyses for the 2 groups and then a second qualitative content analysis to explore differences and commonalities. Results Implementation barriers perceived by policy makers were that not all service users benefit from eHealth and that there is uncertainty about the impact of eHealth on the work of health care professionals. Policy makers also perceived political decision-making as complex; this included problems related to provision of technical infrastructure and lack of extra resources for health care digitalization. Facilitators were policy makers’ conviction that eHealth is what citizens want, their belief in eHealth solutions as beneficial for health care practice, and their belief in the importance of health care digitalization. Barriers for service users comprised capability limitations and varied preferences of service users and a mismatch of technology with user needs, lack of data protection, and their perception of eHealth as being more time consuming. Facilitators for service users were eHealth technology design and match with their skill set, personal feedback and staff support, a sense of privacy, a credible sender, and flexible use of time.There were several commonalities between the 2 stakeholder groups. Facilitators for both groups were the strong impetus toward technology adoption in society and expectations of time flexibility. Both groups perceived barriers in the difficulties of tailoring eHealth, and both groups expressed uncertainty about the care burden distribution. There were also differences: policy makers perceived that their decision-making was very complex and that resources for implementation were limited. Service users highlighted their need to feel that their digital data were protected and that they needed to trust the eHealth sender. Conclusions Perceptions about barriers to and facilitators of eHealth implementation varied among stakeholders in different parts of the health care system. The study points to the need to reach an enhanced mutual understanding of priorities and overcome challenges at both the micro and macro levels of the health care system. More well-balanced decisions at the policy-maker level may lead to more effective and sustainable development and future implementation of eHealth.
Collapse
Affiliation(s)
- Margit Neher
- Department of Rehabilitation, School of Health and Welfare, Jönköping University, Jönköping, Sweden
| | - Annette Nygårdh
- Department of Nursing Sciences, School of Health and Welfare, Jönköping University, Jönköping, Sweden
| | - Anders Broström
- Department of Nursing Sciences, School of Health and Welfare, Jönköping University, Jönköping, Sweden.,Department of Clinical Neurophysiology, Linköping University Hospital, Linköping, Sweden
| | - Johan Lundgren
- Department of Health, Medicine and Caring Sciences, Linköping University, Linköping, Sweden
| | - Peter Johansson
- Department of Health, Medicine and Caring Sciences, Linköping University, Linköping, Sweden
| |
Collapse
|
10
|
Bierbooms J, Feijt MA, IJsselsteijn WA, Bongers IMB. Design of a Game-Based Training Environment to Enhance Mental Healthcare Professionals’ Skills in Using eMental Health: a User Requirements Analysis (Preprint). JMIR Serious Games 2021; 10:e34700. [PMID: 35896032 PMCID: PMC9377428 DOI: 10.2196/34700] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 03/24/2022] [Accepted: 05/13/2022] [Indexed: 12/04/2022] Open
Abstract
Background A major factor hampering the adoption of technology in mental health care is a lack of knowledge and skills. Serious gaming offers a potentially effective strategy to enhance the skills needed through experiencing and learning-by-doing in a playful way. However, serious gaming solutions are not widely available for mental health care. Therefore, the development of a game-based training environment in mental health care was pursued in a design project. The first step in such a design project is to identify user requirements that should be met. Objective This study aims to deliver user requirements that inform the design of a game-based training environment for mental health care professionals. This environment aims to support mental health care professionals’ knowledge and skill enhancement regarding the use of e–mental health (eMH); for example, video calling, mobile apps, web-based treatment modules, and techniques such as virtual or augmented reality. Methods We used an exploratory multiple methods design consisting of a web-based questionnaire, co-design sessions, and interviews. To ensure a good representation of the target user group, professionals from various disciplines within mental health care were included in the research. The multiple methods design facilitates a broad view of user needs and in-depth knowledge of specific design requirements. We describe the protocol for this research project in a protocol paper published in the JMIR Research Protocols in February 2021. Results The user requirements analysis revealed three types of users for the envisioned game-based training environment: mental health care professionals who want to learn about the basic possibilities of eMH, mental health care professionals who want to develop their eMH skills to the next level, and mental health care professionals who want to experiment with new technologies. This reflects the diversity of needs that were identified, as well as the need to develop a diversity of suitable scenarios in the environment. User requirements analysis shows that the focus of a training environment should be on increasing knowledge about the possibilities of eMH, focusing on experiencing the benefits in particular situations, and building confidence in using eMH in a therapeutic setting. This requires careful consideration of the suitable game characteristics. Conclusions Improvement of mental health care professionals’ skills in eMH requires an environment that is user driven and flexible, and simultaneously incorporates contextual factors that are relevant for its implementation in practice. This user requirements analysis contributes to the understanding of the issues that should be considered in the development of a game-based training environment. This shows that there are multiple and diverse learning needs among mental health care professionals. Various client populations, services, and situations demand various options for training. International Registered Report Identifier (IRRID) RR2-10.2196/18815
Collapse
Affiliation(s)
- Joyce Bierbooms
- Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, Tilburg, Netherlands
| | - Milou A Feijt
- Human-Technology Interaction, Eindhoven University of Technology, Eindhoven, Netherlands
| | - Wijnand A IJsselsteijn
- Human-Technology Interaction, Eindhoven University of Technology, Eindhoven, Netherlands
| | - Inge M B Bongers
- Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, Tilburg, Netherlands
- GGz Eindhoven en de Kempen, Eindhoven, Netherlands
| |
Collapse
|
11
|
Lorenz-Artz K, Bierbooms J, Bongers I. Integrating eHealth within a Transforming Mental Healthcare Setting: A Qualitative Study into Values, Challenges, and Prerequisites. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:10287. [PMID: 34639587 PMCID: PMC8508136 DOI: 10.3390/ijerph181910287] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Revised: 09/23/2021] [Accepted: 09/26/2021] [Indexed: 11/23/2022]
Abstract
Mental health care is shifting towards more person-centered and community-based health care. Although integrating eHealth within a transforming healthcare setting may help accomplishing the shift, research studying this is lacking. This study aims to improve our understanding of the value of eHealth within a transforming mental healthcare setting and to define the challenges and prerequisites for implementing eHealth in particular within this transforming context. In this article, we present the results of 29 interviews with clients, social network members, and professionals of an ambulatory team in transition within a Dutch mental health care institute. The main finding is that eHealth can support a transforming practice shifting towards more recovery-oriented, person-centered, and community-based service in which shared-decision making is self-evident. The main challenge revealed is how to deal with clients' voices, when professionals see the value of eHealth but clients do not want to start using eHealth. The shift towards client-centered and network-oriented care models and towards blended care models are both high-impact changes in themselves. Acknowledging the complexity of combining these high-impact changes might be the first step towards creating blended client-centered and network-oriented care. Future research should examine whether and how these substantial shifts could be mutually supportive.
Collapse
Affiliation(s)
- Karin Lorenz-Artz
- Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, 5000 LE Tilburg, The Netherlands; (J.B.); (I.B.)
- Mental Health Care Institute Eindhoven, 5626 ND Eindhoven, The Netherlands
| | - Joyce Bierbooms
- Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, 5000 LE Tilburg, The Netherlands; (J.B.); (I.B.)
- Mental Health Care Institute Eindhoven, 5626 ND Eindhoven, The Netherlands
| | - Inge Bongers
- Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, 5000 LE Tilburg, The Netherlands; (J.B.); (I.B.)
- Mental Health Care Institute Eindhoven, 5626 ND Eindhoven, The Netherlands
| |
Collapse
|
12
|
Gaebel W, Lukies R, Kerst A, Stricker J, Zielasek J, Diekmann S, Trost N, Gouzoulis-Mayfrank E, Bonroy B, Cullen K, Desie K, Ewalds Mulliez AP, Gerlinger G, Günther K, Hiemstra HJ, McDaid S, Murphy C, Sander J, Sebbane D, Roelandt JL, Thorpe L, Topolska D, Van Assche E, Van Daele T, Van den Broeck L, Versluis C, Vlijter O. Upscaling e-mental health in Europe: a six-country qualitative analysis and policy recommendations from the eMEN project. Eur Arch Psychiatry Clin Neurosci 2021; 271:1005-1016. [PMID: 32393997 DOI: 10.1007/s00406-020-01133-y] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Accepted: 04/27/2020] [Indexed: 11/30/2022]
Abstract
E-mental health (eMH) encompasses the use of digital technologies to deliver, support, or enhance mental health services. Despite the growing evidence for the effectiveness of eMH interventions, the process of implementation of eMH solutions in healthcare remains slow throughout Europe. To address this issue, the e-Mental Health Innovation and Transnational Implementation Platform North-West Europe (eMEN) project was initiated to increase the dissemination and quality of eMH services in Europe. In this project, status analyses regarding eMH in the six participating countries (i.e., Belgium, France, Germany, Ireland, The Netherlands, and the UK) were conducted and eight recommendations for eMH were developed. Expert teams from the six participating countries conducted status analyses regarding the uptake of eMH based on a narrative literature review and stakeholder interviews. Based on these status analyses, the eMEN consortium developed eight policy recommendations to further support the implementation of eMH in Europe. The status analyses showed that the participating countries are in different stages of implementing eMH into mental healthcare. Some barriers to implementing eMH were common among countries (e.g., a limited legal and regulatory framework), while others were country-specific (e.g., fragmented, federal policies). The policy recommendations included fostering awareness, creating strong political commitment, and setting reliable standards related to ethics and data security. The eMEN project has provided the initial recommendations to guide political and regulatory processes regarding eMH. Further research is needed to establish well-tailored implementation strategies and to assess the generalizability of the recommendations beyond the countries involved in the eMEN project.
Collapse
Affiliation(s)
- Wolfgang Gaebel
- Department of Psychiatry, Medical Faculty, LVR-Klinikum Düsseldorf, Heinrich-Heine-University, Bergische Landstr. 2, 40629, Düsseldorf, Germany. .,WHO Collaborating Centre for Quality Assurance and Empowerment in Mental Health, Düsseldorf, Germany. .,LVR-Institute for Healthcare Research, Cologne, Germany.
| | - R Lukies
- LVR-Institute for Healthcare Research, Cologne, Germany
| | - A Kerst
- Department of Psychiatry, Medical Faculty, LVR-Klinikum Düsseldorf, Heinrich-Heine-University, Bergische Landstr. 2, 40629, Düsseldorf, Germany.,WHO Collaborating Centre for Quality Assurance and Empowerment in Mental Health, Düsseldorf, Germany
| | - J Stricker
- Department of Psychiatry, Medical Faculty, LVR-Klinikum Düsseldorf, Heinrich-Heine-University, Bergische Landstr. 2, 40629, Düsseldorf, Germany.,WHO Collaborating Centre for Quality Assurance and Empowerment in Mental Health, Düsseldorf, Germany
| | - J Zielasek
- LVR-Institute for Healthcare Research, Cologne, Germany
| | - S Diekmann
- LVR-Institute for Healthcare Research, Cologne, Germany
| | - N Trost
- LVR-Institute for Healthcare Research, Cologne, Germany
| | | | - B Bonroy
- Thomas More University of Applied Sciences, Geel, Belgium
| | - K Cullen
- Mental Health Reform, Dublin, Ireland
| | - K Desie
- Pulso Europe, Leuven, Belgium
| | - A P Ewalds Mulliez
- WHO Collaborating Centre for Research and Training in Mental Health-EPSM Lille-Métropole, Lille, France
| | - G Gerlinger
- German Association for Psychiatry, Psychotherapy and Psychosomatics e.V. (DGPPN), Berlin, Germany
| | - K Günther
- German Association for Psychiatry, Psychotherapy and Psychosomatics e.V. (DGPPN), Berlin, Germany
| | - H J Hiemstra
- Inserm, Clinical Epidemiology and Economic Evaluation Applied to Vulnerable Populations (ECEVE), Paris Diderot University, Paris, France
| | - S McDaid
- Mental Health Reform, Dublin, Ireland
| | - C Murphy
- Mental Health Foundation, London, UK
| | - J Sander
- German Association for Psychiatry, Psychotherapy and Psychosomatics e.V. (DGPPN), Berlin, Germany
| | - D Sebbane
- WHO Collaborating Centre for Research and Training in Mental Health-EPSM Lille-Métropole, Lille, France.,Inserm, Clinical Epidemiology and Economic Evaluation Applied to Vulnerable Populations (ECEVE), Paris Diderot University, Paris, France
| | - J L Roelandt
- WHO Collaborating Centre for Research and Training in Mental Health-EPSM Lille-Métropole, Lille, France.,Inserm, Clinical Epidemiology and Economic Evaluation Applied to Vulnerable Populations (ECEVE), Paris Diderot University, Paris, France
| | - L Thorpe
- Mental Health Foundation, London, UK
| | | | - E Van Assche
- Thomas More University of Applied Sciences, Geel, Belgium
| | - T Van Daele
- Thomas More University of Applied Sciences, Geel, Belgium
| | | | | | - O Vlijter
- Stichting Arq, Diemen, The Netherlands
| |
Collapse
|
13
|
Kuso S, Nitsch M, Zeiler M, Simek M, Adamcik T, Dey M, Berger T, Krieger T, Weisel KK, Zarski AC, Ebert DD, Schaub MP, Moser CT, Botella C, Baños R, Herrero R, Etchemendy E, Nacke B, Beintner I, Vollert B, Schmidt-Hantke J, Hütter K, Jacobi C, Waldherr K. Stakeholders' views on online interventions to prevent common mental health disorders in adults implemented into existing healthcare systems in Europe. Eur J Public Health 2021; 31:i55-i63. [PMID: 34240157 PMCID: PMC8495679 DOI: 10.1093/eurpub/ckab043] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
BACKGROUND Online preventive interventions can help to reduce the incidence of mental disorders. Whereas knowledge on stakeholders' attitudes and factors relevant for successfully integrating online treatment into existing healthcare systems is available, knowledge is scarce for online prevention. METHODS Stakeholders from Germany, Switzerland, Austria and Spain were surveyed. Potential facilitators/delivery staff (e.g. psychologists, psychotherapists) completed an online questionnaire (n = 183), policy makers (i.e. from the governing sector or health insurance providers) participated in semi-structured interviews (n = 16) and target groups/potential users of mental illness prevention (n = 49) participated in ten focus groups. Thematic analysis was used to identify their experiences with and attitudes and needs regarding online programmes to prevent mental disorders. Additionally, it was examined which groups they consider underserved and which factors they consider as fostering and hindering for reach, adoption, implementation and maintenance (cf. RE-AIM model) when integrating online prevention into existing healthcare systems. RESULTS Main advantages of online mental illness prevention are perceived in low structural and psychological barriers. Lack of personal contact, security, privacy and trust concerns were discussed as disadvantages. Relevant needs are high usability and target group appropriateness, evidence for effectiveness and the use of motivational tools. CONCLUSIONS Positive attitudes among stakeholders are the key for successful integration of online mental illness prevention into existing healthcare systems. Potential facilitators/delivery staff must receive training and support to implement these programmes; the programmes must be attractive and continuously evaluated, updated and promoted to ensure ongoing reach; and existing infrastructure and contextual factors must be considered.
Collapse
Affiliation(s)
- Stefanie Kuso
- Ferdinand Porsche FernFH-Distance Learning University of Applied Sciences, Wiener Neustadt 2700, Austria
| | - Martina Nitsch
- Ferdinand Porsche FernFH-Distance Learning University of Applied Sciences, Wiener Neustadt 2700, Austria
| | - Michael Zeiler
- Department for Child and Adolescent Psychiatry, Medical University of Vienna, Vienna 1090, Austria
| | - Monika Simek
- Department for Child and Adolescent Psychiatry, Medical University of Vienna, Vienna 1090, Austria
| | - Tanja Adamcik
- Ferdinand Porsche FernFH-Distance Learning University of Applied Sciences, Wiener Neustadt 2700, Austria
| | - Michelle Dey
- Swiss Research Institute for Public Health and Addiction ISGF, Associated to the University of Zurich, Zurich, Switzerland
| | - Thomas Berger
- Department of Clinical Psychology and Psychotherapy, University of Bern, Bern, Switzerland
| | - Tobias Krieger
- Department of Clinical Psychology and Psychotherapy, University of Bern, Bern, Switzerland
| | - Kiona K Weisel
- Department of Clinical Psychology and Psychotherapy, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Anna-Carlotta Zarski
- Department of Clinical Psychology and Psychotherapy, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - David D Ebert
- Department of Clinical Psychology and Psychotherapy, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Michael P Schaub
- Swiss Research Institute for Public Health and Addiction ISGF, Associated to the University of Zurich, Zurich, Switzerland
| | - Christian T Moser
- Department of Clinical Psychology and Psychotherapy, University of Bern, Bern, Switzerland
| | - Christina Botella
- Jaume I University, Castellón, Spain.,CIBER Pathophysiology of Obesity and Nutrition (CB06/03), Carlos III Institute of Health, Madrid, Spain
| | - Rosa Baños
- CIBER Pathophysiology of Obesity and Nutrition (CB06/03), Carlos III Institute of Health, Madrid, Spain.,Department of Personality, Evaluation and Psychological Treatments, University of Valencia, Valencia, Spain
| | - Rocio Herrero
- CIBER Pathophysiology of Obesity and Nutrition (CB06/03), Carlos III Institute of Health, Madrid, Spain.,Department of Personality, Evaluation and Psychological Treatments, University of Valencia, Valencia, Spain
| | - Ernestina Etchemendy
- CIBER Pathophysiology of Obesity and Nutrition (CB06/03), Carlos III Institute of Health, Madrid, Spain.,Department of Personality, Evaluation and Psychological Treatments, University of Valencia, Valencia, Spain
| | - Barbara Nacke
- Department of Clinical Psychology and Psychotherapy, TU Dresden, Dresden, Germany
| | - Ina Beintner
- Department of Clinical Psychology and Psychotherapy, TU Dresden, Dresden, Germany
| | - Bianka Vollert
- Department of Clinical Psychology and Psychotherapy, TU Dresden, Dresden, Germany
| | | | - Kristian Hütter
- Department of Clinical Psychology and Psychotherapy, TU Dresden, Dresden, Germany
| | - Corinna Jacobi
- Department of Clinical Psychology and Psychotherapy, TU Dresden, Dresden, Germany
| | - Karin Waldherr
- Ferdinand Porsche FernFH-Distance Learning University of Applied Sciences, Wiener Neustadt 2700, Austria
| |
Collapse
|
14
|
Lal S, Siafa L, Lee H, Adair CE. Priority Given to Technology in Government-Based Mental Health and Addictions Vision and Strategy Documents: Systematic Policy Review. J Med Internet Res 2021; 23:e25547. [PMID: 33949955 PMCID: PMC8135019 DOI: 10.2196/25547] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 03/01/2021] [Accepted: 04/04/2021] [Indexed: 11/20/2022] Open
Abstract
Background The use of information and communication technologies (ICTs) to deliver mental health and addictions (MHA) services is a global priority, especially considering the urgent shift towards virtual delivery of care in response to the COVID-19 pandemic. It is important to monitor the evolving role of technology in MHA services. Given that MHA policy documents represent the highest level of priorities for a government’s vision and strategy for mental health care, one starting point is to measure the frequency with which technology is mentioned and the terms used to describe its use in MHA policy documents (before, during, and after COVID-19). Yet, to our knowledge, no such review of the extent to which ICTs are referred to in Canadian MHA policy documents exists to date. Objective The objective of this systematic policy review was to examine the extent to which technology is addressed in Canadian government–based MHA policy documents prior to the COVID-19 pandemic to establish a baseline for documenting change. Methods We reviewed 22 government-based MHA policy documents, published between 2011 and 2019 by 13 Canadian provinces and territories. We conducted content analysis to synthesize the policy priorities addressed in these documents into key themes, and then systematically searched for and tabulated the use of 39 technology-related keywords (in English and French) to describe and compare jurisdictions. Results Technology was addressed in every document, however, to a varying degree. Of the 39 searched keywords, we identified 22 categories of keywords pertaining to the use of technology to deliver MHA services and information. The 6 most common categories were tele (n=16/22), phone (n=12/22), tech (n=11/22), online (n=10/22), line (n=10/22), and web (n=10/22), with n being the number of policy documents in which the category was mentioned out of 22 documents. The use of terms referring to advanced technologies, such as virtual (n=6/22) and app (n= 4/22), were less frequent. Additionally, policy documents from some provinces and territories (eg, Alberta and Newfoundland and Labrador) mentioned a diverse range of ICTs, whereas others described only 1 form of ICT. Conclusions This review indicates that technology has been given limited strategic attention in Canadian MHA policy. Policy makers may have limited knowledge on the evidence and potential of using technology in this field, highlighting the value for knowledge translation and collaborative initiatives among policy makers and researchers. The development of a pan-Canadian framework for action addressing the integration and coordination of technology in mental health services can also guide initiatives in this field. Our findings provide a prepandemic baseline and replicable methods to monitor how the use of technology-supported services and innovations emerge relative to other priorities in MHA policy during and after the COVID-19 pandemic.
Collapse
Affiliation(s)
- Shalini Lal
- School of Rehabilitation, Faculty of Medicine, University of Montréal, Montréal, QC, Canada.,Youth Mental Health and Technology Lab, Health Innovation and Evaluation Hub, University of Montréal Hospital Research Centre, Montréal, QC, Canada.,Prevention and Early Intervention Program for Psychosis and ACCESS Open Minds, Douglas Mental Health University Institute, Montréal, QC, Canada
| | - Lyna Siafa
- Youth Mental Health and Technology Lab, Health Innovation and Evaluation Hub, University of Montréal Hospital Research Centre, Montréal, QC, Canada.,Department of Medicine, McGill University, Montréal, QC, Canada
| | - Hajin Lee
- School of Rehabilitation, Faculty of Medicine, University of Montréal, Montréal, QC, Canada.,Youth Mental Health and Technology Lab, Health Innovation and Evaluation Hub, University of Montréal Hospital Research Centre, Montréal, QC, Canada
| | - Carol E Adair
- Department of Psychiatry, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada.,Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| |
Collapse
|
15
|
Borghouts J, Eikey E, Mark G, De Leon C, Schueller SM, Schneider M, Stadnick N, Zheng K, Mukamel D, Sorkin DH. Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review. J Med Internet Res 2021; 23:e24387. [PMID: 33759801 PMCID: PMC8074985 DOI: 10.2196/24387] [Citation(s) in RCA: 287] [Impact Index Per Article: 95.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 12/24/2020] [Accepted: 02/08/2021] [Indexed: 01/14/2023] Open
Abstract
Background Digital mental health interventions (DMHIs), which deliver mental health support via technologies such as mobile apps, can increase access to mental health support, and many studies have demonstrated their effectiveness in improving symptoms. However, user engagement varies, with regard to a user’s uptake and sustained interactions with these interventions. Objective This systematic review aims to identify common barriers and facilitators that influence user engagement with DMHIs. Methods A systematic search was conducted in the SCOPUS, PubMed, PsycINFO, Web of Science, and Cochrane Library databases. Empirical studies that report qualitative and/or quantitative data were included. Results A total of 208 articles met the inclusion criteria. The included articles used a variety of methodologies, including interviews, surveys, focus groups, workshops, field studies, and analysis of user reviews. Factors extracted for coding were related to the end user, the program or content offered by the intervention, and the technology and implementation environment. Common barriers included severe mental health issues that hampered engagement, technical issues, and a lack of personalization. Common facilitators were social connectedness facilitated by the intervention, increased insight into health, and a feeling of being in control of one’s own health. Conclusions Although previous research suggests that DMHIs can be useful in supporting mental health, contextual factors are important determinants of whether users actually engage with these interventions. The factors identified in this review can provide guidance when evaluating DMHIs to help explain and understand user engagement and can inform the design and development of new digital interventions.
Collapse
Affiliation(s)
| | - Elizabeth Eikey
- University of California San Diego, San Diego, CA, United States
| | - Gloria Mark
- University of California Irvine, Irvine, CA, United States
| | | | | | | | - Nicole Stadnick
- University of California San Diego, San Diego, CA, United States
| | - Kai Zheng
- University of California Irvine, Irvine, CA, United States
| | - Dana Mukamel
- University of California Irvine, Irvine, CA, United States
| | - Dara H Sorkin
- University of California Irvine, Irvine, CA, United States
| |
Collapse
|
16
|
Ganapathy A, Clough BA, Casey LM. Organizational and Policy Barriers to the Use of Digital Mental Health by Mental Health Professionals. Telemed J E Health 2021; 27:1332-1343. [PMID: 33646057 DOI: 10.1089/tmj.2020.0455] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Background: Digital mental health (DMH) provides effective methods of overcoming issues of time constraints, accessibility, and availability of mental health care. They can provide a valuable means to deliver mental health care in the present pandemic. However, adoption of these methods has been slow. Mental health professional (MHP) concerns at the organizational and policy level that influence this slow adoption need to be examined. Materials and Methods: A narrative review was conducted to identify the barriers. Searches using the databases Scopus, Embase, and PubMed were conducted to identify research focused on barriers reported by MHPs to use DMH. Results: The search resulted in 356 unique citations, and 21 papers met the inclusion and exclusion criteria. Forward and backward sampling resulted in identifying an additional 19 relevant papers. Discussion: Unmet needs for information, training, and infrastructure, challenges to the workflow and excessive workloads, and ambiguous policies serve as barriers to DMH use. This article recommends strategies for researchers, organizations, DMH designers, and governmental institutions to ensure efficient utilization of DMH. Conclusion: Concerted efforts at individual, organizational, and governmental levels are essential to ensure efficient utilization of DMH.
Collapse
Affiliation(s)
- Aarthi Ganapathy
- School of Applied Psychology, Griffith University, Brisbane, Australia.,Menzies Health Institute, Mount Gravatt, Australia
| | - Bonnie A Clough
- School of Applied Psychology, Griffith University, Brisbane, Australia.,Menzies Health Institute, Mount Gravatt, Australia
| | - Leanne M Casey
- School of Applied Psychology, Griffith University, Brisbane, Australia.,Menzies Health Institute, Mount Gravatt, Australia
| |
Collapse
|
17
|
Fletcher S, Chondros P, Densley K, Murray E, Dowrick C, Coe A, Hegarty K, Davidson S, Wachtler C, Mihalopoulos C, Lee YY, Chatterton ML, Palmer VJ, Gunn J. Matching depression management to severity prognosis in primary care: results of the Target-D randomised controlled trial. Br J Gen Pract 2021; 71:e85-e94. [PMID: 33431380 PMCID: PMC7846356 DOI: 10.3399/bjgp.2020.0783] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Accepted: 12/11/2020] [Indexed: 10/31/2022] Open
Abstract
BACKGROUND Mental health treatment rates are increasing, but the burden of disease has not reduced. Tools to support efficient resource distribution are required. AIM To investigate whether a person-centred e-health (Target-D) platform matching depression care to symptom severity prognosis can improve depressive symptoms relative to usual care. DESIGN AND SETTING Stratified individually randomised controlled trial in 14 general practices in Melbourne, Australia, from April 2016 to February 2019. In total, 1868 participants aged 18-65 years who had current depressive symptoms; internet access; no recent change to antidepressant; no current antipsychotic medication; and no current psychological therapy were randomised (1:1) via computer-generated allocation to intervention or usual care. METHOD The intervention was an e-health platform accessed in the GP waiting room, comprising symptom feedback, priority-setting, and prognosis-matched management options (online self-help, online guided psychological therapy, or nurse-led collaborative care). Management options were flexible, neither participants nor staff were blinded, and there were no substantive protocol deviations. The primary outcome was depressive symptom severity (9-item Patient Health Questionnaire [PHQ-9]) at 3 months. RESULTS In intention to treat analysis, estimated between- arm difference in mean PHQ-9 scores at 3 months was -0.88 (95% confidence interval [CI] = -1.45 to -0.31) favouring the intervention, and -0.59 at 12 months (95% CI = -1.18 to 0.01); standardised effect sizes of -0.16 (95% CI = -0.26 to -0.05) and -0.10 (95% CI = -0.21 to 0.002), respectively. No serious adverse events were reported. CONCLUSION Matching management to prognosis using a person-centred e-health platform improves depressive symptoms at 3 months compared to usual care and could feasibly be implemented at scale. Scope exists to enhance the uptake of management options.
Collapse
Affiliation(s)
- Susan Fletcher
- Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia
| | - Patty Chondros
- Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia
| | - Konstancja Densley
- Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia
| | - Elizabeth Murray
- Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia; professor of eHealth and primary care, Research Department of Primary Care and Population Health, University College London, London, UK
| | - Christopher Dowrick
- Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia; professor of primary medical care, Department of Health Services Research, University of Liverpool, Liverpool, UK
| | - Amy Coe
- Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia
| | - Kelsey Hegarty
- Department of General Practice, Melbourne Medical School, University of Melbourne; director, Centre for Family Violence Prevention, The Royal Women's Hospital, Melbourne, Australia
| | - Sandra Davidson
- Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia
| | - Caroline Wachtler
- Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia; family medicine resident, Department of General Practice and Primary Care, Karolinska Institutet, Solna, Sweden
| | - Cathrine Mihalopoulos
- Deakin Health Economics, Institute for Health Transformation, Deakin University, Geelong, Australia
| | - Yong Yi Lee
- Deakin Health Economics, Institute for Health Transformation, Deakin University, Geelong; honorary fellow, School of Public Health, University of Queensland, Brisbane; health economist, Policy and Epidemiology Group, Queensland Centre for Mental Health Research, Brisbane, Australia
| | - Mary Lou Chatterton
- Deakin Health Economics, Institute for Health Transformation, Deakin University, Geelong, Australia
| | - Victoria J Palmer
- Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia
| | - Jane Gunn
- Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne; chair of primary care research, Department of General Practice, Melbourne Medical School, University of Melbourne, Melbourne, Australia
| |
Collapse
|
18
|
Kip H, Bouman YHA. A Perspective on the Integration of eHealth in Treatment of Offenders: Combining Technology and the Risk-Need-Responsivity Model. Front Psychiatry 2021; 12:703043. [PMID: 34539462 PMCID: PMC8440815 DOI: 10.3389/fpsyt.2021.703043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Accepted: 08/04/2021] [Indexed: 11/14/2022] Open
Abstract
While there are multiple ways in which eHealth interventions such as online modules, apps and virtual reality can improve forensic psychiatry, uptake in practice is low. To overcome this problem, better integration of eHealth in treatment is necessary. In this perspective paper, we describe how the possibilities of eHealth can be connected to the risk-need-responsivity (RNR) model. To account for the risk-principle, stand-alone eHealth interventions might be used to offer more intensive treatment to high-risk offenders. The need-principle can be addressed by connecting novel experience-based interventions such as VR and apps to stable and acute dynamic risk factors. Finally, using and combining personalized interventions is in line with the responsivity-principle. Based on research inside and outside of forensic psychiatry, we conclude that there are many possibilities for eHealth to improve treatment-not just based on RNR, but also on other models. However, there is a pressing need for more development, implementation and evaluation research.
Collapse
Affiliation(s)
- Hanneke Kip
- Department of Psychology, Health and Technology, University of Twente, Enschede, Netherlands.,Department of Research, Stichting Transfore, Deventer, Netherlands
| | | |
Collapse
|
19
|
Kip H, Wentzel J, Kelders SM. Shaping Blended Care: Adapting an Instrument to Support Therapists in Using eMental Health. JMIR Ment Health 2020; 7:e24245. [PMID: 33185559 PMCID: PMC7695535 DOI: 10.2196/24245] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/10/2020] [Revised: 10/05/2020] [Accepted: 10/05/2020] [Indexed: 01/22/2023] Open
Abstract
BACKGROUND Although eMental health interventions, especially when delivered in a blended way, have great potential to improve the quality and efficiency of mental health care, their use in practice lags behind expectations. The Fit for Blended Care (FfBC) instrument was developed to support therapists and clients in shaping blended care in a way that optimally fits their needs. However, this existing version cannot be directly applied to specific branches of mental health care as it is too broad and generic. OBJECTIVE The goal of this study is to adapt the existing FfBC instrument to fit a specific, complex setting-forensic mental health care-by means of participatory development with therapists. METHODS The participatory process was divided into 4 phases and was executed by a project team consisting of 1 manager, 3-5 therapists, and 1 researcher. In phase 1, general requirements for the adaptation of the existing instrument were discussed in 2 focus groups with the project team. In phase 2, patient-related factors that influence the use of an existing web-based intervention were elicited through semistructured interviews with all 18 therapists working at an outpatient clinic. In phase 3, multiple focus groups with the project teams were held to create the first version of the adapted FfBC instrument. In phase 4, a digital prototype of the instrument was used with 8 patients, and the experiences of the 4 therapists were discussed in a focus group. RESULTS In phase 1, it became clear that the therapists' main requirement was to develop a much shorter instrument with a few items, in which the content was specifically tailored to the characteristics of forensic psychiatric outpatients. The interviews showed a broad range of patient-related factors, of which 5 were used in the instrument: motivation for blended treatment; writing about thoughts, feelings, and behavior; conscientiousness; psychosocial problems; and social support. In addition, a part of the instrument was focused on the practical necessary preconditions that patients should fill by themselves before the treatment was developed. The use of the web-based prototype of the instrument in treatment resulted in overall positive experiences with the content; however, therapists indicated that the items should be formulated in a more patient-centered way to encourage their involvement in discussing the factors. CONCLUSIONS The participatory, iterative process of this study resulted in an adapted version of the FfBC instrument that fits the specific forensic context and supports shared decision making. In general, the adaptiveness of the instrument is important: its content and implementation should fit the type of care, the organization, and eHealth intervention. To adapt the instrument to other contexts, the guidelines described in this paper can be followed.
Collapse
Affiliation(s)
- Hanneke Kip
- Centre for eHealth and Wellbeing Research, Department of Psychology, Health & Technology, University of Twente, Enschede, Netherlands.,Department of Research, Transfore, Deventer, Netherlands
| | - Jobke Wentzel
- Centre for eHealth and Wellbeing Research, Department of Psychology, Health & Technology, University of Twente, Enschede, Netherlands.,Research Group IT Innovations in Health Care, Windesheim University of Applied Sciences, Zwolle, Netherlands
| | - Saskia M Kelders
- Centre for eHealth and Wellbeing Research, Department of Psychology, Health & Technology, University of Twente, Enschede, Netherlands.,Optentia Research Focus Area, North-West University, Vanderbijlpark, South Africa
| |
Collapse
|
20
|
Brantnell A, Woodford J, Baraldi E, van Achterberg T, von Essen L. Views of Implementers and Nonimplementers of Internet-Administered Cognitive Behavioral Therapy for Depression and Anxiety: Survey of Primary Care Decision Makers in Sweden. J Med Internet Res 2020; 22:e18033. [PMID: 32784186 PMCID: PMC7450364 DOI: 10.2196/18033] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2020] [Revised: 05/11/2020] [Accepted: 05/13/2020] [Indexed: 12/19/2022] Open
Abstract
BACKGROUND Internet-administered cognitive behavioral therapy (ICBT) has been demonstrated to be an effective intervention for adults with depression and/or anxiety and is recommended in national guidelines for provision within Swedish primary care. However, the number and type of organizations that have implemented ICBT within primary care in Sweden is currently unclear. Further, there is a lack of knowledge concerning barriers and facilitators to ICBT implementation. OBJECTIVE The two primary objectives were to identify and describe primary care organizations providing ICBT in Sweden and compare decision makers' (ie, directors of primary care organizations) views on barriers and facilitators to implementation of ICBT among ICBT implementers (ie, organizations that offered ICBT) and nonimplementers (ie, organizations that did not offer ICBT). METHODS An online survey based on a checklist for identifying barriers and facilitators to implementation was developed and made accessible to decision makers from all primary care organizations in Sweden. The survey consisted of background questions (eg, provision of ICBT and number of persons working with ICBT) and barriers and facilitators relating to the following categories: users, therapists, ICBT programs, organizations, and wider society. RESULTS The participation rate was 35.75% (404/1130). The majority (250/404, 61.8%) of participants were health care center directors and had backgrounds in nursing. Altogether, 89.8% (363/404) of the participating organizations provided CBT. A minority (83/404, 20.5%) of organizations offered ICBT. Most professionals delivering ICBT were psychologists (67/83, 80%) and social workers (31/83, 37%). The majority (61/83, 73%) of organizations had 1 to 2 persons delivering ICBT interventions. The number of patients treated with ICBT during the last 12 months was 1 to 10 in 65% (54/83) of the organizations, ranging between 1 and 400 treated patients across the whole sample. There were 9 significant (P<.05) differences out of 37 possible between implementers and nonimplementers. For example, more implementers (48/51, 94%) than nonimplementers (107/139, 76.9%) perceived few technical problems (P<.001), and more implementers (53/77, 68%) than nonimplementers (103/215, 47.9%) considered that their organization has resources to offer ICBT programs (P<.001). CONCLUSIONS Despite research demonstrating the effectiveness of ICBT for depression and anxiety and national guidelines recommending its use, ICBT is implemented in few primary care organizations in Sweden. Several interesting differences between implementers and nonimplementers were identified, which may help inform interventions focusing on facilitating the implementation of ICBT.
Collapse
Affiliation(s)
- Anders Brantnell
- Clinical Psychology in Healthcare, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden.,Division of Industrial Engineering and Management, Department of Civil and Industrial Engineering, Uppsala University, Uppsala, Sweden
| | - Joanne Woodford
- Clinical Psychology in Healthcare, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| | - Enrico Baraldi
- Division of Industrial Engineering and Management, Department of Civil and Industrial Engineering, Uppsala University, Uppsala, Sweden
| | - Theo van Achterberg
- KU Leuven, Department of Public Health and Primary Care, Academic Centre for Nursing and Midwifery, Leuven, Belgium
| | - Louise von Essen
- Clinical Psychology in Healthcare, Department of Women's and Children's Health, Uppsala University, Uppsala, Sweden
| |
Collapse
|
21
|
Apolinário-Hagen J, Hennemann S, Kück C, Wodner A, Geibel D, Riebschläger M, Zeißler M, Breil B. Exploring User-Related Drivers of the Early Acceptance of Certified Digital Stress Prevention Programs in Germany. Health Serv Insights 2020; 13:1178632920911061. [PMID: 32206013 PMCID: PMC7074489 DOI: 10.1177/1178632920911061] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2020] [Accepted: 02/14/2020] [Indexed: 12/29/2022] Open
Abstract
Electronic mental health services represent innovative instruments to increase the dissemination of stress programs in primary prevention. However, little is known about facilitators of their uptake. This study aimed to explore determinants of the acceptance of centrally certified digital stress coping programs and preferences for service delivery modes among adult members of German statutory health insurances. Participants completed a multi-construct 45-item questionnaire covering acceptance of digital stress prevention (behavioral use intention) and potential predictors we assessed using hierarchical regression analysis-(1) socio-demographic variables and time spent online, (2) openness to experience, (3) perceived stress, and (4) attitudes toward e-mental health. Preferences in terms of the willingness to use online, face-to-face and blended programs were analyzed using paired t-tests. Participants (N = 171, 66% female, 18-69 years) reported a moderate acceptance of digital stress management (M = 2.76, SD = 1.16, range: 1-5). We identified younger age (ß = -0.16, P = .009), openness to experience (ß = 0.17, P = .003), and positive attitudes (ß = 0.61, P < .001) as predictors of acceptance (R 2 = .50, P < .001). Face-to-face was preferred over online (d = 0.40) and blended (d = 0.33), and blended over stand-alone online delivery mode (d = 0.19; all P < .001). Our findings indicate that promoting favorable attitudes toward digital stress prevention through tailored information may be a starting point to facilitate their adoption.
Collapse
Affiliation(s)
- Jennifer Apolinário-Hagen
- Institute of Occupational, Social and Environmental Medicine, Centre for Health and Society, Faculty of Medicine, University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Severin Hennemann
- Department of Clinical Psychology, Psychotherapy and Experimental Psychopathology, Institute of Psychology, University of Mainz, Mainz, Germany
| | - Christina Kück
- Faculty of Psychology, University of Hagen, Hagen, Germany
| | | | - Dorota Geibel
- Faculty of Psychology, University of Hagen, Hagen, Germany
| | | | - Martin Zeißler
- Faculty of Psychology, University of Hagen, Hagen, Germany
| | - Bernhard Breil
- Faculty of Health Care, Hochschule Niederrhein, University of Applied Sciences, Krefeld, Germany
| |
Collapse
|
22
|
Pywell J, Vijaykumar S, Dodd A, Coventry L. Barriers to older adults' uptake of mobile-based mental health interventions. Digit Health 2020; 6:2055207620905422. [PMID: 32110429 PMCID: PMC7016304 DOI: 10.1177/2055207620905422] [Citation(s) in RCA: 43] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Accepted: 01/14/2020] [Indexed: 11/29/2022] Open
Abstract
Background To address increasing demand of mental healthcare treatments for older adults and the need to reduce delivery costs, healthcare providers are turning to mobile applications. The importance of psychological barriers have been highlighted in the uptake of mobile-based mental health interventions and efforts have been made to identify these barriers in order to facilitate initial uptake and acceptance. However, limited research has focused on older adults’ awareness of these applications and factors that might be hindering their use. Objective The purpose of this study was to explore the perceived barriers that older adults experience in the uptake of mobile-based mental health interventions. Methods Semi-structured interviews were conducted with a sample of 10 older adults, 50 years or older (female = 7, mean age = 68 years), who experienced periods of low mood. National Health Service applications were demonstrated to facilitate conversation and explore participants’ understanding of mental health and mobile-based mental health interventions. Thematic analysis was used to analyse the interview transcripts. Results The social ecological model was adopted as an organising framework for the thematic analysis which identified six distinct barriers to older adults’ uptake of mobile-based mental health interventions: mental electronic-health (e-health) awareness, interaction with technology, discontinuation, ‘seeing’ facilitates therapeutic alliance, incongruent role of the general practitioner and privacy and confidentiality. Conclusions Older adults experience a number of barriers to uptake ranging from the individual level to a macro, organisational level. The practical implications of these barriers are discussed such as the need for increased awareness of mobile-based mental health interventions among older adults.
Collapse
Affiliation(s)
- Jake Pywell
- Jake Pywell, PaCT Lab, Northumberland Building, Northumbria University, Newcastle upon Tyne, NE1 8ST, UK.
| | | | | | | |
Collapse
|
23
|
Abstract
The increasing need for mental health services in the population is posing significant challenges for the health system. It is therefore important to identify new approaches to delivering care that are sustainable and scalable in terms of reach and impact. E-mental health is one approach that shows promise in addressing the treatment gap in mental healthcare. E-mental health involves leveraging the Internet and related technologies such as smartphone apps, web sites, and social media to deliver mental health services. Over the past decade, this field has made significant advancements in Canada and internationally. In this article, the author introduces the e-mental health field and provides an overview of promising Canadian developments in relation to policy, research, and practice. In addition, the article discusses some of the challenges facing the wide-scale implementation of e-mental health and identifies priority areas of focus for health leaders to advance the field.
Collapse
Affiliation(s)
- Shalini Lal
- 1 University of Montreal, Montreal, Canada.,2 University of Montreal Hospital Research Center (CRCHUM), Montreal, Canada.,3 Douglas Mental Health University Institute, Montreal, Canada
| |
Collapse
|
24
|
Digital depression screening in HIV primary care in South Africa: mood in retroviral + application monitoring [MIR + IAM]. Glob Ment Health (Camb) 2019; 6:e2. [PMID: 30854218 PMCID: PMC6401371 DOI: 10.1017/gmh.2018.35] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2018] [Revised: 10/26/2018] [Accepted: 11/22/2018] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND Integrating mental health care into HIV services is critical to addressing the high unmet treatment needs for people living with HIV and comorbid major depressive disorder. Introducing routine mental health screening at the primary health care level is a much needed diagonal approach to enhancing HIV care. In low-resource settings with a shortage of mental health care providers, eMental Health may provide a novel opportunity to attenuate this treatment gap and strengthen the health system. OBJECTIVE To conduct formative health systems research on the implementation of routine depression screening using a digital tool - Mood in Retroviral Positive Individuals Application Monitoring (MIR + IAM) - in an HIV primary care setting in South Africa. METHODS A Theory of Change (ToC) approach was utilised through individual and group session interviews to design an intervention that is embedded in the local context. Ten experts and local stakeholders were selected from the UK and South Africa. Data were analysed thematically using Atlas.ti to identify interventions, assumptions, barriers and facilitators of implementation. FINDINGS The participants considered digital depression screening in HIV care services relevant for the improvement of mental health in this population. The six main themes identified from the ToC process were: (1) user experience including acceptability by patients, issues of patient privacy and digital literacy, and the need for a patient-centred tool; (2) benefits of the digital tool for data collection and health promotion; (3) availability of treatment after diagnosis; (4) human and physical resource capacity of primary health care; (5) training for lay health care workers; and (6) demonstration of the intervention's usefulness to generate interest from decision-makers. CONCLUSION Digital depression screening coupled with routine mental health data collection and analysis in HIV care is an applicable service that could improve the mental and physical health outcomes of this population. Careful consideration of the local health system capacity, including both workers and patients, is required. Future research to refine this intervention should focus on service users, government stakeholders and funders.
Collapse
|
25
|
Hidalgo-Mazzei D, Reinares M, Mateu A, Nikolova VL, Bonnín CDM, Samalin L, García-Estela A, Pérez-Solá V, Young AH, Strejilevich S, Vieta E, Colom F. OpenSIMPLe: A real-world implementation feasibility study of a smartphone-based psychoeducation programme for bipolar disorder. J Affect Disord 2018; 241:436-445. [PMID: 30145515 DOI: 10.1016/j.jad.2018.08.048] [Citation(s) in RCA: 66] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/20/2018] [Revised: 07/19/2018] [Accepted: 08/12/2018] [Indexed: 10/28/2022]
Abstract
BACKGROUND Few evidence-based mental health apps are widely available to patients and, conversely, many of the available apps have not been appropriately evaluated. Given that the ultimate goal is to scale-up and open internet-based platforms (IBP), it is crucial to appropriately evaluate their real-world feasibility beforehand. We aimed to evaluate the implementation feasibility of a smartphone-based psychoeducational programme for bipolar disorder, exploring its long-term retention, usability, perceived helpfulness and satisfaction, alongside its impact on secondary health outcomes. METHODS Participants were recruited via the project website after completing an online screening questionnaire. They were requested to complete web-based questionnaires before using the app and after 6 months of use which included sociodemographic, illness and treatment variables, the world health organisation-five well-being index (WHO-5) and the short form health survey (SF-36). The follow-up questionnaires also contained satisfaction and usefulness questions. RESULTS 201 participants took part in the study. According to their retention, 66.2% of the participants were classified as noncompleters and 33.8% as completers. The only predictor significantly associated with higher odds of retention was older age (OR = 1.021, p < 0.001). 62% of the users reported they were satisfied with the programme with a higher percentage among completers. Who-5 baseline and follow-up scores showed a significant improvement as well as 6 out of 8 domains of the SF-36. LIMITATIONS Screening and outcome measures were administered using exclusively self-reported online methods. CONCLUSION The 6-month attrition rate of the programme was high. Positive outcomes regarding satisfaction were found predominantly among completers. The optimal dosage and retention of IBP mental health programmes remain challenging issues that need further research.
Collapse
Affiliation(s)
- Diego Hidalgo-Mazzei
- Centre for Affective Disorders, Department of Psychological Medicine, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom; Bipolar Disorder Unit, Institute of Neuroscience, Hospital Clinic, University of Barcelona, IDIBAPS, CIBERSAM, Barcelona, Catalonia, Spain
| | - María Reinares
- Bipolar Disorder Unit, Institute of Neuroscience, Hospital Clinic, University of Barcelona, IDIBAPS, CIBERSAM, Barcelona, Catalonia, Spain
| | - Ainoa Mateu
- Centre for Psychiatry, Division of Brain Sciences, Department of Medicine, Imperial College London, London, United Kingdom
| | - Viktoriya L Nikolova
- Centre for Affective Disorders, Department of Psychological Medicine, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom
| | - Caterina Del Mar Bonnín
- Bipolar Disorder Unit, Institute of Neuroscience, Hospital Clinic, University of Barcelona, IDIBAPS, CIBERSAM, Barcelona, Catalonia, Spain
| | - Ludovic Samalin
- Department of Psychiatry, CHU Clermont-Ferrand, University of Auvergne, EA 7280, Clermont-Ferrand, France
| | - Aitana García-Estela
- Mental Health Group, IMIM (Institut Hospital del Mar d'Investigacions Mèdiques)-Hospital del Mar,CIBERSAM, Barcelona, Catalonia, Spain
| | - Víctor Pérez-Solá
- Mental Health Group, IMIM (Institut Hospital del Mar d'Investigacions Mèdiques)-Hospital del Mar,CIBERSAM, Barcelona, Catalonia, Spain
| | - Allan H Young
- Centre for Affective Disorders, Department of Psychological Medicine, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom
| | - Sergio Strejilevich
- Bipolar Disorder Programme, Neurosciences Institute, Favaloro University, Buenos Aires, Argentina
| | - Eduard Vieta
- Bipolar Disorder Unit, Institute of Neuroscience, Hospital Clinic, University of Barcelona, IDIBAPS, CIBERSAM, Barcelona, Catalonia, Spain.
| | - Francesc Colom
- Mental Health Group, IMIM (Institut Hospital del Mar d'Investigacions Mèdiques)-Hospital del Mar,CIBERSAM, Barcelona, Catalonia, Spain
| |
Collapse
|
26
|
Clinical Nurse Specialists' Perceptions of a Mental Health Patient Portal. CLIN NURSE SPEC 2018; 32:313-322. [PMID: 30299334 DOI: 10.1097/nur.0000000000000406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
PURPOSE The purposes of this study were to explore clinical nurse specialists' views of the potential influence of a mental health portal on nursing practice and to identify portal implementation strategies. METHODS A qualitative descriptive approach was used. Semistructured interviews were conducted with 5 clinical nurse specialists. Two independent coders conducted an inductive content analysis of the transcribed interviews to generate codes describing patterns in the data to identify originating themes. RESULTS The content analysis uncovered the following 4 themes: (1) implementation strategies, (2) nurse likelihood to recommend, (3) impact on nursing practice, and (4) perceived influence on patients. CONCLUSION Direct care nurses may benefit from education and coaching on how to document in the record using patient-centered language that is understandable to patients who may be reading it. In addition, the use of patient portals should be designed to fit into nurses' existing clinical workflows. Finally, more research is needed to identify the benefits and unintended consequences of patient portals within a mental health context.
Collapse
|
27
|
Abstract
PURPOSE OF REVIEW The purpose of this update is to provide an overview of the breadth of research studies published from April 2017 to April 2018 on mobile-based interventions for mental health, with a special emphasis on smartphone-based interventions. RECENT FINDINGS Several studies during the review period have described the process of applying user-centred design in the development of mental health apps and novel approaches to enhance user-engagement. Studies on consumer perspectives indicate largely positive findings about open-ness to utilize mental health apps. There is a scarcity of similar studies on health providers. Efficacy studies have provided evidence for apps for a variety of psychiatric disorders. There are fewer studies on preventive and promotive interventions. Although a plethora of mental health apps is available for public, most have not undergone scientific evaluation. Many well researched apps are not accessible to public. The potential of smartphone technology in enhancing healthcare service delivery in low-resource settings has also been examined in a few studies. SUMMARY Evidence for acceptability, feasibility and efficacy of mobile-based mental health interventions for facilitating recovery is on the rise. More research is needed on implementation and integration of these interventions in diverse real-world clinical and community contexts.
Collapse
|
28
|
Hill C, Creswell C, Vigerland S, Nauta MH, March S, Donovan C, Wolters L, Spence SH, Martin JL, Wozney L, McLellan L, Kreuze L, Gould K, Jolstedt M, Nord M, Hudson JL, Utens E, Ruwaard J, Albers C, Khanna M, Albano AM, Serlachius E, Hrastinski S, Kendall PC. Navigating the development and dissemination of internet cognitive behavioral therapy (iCBT) for anxiety disorders in children and young people: A consensus statement with recommendations from the #iCBTLorentz Workshop Group. Internet Interv 2018; 12:1-10. [PMID: 30135763 PMCID: PMC6096322 DOI: 10.1016/j.invent.2018.02.002] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/21/2017] [Revised: 02/13/2018] [Accepted: 02/14/2018] [Indexed: 12/21/2022] Open
Abstract
Initial internet-based cognitive behavioral therapy (iCBT) programs for anxiety disorders in children and young people (CYP) have been developed and evaluated, however these have not yet been widely adopted in routine practice. The lack of guidance and formalized approaches to the development and dissemination of iCBT has arguably contributed to the difficulty in developing iCBT that is scalable and sustainable beyond academic evaluation and that can ultimately be adopted by healthcare providers. This paper presents a consensus statement and recommendations from a workshop of international experts in CYP anxiety and iCBT (#iCBTLorentz Workshop Group) on the development, evaluation, engagement and dissemination of iCBT for anxiety in CYP.
Collapse
Affiliation(s)
- Claire Hill
- School of Psychology & Clinical Language Sciences, University of Reading, UK
| | - Cathy Creswell
- School of Psychology & Clinical Language Sciences, University of Reading, UK
| | - Sarah Vigerland
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, Sweden
- Stockholm Health Care Services, Stockholm County Council, Sweden
| | - Maaike H. Nauta
- Clinical Psychology and Experimental Psychopathology, University of Groningen, The Netherlands
| | - Sonja March
- School of Psychology and Counselling & Institute for Resilient Regions, University of Southern Queensland, Australia
| | | | - Lidewij Wolters
- Norwegian University of Science and Technology (NTNU), Faculty of Medicine, Regional Centre for Child and Youth Mental Health and Child Welfare (RKBU Central Norway), Trondheim, Norway
- Academic Center for Child and Adolescent Psychiatry, de Bascule, Amsterdam, The Netherlands
| | - Susan H. Spence
- Australian Institute of Suicide Research and Prevention and School of Applied Psychology, Griffith University, Australia
| | - Jennifer L. Martin
- NIHR MindTech Cooperative, Faculty of Medicine & Health Sciences, University of Nottingham, UK
| | - Lori Wozney
- Centre for Research in Family Health, IWK Health Centre, Halifax, Canada
| | - Lauren McLellan
- Centre for Emotional Health, Department of Psychology, Macquarie University, Australia
| | - Leonie Kreuze
- Clinical Psychology and Experimental Psychopathology, University of Groningen, The Netherlands
| | - Karen Gould
- Centre for Emotional Health, Department of Psychology, Macquarie University, Australia
| | - Maral Jolstedt
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, Sweden
- Stockholm Health Care Services, Stockholm County Council, Sweden
| | - Martina Nord
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, Sweden
- Stockholm Health Care Services, Stockholm County Council, Sweden
| | - Jennifer L. Hudson
- Centre for Emotional Health, Department of Psychology, Macquarie University, Australia
| | - Elisabeth Utens
- Academic Center for Child and Adolescent Psychiatry, de Bascule, Amsterdam, The Netherlands
- Department of Child and Adolescent Psychiatry/Psychology, Erasmus University Medical Center, Rotterdam, The Netherlands
- Research Institute of Child Development and Education, University of Amsterdam, The Netherlands
| | - Jeroen Ruwaard
- Department of Clinical Psychology, VU University, Amsterdam, The Netherlands
| | - Casper Albers
- Department of Psychometrics & Statistics, University of Groningen, The Netherlands
| | - Muniya Khanna
- OCD & Anxiety Institute, Plymouth Meeting, PA, USA
- Children's Hospital of Philadelphia, Philadelphia, PA, USA
| | | | - Eva Serlachius
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, Sweden
- Stockholm Health Care Services, Stockholm County Council, Sweden
| | | | - Philip C. Kendall
- Child & Adolescent Anxiety Disorders Clinic, Temple University, Philadelphia, PA, USA
| |
Collapse
|
29
|
Vis C, Mol M, Kleiboer A, Bührmann L, Finch T, Smit J, Riper H. Improving Implementation of eMental Health for Mood Disorders in Routine Practice: Systematic Review of Barriers and Facilitating Factors. JMIR Ment Health 2018; 5:e20. [PMID: 29549072 PMCID: PMC5878369 DOI: 10.2196/mental.9769] [Citation(s) in RCA: 109] [Impact Index Per Article: 18.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/04/2018] [Revised: 02/07/2018] [Accepted: 02/08/2018] [Indexed: 01/18/2023] Open
Abstract
BACKGROUND Electronic mental health interventions (eMental health or eMH) can be used to increase accessibility of mental health services for mood disorders, with indications of comparable clinical outcomes as face-to-face psychotherapy. However, the actual use of eMH in routine mental health care lags behind expectations. Identifying the factors that might promote or inhibit implementation of eMH in routine care may help to overcome this gap between effectiveness studies and routine care. OBJECTIVE This paper reports the results of a systematic review of the scientific literature identifying those determinants of practices relevant to implementing eMH for mood disorders in routine practice. METHODS A broad search strategy was developed with high sensitivity to four key terms: implementation, mental health care practice, mood disorder, and eMH. The reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework was applied to guide the review and structure the results. Thematic analysis was applied to identify the most important determinants that facilitate or hinder implementation of eMH in routine practice. RESULTS A total of 13,147 articles were screened, of which 48 studies were included in the review. Most studies addressed aspects of the reach (n=33) of eMH, followed by intervention adoption (n=19), implementation of eMH (n=6), and maintenance (n=4) of eMH in routine care. More than half of the studies investigated the provision of mental health services through videoconferencing technologies (n=26), followed by Internet-based interventions (n=20). The majority (n=44) of the studies were of a descriptive nature. Across all RE-AIM domains, we identified 37 determinants clustered in six main themes: acceptance, appropriateness, engagement, resources, work processes, and leadership. The determinants of practices are expressed at different levels, including patients, mental health staff, organizations, and health care system level. Depending on the context, these determinants hinder or facilitate successful implementation of eMH. CONCLUSIONS Of the 37 determinants, three were reported most frequently: (1) the acceptance of eMH concerning expectations and preferences of patients and professionals about receiving and providing eMH in routine care, (2) the appropriateness of eMH in addressing patients' mental health disorders, and (3) the availability, reliability, and interoperability with other existing technologies such as the electronic health records are important factors for mental health care professionals to remain engaged in providing eMH to their patients in routine care. On the basis of the taxonomy of determinants of practices developed in this review, implementation-enhancing interventions can be designed and applied to achieve better implementation outcomes. Suggestions for future research and implementation practice are provided.
Collapse
Affiliation(s)
- Christiaan Vis
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Department of Mental Health, Amsterdam Public Health Research Institute, Vrije Universiteit Medical Center / Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Mayke Mol
- Department of Mental Health, Amsterdam Public Health Research Institute, Vrije Universiteit Medical Center / Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Department of Research and Innovation, Specialized Mental Health Care, GGZ InGeest, Amsterdam, Netherlands
| | - Annet Kleiboer
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Department of Mental Health, Amsterdam Public Health Research Institute, Vrije Universiteit Medical Center / Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Leah Bührmann
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Department of Mental Health, Amsterdam Public Health Research Institute, Vrije Universiteit Medical Center / Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Tracy Finch
- Healthcare & Implementation Science, Department of Nursing, Midwifery & Health, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Jan Smit
- Department of Mental Health, Amsterdam Public Health Research Institute, Vrije Universiteit Medical Center / Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Department of Research and Innovation, Specialized Mental Health Care, GGZ InGeest, Amsterdam, Netherlands
| | - Heleen Riper
- Department of Clinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Department of Mental Health, Amsterdam Public Health Research Institute, Vrije Universiteit Medical Center / Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Department of Research and Innovation, Specialized Mental Health Care, GGZ InGeest, Amsterdam, Netherlands.,Telepsychiatric Unit, Faculty of Health Science, University Hospital / University of Southern Denmark, Odense, Denmark
| |
Collapse
|