1
|
Taher R, Hall CL, Bergin ADG, Gupta N, Heaysman C, Jacobsen P, Kabir T, Kalnad N, Keppens J, Hsu CW, McGuire P, Peters E, Shergill S, Stahl D, Stock BW, Yiend J. Developing a process for assessing the safety of a digital mental health intervention and gaining regulatory approval: a case study and academic's guide. Trials 2024; 25:604. [PMID: 39252100 PMCID: PMC11385814 DOI: 10.1186/s13063-024-08421-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Accepted: 08/21/2024] [Indexed: 09/11/2024] Open
Abstract
BACKGROUND The field of digital mental health has followed an exponential growth trajectory in recent years. While the evidence base has increased significantly, its adoption within health and care services has been slowed by several challenges, including a lack of knowledge from researchers regarding how to navigate the pathway for mandatory regulatory approval. This paper details the steps that a team must take to achieve the required approvals to carry out a research study using a novel digital mental health intervention. We used a randomised controlled trial of a digital mental health intervention called STOP (Successful Treatment of Paranoia) as a worked example. METHODS The methods section explains the two main objectives that are required to achieve regulatory approval (MHRA Notification of No Objection) and the detailed steps involved within each, as carried out for the STOP trial. First, the existing safety of digital mental health interventions must be demonstrated. This can refer to literature reviews, any feasibility/pilot safety data, and requires a risk management plan. Second, a detailed plan to further evaluate the safety of the digital mental health intervention is needed. As part of this we describe the STOP study's development of a framework for categorising adverse events and based on this framework, a tool to collect adverse event data. RESULTS We present literature review results, safety-related feasibility study findings and the full risk management plan for STOP, which addressed 26 possible hazards, and included the 6-point scales developed to quantify the probability and severity of typical risks involved when a psychiatric population receives a digital intervention without the direct support of a therapist. We also present an Adverse Event Category Framework for Digital Therapeutic Devices and the Adverse Events Checklist-which assesses 15 different categories of adverse events-that was constructed from this and used in the STOP trial. CONCLUSIONS The example shared in this paper serves as a guide for academics and professionals working in the field of digital mental health. It provides insights into the safety assessment requirements of regulatory bodies when a clinical investigation of a digital mental health intervention is proposed. Methods, scales and tools that could easily be adapted for use in other similar research are presented, with the expectation that these will assist other researchers in the field seeking regulatory approval for digital mental health products.
Collapse
Affiliation(s)
- Rayan Taher
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Charlotte L Hall
- Institute of Mental Health, School of Medicine, National Institute for Health and Care Research MindTech MedTech Co-Operative, University of Nottingham, Nottingham, UK
| | - Aislinn D Gomez Bergin
- Institute of Mental Health, School of Medicine, National Institute for Health and Care Research MindTech MedTech Co-Operative, University of Nottingham, Nottingham, UK
- School of Computer Science, University of Nottingham, Nottingham, UK
| | | | - Clare Heaysman
- London Institute for Healthcare Engineering, King's College London, London, UK
| | - Pamela Jacobsen
- Department of Psychology, Addiction and Mental Health Group, Bath Centre for Mindfulness and Compassion, University of Bath, Bath, UK
| | | | | | - Jeroen Keppens
- Department of Informatics, King's College London, London, UK
| | - Che-Wei Hsu
- Department of Psychological Medicine, Dunedin School of Medicine, University of Otago, Otago, New Zealand
| | - Philip McGuire
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - Emmanuelle Peters
- Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | | | - Daniel Stahl
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | | | - Jenny Yiend
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK.
| |
Collapse
|
2
|
Thelwell ELR, Dunkerley L, Goodwin R, Giacco D. Effectiveness of online social networking interventions on social isolation and quality of life of people with psychosis: A systematic review. Psychiatry Res 2024; 339:116088. [PMID: 39032357 DOI: 10.1016/j.psychres.2024.116088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Revised: 05/10/2024] [Accepted: 07/14/2024] [Indexed: 07/23/2024]
Abstract
BACKGROUND Social isolation is frequent in people with psychosis, contributing to negative health outcomes. Interventions including online social networking (OSN) may overcome some psychosis-related barriers and facilitate social interactions. However, evidence is currently sparse and needs to be collated in a systematic review to better understand effectiveness. METHOD Following PRISMA guidelines, this review yielded 9835 results. Eleven publications, reporting data from five RCTs and six non-controlled studies, met the inclusion criteria. Two independent reviewers undertook data extraction and quality assessment, with results narratively synthesised. RESULTS This review looked broadly at interventions including either purpose-build platforms for peer-to-peer interactions or existing OSN tools. Yet, we only identified interventions utilising purpose-designed platforms. Early small-scale studies suggested OSN interventions reduced social isolation, but larger effectiveness studies did not confirm these effects. No improvements in quality-of-life outcomes were identified. CONCLUSION Higher quality and longer-term studies did not support effectiveness of current OSN interventions in reducing social isolation or improving quality of life of people with psychosis. These interventions used purpose-built platforms and encouraged OSN between selected individuals, which may explain these outcomes. Future research may explore promoting safe use of mainstream OSN platforms to expand the social networks of individuals with psychosis.
Collapse
Affiliation(s)
| | - Laura Dunkerley
- Warwick Medical School, the University of Warwick, Coventry, England; Coventry and Warwickshire Partnership NHS Trust, England
| | - Robin Goodwin
- Department of Psychology, University of Warwick, Coventry, England
| | - Domenico Giacco
- Warwick Medical School, the University of Warwick, Coventry, England; Coventry and Warwickshire Partnership NHS Trust, England
| |
Collapse
|
3
|
Despoti A, Megari K, Tsiakiri A, Toumaian M, Koutzmpi V, Liozidou A, Tsapanou A. Effectiveness of remote neuropsychological interventions: A systematic review. APPLIED NEUROPSYCHOLOGY. ADULT 2024:1-9. [PMID: 39067003 DOI: 10.1080/23279095.2024.2382814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/30/2024]
Abstract
OBJECTIVE Remote healthcare services is an upgrowing dynamic field that has been used to reduce potential disease spread and prevent overloading of the healthcare system during COVID-19 pandemic. The need for online interventions during the pandemic required immediate response with sometimes inadequate preparation. The aim of the present study is to investigate the effectiveness of remote healthcare services in the field of neuropsychological interventions. METHODS A systematic literature search was conducted in the electronic databases of PubMed, PsychINFO and Google Scholar. The main search terms were "remote neuropsychological intervention or training." The included articles were RCT studies published in English, examining the effectiveness of remote healthcare services in neuropsychological interventions for adults with neurological disease diagnoses. Studies involving psychiatric disorders were excluded. Two reviewers assessed the quality of the studies and risk of bias using the PEDro Scale. RESULTS A total of 10 studies with 2.221 participants were included. All studies concluded that remote healthcare intervention programs can be feasible, safe and effective in the rehabilitation process of neurological diseases. DISCUSSION The present review demonstrated that the domains of neuropsychology have opportunities to forge ahead beyond traditional settings and have the ability to adapt to constantly changing environmental conditions with a view to providing patient care. Health policy plans should therefore be reformulated to include these needs in accordance with the social and cultural context of implementation.
Collapse
Affiliation(s)
- Akyllina Despoti
- Clinical Ergospirometry, Exercise and Rehabilitation Laboratory, 1st Critical Care Department, Evangelismos Hospital, School of Medicine, National & Kapodistrian University of Athens, Athens, Greece
- Hellenic Neuropsychological Society, Athens, Greece
| | - Kalliopi Megari
- Hellenic Neuropsychological Society, Athens, Greece
- CITY College, University of York Europe Campus, Thessaloniki, Greece
| | - Anna Tsiakiri
- Hellenic Neuropsychological Society, Athens, Greece
- Department of Neurology, Medical School, Democritus University of Thrace, Alexandroupoli, Greece
| | - Maida Toumaian
- Hellenic Neuropsychological Society, Athens, Greece
- Laboratory of Cognitive Neuroscience and Sensorimotor Control, University Mental Health, Neurosciences and Precision Medicine Research Institute "Costas Stefanis,"Athens, Greece
| | - Vasiliki Koutzmpi
- Hellenic Neuropsychological Society, Athens, Greece
- Athens Alzheimer's Association, Athens, Greece
| | - Athanasia Liozidou
- Hellenic Neuropsychological Society, Athens, Greece
- Laboratory of Cognitive Neuroscience and Clinical Neuropsychology, Psychology Department, Scientific College of Greece
- Laboratory of Clinical Neuropsychology, Eginiteion Hospital, Neurology Department, Medical School of Athens, National and Kapodistrian University of Athens, Athens, Greece
| | - Angeliki Tsapanou
- Hellenic Neuropsychological Society, Athens, Greece
- Athens Alzheimer's Association, Athens, Greece
- Cognitive Neuroscience Division, Columbia University Irving Medical Center, New York, NY, USA
| |
Collapse
|
4
|
Fisher M, Etter K, Murray A, Ghiasi N, LaCross K, Ramsay I, Currie A, Fitzpatrick K, Biagianti B, Schlosser D, Loewy R, Vinogradov S. The Effects of Remote Cognitive Training Combined With a Mobile App Intervention on Psychosis: Double-Blind Randomized Controlled Trial. J Med Internet Res 2023; 25:e48634. [PMID: 37955951 PMCID: PMC10682932 DOI: 10.2196/48634] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 09/14/2023] [Accepted: 09/26/2023] [Indexed: 11/14/2023] Open
Abstract
BACKGROUND Impairments in cognition and motivation are core features of psychosis and strong predictors of social and occupational functioning. Accumulating evidence indicates that cognitive deficits in psychosis can be improved by computer-based cognitive training programs; however, barriers include access and adherence to cognitive training exercises. Limited evidence-based methods have been established to enhance motivated behavior. In this study, we tested the effects of web-based targeted cognitive and social cognitive training (TCT) delivered in conjunction with an innovative digital smartphone app called Personalized Real-Time Intervention for Motivational Enhancement (PRIME). The PRIME app provides users with a motivational coach to set personalized goals and secure social networking for peer support. OBJECTIVE This study investigated whether deficits in cognition and motivation in people with a psychosis spectrum disorder (N=100) can be successfully addressed with 30 hours of TCT+PRIME as compared with 30 hours of a computer games control condition (CG) plus PRIME (CG+PRIME). Here, we describe our study procedures, the feasibility and acceptability of the intervention, and the results on all primary outcomes. METHODS In this double-blind randomized controlled trial, English-speaking participants completed all cognitive training, PRIME activities, and assessments remotely. Participants completed a diagnostic interview and remote cognitive, clinical, and self-report measures at baseline, posttraining, and at a 6-month follow-up. RESULTS This study included participants from 27 states across the United States and 8 countries worldwide. The study population was 58% (58/100) female, with a mean age of 33.77 (SD 10.70) years. On average, participants completed more than half of the cognitive training regimen (mean 18.58, SD 12.47 hours of training), and logged into the PRIME app 4.71 (SD 1.58) times per week. The attrition rate of 22% (22/100) was lower than that reported in our previous studies on remote cognitive training. The total sample showed significant gains in global cognition (P=.03) and attention (P<.001). The TCT+PRIME participants showed significantly greater gains in emotion recognition (P<.001) and global cognition at the trend level (P=.09), although this was not statistically significant, relative to the CG+PRIME participants. The total sample also showed significant improvements on multiple indices of motivation (P=.02-0.05), in depression (P=.04), in positive symptoms (P=.04), and in negative symptoms at a trend level (P=.09), although this was not statistically significant. Satisfaction with the PRIME app was rated at 7.74 (SD 2.05) on a scale of 1 to 10, with higher values indicating more satisfaction. CONCLUSIONS These results demonstrate the feasibility and acceptability of remote cognitive training combined with the PRIME app and that this intervention can improve cognition, motivation, and symptoms in individuals with psychosis. TCT+PRIME appeared more effective in improving emotion recognition and global cognition than CG+PRIME. Future analyses will test the relationship between hours of cognitive training completed; PRIME use; and changes in cognition, motivation, symptoms, and functioning. TRIAL REGISTRATION ClinicalTrials.gov NCT02782442; https://clinicaltrials.gov/study/NCT02782442.
Collapse
Affiliation(s)
- Melissa Fisher
- Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Kevin Etter
- Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
- Department of Psychiatry & Behavioral Sciences, University of California, San Francisco, San Francisco, CA, United States
- Edgewood Center for Children and Families, San Francisco, CA, United States
| | - Aimee Murray
- Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Neelu Ghiasi
- Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Kristin LaCross
- Department of Psychiatry & Behavioral Sciences, University of California, San Francisco, San Francisco, CA, United States
| | - Ian Ramsay
- Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Ariel Currie
- Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Karrie Fitzpatrick
- Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Bruno Biagianti
- Department of Psychology, University of Milan Bicocca, Milano, Italy
| | - Danielle Schlosser
- Department of Psychiatry & Behavioral Sciences, University of California, San Francisco, San Francisco, CA, United States
| | - Rachel Loewy
- Department of Psychiatry & Behavioral Sciences, University of California, San Francisco, San Francisco, CA, United States
| | - Sophia Vinogradov
- Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| |
Collapse
|
5
|
Foley G, Ricciardelli R. Views on the Functionality and Use of the PeerConnect App Among Public Safety Personnel: Qualitative Analysis. JMIR Form Res 2023; 7:e46968. [PMID: 37930765 PMCID: PMC10660208 DOI: 10.2196/46968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 07/24/2023] [Accepted: 08/07/2023] [Indexed: 11/07/2023] Open
Abstract
BACKGROUND Research supports that public safety personnel (PSP) are regularly exposed to potentially psychologically traumatic events and occupational stress, which can compromise their well-being. To help address PSP well-being and mental health, peer support is increasingly being adopted (and developed) in PSP organizations. Peer support apps have been developed to connect the peer and peer supporter anonymously and confidentially, but little is known about their effectiveness, utility, and uptake. OBJECTIVE We designed this study to evaluate the functionality and use of the PeerConnect app, which is a vehicle for receiving and administering peer support. The app connects peers but also provides information (eg, mental health screening tools, newsfeed) to users; thus, we wanted to understand why PSP adopted or did not adopt the app and the app's perceived utility. Our intention was to determine if the app served the purpose of connectivity for PSP organizations implementing peer support. METHODS A sample of PSP (N=23) participated in an interview about why they used or did not use the app. We first surveyed participants across PSP organizations in Ontario, Canada, and at the end of the survey invited participants to participate in a follow-up interview. Of the 23 PSP interviewed, 16 were PeerConnect users and 7 were nonusers. After transcribing all audio recordings of the interviews, we used an emergent theme approach to analyze themes within and across responses. RESULTS PSP largely viewed PeerConnect positively, with the Connect feature being most popular (this feature facilitated peer support), followed by the Newsfeed and Resources. App users appreciated the convenience of the app and felt the app helped reduce the stigma around peer support use and pressure on peer supporters while raising awareness of wellness. PSP who did not use the app attributed their nonuse to disinterest or uncertainty about the need for a peer support app and the web-based nature of the app. To increase app adoption, participants recommended increased communication and promotion of the app by the services and continued efforts to combat mental health stigma. CONCLUSIONS We provide contextual information about a peer support app's functionality and use. Our findings demonstrate that PSP are open to the use of mental health and peer support apps, but more education is required to reduce mental health stigma. Future research should continue to evaluate peer support apps for PSP to inform their design and ensure they are fulfilling their purpose.
Collapse
Affiliation(s)
- Gillian Foley
- Fisheries and Marine Institute, Memorial University of Newfoundland, St. John's, NL, Canada
| | - Rosemary Ricciardelli
- Fisheries and Marine Institute, Memorial University of Newfoundland, St. John's, NL, Canada
| |
Collapse
|
6
|
Biagianti B, Conelea C, Dabit S, Ross D, Beard KL, Harris E, Shen E, Jordan J, Bernstein GA. A Mobile Application Adjunct to Augment Cognitive-Behavioral Group Therapy for Adolescents with Social Anxiety: Feasibility and Acceptability Results from the Wiring Adolescents with Social Anxiety via Behavioral Interventions Pilot Trial. J Child Adolesc Psychopharmacol 2023; 33:212-224. [PMID: 37471177 PMCID: PMC10458379 DOI: 10.1089/cap.2023.0001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/22/2023]
Abstract
Objective: Cognitive-Behavioral Group Therapy (CBGT) is an established treatment for Social Anxiety (SA). However, diagnostic recovery rate is only 20.5% in CBGT, and up to 50% of patients remain symptomatic posttreatment. Using videocalls to deliver digital CBGT (dCBGT) is feasible, cost-effective, and efficacious. Yet, the impact of dCBGT on social functioning remains limited, as dCBGT does not offer opportunities for monitoring cognition and behavior in social situations. Wiring Adolescents with Social Anxiety via Behavioral Interventions (WASABI), a clinician-assisted application that uses ecological momentary assessments (EMAs), cognitive bias tests, and clinical self-reports, was investigated as an adjunct to dCBGT. Methods: A prospective, parallel arm, double-blind randomized controlled trial was employed in 24 SA adolescents randomly assigned to dCBGT versus dCBGT plus WASABI. Results: Study completion rates (83%) and exit survey data indicated that WASABI is feasible and acceptable. Engagement with EMAs varied from four to 244 EMAs completed per person. Cognitive bias tests and clinical self-reports were completed at least weekly by 53% and 69% of participants, respectively. While standard tests did not reveal statistically significant differences between dCBGT plus WASABI and dCBGT alone, effect sizes were greater for dCBGT plus WASABI on symptom severity, social skills, and functioning. Conclusions: Despite the small sample, preliminary results suggest that WASABI is feasible, acceptable, and may be an effective augmentation tool for treating SA in teenagers.
Collapse
Affiliation(s)
- Bruno Biagianti
- Department of Psychology, University of Milano-Bicocca, Milan, Italy
| | - Christine Conelea
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Masonic Institute for the Developing Brain, Minneapolis, Minnesota, USA
| | - Sawsan Dabit
- Department of R&D, Posit Science Corporation, San Francisco, California, USA
| | - Daniel Ross
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Masonic Institute for the Developing Brain, Minneapolis, Minnesota, USA
| | - Katie L. Beard
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Masonic Institute for the Developing Brain, Minneapolis, Minnesota, USA
| | - Elizabeth Harris
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Masonic Institute for the Developing Brain, Minneapolis, Minnesota, USA
| | - Erin Shen
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Masonic Institute for the Developing Brain, Minneapolis, Minnesota, USA
| | - Josh Jordan
- Department of Psychiatry and Behavioral Sciences, University of California San Francisco, San Francisco, California, USA
| | - Gail A. Bernstein
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Masonic Institute for the Developing Brain, Minneapolis, Minnesota, USA
| |
Collapse
|
7
|
Remote cognitive assessment in severe mental illness: a scoping review. SCHIZOPHRENIA 2022; 8:14. [PMID: 35249112 PMCID: PMC8897553 DOI: 10.1038/s41537-022-00219-x] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 12/16/2021] [Indexed: 11/16/2022]
Abstract
Many individuals living with severe mental illness, such as schizophrenia, present cognitive deficits and reasoning biases negatively impacting clinical and functional trajectories. Remote cognitive assessment presents many opportunities for advancing research and treatment but has yet to be widely used in psychiatric populations. We conducted a scoping review of remote cognitive assessment in severe mental illness to provide an overview of available measures and guide best practices. Overall, 34 studies (n = 20,813 clinical participants) were reviewed and remote measures, psychometrics, facilitators, barriers, and future directions were synthesized using a logic model. We identified 82 measures assessing cognition in severe mental illness across 11 cognitive domains and four device platforms. Remote measures were generally comparable to traditional versions, though psychometric properties were infrequently reported. Facilitators included standardized procedures and wider recruitment, whereas barriers included imprecise measure adaptations, technology inaccessibility, low patient engagement, and poor digital literacy. Our review identified several remote cognitive measures in psychiatry across all cognitive domains. However, there is a need for more rigorous validation of these measures and consideration of potentially influential factors, such as sex and gender. We provide recommendations for conducting remote cognitive assessment in psychiatry and fostering high-quality research using digital technologies.
Collapse
|
8
|
Kwon S, Firth J, Joshi D, Torous J. Accessibility and availability of smartphone apps for schizophrenia. SCHIZOPHRENIA (HEIDELBERG, GERMANY) 2022; 8:98. [PMID: 36385116 PMCID: PMC9668219 DOI: 10.1038/s41537-022-00313-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Accepted: 11/05/2022] [Indexed: 05/25/2023]
Abstract
App-based interventions have the potential to enhance access to and quality of care for patients with schizophrenia. However, less is known about the current state of schizophrenia apps in research and how those translate to publicly available apps. This study, therefore, aimed to review schizophrenia apps offered on marketplaces and research literature with a focus on accessibility and availability. A search of recent reviews, gray literature, PubMed, and Google Scholar was conducted in August 2022. A search of the U.S. Apple App Store and Google Play App Store was conducted in July 2022. All eligible studies and apps were systematically screened/reviewed. The academic research search produced 264 results; 60 eligible studies were identified. 51.7% of research apps were built on psychosis-specific platforms and 48.3% of research apps were built on non-specific platforms. 83.3% of research apps offered monitoring functionalities. Only nine apps, two designed on psychosis-specific platforms and seven on non-specific platforms were easily accessible. The search of app marketplaces uncovered 537 apps; only six eligible marketplace apps were identified. 83.3% of marketplace apps only offered psychoeducation. All marketplace apps lacked frequent updates with the average time since last update 1121 days. There are few clinically relevant apps accessible to patients on the commercial marketplaces. While research efforts are expanding, many research apps are unavailable today. Better translation of apps from research to the marketplace and a focus on sustainable interventions are important targets for the field.
Collapse
Affiliation(s)
- Sam Kwon
- Department of Psychiatry, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Joseph Firth
- Division of Psychology and Mental Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK
- Greater Manchester Mental Health NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
| | - Devayani Joshi
- Department of Psychiatry, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - John Torous
- Department of Psychiatry, Beth Israel Deaconess Medical Center, Boston, MA, USA.
| |
Collapse
|
9
|
Knouse LE, Hu X, Sachs G, Isaacs S. Usability and feasibility of a cognitive-behavioral mobile app for ADHD in adults. PLOS DIGITAL HEALTH 2022; 1:e0000083. [PMID: 36812621 PMCID: PMC9931323 DOI: 10.1371/journal.pdig.0000083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 06/29/2022] [Indexed: 11/19/2022]
Abstract
OBJECTIVE Cognitive-behavioral therapy (CBT) has growing evidence of efficacy for Attention-Deficit/Hyperactivity Disorder (ADHD) in adults. Mobile health apps are promising tools for delivering scalable CBT. In a 7-week open study of Inflow, a CBT-based mobile app, we assessed usability and feasibility to prepare for a randomized controlled trial (RCT). METHOD 240 adults recruited online completed baseline and usability assessments at 2 (n = 114), 4 (n = 97) and after 7 weeks (n = 95) of Inflow use. 93 participants self-reported ADHD symptoms and impairment at baseline and 7 weeks. RESULTS Participants rated Inflow's usability favorably, used the app a median of 3.86 times per week, and a majority of those using the app for 7 weeks self-reported decreases in ADHD symptoms and impairment. CONCLUSION Inflow demonstrated usability and feasibility among users. An RCT will determine whether Inflow is associated with improvement among more rigorously assessed users and beyond non-specific factors.
Collapse
Affiliation(s)
- Laura E. Knouse
- Department of Psychology, University of Richmond, Richmond, Virginia, United States of America
- * E-mail:
| | - Xiaodi Hu
- Department of Psychology, University of Richmond, Richmond, Virginia, United States of America
- Master of Science in Human-Computer Interaction Program, College of Information Studies, University of Maryland, College Park, Maryland, United States of America
| | | | | |
Collapse
|
10
|
Trapp W, Heid A, Röder S, Wimmer F, Hajak G. Cognitive Remediation in Psychiatric Disorders: State of the Evidence, Future Perspectives, and Some Bold Ideas. Brain Sci 2022; 12:683. [PMID: 35741569 PMCID: PMC9221116 DOI: 10.3390/brainsci12060683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Revised: 05/15/2022] [Accepted: 05/20/2022] [Indexed: 12/10/2022] Open
Abstract
Many people with psychiatric disorders experience impairments in cognition. These deficits have a significant impact on daily functioning and sometimes even on the further course of their disease. Cognitive remediation (CR) is used as an umbrella term for behavioral training interventions to ameliorate these deficits. In most but not all studies, CR has proven effective in improving cognition and enhancing everyday functional outcomes. In this paper, after quickly summarizing the empirical evidence, practical advice to optimize the effects of CR interventions is provided. We advocate that CR interventions should be as fun and motivating as possible, and therapists should at least consider using positively toned emotional stimuli instead of neutral stimuli. Participants should be screened for basic processing deficits, which should be trained before CR of higher-order cognitive domains. CR should stimulate metacognition and utilize natural settings to invoke social cognition. Wherever possible, CR tasks should link to tasks that participants face in their everyday life. Therapists should consider that participants might also benefit from positive side effects on symptomatology. Finally, the CR approach might even be utilized in settings where the treatment of cognitive impairments is not a primary target.
Collapse
Affiliation(s)
- Wolfgang Trapp
- Department of Psychiatry and Psychotherapy, Social Foundation Bamberg, 96049 Bamberg, Germany
- Fachhochschule des Mittelstands, Department of Psychology, University of Applied Sciences, 96050 Bamberg, Germany
| | - Andreas Heid
- Department of Psychiatry and Psychotherapy, Social Foundation Bamberg, 96049 Bamberg, Germany
| | - Susanne Röder
- Department of Psychiatry and Psychotherapy, Social Foundation Bamberg, 96049 Bamberg, Germany
| | - Franziska Wimmer
- Department of Psychiatry and Psychotherapy, Social Foundation Bamberg, 96049 Bamberg, Germany
| | - Göran Hajak
- Department of Psychiatry and Psychotherapy, Social Foundation Bamberg, 96049 Bamberg, Germany
| |
Collapse
|
11
|
Jameel L, Valmaggia L, Barnes G, Cella M. mHealth technology to assess, monitor and treat daily functioning difficulties in people with severe mental illness: A systematic review. J Psychiatr Res 2021; 145:35-49. [PMID: 34856524 DOI: 10.1016/j.jpsychires.2021.11.033] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2021] [Revised: 10/18/2021] [Accepted: 11/20/2021] [Indexed: 11/21/2022]
Abstract
Severe mental illness (SMI) is associated with poor daily functioning; however available interventions currently under-deliver on their recovery prospect. Mobile digital health (mHealth) interventions are increasingly being developed and evaluated, and have the potential to support recovery. This review evaluates the use of mHealth technology to assess, monitor and reduce functioning difficulties in people with SMI. Studies were systematically searched on multiple databases. Study quality was assessed and double-rated independently. Findings were organised using a narrative synthesis and results were summarised according to the mHealth device purpose, i.e., assessment and monitoring or intervention. Thirty-eight studies comprised of 2262 participants met the inclusion criteria. Smartphones were the most popular mHealth device; personal digital assistants, wearables and tablets were also used. mHealth was widely found to be acceptable and feasible, with preliminary findings suggesting it can support functional recovery by augmenting an intervention, simplifying the assessment, increasing monitoring frequency and/or providing more detailed information. Considerations for overcoming barriers to implementation, recommendations for future research to establish effectiveness, personalisation and specification of mHealth devices and methodologies are discussed. The value of mHealth for remote delivery of recovery based interventions is also considered.
Collapse
Affiliation(s)
- Leila Jameel
- South London and the Maudsley NHS Trust, UK; Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK.
| | - Lucia Valmaggia
- South London and the Maudsley NHS Trust, UK; Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK; Katholieke Leuven Universitet, Belgium
| | - Georgina Barnes
- South London and the Maudsley NHS Trust, UK; Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
| | - Matteo Cella
- South London and the Maudsley NHS Trust, UK; Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
| |
Collapse
|
12
|
Improving social functioning in people with schizophrenia-spectrum disorders via mobile experimental interventions: Results from the CLIMB pilot trial. SCHIZOPHRENIA RESEARCH-COGNITION 2021; 26:100211. [PMID: 34381699 PMCID: PMC8340304 DOI: 10.1016/j.scog.2021.100211] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 07/15/2021] [Accepted: 07/21/2021] [Indexed: 12/02/2022]
Abstract
Background Patients with Schizophrenia Spectrum Disorders (SSD) demonstrate poor social functioning. While group-based approaches show long-term improvements, access to treatments is limited. Digital platforms hold promise to overcome barriers to treatment delivery and improve outcomes. Objective In a parallel arm, double-blind RCT, we tested CLIMB, a clinician-assisted, adjunct to treatment that includes computerized social cognition training (SCT), ecological momentary assessments (EMAs), group tele-therapy, and moderated messaging. CLIMB was compared to an active control that includes computerized general cognitive training (GCT), unstructured support groups, and unmoderated messaging. Methods The primary outcome was social functioning. Secondary outcomes were negative symptoms and quality of life (QoL). Given the sample size, Propensity Score Models were used to ensure balanced baseline covariates. Mixed-effects models examined change over time. Results 24 participants completed the study (12 per arm). No significant between-group differences emerged in engagement. CLIMB participants engaged in a median of 8 sessions (IQR = 2), 2.8 h of SCT (IQR = 7.5), and 2710 EMAs; control participants engaged in a median of 9 sessions (IQR = 3) and 2.2 h of GCT (IQR = 7.9). As a group, participants showed significant improvements in social functioning (p = .046), with no between-group differences. Intent-to-treat analyses indicated greater improvements in QoL (p = .025) for the active control. Conclusions Delivering group-based mobile interventions to individuals with SSD is feasible. EMAs allow clinicians to maintain inter-session engagement, build participant self-awareness, and tailor treatment delivery. In this treatment model, whether SCT or GCT is more effective remains unclear. Further research will evaluate group-based mobile interventions to improve outcomes in SSD.
Collapse
|
13
|
Abstract
PURPOSE OF REVIEW The purpose of this paper is to review the application of telehealth in the assessment and treatment of psychotic illnesses. We present the contextual factors which make this approach to clinical care compelling, and review existing evidence about feasibility, acceptability, and effectiveness. RECENT FINDINGS The use of telehealth with individuals that suffer from serious mental illness and psychosis has been demonstrated to be feasible and acceptable, with effectiveness that is comparable to in-person clinical care. Telehealth holds the additional promises of expanding access, connecting patients, families, and the general public to behavioral health resources, and reducing overall health care costs. We provide two case examples which demonstrate the successful use of technology for the delivery and coordination of effective patient care for individuals with psychotic illnesses.
Collapse
Affiliation(s)
- Amy L. Donahue
- Access Care Services, Colorado Access, 11100 E Bethany Drive, Aurora, CO 80014 USA
| | - Jennifer Rodriguez
- Access Care Services, Colorado Access, 11100 E Bethany Drive, Aurora, CO 80014 USA
| | - Jay H. Shore
- Access Care Services, Colorado Access, 11100 E Bethany Drive, Aurora, CO 80014 USA ,grid.430503.10000 0001 0703 675XDepartment of Psychiatry and Family Medicine, School of Medicine And Centers for American Indian and Alaska Native Health, Colorado School of Public Health, Anschutz Medical Campus, Aurora, CO USA
| |
Collapse
|
14
|
Fulford D, Mote J, Gard DE, Mueser KT, Gill K, Leung L, Dillaway K. Development of the Motivation and Skills Support (MASS) social goal attainment smartphone app for (and with) people with schizophrenia. ACTA ACUST UNITED AC 2020; 30:23-32. [PMID: 33437970 DOI: 10.1016/j.jbct.2020.03.016] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
People with schizophrenia and schizoaffective disorder (SZ) often struggle with social impairment, including small social networks and loneliness. Limitations in social skills and reduced social motivation-effort to engage in social connection-are key contributors to social impairment. While evidence-based approaches to improving social outcomes are available, including social skills training and cognitive behavioral therapy for psychosis, ongoing access to these interventions is often limited. Mobile technologies, including smartphone applications (apps), may address some of this need. In this paper, we describe the development of a smartphone app designed to address social skill and motivation deficits in SZ: the Motivation and Skills Support (MASS) app. We discuss the incorporation of stakeholder input into intervention design as well as results from usability pilot testing of the app in a sample of people with SZ. Finally, we describe next steps in the development and testing process of the MASS app.
Collapse
Affiliation(s)
- Daniel Fulford
- Sargent College of Health & Rehabilitation Sciences, Boston University, Boston, USA.,Department of Psychological & Brain Sciences, Boston University, Boston, USA
| | - Jasmine Mote
- Sargent College of Health & Rehabilitation Sciences, Boston University, Boston, USA
| | - David E Gard
- Department of Psychology, San Francisco State University, San Francisco, USA
| | - Kim T Mueser
- Sargent College of Health & Rehabilitation Sciences, Boston University, Boston, USA.,Department of Psychological & Brain Sciences, Boston University, Boston, USA.,Department of Psychiatry, Boston University, Boston, USA
| | - Kathryn Gill
- Sargent College of Health & Rehabilitation Sciences, Boston University, Boston, USA
| | - Lawrence Leung
- Department of Psychology, San Francisco State University, San Francisco, USA
| | - Kara Dillaway
- Sargent College of Health & Rehabilitation Sciences, Boston University, Boston, USA
| |
Collapse
|
15
|
Nahum M, Lee H, Fisher M, Green MF, Hooker CI, Ventura J, Jordan JT, Rose A, Kim SJ, Haut KM, Merzenich MM, Vinogradov S. Online Social Cognition Training in Schizophrenia: A Double-Blind, Randomized, Controlled Multi-Site Clinical Trial. Schizophr Bull 2020; 47:108-117. [PMID: 32614046 PMCID: PMC7825077 DOI: 10.1093/schbul/sbaa085] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Social cognition (SC), the mental operations underlying social functioning, are impaired in schizophrenia. Their direct link to functional outcome and illness status have made them an important therapeutic target. However, no effective treatment for these deficits is currently applied as a standard of care. To address this need, we have developed SocialVille-an online, plasticity-based training program that targets SC deficits in schizophrenia. Here we report the outcomes of a double-blind, controlled, randomized, multi-site clinical trial of SocialVille. Outpatients with schizophrenia were randomized to complete 40 sessions of either SocialVille (N = 55 completers) or active control (computer games; N = 53 completers) from home. The a priori co-primary outcome measures were a social cognitive composite and a functional capacity outcome (UCSD Performance-based Skills Assessment [UPSA-2]). Secondary outcomes included a virtual functional capacity measure (VRFCAT), social functioning, quality of life, and motivation. Linear mixed models revealed a group × time interaction favoring the treatment group for the social cognitive composite (b = 2.81; P < .001) but not for the UPSA-2 measure. Analysis of secondary outcome measures showed significant group × time effects favoring the treatment group on SC and social functioning, on the virtual functional capacity measure and a motivation subscale, although these latter findings were nonsignificant with FDR correction. These results provide support for the efficacy of a remote, plasticity-based social cognitive training program in improving SC and social functioning in schizophrenia. Such treatments may serve as a cost-effective adjunct to existing psychosocial treatments. Trial Registration: NCT02246426.
Collapse
Affiliation(s)
- Mor Nahum
- School of Occupational Therapy, Faculty of Medicine, Hebrew University, Jerusalem, Israel,Department of Research and Development, Posit Science Inc., San Francisco, CA,To whom correspondence should be addressed; School of Occupational Therapy, Faculty of Medicine, The Hebrew University, PO Box 24026, Mount Scopus, Jerusalem, 91240, Israel; tel: +972-54-732-6655, fax: +972-2-5325345, e-mail:
| | - Hyunkyu Lee
- Department of Research and Development, Posit Science Inc., San Francisco, CA
| | - Melissa Fisher
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN
| | - Michael F Green
- VA Greater Los Angeles, Los Angeles, CA,Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, CA
| | - Christine I Hooker
- Department of Psychiatry and Behavioral Sciences, Rush University Medical Center, Chicago, IL
| | - Joseph Ventura
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, CA
| | - Joshua T Jordan
- Department of Psychiatry, University of California, San Francisco, CA
| | - Annika Rose
- Department of Research and Development, Posit Science Inc., San Francisco, CA
| | - Sarah-Jane Kim
- Department of Research and Development, Posit Science Inc., San Francisco, CA
| | - Kristen M Haut
- Department of Psychiatry and Behavioral Sciences, Rush University Medical Center, Chicago, IL
| | - Michael M Merzenich
- Department of Research and Development, Posit Science Inc., San Francisco, CA
| | - Sophia Vinogradov
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN
| |
Collapse
|
16
|
Fortuna KL, Naslund JA, LaCroix JM, Bianco CL, Brooks JM, Zisman-Ilani Y, Muralidharan A, Deegan P. Digital Peer Support Mental Health Interventions for People With a Lived Experience of a Serious Mental Illness: Systematic Review. JMIR Ment Health 2020; 7:e16460. [PMID: 32243256 PMCID: PMC7165313 DOI: 10.2196/16460] [Citation(s) in RCA: 92] [Impact Index Per Article: 23.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/14/2019] [Revised: 12/27/2019] [Accepted: 01/01/2020] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND Peer support is recognized globally as an essential recovery service for people with mental health conditions. With the influx of digital mental health services changing the way mental health care is delivered, peer supporters are increasingly using technology to deliver peer support. In light of these technological advances, there is a need to review and synthesize the emergent evidence for peer-supported digital health interventions for adults with mental health conditions. OBJECTIVE The aim of this study was to identify and review the evidence of digital peer support interventions for people with a lived experience of a serious mental illness. METHODS This systematic review was conducted using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) procedures. The PubMed, Embase, Web of Science, Cochrane Central, CINAHL, and PsycINFO databases were searched for peer-reviewed articles published between 1946 and December 2018 that examined digital peer support interventions for people with a lived experience of a serious mental illness. Additional articles were found by searching the reference lists from the 27 articles that met the inclusion criteria and a Google Scholar search in June 2019. Participants, interventions, comparisons, outcomes, and study design (PICOS) criteria were used to assess study eligibility. Two authors independently screened titles and abstracts, and reviewed all full-text articles meeting the inclusion criteria. Discrepancies were discussed and resolved. All included studies were assessed for methodological quality using the Methodological Quality Rating Scale. RESULTS A total of 30 studies (11 randomized controlled trials, 2 quasiexperimental, 15 pre-post designs, and 2 qualitative studies) were included that reported on 24 interventions. Most of the studies demonstrated feasibility, acceptability, and preliminary effectiveness of peer-to-peer networks, peer-delivered interventions supported with technology, and use of asynchronous and synchronous technologies. CONCLUSIONS Digital peer support interventions appear to be feasible and acceptable, with strong potential for clinical effectiveness. However, the field is in the early stages of development and requires well-powered efficacy and clinical effectiveness trials. TRIAL REGISTRATION PROSPERO CRD42020139037; https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID= 139037.
Collapse
Affiliation(s)
| | - John A Naslund
- Department of Global Health and Social Medicine, Harvard Medical School, Harvard University, Boston, MA, United States
| | - Jessica M LaCroix
- Department of Medical & Clinical Psychology, Uniformed Services University of the Health Sciences, Rockville, MD, United States
| | - Cynthia L Bianco
- The Giesel School of Medicine, Dartmouth College, Concord, NH, United States
| | - Jessica M Brooks
- Geriatric Research, Education and Clinical Center, James J Peters VA Medical Center, New York, NY, United States
| | - Yaara Zisman-Ilani
- Department of Social and Behavioral Sciences, College of Public Health, Temple University, Philadelphia, PA, United States
| | - Anjana Muralidharan
- Department of Medical & Clinical Psychology, Uniformed Services University of the Health Sciences, Rockville, MD, United States
| | | |
Collapse
|
17
|
Biagianti B, Fisher M, Loewy R, Brandrett B, Ordorica C, LaCross K, Schermitzler B, McDonald M, Ramsay I, Vinogradov S. Specificity and Durability of Changes in Auditory Processing Efficiency After Targeted Cognitive Training in Individuals With Recent-Onset Psychosis. Front Psychiatry 2020; 11:857. [PMID: 33005156 PMCID: PMC7484996 DOI: 10.3389/fpsyt.2020.00857] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/17/2020] [Accepted: 08/06/2020] [Indexed: 12/02/2022] Open
Abstract
BACKGROUND We previously demonstrated that the high heterogeneity of response to computerized Auditory Training (AT) in psychosis can be ascribed to individual differences in sensory processing efficiency and neural plasticity. In particular, we showed that Auditory Processing Speed (APS) serves as a behavioral measure of target engagement, with faster speed predicting greater transfer effects to untrained cognitive domains. Here, we investigate whether the ability of APS to function as a proxy for target engagement is unique to AT, or if it applies to other training interventions, such as Executive Functioning Training (EFT). Additionally, we examine whether changes in APS are durable after these two forms of training. METHODS One hundred and twenty-five participants with Recent Onset Psychosis (ROP) were randomized to AT (n = 66) and EFT (n = 59), respectively. APS was captured at baseline, after treatment, and at 6-month follow-up. Mixed models repeated measures analysis with restricted maximum likelihood was used to examine whether training condition differentiated APS trajectories. Within-group correlational analyses were used to study the relationship between APS and performance improvements in each of the training exercises. RESULTS The two groups were matched for age, gender, education, and baseline APS. Participants showed high inter-individual variability in APS at each time point. The mixed model showed a significant effect of time (F = 5.99, p = .003) but not a significant group-by-time effect (F = .73, p = .48). This was driven by significant APS improvements AT patients after treatment (d = .75) that were maintained after 6 months (d = .63). Conversely, in EFT patients, APS improvements did not reach statistical significance after treatment (p = .33) or after 6 months (p = .24). In AT patients, baseline APS (but not APS change) highly predicted peak performance for each training exercise (all r's >.42). CONCLUSIONS Participant-specific speed in processing basic auditory stimuli greatly varies in ROP, and strongly influences the magnitude of response to auditory but not executive functioning training. Importantly, enhanced auditory processing efficiency persists 6 months after AT, suggesting the durability of neuroplasticity processes induced by this form of training. Future studies should aim to identify markers of target engagement and durability for cognitive training interventions that target sensory modalities beyond the auditory domain.
Collapse
Affiliation(s)
- Bruno Biagianti
- Department of R&D, Posit Science Corporation, San Francisco, CA, United States.,Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy
| | - Melissa Fisher
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Rachel Loewy
- Department of Psychiatry, University of California, San Francisco, San Francisco, CA, United States
| | | | - Catalina Ordorica
- Department of Psychiatry, University of California, San Francisco, San Francisco, CA, United States
| | - Kristin LaCross
- Department of Psychiatry, University of California, San Francisco, San Francisco, CA, United States
| | - Brandon Schermitzler
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Michelle McDonald
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Ian Ramsay
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| | - Sophia Vinogradov
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| |
Collapse
|
18
|
The effects of cognitive remediation on cognitive abilities and real-world functioning among people with bipolar disorder: A systematic review: Special Section on "Translational and Neuroscience Studies in Affective Disorders". Section Editor, Maria Nobile MD, PhD. This Section of JAD focuses on the relevance of translational and neuroscience studies in providing a better understanding of the neural basis of affective disorders. The main aim is to briefly summaries relevant research findings in clinical neuroscience with particular regards to specific innovative topics in mood and anxiety disorders. J Affect Disord 2019; 257:691-697. [PMID: 31377606 PMCID: PMC6711788 DOI: 10.1016/j.jad.2019.07.059] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/30/2019] [Revised: 07/16/2019] [Accepted: 07/17/2019] [Indexed: 01/04/2023]
Abstract
BACKGROUND Bipolar disorder (BD) is characterized by cognitive impairments that are known to predict psychosocial functioning and quality of life. While cognitive remediation (CR) was originally developed to directly target cognitive symptoms in traumatic brain injury and psychotic illnesses, the efficacy of CR in BD has begun to emerge only in the last decade. Functional Remediation (FR) is an integrated intervention that has been developed to restore psychosocial functioning by means of ecological neurocognitive techniques that involve psychoeducation about cognitive dysfunctions and their impact on the general functioning. Because of the heterogeneity of treatment targets and mechanisms of actions, here we aim to illustrate the effects induced by existing CR/FR approaches in BD. METHODS In this systematic review, we evaluated cognitive and functional outcomes after CR/FR in studies conducted in BD. RESULTS Eleven studies met inclusion criteria: 3 RCTs that compared CR/FR to one or more control condition (n = 354), 5 secondary analyses that further examined data from these trials, 2 single-arm studies, and 1 naturalistic study. While features such as the use of computerized training tools and a group-based format recurred across studies, CR/FR paradigms targeting different cognitive and functional domains showed specificity of training focus to outcomes. Effect sizes were in the medium-large range, suggesting that patients with BD respond to treatment at or above the level reported in psychotic patients. Integrated approaches that combined cognitive exercises with group-based experiences were associated with both cognitive and functional improvements. CONCLUSIONS In this review, we found support for the use of CR/FR paradigms in patients with BD with evidence of cognitive and functional improvements. The scarcity of currently published RCTs as well as of data examining mechanisms of action and neural correlates limits the generalizability of our findings.
Collapse
|
19
|
Kumari V. Is clinical psychiatry about to get smarter? A commentary on 'Objective smartphone data as a potential diagnostic marker of bipolar disorder'. Aust N Z J Psychiatry 2019; 53:361-362. [PMID: 30636431 DOI: 10.1177/0004867418821442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Veena Kumari
- Centre for Cognitive Neuroscience, Department of Life Sciences, College of Health and Life Sciences, Brunel University London, London, UK
| |
Collapse
|
20
|
Aref-Adib G, McCloud T, Ross J, O'Hanlon P, Appleton V, Rowe S, Murray E, Johnson S, Lobban F. Factors affecting implementation of digital health interventions for people with psychosis or bipolar disorder, and their family and friends: a systematic review. Lancet Psychiatry 2019; 6:257-266. [PMID: 30522979 DOI: 10.1016/s2215-0366(18)30302-x] [Citation(s) in RCA: 55] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/22/2018] [Revised: 07/31/2018] [Accepted: 08/01/2018] [Indexed: 12/20/2022]
Abstract
Digital health interventions present an important opportunity to improve health care for people with psychosis or bipolar disorder, but despite their potential, integrating and implementing them into clinical settings has been difficult worldwide. This Review aims to identify factors affecting implementation of digital health interventions for people affected by psychosis or bipolar disorder. We searched seven databases and synthesised data from 26 studies using the Consolidated Framework for Implementation Research. Attitudes and beliefs about interventions were crucial factors for both staff and service users, with negative attitudes and scepticism resulting in a lack of motivation to engage with interventions or complete them. The complexity of the interventions was a barrier for people with psychiatric symptoms, low premorbid intelligence quotient, or minimal information technology skills. The accessibility and adaptability of interventions were key facilitators, but insufficient resources, finances, and staff time were barriers to implementation. Interventions need to be user friendly and adaptable to the needs and capabilities of people with psychosis or bipolar disorder, and the staff who support their implementation. Service users and staff should cofacilitate the process of developing and implementing the interventions.
Collapse
Affiliation(s)
- Golnar Aref-Adib
- Division of Psychiatry, University College London, London, UK; Camden and Islington National Health Service Foundation Trust, St Pancras Hospital, London, UK.
| | - Tayla McCloud
- Division of Psychiatry, University College London, London, UK
| | - Jamie Ross
- Research Department of Primary Care and Population Health, University College London, London, UK
| | - Puffin O'Hanlon
- Division of Psychiatry, University College London, London, UK
| | - Victoria Appleton
- Faculty of Health and Medicine, Furness College, Lancaster University, Lancaster, UK
| | - Sarah Rowe
- Division of Psychiatry, University College London, London, UK
| | - Elizabeth Murray
- Research Department of Primary Care and Population Health, University College London, London, UK
| | - Sonia Johnson
- Division of Psychiatry, University College London, London, UK; Camden and Islington National Health Service Foundation Trust, St Pancras Hospital, London, UK
| | - Fiona Lobban
- Faculty of Health and Medicine, Furness College, Lancaster University, Lancaster, UK
| |
Collapse
|
21
|
Barbeito S, Sánchez-Gutiérrez T, Mayoral M, Moreno M, Ríos-Aguilar S, Arango C, Calvo A. Mobile App-Based Intervention for Adolescents With First-Episode Psychosis: Study Protocol for a Pilot Randomized Controlled Trial. Front Psychiatry 2019; 10:27. [PMID: 30804818 PMCID: PMC6370739 DOI: 10.3389/fpsyt.2019.00027] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/05/2018] [Accepted: 01/16/2019] [Indexed: 01/26/2023] Open
Abstract
Introduction: Previous studies have shown an improvement in the access to treatment for patients with first-episode psychosis (FEP), specifically young patients, through mobile app-based interventions. The aim of this study is to test the effectiveness of a mobile app-based intervention to improve community functioning in adolescents with FEP. Mobile app-based interventions could increase quality of life and disease awareness, which improve adherence to treatment and reduce the frequency of relapses and rehospitalizations in adolescents with FEP. Methods: This article describes a mobile app treatment and the pilot trial protocol for patients with FEP. We will perform a single-blind randomized clinical trial (RCT) including patients with FEP aged 14-19 years recruited from Gregorio Marañón Hospital, Madrid, Spain. Patients will be randomly assigned to an intervention group, which will receive treatment as usual plus five modules of a psychological intervention through the mobile app (psychoeducation, recognition of symptoms and prevention of relapses, problem solving, mindfulness, and contact wall), or to a control group (standard care). The effectiveness of the intervention will be assessed by means of an extensive battery of clinical tests at baseline and at 3 months of follow-up. The primary outcome is reduction in psychotic and depressive symptoms; secondary outcomes comprise adherence, awareness, use of drugs, and quality of life. Data will be analyzed on an intention-to-treat (ITT) basis. Mixed model repeated-measures analysis will be used to explore the following effect: group × time interaction between the control group and the intervention group for clinical and functional variables during the follow-up period. Discussion: This is an innovative study for the assessment of a psychological intervention through a mobile app for patients with FEP during the critical period. This pilot RCT is intended to be a precursor to larger studies, which in turn could facilitate dissemination of mobile app therapy for patients with FEP. Ethics and Dissemination: The local ethics committee approved the study protocol. All participants must sign the informed consent, to participate. After finalizing the study, the results will be published. Trial registration: NCT03161249. NCT clinicaltrials.gov. Date of registration in primary registry 02 May 2017. clinicaltrials.gov.
Collapse
Affiliation(s)
- Sara Barbeito
- Faculty of Health Sciences, Universidad Internacional de la Rioja (UNIR), Logroño, Spain
| | | | - María Mayoral
- Department of Child and Adolescent Psychiatry, Hospital General Universitario Gregorio Marañón School of Medicine, Universidad Complutense, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), CIBERSAM, Madrid, Spain
| | - Miguel Moreno
- Faculty of Health Sciences, Universidad Internacional de la Rioja (UNIR), Logroño, Spain.,Mental Health Network of Guipuzcoa, Biodonostia, San Sebastian, Spain
| | - Sergio Ríos-Aguilar
- School of Engineering and Technology, Universidad Internacional de La Rioja (UNIR), Logroño, Spain
| | - Celso Arango
- Department of Child and Adolescent Psychiatry, Hospital General Universitario Gregorio Marañón School of Medicine, Universidad Complutense, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), CIBERSAM, Madrid, Spain
| | - Ana Calvo
- Faculty of Health Sciences, Universidad Internacional de la Rioja (UNIR), Logroño, Spain
| |
Collapse
|
22
|
Schlosser DA, Campellone TR, Truong B, Etter K, Vergani S, Komaiko K, Vinogradov S. Efficacy of PRIME, a Mobile App Intervention Designed to Improve Motivation in Young People With Schizophrenia. Schizophr Bull 2018; 44:1010-1020. [PMID: 29939367 PMCID: PMC6101497 DOI: 10.1093/schbul/sby078] [Citation(s) in RCA: 107] [Impact Index Per Article: 17.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
The onset of schizophrenia occurs during a period critical for development of social relationships and functional independence. As such, interventions that target the early course of illness have the potential to stave off functional decline and restore functioning to pre-illness levels. In this entirely remote study, people with recent-onset schizophrenia spectrum disorders (SSDs) participated in a 12-week randomized controlled trial to determine the efficacy of PRIME (personalized real-time intervention for motivational enhancement), a mobile-based digital health intervention designed to improve motivation and quality of life. Participants were randomized into the PRIME (n = 22) or treatment-as-usual/waitlist (TAU/WL) condition (n = 21) and completed assessments at baseline, post-trial (12 wk), and for people in the PRIME condition, 3 months after the end of the trial. After 12-weeks, WL participants received PRIME, resulting in a total sample of 38 participants completing PRIME. In PRIME, participants worked towards self-identified goals with the support of a virtual community of age-matched peers with schizophrenia-spectrum disorders as well as motivation coaches. Compared to the WL condition, people in the PRIME condition had significantly greater improvements in self-reported depression, defeatist beliefs, self-efficacy, and a trend towards motivation/pleasure negative symptoms post-trial, and these improvements were maintained 3 months after the end of trial. We also found that people in the PRIME condition had significantly greater improvements in components of social motivation post-trial (anticipated pleasure and effort expenditure). Our results suggest that PRIME has the potential to be an effective mobile-based intervention for improving aspects of mood and motivation in young people with SSDs.
Collapse
Affiliation(s)
- Danielle A Schlosser
- UCSF Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA,Healthcare and Science Division, Verily Life Sciences, South San Francisco, CA,To whom correspondence should be addressed; 401 Parnassus Avenue, San Francisco, CA 94134, US; tel: 415-476-8721, fax: 415-476-7320, e-mail:
| | - Timothy R Campellone
- UCSF Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA,Mental Health Services, San Francisco Veterans Affairs Medical Center, San Francisco, CA
| | - Brandy Truong
- UCSF Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA
| | - Kevin Etter
- UCSF Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA,Healthcare and Science Division, Verily Life Sciences, South San Francisco, CA
| | | | - Kiya Komaiko
- UCSF Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA
| | - Sophia Vinogradov
- UCSF Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA,Department of Psychiatry, University of Minnesota, Minneapolis, MN
| |
Collapse
|
23
|
Biagianti B, Quraishi SH, Schlosser DA. Potential Benefits of Incorporating Peer-to-Peer Interactions Into Digital Interventions for Psychotic Disorders: A Systematic Review. Psychiatr Serv 2018; 69:377-388. [PMID: 29241435 PMCID: PMC5988432 DOI: 10.1176/appi.ps.201700283] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
OBJECTIVE Peer-to-peer interactions and support groups mitigate experiences of social isolation and loneliness often reported by individuals with psychotic disorders. Online peer-to-peer communication can promote broader use of this form of social support. Peer-to-peer interactions occur naturally on social media platforms, but they can negatively affect mental health. Recent digital interventions for persons with psychotic disorders have harnessed the principles of social media to incorporate peer-to-peer communication. This review examined the feasibility, acceptability, and preliminary efficacy of recent digital interventions in order to identify strategies to maximize benefits of online peer-to-peer communication for persons with psychotic disorders. METHODS An electronic database search of PubMed, EMBASE, PsycINFO, Ovid MEDLINE, Cochrane Central Register of Controlled Trials, and Health Technology Assessment Database was conducted in February 2017 and yielded a total of 1,015 results. Eight publications that reported data from six independent trials and five interventions were reviewed. RESULTS The technology supporting peer-to-peer communication varied greatly across studies, from online forums to embedded social networking. When peer-to-peer interactions were moderated by facilitators, retention, engagement, acceptability, and efficacy were higher than for interventions with no facilitators. Individuals with psychotic disorders were actively engaged with moderated peer-to-peer communication and showed improvements in perceived social support. Studies involving service users in intervention design showed higher rates of acceptability. CONCLUSIONS Individuals with psychotic disorders value and benefit from digital interventions that include moderated peer-to-peer interactions. Incorporating peer-to-peer communication into digital interventions for this population may increase compliance with other evidence-based therapies by producing more acceptable and engaging online environments.
Collapse
Affiliation(s)
- Bruno Biagianti
- The authors are with the Department of Psychiatry, University of California, San Francisco. Dr. Biagianti is also with Posit Science Corporation, San Francisco. Dr. Schlosser is also with Verily Life Sciences LLC, Mountain View, California
| | - Sophia H Quraishi
- The authors are with the Department of Psychiatry, University of California, San Francisco. Dr. Biagianti is also with Posit Science Corporation, San Francisco. Dr. Schlosser is also with Verily Life Sciences LLC, Mountain View, California
| | - Danielle A Schlosser
- The authors are with the Department of Psychiatry, University of California, San Francisco. Dr. Biagianti is also with Posit Science Corporation, San Francisco. Dr. Schlosser is also with Verily Life Sciences LLC, Mountain View, California
| |
Collapse
|
24
|
Berry N, Bucci S, Lobban F. Use of the Internet and Mobile Phones for Self-Management of Severe Mental Health Problems: Qualitative Study of Staff Views. JMIR Ment Health 2017; 4:e52. [PMID: 29092809 PMCID: PMC5688247 DOI: 10.2196/mental.8311] [Citation(s) in RCA: 57] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/01/2017] [Revised: 08/14/2017] [Accepted: 08/21/2017] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Researchers are currently investigating the feasibility, acceptability, and efficacy of digital health interventions for people who experience severe mental health problems such as psychosis and bipolar disorder. Although the acceptability of digital health interventions for severe mental health problems appears to be relatively high and some people report successfully using the Internet and mobile phones to manage their mental health, the attitudes of mental health care staff toward such approaches have yet to be considered. OBJECTIVE The aim of this study was to explore mental health care staff experiences of clients with severe mental health problems engaging with the Internet and mobile phones to self-manage their mental health and their views toward these behaviors. The study also sought to examine the opinions expressed by mental health care staff toward digital health interventions for severe mental health problems to identify potential facilitators and barriers to implementation. METHODS Four focus groups were conducted with 20 staff working in mental health care services in the North West of the England using a topic guide. Focus groups involved 12 staff working in secondary care psychological services (7 participants in focus group 1 and 5 participants in focus group 4), 4 staff working in a rehabilitation unit (focus group 2), and 4 staff working in a community mental health team (focus group 3). Focus groups were transcribed verbatim, and transcripts were analyzed thematically to identify key themes that emerged from the data. RESULTS Four overarching themes, two with associated subthemes, were identified: (1) staff have conflicting views about the pros and cons of using Web-based resources and digital health interventions to manage mental health; (2) digital health interventions could increase access to mental health support options for severe mental health problems but may perpetuate the digital divide; (3) digital health interventions' impact on staff roles and responsibilities; and (4) digital health interventions should be used to enhance, not replace, face-to-face support. CONCLUSIONS This study is the first, to our knowledge, to qualitatively explore the experiences and attitudes of mental health care staff toward individuals with severe mental health problems using the Internet, mobile phones, and digital health interventions to self-manage their mental health. Understanding the positive and negative experiences and views shared by staff toward both current and potential digital health intervention use has enabled the identification of several considerations for implementation. Additionally, the findings suggest mental health care staff need clear guidance and training in relation to their responsibilities in recommending reputable and secure websites, forums, and digital health interventions and in how to manage professional boundaries on the Internet. Overall, the study highlights that digital health interventions could be well received by staff working in mental health services but importantly, such management options must be presented to frontline staff as an avenue to enhance care and extend choice, rather than as a method to reduce costs.
Collapse
Affiliation(s)
- Natalie Berry
- Division of Psychology and Mental Health, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, United Kingdom.,Health eResearch Centre, Institute of Population Health, University of Manchester, Manchester, United Kingdom
| | - Sandra Bucci
- Division of Psychology and Mental Health, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, United Kingdom.,Manchester Academic Health Science Centre, Greater Manchester Mental Health NHS Foundation Trust, Manchester, United Kingdom
| | - Fiona Lobban
- Spectrum Centre for Mental Health Research, School of Health and Medicine, Lancaster University, Lancaster, United Kingdom
| |
Collapse
|
25
|
Biagianti B, Hidalgo-Mazzei D, Meyer N. Developing digital interventions for people living with serious mental illness: perspectives from three mHealth studies. EVIDENCE-BASED MENTAL HEALTH 2017; 20:98-101. [PMID: 29025862 PMCID: PMC5750413 DOI: 10.1136/eb-2017-102765] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/15/2017] [Revised: 09/10/2017] [Accepted: 09/13/2017] [Indexed: 12/29/2022]
Abstract
The rapidly expanding field of mobile health (mHealth) seeks to harness increasingly affordable and ubiquitous mobile digital technologies including smartphones, tablets, apps and wearable devices to enhance clinical care. Accumulating evidence suggests that mHealth interventions are increasingly being adopted and valued by people living with serious mental illnesses such as schizophrenia and bipolar disorder, as a means of better understanding and managing their condition. We draw on experiences from three geographically and methodologically distinct mHealth studies to provide a pragmatic overview of the key challenges and considerations relating to the process of developing digital interventions for this population.
Collapse
Affiliation(s)
- Bruno Biagianti
- Department of Psychiatry, University of California at San Francisco, San Francisco, California, USA.,Department of Health Sciences, University of Milan, Milan, Italy.,Research and Development, Posit Science Inc., San Francisco, California, USA
| | - Diego Hidalgo-Mazzei
- Department of Psychiatry and Psychology, Bipolar Disorders Program, Institute of Neuroscience, Hospital Clinic, University of Barcelona, IDIBAPS, CIBERSAM, Barcelona, Spain
| | - Nicholas Meyer
- Department of Psychosis Studies, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| |
Collapse
|
26
|
Biagianti B, Fisher M, Howard L, Rowlands A, Vinogradov S, Woolley J. Feasibility and preliminary efficacy of remotely delivering cognitive training to people with schizophrenia using tablets. SCHIZOPHRENIA RESEARCH-COGNITION 2017; 10:7-14. [PMID: 28824850 PMCID: PMC5544490 DOI: 10.1016/j.scog.2017.07.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 05/19/2017] [Revised: 07/26/2017] [Accepted: 07/27/2017] [Indexed: 01/13/2023]
Abstract
Background Limited access to Cognitive Training (CT) for people with schizophrenia (SZ) prevents widespread adoption of this intervention. Delivering CT remotely via tablets may increase accessibility, improve scheduling flexibility, and diminish patient burden. Methods In this reanalysis of data from a larger trial of CT, we compared two samples of individuals with SZ who chose to complete 40 h of CT either on desktop computers in the laboratory (N = 33) or remotely via iPads (N = 41). We examined attrition rates and adherence to training, and investigated whether remote iPad-based CT and in-person desktop-based CT induced significantly different improvements in cognitive and real-world functioning. Results The attrition rate was 36.6%. On average, participants completed 3.06 h of CT per week. There were no significant between-group differences in attrition and adherence to CT requirements. Participants who completed iPad-based CT were significantly younger and had lower symptoms at baseline compared to participants who completed CT on the lab desktops. Controlling for age and symptom severity, rANCOVA showed that iPad-based and desktop-based CT similarly and significantly improved verbal learning and problem solving. Main effects of time, at trend level significance, were evident in global cognition, verbal memory, quality of life, and social functioning. All group by time interactions were non-significant except for verbal memory, where iPad users showed greater gains. Within-group effect sizes for changes in outcomes were in the small range. Conclusion Although underpowered and not randomized, this study demonstrates that delivering CT remotely to people with SZ using tablets is feasible and results in retention rates, adherence, and cognitive and functional outcome improvements that are comparable to those observed when CT is delivered in the laboratory. This has important implications in terms of scalability and dissemination of CT. These results require confirmation in larger samples.
Collapse
Affiliation(s)
- Bruno Biagianti
- Department of Psychiatry, University of California, San Francisco, USA.,Posit Science, Inc., USA
| | | | - Lisa Howard
- Department of Psychiatry, University of California, San Francisco, USA
| | - Abby Rowlands
- Department of Psychiatry, University of California, San Francisco, USA
| | | | - Joshua Woolley
- Department of Psychiatry, University of California, San Francisco, USA
| |
Collapse
|