1
|
Ng TJ, Ling J, Robbins LB, Kao TSA. Stress Management Interventions Among U.S. High School Adolescents: A Meta-Analysis. J Am Psychiatr Nurses Assoc 2024; 30:252-278. [PMID: 36971329 DOI: 10.1177/10783903231161608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
BACKGROUND Adolescent ineffective stress management has been associated with negative health outcomes, such as anxiety and depression. Comprehensively evaluating the effects of stress management interventions is needed. AIMS The aim of this study was to quantitatively evaluate the effects of stress management interventions on mental health outcomes (stress, anxiety, depression, and positive and negative affect) and perform moderation analysis to identify moderators of intervention effects on stress, anxiety, and depression among U.S. high school adolescents. METHODS Four databases (CINAHL, ERIC, PubMed, and PsycINFO) were searched. After literature screening, 24 articles describing 25 studies were retained. Hedge's g was calculated using random-effects models. Exploratory moderation analyses were performed to identify moderators. RESULTS The pooled effects on reducing stress were -0.36. The interventions had small effects on decreasing anxiety (g = -0.31) and depression (g = -0.23). Long-term follow-up effects were -0.77 on perceived stress, -0.08 on anxiety, and -0.19 on depression. Mind-body and cognitive-behavioral interventions had moderate effects on reducing anxiety (g = -0.51). Interventions with longer duration (>8 weeks) were more effective in reducing anxiety (-0.39 vs. -0.26) and depression (-0.36 vs. -0.17). CONCLUSIONS These findings support the short-term effectiveness of stress management interventions in improving mental health among high school adolescents in the United States. Subsequent research efforts should focus on sustaining long-term effects.
Collapse
Affiliation(s)
- Teresa J Ng
- Teresa J. Ng, PhD Student, BSN, RN, Michigan State University College of Nursing, East Lansing, MI, USA
| | - Jiying Ling
- Jiying Ling, PhD, RN, FAAN, Michigan State University College of Nursing, East Lansing, MI, USA
| | - Lorraine B Robbins
- Lorraine B. Robbins, PhD, RN, FNP-BC, FAAN, Michigan State University College of Nursing, East Lansing, MI, USA
| | - Tsui-Sui A Kao
- Tsui-sui "Annie" Kao, PhD, RN, FNP-BC, FAANP, Michigan State University College of Nursing, East Lansing, MI, USA
| |
Collapse
|
2
|
Ho TQA, Le LKD, Engel L, Le N, Melvin G, Le HND, Mihalopoulos C. Barriers to and facilitators of user engagement with web-based mental health interventions in young people: a systematic review. Eur Child Adolesc Psychiatry 2024:10.1007/s00787-024-02386-x. [PMID: 38356043 DOI: 10.1007/s00787-024-02386-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 01/22/2024] [Indexed: 02/16/2024]
Abstract
Many young people (YP) are diagnosed with mental illnesses and require support. Web-based mental health interventions (W-MHIs) have been increasingly utilized by YP, healthcare providers, and parents due to reasons including convenience and anonymity. W-MHIs are effective in improving mental health in YP. However, real-world engagement with W-MHIs remains low. Therefore, understanding barriers/facilitators of user engagement with W-MHIs is necessary to promote W-MHIs and help users gain optimal benefits through higher engagement. This review aims to identify barriers/facilitators of user engagement with W-MHIs in YP aged 10-24 years. A systematic search of five databases for English language, peer-reviewed publications was conducted between January 2010 and February 2023. Studies examining factors influencing user engagement with W-MHIs, described as barriers or facilitators, were included. Study quality was assessed using the Mixed Methods Appraisal Tool. A narrative synthesis was performed. Of 4088 articles identified, 69 studies were included. Barriers/facilitators were reported by young people (63 studies), providers (17 studies), and parents/caregivers (8 studies). YP perceived that usefulness and connectedness were the most common facilitators, whereas low-perceived need was the most reported barrier. Both providers and parents reported that perceived usefulness for YP was the most common facilitator, whereas concerns about program effectiveness and privacy were noted as barriers. This review found that program- and individual-related factors were important determinants of engagement with W-MHIs. This review provides guidance on the future design and development of new interventions, narrowing the gap between existing W-MHIs and unmet needs of users.
Collapse
Affiliation(s)
- Thi Quynh Anh Ho
- Deakin Health Economics, School of Health and Social Development, Institute for Health Transformation, Deakin University, Melbourne, VIC, Australia.
| | - Long Khanh-Dao Le
- Monash University Health Economics Group, School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
| | - Lidia Engel
- Monash University Health Economics Group, School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
| | - Ngoc Le
- Deakin Health Economics, School of Health and Social Development, Institute for Health Transformation, Deakin University, Melbourne, VIC, Australia
| | - Glenn Melvin
- School of Psychology, Deakin University, Melbourne, VIC, Australia
| | - Ha N D Le
- Deakin Health Economics, School of Health and Social Development, Institute for Health Transformation, Deakin University, Melbourne, VIC, Australia
| | - Cathrine Mihalopoulos
- Monash University Health Economics Group, School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
| |
Collapse
|
3
|
Smith MVA, Grohmann D, Trivedi D. Use of social media in recruiting young people to mental health research: a scoping review. BMJ Open 2023; 13:e075290. [PMID: 38016791 PMCID: PMC10685975 DOI: 10.1136/bmjopen-2023-075290] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 11/09/2023] [Indexed: 11/30/2023] Open
Abstract
OBJECTIVES This review explored the literature on the use of social media in recruiting young people, aged 13-18 years, to mental health research. It aimed to identify barriers and facilitators to recruitment and strategies to improve participation in future research. DESIGN Scoping review. DATA SOURCES Articles published between January 2011 and February 2023 were searched for on PubMed, Scopus, Medline (via EBSCOhost) and Cochrane Library databases. ELIGIBILITY CRITERIA Studies that outlined social media as a recruitment method and recruited participants aged 13-18 years. DATA EXTRACTION AND SYNTHESIS Data was extracted by two reviewers independently and cross-checked by a third reviewer. Data on study design, aims, participants, recruitment methods and findings related specifically to social media as a recruitment tool were collected. RESULTS 24 journal articles met the inclusion criteria. Studies were predominantly surveys (n=13) conducted in the USA (n=16) recruiting via Facebook (n=16) and/or Instagram (n=14). Only nine of the included articles provided a summary of success and reviewed the efficacy of social media recruitment for young people in mental health research. Type of advertisement, the language used, time of day and the use of keywords were all found to be factors that may influence the success of recruitment through social media; however, as these are based on findings from a small number of studies, such potential influences require further investigation. CONCLUSION Social media recruitment can be a successful method for recruiting young people to mental health research. Further research is needed into recruiting socioeconomically marginalised groups using this method, as well as the effectiveness of new social media platforms. REGISTRATION Open Science Framework Registry (https://osf.io/mak75/).
Collapse
Affiliation(s)
- Megan V A Smith
- Life and Medical Sciences, University of Hertfordshire, Hatfield, UK
| | | | - Daksha Trivedi
- Health and Social Work, University of Hertfordshire, Hatfield, UK
| |
Collapse
|
4
|
Duffecy J, Grekin R, Long JD, Mills JA, O'Hara M. Randomized controlled trial of Sunnyside: Individual versus group-based online interventions to prevent postpartum depression. J Affect Disord 2022; 311:538-547. [PMID: 35654284 PMCID: PMC11078531 DOI: 10.1016/j.jad.2022.05.123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 05/23/2022] [Accepted: 05/27/2022] [Indexed: 12/30/2022]
Abstract
BACKGROUND Postpartum depression (PPD) is a serious mental health problem that has a prevalence rate of nearly 20% in the first three months after delivery. The purpose of this study was to evaluate the benefit of Sunnyside, an internet-based cognitive-behavioral intervention, delivered in a group format compared to the same intervention delivered individually for the prevention of PPD. METHOD 210 people between 20- and 28-weeks gestation and who scored between 5 and 14 on the PHQ-8 and who did not meet criteria for major depression were recruited online. The Inventory of Depression and Anxiety Symptoms (IDAS), the Hamilton Rating Scale for Depression (HAMD), and the depression and anxiety modules of the MINI were obtained at baseline, post-treatment, and 12-weeks postpartum. Intervention adherence was measured by site usage. RESULTS Across self-report and interview measures of depression there were no significant differences in outcome between the group and the individual versions of the program. Rates of major depression and generalized anxiety disorder in the postpartum period were low and adherence to the conditions was similarly high. Participants in the individual condition were significantly more satisfied than participants in the group condition (p < 0.05). LIMITATIONS The sample was predominantly white (85%) and recruited online, which may limit generalizability. CONCLUSIONS The group intervention was not more effective than the individual intervention. However, ignoring groups, many measures improved over time. The results of this study provide evidence that mood symptoms improve when participating in an online preventive intervention for postpartum depression.
Collapse
Affiliation(s)
- Jennifer Duffecy
- University of Illinois - Chicago, Department of Psychiatry, United States of America.
| | - Rebecca Grekin
- University of Iowa, Department of Psychological and Brain Sciences, United States of America
| | - Jeffrey D Long
- University of Iowa, Department of Psychiatry, United States of America; University of Iowa, Department of Biostatistics, United States of America
| | - James A Mills
- University of Iowa, Department of Psychiatry, United States of America
| | - Michael O'Hara
- University of Iowa, Department of Psychological and Brain Sciences, United States of America
| |
Collapse
|
5
|
Wu H, Ji JM, Qian Y, Jin XH, Yu HR, Liu XM, Du L, Fu XL, Chen HL. Relationship between depressive symptoms and internet usage time among adolescents: Results from a nationwide survey. Psychiatry Res 2022; 313:114603. [PMID: 35544986 DOI: 10.1016/j.psychres.2022.114603] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/21/2021] [Revised: 04/30/2022] [Accepted: 05/02/2022] [Indexed: 12/27/2022]
Abstract
Adolescent depression is becoming a public health problem. In this study the association between depressive symptoms and internet usage time in adolescents was examined, with data collected from the China Education Tracking Survey (CEPS). The survey is publicly available and carried out nationwide. A logistic regression analysis was conducted with odds ratios (OR) and 95% confidence intervals (CI), the subgroup analysis examined the relationships between internet usage time and depressive symptoms. A total of 10,705 adolescents were involved, where 46.4% of them are caught by the internet for more than two hours per day. Adolescents keeping on the internet for 6-8 h per day were reported to have higher odds of depressive symptoms than adolescents who were free from it with the confounders of individual, family, and school adjusted, which were observed among groups with a medium family economic status without living with their father and with a sleep time less than nine hours. The results revealed that adolescents spending more time online had a higher risk of experiencing depression symptoms. This study suggested that it is helpful for mental health professionals to evaluate and develop prevention interventions for depressive symptoms in adolescents promptly through monitoring and managing online time.
Collapse
Affiliation(s)
- Hua Wu
- School of Medicine, Nantong University, Nantong, Jiangsu, PR China
| | - Jia-Mei Ji
- School of Medicine, Nantong University, Nantong, Jiangsu, PR China; Nantong Tongzhou District People's Hospital, Nantong, Jiangsu, PR China
| | - Yan Qian
- Department of Oncology, Affiliated Hospital of Nantong University, Nantong, Jiangsu, PR China
| | - Xiao-Hong Jin
- Department of Oncology, Affiliated Hospital of Nantong University, Nantong, Jiangsu, PR China
| | - Hai-Rong Yu
- Department of Thoracic Oncology, Affiliated Hospital of Nantong University, Nantong, Jiangsu, PR China
| | - Xiao-Man Liu
- Department of Ophthalmology, Affiliated Hospital of Nantong University, Nantong, Jiangsu, PR China
| | - Lin Du
- School of Medicine, Nantong University, Nantong, Jiangsu, PR China
| | - Xue-Lei Fu
- School of Medicine, Nantong University, Nantong, Jiangsu, PR China
| | - Hong-Lin Chen
- School of Public Health, Nantong University, 9# Se yuan Road, Nantong, Jiangsu 226000, PR China.
| |
Collapse
|
6
|
Hill C, Reardon T, Taylor L, Creswell C. Online Support and Intervention for Child Anxiety (OSI): Development and Usability Testing. JMIR Form Res 2022; 6:e29846. [PMID: 35416781 PMCID: PMC9047721 DOI: 10.2196/29846] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Revised: 10/18/2021] [Accepted: 01/07/2022] [Indexed: 01/29/2023] Open
Abstract
BACKGROUND Internet-based treatments for child anxiety may help to increase access to evidence-based therapies; however, user engagement, uptake, and adherence within routine clinical practice remain as challenges. Involving the intended end users in the development process through user-centered design and usability testing is crucial for maximizing user engagement and adoption of internet-based treatments, but so far this has been lacking for internet-based treatments for child anxiety. OBJECTIVE The aim of this study is to develop an internet-based treatment for child anxiety through a process of user-centered design (phase 1) and usability testing (phase 2), based on an existing evidence-based, face-to-face, therapist-supported, parent-led cognitive behavioral therapy intervention. It is intended that the internet-based version of this treatment would consist of a parent website, case management system for clinicians, and mobile game app for children. METHODS Parents, children, and clinicians who were familiar with the face-to-face version of the treatment were recruited from 2 National Health Service clinics. In phase 1, participants participated in 3 workshops to gain feedback on the overall concept, explore their wants and needs for the websites and game, generate ideas on how the treatment may look, and gain feedback on initial mock-ups of the websites and game. In phase 2, participants attended 3 individual usability testing sessions where they were presented with working prototypes of the website or game and asked to perform a series of tasks on the website (parents and clinicians) or play the game (children). The frequency and details on usability errors were recorded. Participants were asked for their feedback on the website and game using a standardized usability questionnaire and semistructured interviews. The websites and game were iterated after each round of usability testing in response to this feedback. RESULTS In phase 1, participants approved the general concept and rated the initial mock-ups of the website and game positively. In phase 2, working prototypes were rated positively and usability errors declined across the iterations and were mainly cosmetic or minor issues relating to esthetic preference, with few issues regarding ability to navigate the website or technical issues affecting functionality. Feedback from the semistructured interviews further supported the positive response of participants to the website and game, and helped identify areas for improvement during the iteration process. The final iteration of the website and game are presented. CONCLUSIONS Taking an iterative approach to development through user-centered design and usability testing has resulted in an internet-based treatment for child anxiety (Online Support and Intervention for child anxiety) that appears to meet the needs and expectations of the intended users (parents, children, and clinicians) and is easy and enjoyable to use.
Collapse
Affiliation(s)
- Claire Hill
- School of Psychology & Clinical Language Sciences, University of Reading, Reading, United Kingdom
| | - Tessa Reardon
- Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Lucy Taylor
- School of Psychology & Clinical Language Sciences, University of Reading, Reading, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Cathy Creswell
- Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
7
|
Newton AS, March S, Gehring ND, Rowe AK, Radomski AD. Establishing a Working Definition of User Experience for eHealth Interventions of Self-reported User Experience Measures With eHealth Researchers and Adolescents: Scoping Review. J Med Internet Res 2021; 23:e25012. [PMID: 34860671 PMCID: PMC8686463 DOI: 10.2196/25012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 03/27/2021] [Accepted: 09/23/2021] [Indexed: 01/16/2023] Open
Abstract
BACKGROUND Across eHealth intervention studies involving children, adolescents, and their parents, researchers have measured user experience to assist with intervention development, refinement, and evaluation. To date, no widely accepted definitions or measures of user experience exist to support a standardized approach for evaluation and comparison within or across interventions. OBJECTIVE We conduct a scoping review with subsequent Delphi consultation to identify how user experience is defined and measured in eHealth research studies, characterize the measurement tools used, and establish working definitions for domains of user experience that could be used in future eHealth evaluations. METHODS We systematically searched electronic databases for published and gray literature available from January 1, 2005, to April 11, 2019. We included studies assessing an eHealth intervention that targeted any health condition and was designed for use by children, adolescents, and their parents. eHealth interventions needed to be web-, computer-, or mobile-based, mediated by the internet with some degree of interactivity. We required studies to report the measurement of user experience as first-person experiences, involving cognitive and behavioral factors reported by intervention users. We appraised the quality of user experience measures in included studies using published criteria: well-established, approaching well-established, promising, or not yet established. We conducted a descriptive analysis of how user experience was defined and measured in each study. Review findings subsequently informed the survey questions used in the Delphi consultations with eHealth researchers and adolescent users for how user experience should be defined and measured. RESULTS Of the 8634 articles screened for eligibility, 129 articles and 1 erratum were included in the review. A total of 30 eHealth researchers and 27 adolescents participated in the Delphi consultations. On the basis of the literature and consultations, we proposed working definitions for 6 main user experience domains: acceptability, satisfaction, credibility, usability, user-reported adherence, and perceived impact. Although most studies incorporated a study-specific measure, we identified 10 well-established measures to quantify 5 of the 6 domains of user experience (all except for self-reported adherence). Our adolescent and researcher participants ranked perceived impact as one of the most important domains of user experience and usability as one of the least important domains. Rankings between adolescents and researchers diverged for other domains. CONCLUSIONS Findings highlight the various ways in which user experience has been defined and measured across studies and what aspects are most valued by researchers and adolescent users. We propose incorporating the working definitions and available measures of user experience to support consistent evaluation and reporting of outcomes across studies. Future studies can refine the definitions and measurement of user experience, explore how user experience relates to other eHealth outcomes, and inform the design and use of human-centered eHealth interventions.
Collapse
Affiliation(s)
- Amanda S Newton
- Department of Pediatrics, University of Alberta, Edmonton, AB, Canada
| | - Sonja March
- School of Psychology and Counselling, Centre for Health Research, University of Southern Queensland, Springfield Central, Australia
| | - Nicole D Gehring
- Department of Pediatrics, University of Alberta, Edmonton, AB, Canada
| | - Arlen K Rowe
- School of Psychology and Counselling, Centre for Health Research, University of Southern Queensland, Springfield Central, Australia
| | - Ashley D Radomski
- Knowledge Institute for Child and Youth Mental Health and Addictions, Ottawa, ON, Canada.,CHEO (Children's Hospital of Eastern Ontario) Research Institute, Ottawa, ON, Canada
| |
Collapse
|
8
|
van Doorn M, Nijhuis LA, Egeler MD, Daams JG, Popma A, van Amelsvoort T, McEnery C, Gleeson JF, Öry FG, Avis KA, Ruigt E, Jaspers MWM, Alvarez-Jimenez M, Nieman DH. Online Indicated Preventive Mental Health Interventions for Youth: A Scoping Review. Front Psychiatry 2021; 12:580843. [PMID: 33995136 PMCID: PMC8116558 DOI: 10.3389/fpsyt.2021.580843] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Accepted: 03/30/2021] [Indexed: 12/16/2022] Open
Abstract
Objective: Between the ages of 12 and 25 the onset of mental disorders typically occurs, and the burden of mental health problems is greatest for this group. Indicated preventive interventions to target individuals with subclinical symptoms to prevent the transition to clinical levels of disorders have gained considerable traction. However, the threshold to seek help appears to be high even when help is needed. Online interventions could offer a solution, especially during the COVID-19 pandemic. This scoping review will present an overview of the recent research of indicated online preventive interventions for youth (12-25 years) experiencing the early stages of mental health complaints with the aim of identifying the nature and extent of the research evidence. Methods: The 5-stage framework by Arksey and O'Malley was used. Academic literature published from 2013 onwards in printed or electronic format was included from Scopus, PsychINFO, and Ovid MEDLINE(R) ALL. Results: The search yielded 11,122 results, with the final selection resulting in inclusion of 30 articles for this review. In total, the articles included 4,950 participants. 26.7% of the selected articles focused on youth between 12 and 25 years. Of the articles 60% did not screen for, nor exclude participants with clinical levels of symptoms. Most studies used a common evidence-based therapy for the disorder-category targeted. More than half of the online interventions included some form of human support. Adherence levels ranged between 27.9 and 98%. The results indicate general effectiveness, usability and acceptability of online indicated preventive interventions. The most commonly used approach was CBT (n = 12 studies). Studies varied in their size, rigor of study, effectiveness and outcome measures. Online interventions with a combination of clinical and peer moderation (n = 3 studies) appear to result in the most stable and highest effect sizes. Conclusion: Online indicated preventive mental health interventions for youth with emerging mental health issues show promise in reducing various mental health complaints, and increasing positive mental health indicators such as well-being and resilience. Additionally, high levels of usability and acceptability were found. However, the included studies show important methodological shortcomings. Also, the research has mainly focused on specific diagnostic categories, meaning there is a lack of transdiagnostic approaches. Finally, clear definitions of- as well as instruments to measure- emerging or subclinical mental health symptoms in youth remain are missing.
Collapse
Affiliation(s)
| | | | - Mees D. Egeler
- Amsterdam University Medical Centers, Amsterdam, Netherlands
| | - Joost G. Daams
- Amsterdam University Medical Centers, Amsterdam, Netherlands
| | - Arne Popma
- Amsterdam University Medical Centers, Amsterdam, Netherlands
| | - Thérèse van Amelsvoort
- Department of Psychiatry and Neuropsychology, Maastricht University, Maastricht, Netherlands
| | - Carla McEnery
- Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
- Orygen, Parkville, VIC, Australia
| | - John F. Gleeson
- Orygen, Parkville, VIC, Australia
- Healthy Brain and Mind Research Centre and School of Behavioural and Health Sciences, Australian Catholic University, Melbourne, VIC, Australia
| | - Ferko G. Öry
- Erasmus University College, Rotterdam, Netherlands
| | - Kate A. Avis
- Amsterdam University Medical Centers, Amsterdam, Netherlands
| | - Emma Ruigt
- Amsterdam University Medical Centers, Amsterdam, Netherlands
- Minddistrict, Amsterdam, Netherlands
| | | | - Mario Alvarez-Jimenez
- Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
- Orygen, Parkville, VIC, Australia
| | | |
Collapse
|
9
|
Albritton T, Ford KL, Elsbernd K, Santodomingo M, Juzang I, Weddington P, Bull S. Implementing a Peer Advocate Mental Health Digital Intervention Program for Ohio Youth: Descriptive Pilot Study. JMIR Ment Health 2021; 8:e24605. [PMID: 33890868 PMCID: PMC8105753 DOI: 10.2196/24605] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/26/2020] [Revised: 01/29/2021] [Accepted: 02/05/2021] [Indexed: 01/13/2023] Open
Abstract
BACKGROUND In the United States, millions of adolescents report poor mental health, where 1 in 5 teenagers considers suicide. Reducing stigma and fostering peer support remains critical for positive mental health interventions and programs. Increasingly, digital mental health tools have emerged with great promise, leveraging social networks. Despite the potential, limited understanding of such comprehensive programs and their implementation exist. OBJECTIVE The objective of this study investigates a piloted digital mental health training program (Be Present) for youth, specifically describing the impact on youth behavioral outcomes and user engagement and identifying high-risk youth in the early phases of prevention. METHODS Eligibility included Ohio residents (aged 14 to 22 years) to be enrolled as either a Friend or a Peer Advocate. From May 1 to June 1, 2019, participants completed the Advocate training course, taking pretest and posttest surveys. Single-arm descriptive analyses measured youth outcomes (self-efficacy, intentions, behaviors, social support, knowledge, and sources of strength) and engagement and assessed risk based on survey responses. RESULTS A total of 65 adolescents participated, with 54 completing both pretest and posttest surveys. The majority of participants included non-Hispanic White females. Findings illustrated a significant increase in self-report of referrals for mental health services as well as in perceptions that youth had of experiencing social support; however, no significant differences were found for measures of self-efficacy, knowledge, and sources of strength between pretest and posttest surveys. Roughly two-thirds of the participants completed all of the Advocate training modules, and we observed a gradual decline in engagement. Most respondents who received escalated high-risk response messages identified as female. CONCLUSIONS The pilot presented promise for implementing a digital mental health program focused on peer support, specifically observing reported youth behavioral outcomes and user engagement and identifying high-risk youth. Various limitations exist given the small nonrepresentative sample and lack of control group. All findings should be considered preliminary to a larger trial and underscore the feasibility of delivering online training programs to bolster adolescent mental health. Such formative evaluation proved critical for future implementation and research, offering opportunity for substantial improvements for real-world digital mental health programs.
Collapse
Affiliation(s)
- Tashuna Albritton
- CUNY School of Medicine, City College of New York, New York, NY, United States
| | - Kelsey Lynett Ford
- Colorado School of Public Health, University of Colorado, Aurora, CO, United States
| | - Kira Elsbernd
- Colorado School of Public Health, University of Colorado, Aurora, CO, United States
| | - Melodie Santodomingo
- Colorado School of Public Health, University of Colorado, Aurora, CO, United States
| | - Ivan Juzang
- MEE Productions Inc, Philadelphia, PA, United States
| | | | - Sheana Bull
- Colorado School of Public Health, University of Colorado, Aurora, CO, United States
| |
Collapse
|
10
|
Javidi H, Widman L, Lipsey N, Brasileiro J, Javidi F, Jhala A. Redeveloping a Digital Sexual Health Intervention for Adolescents to Allow for Broader Dissemination: Implications for HIV and STD Prevention. AIDS EDUCATION AND PREVENTION : OFFICIAL PUBLICATION OF THE INTERNATIONAL SOCIETY FOR AIDS EDUCATION 2021; 33:89-102. [PMID: 33821678 DOI: 10.1521/aeap.2021.33.2.89] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
HIV/STDs and unintended pregnancy persist among adolescents in the United States; thus, effective sexual health interventions that can be broadly disseminated are necessary. Digital health interventions are highly promising because they allow for customization and widespread reach. The current project involved redeveloping and expanding HEART (Health Education and Relationship Training)-a brief, digital sexual health intervention efficacious at improving safer sex knowledge, self-efficacy, and behavior-onto an open-source platform to allow for greater interactivity and accessibility while reducing long-term program costs. The authors describe the process of adapting, reprogramming, and evaluating the new program, which may serve as a guide for investigators seeking to adapt behavioral interventions onto digital platforms. The final product is an open-source intervention that can be easily adapted for new populations. Among 233 adolescents (Mage = 15.06; 64% girls), HEART was highly acceptable and generally feasible to administer, with no differences in acceptability by gender or sexual identity.
Collapse
Affiliation(s)
- Hannah Javidi
- North Carolina State University, Department of Psychology, Raleigh, North Carolina
| | - Laura Widman
- North Carolina State University, Department of Psychology, Raleigh, North Carolina
| | - Nikolette Lipsey
- North Carolina State University, Department of Psychology, Raleigh, North Carolina
| | - Julia Brasileiro
- North Carolina State University, Department of Psychology, Raleigh, North Carolina
| | - Farhad Javidi
- Central Piedmont Community College, Simulation and Game Development, Charlotte, North Carolina
| | - Arnav Jhala
- North Carolina State University, Department of Computer Science, Raleigh, North Carolina
| |
Collapse
|
11
|
Borghouts J, Eikey E, Mark G, De Leon C, Schueller SM, Schneider M, Stadnick N, Zheng K, Mukamel D, Sorkin DH. Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review. J Med Internet Res 2021; 23:e24387. [PMID: 33759801 PMCID: PMC8074985 DOI: 10.2196/24387] [Citation(s) in RCA: 275] [Impact Index Per Article: 91.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 12/24/2020] [Accepted: 02/08/2021] [Indexed: 01/14/2023] Open
Abstract
Background Digital mental health interventions (DMHIs), which deliver mental health support via technologies such as mobile apps, can increase access to mental health support, and many studies have demonstrated their effectiveness in improving symptoms. However, user engagement varies, with regard to a user’s uptake and sustained interactions with these interventions. Objective This systematic review aims to identify common barriers and facilitators that influence user engagement with DMHIs. Methods A systematic search was conducted in the SCOPUS, PubMed, PsycINFO, Web of Science, and Cochrane Library databases. Empirical studies that report qualitative and/or quantitative data were included. Results A total of 208 articles met the inclusion criteria. The included articles used a variety of methodologies, including interviews, surveys, focus groups, workshops, field studies, and analysis of user reviews. Factors extracted for coding were related to the end user, the program or content offered by the intervention, and the technology and implementation environment. Common barriers included severe mental health issues that hampered engagement, technical issues, and a lack of personalization. Common facilitators were social connectedness facilitated by the intervention, increased insight into health, and a feeling of being in control of one’s own health. Conclusions Although previous research suggests that DMHIs can be useful in supporting mental health, contextual factors are important determinants of whether users actually engage with these interventions. The factors identified in this review can provide guidance when evaluating DMHIs to help explain and understand user engagement and can inform the design and development of new digital interventions.
Collapse
Affiliation(s)
| | - Elizabeth Eikey
- University of California San Diego, San Diego, CA, United States
| | - Gloria Mark
- University of California Irvine, Irvine, CA, United States
| | | | | | | | - Nicole Stadnick
- University of California San Diego, San Diego, CA, United States
| | - Kai Zheng
- University of California Irvine, Irvine, CA, United States
| | - Dana Mukamel
- University of California Irvine, Irvine, CA, United States
| | - Dara H Sorkin
- University of California Irvine, Irvine, CA, United States
| |
Collapse
|
12
|
Sanchez C, Grzenda A, Varias A, Widge AS, Carpenter LL, McDonald WM, Nemeroff CB, Kalin NH, Martin G, Tohen M, Filippou-Frye M, Ramsey D, Linos E, Mangurian C, Rodriguez CI. Social media recruitment for mental health research: A systematic review. Compr Psychiatry 2020; 103:152197. [PMID: 32992073 PMCID: PMC7704547 DOI: 10.1016/j.comppsych.2020.152197] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 07/14/2020] [Accepted: 08/06/2020] [Indexed: 12/29/2022] Open
Abstract
BACKGROUND Social media holds exciting promise for advancing mental health research recruitment, however, the extent and efficacy to which these platforms are currently in use are underexplored. OBJECTIVE A systematic review was conducted to characterize the current use and efficacy of social media in recruiting participants for mental health research. METHOD A literature review was performed using MEDLINE, EMBASE, and PsychINFO. Only non-duplicative manuscripts written in the English language and published between 1/1/2004-3/31/2019 were selected for further screening. Data extracted included study type and design, participant inclusion criteria, social media platform, advertising strategy, final recruited sample size, recruitment location, year, monetary incentives, comparison to other recruitment methods if performed, and final cost per participant. RESULTS A total of 176 unique studies that used social media for mental health research recruitment were reviewed. The majority of studies were cross-sectional (62.5%) in design and recruited adults. Facebook was overwhelmingly the recruitment platform of choice (92.6%), with the use of paid advertisements being the predominant strategy (60.8%). Of the reviewed studies, substance abuse (43.8%) and mood disorders (15.3%) were the primary subjects of investigation. In 68.3% of studies, social media recruitment performed as well as or better than traditional recruitment methods in the number and cost of final enrolled participants. The majority of studies used Facebook for recruitment at a median cost per final recruited study participant of $19.47. In 55.6% of the studies, social media recruitment was the more cost-effective recruitment method when compared to traditional methods (e.g., referrals, mailing). CONCLUSION Social media appears to be an effective and economical recruitment tool for mental health research. The platform raises methodological and privacy concerns not covered in current research regulations that warrant additional consideration.
Collapse
Affiliation(s)
- Catherine Sanchez
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Adrienne Grzenda
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
| | - Andrea Varias
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Alik S Widge
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, MN, USA
| | - Linda L Carpenter
- Department of Psychiatry and Human Behavior, Butler Hospital and Warren Alpert Medical School, Brown University, Providence, RI, USA
| | - William M McDonald
- Department of Psychiatry and Human Behavior, Emory University School of Medicine, Atlanta, GA, USA
| | - Charles B Nemeroff
- Department of Psychiatry, University of Texas at Austin Dell Medical School, Austin, TX, USA
| | - Ned H Kalin
- Department of Psychiatry, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA
| | - Glenn Martin
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Mauricio Tohen
- Department of Psychiatry and Behavioral Sciences, University of New Mexico Health Sciences Center, Albuquerque, NM, USA
| | - Maria Filippou-Frye
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Drew Ramsey
- Department of Psychiatry, Columbia University, New York, NY, USA
| | - Eleni Linos
- Department of Dermatology, Stanford University, Stanford, CA, USA
| | - Christina Mangurian
- Department of Psychiatry, Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA; UCSF Center for Vulnerable Populations, University of California San Francisco, San Francisco, CA, USA; UCSF Philip R. Lee Institute for Health Policy Studies, University of California San Francisco, San Francisco, CA, USA
| | - Carolyn I Rodriguez
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA; Veterans Affairs Palo Alto Health Care System, Palo Alto, CA, USA.
| |
Collapse
|
13
|
Bergin AD, Vallejos EP, Davies EB, Daley D, Ford T, Harold G, Hetrick S, Kidner M, Long Y, Merry S, Morriss R, Sayal K, Sonuga-Barke E, Robinson J, Torous J, Hollis C. Preventive digital mental health interventions for children and young people: a review of the design and reporting of research. NPJ Digit Med 2020; 3:133. [PMID: 33083568 PMCID: PMC7562906 DOI: 10.1038/s41746-020-00339-7] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Accepted: 09/18/2020] [Indexed: 02/02/2023] Open
Abstract
Digital health interventions (DHIs) have frequently been highlighted as one way to respond to increasing levels of mental health problems in children and young people. Whilst many are developed to address existing mental health problems, there is also potential for DHIs to address prevention and early intervention. However, there are currently limitations in the design and reporting of the development, evaluation and implementation of preventive DHIs that can limit their adoption into real-world practice. This scoping review aimed to examine existing evidence-based DHI interventions and review how well the research literature described factors that researchers need to include in their study designs and reports to support real-world implementation. A search was conducted for relevant publications published from 2013 onwards. Twenty-one different interventions were identified from 30 publications, which took a universal (n = 12), selective (n = 3) and indicative (n = 15) approach to preventing poor mental health. Most interventions targeted adolescents, with only two studies including children aged ≤10 years. There was limited reporting of user co-design involvement in intervention development. Barriers and facilitators to implementation varied across the delivery settings, and only a minority reported financial costs involved in delivering the intervention. This review found that while there are continued attempts to design and evaluate DHIs for children and young people, there are several points of concern. More research is needed with younger children and those from poorer and underserved backgrounds. Co-design processes with children and young people should be recognised and reported as a necessary component within DHI research as they are an important factor in the design and development of interventions, and underpin successful adoption and implementation. Reporting the type and level of human support provided as part of the intervention is also important in enabling the sustained use and implementation of DHIs.
Collapse
Affiliation(s)
- Aislinn D. Bergin
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, Mental Health and Technology Theme, University of Nottingham, Nottingham, UK
| | - Elvira Perez Vallejos
- NIHR Nottingham Biomedical Research Centre, Mental Health and Technology Theme, University of Nottingham, Nottingham, UK
| | - E. Bethan Davies
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, Mental Health and Technology Theme, University of Nottingham, Nottingham, UK
| | - David Daley
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
- Division of Psychiatry and Applied Psychology, University of Nottingham, Nottingham, UK
- Centre for ADHD and Neurodevelopmental Disorders Across the Lifespan, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
| | - Tamsin Ford
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | - Gordon Harold
- Faculty of Education, University of Cambridge, Cambridge, UK
- MRC Centre for Neuropsychiatric Genetics and Genomics, Division of Psychological Medicine and Clinical Neurosciences, Cardiff University, Cardiff, UK
- School of Psychology, Trinity College Dublin, Dublin, Ireland
| | - Sarah Hetrick
- Department of Psychological Medicine, The University of Auckland, Auckland, New Zealand
- Orygen, University of Melbourne, Parkville, Australia
| | - Megan Kidner
- The Children and Young People’s Mental Health Research Collaboration, University of Exeter, Exeter, UK
| | - Yunfei Long
- Horizon Digital Economy Research Institute, University of Nottingham, Nottingham, UK
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK
| | - Sally Merry
- Department of Psychological Medicine, The University of Auckland, Auckland, New Zealand
| | - Richard Morriss
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, Mental Health and Technology Theme, University of Nottingham, Nottingham, UK
- Division of Psychiatry and Applied Psychology, University of Nottingham, Nottingham, UK
- NIHR Applied Research Centre East Midlands, Nottingham, UK
| | - Kapil Sayal
- Division of Psychiatry and Applied Psychology, University of Nottingham, Nottingham, UK
- Centre for ADHD and Neurodevelopmental Disorders Across the Lifespan, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Applied Research Centre East Midlands, Nottingham, UK
| | - Edmund Sonuga-Barke
- Department of Child & Adolescent Psychiatry, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, UK
- Department of Child & Adolescent Psychiatry, Aarhus University, Aarhus, Denmark
| | - Jo Robinson
- Orygen, University of Melbourne, Parkville, Australia
- Centre for Youth Mental Health, University of Melbourne, Parkville, Australia
| | - John Torous
- Department of Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA USA
| | - Chris Hollis
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, Mental Health and Technology Theme, University of Nottingham, Nottingham, UK
- NIHR Applied Research Centre East Midlands, Nottingham, UK
| |
Collapse
|
14
|
Mohr DC, Lattie EG, Tomasino KN, Kwasny MJ, Kaiser SM, Gray EL, Alam N, Jordan N, Schueller SM. A randomized noninferiority trial evaluating remotely-delivered stepped care for depression using internet cognitive behavioral therapy (CBT) and telephone CBT. Behav Res Ther 2019; 123:103485. [PMID: 31634738 PMCID: PMC6916718 DOI: 10.1016/j.brat.2019.103485] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2019] [Revised: 08/26/2019] [Accepted: 09/29/2019] [Indexed: 12/12/2022]
Abstract
This trial examined whether a stepped care program for depression, which initiated treatment with internet cognitive behavioral therapy, including telephone and messaging support, and stepped up non-responders to telephone-administered cognitive behavioral therapy (tCBT), was noninferior, less costly to deliver, and as acceptable to patients compared to tCBT alone. Adults with a diagnosis of major depressive episode (MDE) were randomized to receive up to 20 weeks of stepped care or tCBT. Stepped care (n = 134) was noninferior to tCBT (n = 136) with an end-of-treatment effect size of d = 0.03 and a 6-month post-treatment effect size of d = -0.07 [90% CI 0.29 to 0.14]. Therapist time in stepped care was 5.26 (SD = 3.08) hours versus 10.16 (SD 4.01) for tCBT (p < 0.0001), with a delivery cost difference of $-364.32 [95% CI $-423.68 to $-304.96]. There was no significant difference in pre-treatment preferences (p = 0.10) or treatment dropout (39 in stepped care; 27 in tCBT; p = 0.14). tCBT patients were significantly more satisfied than stepped care patients with the treatment they received (p < 0.0001). These findings indicate that stepped care was less costly to deliver, but no less effective than tCBT. There was no significant difference in treatment preference or completion, however satisfaction with treatment was higher in tCBT than stepped care. TRIAL REGISTRATION: clinicaltrials.gov Identifier: NCT01906476.
Collapse
Affiliation(s)
- David C Mohr
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA.
| | - Emily G Lattie
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Kathryn Noth Tomasino
- Department of Medicine, Northwestern University, NMH/Arkes Family Pavilion, Suite 1400, 676 N. Saint Clair St., Chicago, IL, 60611, USA
| | - Mary J Kwasny
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Susan M Kaiser
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Elizabeth L Gray
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Nameyeh Alam
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Neil Jordan
- Department of Psychiatry and Behavioral Sciences, Mental Health Services & Policy Program, Northwestern University Feinberg School of Medicine, 710 N Lake Shore Dr, 12th Flr, Chicago, IL, 60611, USA; Center of Innovation for Complex Chronic Healthcare, Hines VA Hospital, 5000 S 5th Ave., Hines, IL, 60141, USA
| | - Stephen M Schueller
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| |
Collapse
|
15
|
Nicholas J, Ringland KE, Graham AK, Knapp AA, Lattie EG, Kwasny MJ, Mohr DC. Stepping Up: Predictors of 'Stepping' within an iCBT Stepped-Care Intervention for Depression. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2019; 16:E4689. [PMID: 31775297 PMCID: PMC6926538 DOI: 10.3390/ijerph16234689] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 10/03/2019] [Revised: 11/21/2019] [Accepted: 11/22/2019] [Indexed: 12/26/2022]
Abstract
Internet-based cognitive behavioral therapy (iCBT) may overcome barriers to mental health care and has proven efficacious. However, this approach currently exists outside the existing mental health care delivery system. Stepped care is a proposed framework for integrating digital mental health (DMH) into health systems by initiating iCBT and "stepping up" care to a more intensive intervention should iCBT prove ineffective. This study explores pre-treatment factors associated with reaching stepping criteria among patients receiving iCBT. This exploratory analysis of a stepped care arm of a larger randomized trial examined participants who were stepped to a more intensive intervention if they did not respond to iCBT. The association of pre-treatment factors on stepping were examined using Kruskal-Wallis and Chi-square tests. One-fifth of the 151 participants met criteria for stepping within the 20-week treatment period. Only pre-treatment depression severity and treatment preference were associated with increased likelihood of stepping (p = 0.049 and 0.048, respectively). The low number of individuals who stepped provides support for iCBT as an effective, low intensity treatment for depression. The modest association of pre-treatment depression and preference to not receive iCBT may be useful in identifying patients who are less likely to respond.
Collapse
Affiliation(s)
- Jennifer Nicholas
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University, Chicago, IL 60611, USA; (K.E.R.); (A.K.G.); (A.A.K.); (E.G.L.); (D.C.M.)
| | - Kathryn E. Ringland
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University, Chicago, IL 60611, USA; (K.E.R.); (A.K.G.); (A.A.K.); (E.G.L.); (D.C.M.)
- Department of Communication Studies, Northwestern University, Chicago, IL 60611, USA
| | - Andrea K. Graham
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University, Chicago, IL 60611, USA; (K.E.R.); (A.K.G.); (A.A.K.); (E.G.L.); (D.C.M.)
- Department of Medical Social Sciences, Northwestern University, Chicago, IL 60611, USA
| | - Ashley A. Knapp
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University, Chicago, IL 60611, USA; (K.E.R.); (A.K.G.); (A.A.K.); (E.G.L.); (D.C.M.)
| | - Emily G. Lattie
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University, Chicago, IL 60611, USA; (K.E.R.); (A.K.G.); (A.A.K.); (E.G.L.); (D.C.M.)
- Department of Medical Social Sciences, Northwestern University, Chicago, IL 60611, USA
| | - Mary J. Kwasny
- Biostatistics Collaboration Center, Preventive Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA;
| | - David C. Mohr
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University, Chicago, IL 60611, USA; (K.E.R.); (A.K.G.); (A.A.K.); (E.G.L.); (D.C.M.)
| |
Collapse
|
16
|
Ford KL, Albritton T, Dunn TA, Crawford K, Neuwirth J, Bull S. Youth Study Recruitment Using Paid Advertising on Instagram, Snapchat, and Facebook: Cross-Sectional Survey Study. JMIR Public Health Surveill 2019; 5:e14080. [PMID: 31599739 PMCID: PMC6811770 DOI: 10.2196/14080] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2019] [Revised: 06/21/2019] [Accepted: 08/09/2019] [Indexed: 01/30/2023] Open
Abstract
BACKGROUND The use of paid social media advertising for targeted study recruitment is an effective strategy in health research and evaluation, specifically to reach diverse youth participants. Although the literature adequately describes the utility of Facebook in recruitment, limited information exists for social media platforms that are more popular with youth, specifically Instagram and Snapchat. OBJECTIVE This paper outlines a paid advertising approach using Instagram, Snapchat, and Facebook to evaluate a statewide youth marijuana prevention campaign. The objective of this study was to compare recruitment metrics across Instagram, Snapchat, and Facebook for two surveys documenting youth knowledge, attitudes, and behaviors related to retail marijuana in Colorado post legalization. In addition, the study assessed the feasibility of using Instagram and Snapchat as effective additions to Facebook for youth study recruitment. METHODS A social media recruitment strategy was used to conduct two cross-sectional surveys of youth, aged 13 to 20 years, in Colorado. Geographically targeted ads across 3 social media platforms encouraged the completion of a Web-based self-administered survey. Ad Words and Snap Ads were used to deploy and manage advertising campaigns, including ad design, placement, and analysis. Ad costs and recruitment metrics (ie, impressions, link clicks, and conversion rates) were calculated across the three social media platforms. RESULTS Over two 1-month periods, 763,613 youth were reached (ie, impressions), 6089 of them clicked survey links (ie, clicks), and 828 eligible youth completed surveys about knowledge, attitudes, and behaviors related to retail marijuana. Instagram converted 36.13% (803/2222) of impressions to clicks (ie, conversion rate) in the first survey and 0.87% (864/98982) in the second survey. Snapchat generated the most impressions and link clicks, but it did so with the lowest conversion rate for both surveys, with a 1.40% (1600/114,200) conversion rate in the first survey and a 0.36% (1818/504700) conversion rate in the second survey. Facebook maintained a consistent conversion rate of roughly 2% across both surveys, despite reductions in budget for the second survey. The cost-per-click ranged between US $0.25 and $0.37 across the three platforms, with Snapchat as both the most cost-effective platform in the first survey and the most expensive platform in the second survey. CONCLUSIONS Recruitment and enrollment outcomes indicate the use of Instagram and Snapchat, in addition to Facebook, may be a modern, useful, and cost-effective approach to reach youth with surveys on sensitive health topics. As the use of Facebook declines among youth, the use of more popular social media platforms can augment study recruitment for health research and evaluation efforts.
Collapse
Affiliation(s)
- Kelsey Lynett Ford
- The mHealth Impact Lab, Colorado School of Public Health, Aurora, CO, United States.,Anschutz Medical Campus, University of Colorado, Aurora, CO, United States
| | - Tashuna Albritton
- School of Medicine, The City College of New York, New York, NY, United States
| | - Tara A Dunn
- Colorado Department of Public Health & Environment, Denver, CO, United States
| | - Kacy Crawford
- Colorado Department of Public Health & Environment, Denver, CO, United States
| | - Jessica Neuwirth
- Colorado Department of Public Health & Environment, Denver, CO, United States
| | - Sheana Bull
- The mHealth Impact Lab, Colorado School of Public Health, Aurora, CO, United States.,Anschutz Medical Campus, University of Colorado, Aurora, CO, United States
| |
Collapse
|
17
|
Lattie EG, Adkins EC, Winquist N, Stiles-Shields C, Wafford QE, Graham AK. Digital Mental Health Interventions for Depression, Anxiety, and Enhancement of Psychological Well-Being Among College Students: Systematic Review. J Med Internet Res 2019; 21:e12869. [PMID: 31333198 PMCID: PMC6681642 DOI: 10.2196/12869] [Citation(s) in RCA: 270] [Impact Index Per Article: 54.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2018] [Revised: 05/29/2019] [Accepted: 06/14/2019] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND College students are increasingly reporting common mental health problems, such as depression and anxiety, and they frequently encounter barriers to seeking traditional mental health treatments. Digital mental health interventions, such as those delivered via the Web and apps, offer the potential to improve access to mental health treatment. OBJECTIVE This study aimed to review the literature on digital mental health interventions focused on depression, anxiety, and enhancement of psychological well-being among samples of college students to identify the effectiveness, usability, acceptability, uptake, and adoption of such programs. METHODS We conducted a systematic review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines (registration number CRD42018092800), and the search strategy was conducted by a medical research librarian in the following databases: MEDLINE (Ovid), EMBASE (Elsevier), PsycINFO (EbscoHost), the Cochrane Library (Wiley), and Web of Science (Thomson Reuters) from the date of inception to April 2019. Data were synthesized using a systematic narrative synthesis framework, and formal quality assessments were conducted to address the risk of bias. RESULTS A total of 89 studies met the inclusion criteria. The majority of interventions (71/89, 80%) were delivered via a website, and the most common intervention was internet-based cognitive behavioral therapy (28, 31%). Many programs (33, 37%) featured human support in the form of coaching. The majority of programs were either effective (42, 47%) or partially effective (30, 34%) in producing beneficial changes in the main psychological outcome variables. Approximately half of the studies (45, 51%) did not present any usability or acceptability outcomes, and few studies (4, 4%) examined a broad implementation of digital mental health interventions on college campuses. Quality assessments revealed a moderate-to-severe risk of bias in many of the studies. CONCLUSIONS Results suggest that digital mental health interventions can be effective for improving depression, anxiety, and psychological well-being among college students, but more rigorous studies are needed to ascertain the effective elements of these interventions. Continued research on improving the user experience of, and thus user engagement with, these programs appears vital for the sustainable implementation of digital mental health interventions on college campuses.
Collapse
Affiliation(s)
- Emily G Lattie
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, United States
| | - Elizabeth C Adkins
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, United States
| | - Nathan Winquist
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, United States
| | - Colleen Stiles-Shields
- Department of Psychiatry and Behavioral Sciences, Rush University Medical Center, Chicago, IL, United States
| | - Q Eileen Wafford
- Galter Health Sciences Library and Learning Center, Northwestern University, Chicago, IL, United States
| | - Andrea K Graham
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, United States
| |
Collapse
|
18
|
Duffecy J, Grekin R, Hinkel H, Gallivan N, Nelson G, O'Hara MW. A Group-Based Online Intervention to Prevent Postpartum Depression (Sunnyside): Feasibility Randomized Controlled Trial. JMIR Ment Health 2019; 6:e10778. [PMID: 31140443 PMCID: PMC6707575 DOI: 10.2196/10778] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2018] [Revised: 09/04/2018] [Accepted: 12/30/2018] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND Postpartum depression (PPD) has a 20% 3-month prevalence rate. The consequences of PPD are significant for the mother, infant, and the family. There is a need for preventive interventions for PPD, which are effective and accessible; however, many barriers exist for women who attempt to access perinatal depression prevention programs. Internet interventions for the treatment and prevention of depression are widely accepted as efficacious and may overcome some of the issues pertaining to access to treatment barriers perinatal women face. However, internet interventions offered without any human support tend to have low adherence but positive outcomes for those who do complete treatment. Internet support groups often have high levels of adherence but minimal data supporting efficacy as a treatment for depression. Taken together, these findings suggest that combining the treatment components of individual interventions with the support provided by an internet support group might create an intervention with the scalability and cost-effectiveness of an individual intervention and the better outcomes typically found in supported interventions. OBJECTIVES This study aimed to describe the development of a cognitive behavioral therapy (CBT) internet intervention with peer support to prevent PPD and examine preliminary depression and site usage outcomes. METHODS User-centered design groups were used to develop the internet intervention. Once the intervention was developed, women who were 20 to 28 weeks pregnant with symptoms of depression (Patient Health Questionnaire-8 scores of 5-14) but who had no major depression diagnosis were enrolled in a randomized controlled trial (RCT) to compare 8 weeks of a CBT-based internet intervention with peer support to an individual internet intervention designed to prevent PPD. Assessments took place at baseline, 4 weeks, 8 weeks (end of treatment), and then 4 weeks and 6 weeks postpartum. RESULTS A total of 25 women were randomized. Of these, 24 women completed the RCT. Patient Health Questionnaire-9 scores at 6 weeks postpartum remained below the clinical threshold for referral for treatment in both groups, with depression measures showing a decrease in symptoms from baseline to postpartum. At 6 weeks postpartum, only 4% (1/24) met the criteria for PPD. There was no difference between groups in adherence to the intervention, with an average of 14.55 log-ins over the course of treatment. CONCLUSIONS Results suggest women were responsive to both peer support and individual internet interventions to prevent PPD and that peer support may be a useful feature to keep participants adherent. TRIAL REGISTRATION ClinicalTrials.gov NCT02121015; https://clinicaltrials.gov/ct2/show/NCT02121015 (archived by WebCite at http://www.webcitation.org/765a7qBKy).
Collapse
Affiliation(s)
- Jennifer Duffecy
- Department of Psychiatry, College of Medicine, University of Illinois at Chicago, Chicago, IL, United States
| | - Rebecca Grekin
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, United States.,Serious Mental Illness Treatment Resource and Evaluation Center, Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States
| | - Hannah Hinkel
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, United States.,Western Carolina University, Cullowhee, NC, United States
| | - Nicholas Gallivan
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, United States.,Kansas State University, Manhattan, KS, United States
| | - Graham Nelson
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, United States
| | - Michael W O'Hara
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, United States
| |
Collapse
|
19
|
Lattie EG, Kaiser SM, Alam N, Tomasino KN, Sargent E, Rubanovich CK, Palac HL, Mohr DC. A Practical Do-It-Yourself Recruitment Framework for Concurrent eHealth Clinical Trials: Identification of Efficient and Cost-Effective Methods for Decision Making (Part 2). J Med Internet Res 2018; 20:e11050. [PMID: 30497997 PMCID: PMC6293245 DOI: 10.2196/11050] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2018] [Revised: 09/03/2018] [Accepted: 09/10/2018] [Indexed: 01/26/2023] Open
Abstract
Background The ability to successfully recruit participants for electronic health (eHealth) clinical trials is largely dependent on the use of efficient and effective recruitment strategies. Determining which types of recruitment strategies to use presents a challenge for many researchers. Objective The aim of this study was to present an analysis of the time-efficiency and cost-effectiveness of recruitment strategies for eHealth clinical trials, and it describes a framework for cost-effective trial recruitment. Methods Participants were recruited for one of 5 eHealth trials of interventions for common mental health conditions. A multipronged recruitment approach was used, including digital (eg, social media and Craigslist), research registry-based, print (eg, flyers and posters on public transportation), clinic-based (eg, a general internal medicine clinic within an academic medical center and a large nonprofit health care organization), a market research recruitment firm, and traditional media strategies (eg, newspaper and television coverage in response to press releases). The time costs and fees for each recruitment method were calculated, and the participant yield on recruitment costs was calculated by dividing the number of enrolled participants by the total cost for each method. Results A total of 777 participants were enrolled across all trials. Digital recruitment strategies yielded the largest number of participants across the 5 clinical trials and represented 34.0% (264/777) of the total enrolled participants. Registry-based recruitment strategies were in second place by enrolling 28.0% (217/777) of the total enrolled participants across trials. Research registry-based recruitment had a relatively high conversion rate from potential participants who contacted our center for being screened to be enrolled, and it was also the most cost-effective for enrolling participants in this set of clinical trials with a total cost per person enrolled at US $8.99. Conclusions On the basis of these results, a framework is proposed for participant recruitment. To make decisions on initiating and maintaining different types of recruitment strategies, the resources available and requirements of the research study (or studies) need to be carefully examined.
Collapse
Affiliation(s)
- Emily G Lattie
- Center for Behavioral Intervention Technologies, Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Susan M Kaiser
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Nameyeh Alam
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Kathryn N Tomasino
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Elizabeth Sargent
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Caryn Kseniya Rubanovich
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | | | - David C Mohr
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| |
Collapse
|
20
|
Palac HL, Alam N, Kaiser SM, Ciolino JD, Lattie EG, Mohr DC. A Practical Do-It-Yourself Recruitment Framework for Concurrent eHealth Clinical Trials: Simple Architecture (Part 1). J Med Internet Res 2018; 20:e11049. [PMID: 30389650 PMCID: PMC6238104 DOI: 10.2196/11049] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2018] [Revised: 07/02/2018] [Accepted: 07/05/2018] [Indexed: 12/20/2022] Open
Abstract
Background The ability to identify, screen, and enroll potential research participants in an efficient and timely manner is crucial to the success of clinical trials. In the age of the internet, researchers can be confronted with large numbers of people contacting the program, overwhelming study staff and frustrating potential participants. Objective This paper describes a “do-it-yourself” recruitment support framework (DIY-RSF) that uses tools readily available in many academic research settings to support remote participant recruitment, prescreening, enrollment, and management across multiple concurrent eHealth clinical trials. Methods This work was conducted in an academic research center focused on developing and evaluating behavioral intervention technologies. A needs assessment consisting of unstructured individual and group interviews was conducted to identify barriers to recruitment and important features for the new system. Results We describe a practical and adaptable recruitment management architecture that used readily available software, such as REDCap (Research Electronic Data Capture) and standard statistical software (eg, SAS, R), to create an automated recruitment framework that supported prescreening potential participants, consent to join a research registry, triaging for management of multiple trials, capture of eligibility information for each phase of a recruitment pipeline, and staff management tools including monitoring of participant flow and task assignment/reassignment features. The DIY-RSF was launched in July 2015. As of July 2017, the DIY-RSF has supported the successful recruitment efforts for eight trials, producing 14,557 participant records in the referral tracking database and 5337 participants in the center research registry. The DIY-RSF has allowed for more efficient use of staff time and more rapid processing of potential applicants. Conclusions Using tools already supported at many academic institutions, we describe the architecture and utilization of an adaptable referral management framework to support recruitment for multiple concurrent clinical trials. The DIY-RSF can serve as a guide for leveraging common technologies to improve clinical trial recruitment procedures.
Collapse
Affiliation(s)
- Hannah L Palac
- AbbVie Inc, North Chicago, IL, United States.,Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Nameyeh Alam
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Susan M Kaiser
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Jody D Ciolino
- Division of Biostatistics, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Emily G Lattie
- Center for Behavioral Intervention Technologies, Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - David C Mohr
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| |
Collapse
|
21
|
Community Food Growing in Parks? Assessing the Acceptability and Feasibility in Sheffield, UK. SUSTAINABILITY 2018. [DOI: 10.3390/su10082887] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Urbanisation brings with it increased pressure on land and land uses, particularly green spaces. There has been considerable interest in community food growing in green spaces as part of a wide trend for gardening in the UK, which has been found to bring social, health, and well-being benefits. Such activity tends to take place in community-managed gardens and allotments. In light of the context of austerity within which local authority parks departments currently operate, this study tested the acceptability and feasibility of parks as a potential urban setting for Community Food Growing (CFG) in Sheffield, UK. Employing a combination of resident questionnaires and interviews with community groups and professionals, the study results showed localised differences in the acceptability and feasibility of CFG. Residents’ propensity to want to get involved in CFG differed by age and household composition, which, if acted on across the city, could significantly change the demographic make-up of parks-based community groups in the city. Barriers to CFG in parks were described by community groups and park managers as security and vandalism, need for resources, and undue pressure on the local authority as land-owner. We discuss the emergent questions around who is best placed to manage urban parks, particularly when the public sector is subject to stringent austerity budget measures. The paper concludes with commentary and recommendations about the importance of governance arrangements if CFG is to be included as part of the activities supported and managed in urban parks.
Collapse
|
22
|
Geramita EM, Herbeck Belnap B, Abebe KZ, Rothenberger SD, Rotondi AJ, Rollman BL. The Association Between Increased Levels of Patient Engagement With an Internet Support Group and Improved Mental Health Outcomes at 6-Month Follow-Up: Post-Hoc Analyses From a Randomized Controlled Trial. J Med Internet Res 2018; 20:e10402. [PMID: 30021711 PMCID: PMC6068384 DOI: 10.2196/10402] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2018] [Revised: 05/14/2018] [Accepted: 05/19/2018] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND We recently reported that depressed and anxious primary care patients randomized to a moderated internet support group (ISG) plus computerized cognitive behavioral therapy (cCBT) did not experience improvements in depression and anxiety over cCBT alone at 6-month follow-up. OBJECTIVE The 1% rule posits that 1% of participants in online communities generate approximately 90% of new user-created content. The aims of this study were to apply the 1% rule to categorize patient engagement with the ISG and identify whether any patient subgroups benefitted from ISG use. METHODS We categorized the 302 patients randomized to the ISG as: superusers (3/302, 1.0%), top contributors (30/302, 9.9%), contributors (108/302, 35.8%), observers (87/302, 28.8%) and those who never logged in (74/302, 24.5%). We then applied linear mixed models to examine associations between engagement and 6-month changes in health-related quality of life (HRQoL; Short Form Health Survey Mental Health Component, SF-12 MCS) and depression and anxiety symptoms (Patient-Reported Outcomes Measurement Information System, PROMIS). RESULTS At baseline, participant mean age was 42.6 years, 81.1% (245/302) were female, and mean Patient Health Questionnaire (PHQ-9), Generalized Anxiety Disorder scale (GAD-7), and SF-12 MCS scores were 13.4, 12.6, and 31.7, respectively. Of the 75.5% (228/302) who logged in, 61.8 % (141/228) created ≥1 post (median 1, interquartile range, IQR 0-5); superusers created 42.3 % (630/1488) of posts (median 246, IQR 78-306), top contributors created 34.6% (515/1488; median 11, IQR 10-18), and contributors created 23.1 % (343/1488; median 3, IQR 1-5). Compared to participants who never logged in, the combined superuser + top contributor subgroup (n=33) reported 6-month improvements in anxiety (PROMIS: -11.6 vs -7.8; P=.04) and HRQoL (SF-12 MCS: 16.1 vs 10.1; P=.01) but not in depression. No other subgroup reported significant symptom improvements. CONCLUSIONS Patient engagement with the ISG was more broadly distributed than predicted by the 1% rule. The 11% of participants with the highest engagement levels reported significant improvements in anxiety and HRQoL. TRIAL REGISTRATION ClinicalTrials.gov NCT01482806; https://clinicaltrials.gov/ct2/show/NCT01482806 (Archived by WebCite at http://www.webcitation.org/708Bjlge9).
Collapse
Affiliation(s)
- Emily M Geramita
- Division of General Internal Medicine, University of Pittsburgh Medical Center, Pittsburgh, PA, United States
| | - Bea Herbeck Belnap
- Department of Psychosomatic Medicine and Psychotherapy, University of Göttingen Medical Center, Göttingen, Germany
- Center for Behavioral Health and Smart Technology, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
| | - Kaleab Z Abebe
- Division of General Internal Medicine, University of Pittsburgh Medical Center, Pittsburgh, PA, United States
| | - Scott D Rothenberger
- Division of General Internal Medicine, University of Pittsburgh Medical Center, Pittsburgh, PA, United States
| | - Armando J Rotondi
- Center for Behavioral Health and Smart Technology, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
- Veterans Affairs Pittsburgh Healthcare System, Pittsburgh, PA, United States
| | - Bruce L Rollman
- Center for Behavioral Health and Smart Technology, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
| |
Collapse
|