1
|
Suffoletto B, Lee CM, Mason M. A text message intervention aimed at nurturing peer outreach to help meet drinking limit goals: A remote pilot randomized trial in non-collegiate young adults. Addict Behav 2024; 154:108020. [PMID: 38552400 DOI: 10.1016/j.addbeh.2024.108020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2023] [Revised: 03/14/2024] [Accepted: 03/17/2024] [Indexed: 04/14/2024]
Abstract
OBJECTIVE Scalable interventions attempting to nurture peer outreach to help young adults meet drinking limit goals remain under-developed. To address this gap, we developed ASPIRE, a text message intervention focused on coaching individuals to engage with close peers to assist them in meeting drinking limit goals. METHOD Non-collegiate young adults who had reported one or more heavy drinking days in the preceding month and were at least contemplating change were recruited through social media. Participants were randomly assigned to one of three 6-week text message interventions: Control, Goal Support, or ASPIRE. All groups completed baseline assessments and received weekly text message assessments on Thursdays and Sundays. Control and ASPIRE groups were prompted to complete web-based outcome assessments at 6- and 12-weeks. RESULTS We enrolled 92 young adults from 31 US states (65% female; 73% White). All groups had high text response rates but intervention usability was sub-optimal. Follow-up rates were 87% at 6-weeks and 79% at 12-weeks. Compared to Control, ASPIRE participants reported significantly more peer support and less peer pressure to drink. ASPIRE exhibited higher goal confidence compared to the Goal Support group. Using multiple imputation, there were no significant differences in drinking outcomes between groups. CONCLUSIONS Preliminary findings from this pilot study suggest that a text message intervention focused on nurturing peer outreach to help meet drinking limit goals holds promise in altering peer support and pressure as well as boosting drinking limit goal confidence. Design improvements are needed to reduce alcohol consumption.
Collapse
Affiliation(s)
| | - Christine M Lee
- Department of Psychiatry and Behavioral Sciences, University of Washington
| | | |
Collapse
|
2
|
Lim G, Xue L, Donohue JM, Junker S, Wilson JD, Suffoletto B, Lynch MJ, Pacella-LaBarbara ML, Chang CCH, Krans E, Jarlenski M. Associations between acute pain after vaginal delivery and postpartum opioid prescription fills: a retrospective case-controlled study. Br J Anaesth 2024; 132:978-981. [PMID: 38423825 DOI: 10.1016/j.bja.2024.01.038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Revised: 01/16/2024] [Accepted: 01/22/2024] [Indexed: 03/02/2024] Open
Affiliation(s)
- Grace Lim
- Department of Anesthesiology and Perioperative Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA; Department of Obstetrics, Gynecology and Reproductive Sciences, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA.
| | - Lingshu Xue
- Department of Health Policy and Management, University of Pittsburgh School of Public Health, Pittsburgh, PA, USA
| | - Julie M Donohue
- Department of Health Policy and Management, University of Pittsburgh School of Public Health, Pittsburgh, PA, USA
| | - Stefanie Junker
- Department of Health Policy and Management, University of Pittsburgh School of Public Health, Pittsburgh, PA, USA
| | - J Deanna Wilson
- Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Palo Alto, CA, USA
| | - Michael J Lynch
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | | | - Chung-Chou H Chang
- Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Elizabeth Krans
- Department of Obstetrics, Gynecology and Reproductive Sciences, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA; Magee-Women's Research Institute, Pittsburgh, PA, USA
| | - Marian Jarlenski
- Department of Health Policy and Management, University of Pittsburgh School of Public Health, Pittsburgh, PA, USA
| |
Collapse
|
3
|
Muench F, Madden SP, Oommen S, Forthal S, Srinagesh A, Stadler G, Kuerbis A, Leeman RF, Suffoletto B, Baumel A, Haslip C, Vadhan NP, Morgenstern J. Automated, tailored adaptive mobile messaging to reduce alcohol consumption in help-seeking adults: A randomized controlled trial. Addiction 2024; 119:530-543. [PMID: 38009576 PMCID: PMC10872985 DOI: 10.1111/add.16391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Accepted: 10/10/2023] [Indexed: 11/29/2023]
Abstract
AIMS To test differential outcomes between three 6-month text-messaging interventions to reduce at-risk drinking in help-seeking adults. DESIGN A three-arm single-blind randomized controlled trial with 1-, 3-, 6- and 12-month follow-ups. SETTING United States. A fully remote trial without human contact, with participants recruited primarily via social media outlets. PARTICIPANTS Seven hundred and twenty-three adults (mean = 39.9 years, standard deviation = 10.0; 62.5% female) seeking to reduce their drinking were allocated to 6 months of baseline 'tailored statically' messaging (TS; n = 240), 'tailored adaptive' messaging (TA; n = 239) or 'drink tracking' messaging (DT; n = 244). INTERVENTIONS TS consisted of daily text messages to reduce harmful drinking that were tailored to demographics and alcohol use. TA consisted of daily, tailored text messages that were also adapted based on goal achievement and proactive prompts. DT consisted of a weekly assessment for self-reported drinking over the past 7 days. MEASUREMENTS The primary outcome measure was weekly sum of standard drinks (SSD) at 6-month follow-up. Secondary outcome measures included drinks per drinking day (DDD), number of drinking days (NDD) per week and heavy drinking days (HDD) at 1-, 3-, 6- and 12-month follow-ups. FINDINGS At 6 months, compared with DT, TA resulted in significant SSD reductions of 16.2 (from 28.7 to 12.5) drinks [adjusted risk ratio (aRR) = 0.80, 95% confidence interval (CI) = 0.71, 0.91] using intent-to-treat analysis. TA also resulted in significant improvements in DDD (aRR = 0.84; 95% CI = 0.77-0.92) and drinking days per week (b = -0.39; 95% CI = -0.67, -0.10), but not HDD compared with DT at 6 months. TA was not significantly different from TS at any time-point, except DDD at 6 months. All groups made improvements in SSD at 12-month follow-up compared with baseline with an average reduction of 12.9 drinks per week across groups. CONCLUSIONS Automated tailored mobile messaging interventions are scalable solutions that can reduce weekly alcohol consumption in remote help-seeking drinkers over time.
Collapse
Affiliation(s)
| | - Sean P Madden
- Zucker School of Medicine at Hofstra/Northwell, Feinstein Institutes for Medical Research, Manhasset, NY, USA
| | | | | | | | | | - Alexis Kuerbis
- Silberman School of Social Work, Hunter College at CUNY, The Graduate Center at CUNY, New York, NY, USA
| | - Robert F Leeman
- Department of Health Sciences, College of Health and Human Performance, University of Florida, Gainesville, FL, USA
| | | | - Amit Baumel
- Department of Community Mental Health, University of Haifa, Haifa, Israel
| | - Cameron Haslip
- Zucker School of Medicine at Hofstra/Northwell, Feinstein Institutes for Medical Research, Manhasset, NY, USA
| | - Nehal P Vadhan
- Zucker School of Medicine at Hofstra/Northwell, Feinstein Institutes for Medical Research, Manhasset, NY, USA
| | - Jon Morgenstern
- Zucker School of Medicine at Hofstra/Northwell, Feinstein Institutes for Medical Research, Manhasset, NY, USA
| |
Collapse
|
4
|
Cinkowski C, Yefimova M, Suffoletto B. Development of the geriatric risk assessment in the ED (GRAED) tool to predict decline after emergency department (ED) visit. J Am Geriatr Soc 2024. [PMID: 38241203 DOI: 10.1111/jgs.18745] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 12/03/2023] [Accepted: 12/11/2023] [Indexed: 01/21/2024]
Affiliation(s)
| | - Maria Yefimova
- Center for Nursing Excellence and Innovation, UCSF Health, San Francisco, California, USA
- Department of Physiological Nursing, UCSF School of Nursing, San Francisco, California, USA
| | - Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Stanford, California, USA
| |
Collapse
|
5
|
Chung T, Suffoletto B, Ewing SWF, Bhurosy T, Jiang Y, Valera P. Prediction Rules Identify Which Young Adults Have Higher Rates of Heavy Episodic Drinking After Exposure to 12-Week Text Message Interventions. Subst Use Addctn J 2024; 45:144-149. [PMID: 38258850 PMCID: PMC10924270 DOI: 10.1177/29767342231206653] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
BACKGROUND An alcohol text message intervention recently demonstrated effects in reducing heavy episodic drinking (HED) days at the three month follow-up in young adults with a history of hazardous drinking. An important next step in understanding intervention effects involves identifying baseline participant characteristics that predict who will benefit from intervention exposure to support clinical decision-making and guide further intervention development. To identify baseline characteristics that predict HED, this exploratory study used a prediction rule ensemble (PRE). Compared to more complex decision-tree methods (e.g., random forest), PREs have comparable performance, while generating simpler rules that can directly identify subgroups that do or do not respond to intervention. METHODS This secondary analysis examined data from 916 young adults who reported HED (68.5% female, mean age = 22.1, SD = 2.1), were enrolled in an alcohol text message randomized clinical trial and who completed baseline assessment and the three month follow-up. A PRE with ten fold cross-validation, which included 21 baseline variables representing sociodemographic characteristics (e.g., sex, age, race, ethnicity, college enrollment), alcohol consumption (frequency of alcohol consumption, quantity consumed on a typical drinking day, frequency of HED), impulsivity subscales (i.e., negative urgency, positive urgency, lack of premeditation, lack of perseverance, sensation seeking), readiness to change, perceived peer drinking and HED-related consequences, and intervention status were used to predict HED at the three month follow-up. RESULTS The PRE identified 12 rules that predicted HED at three months (R2 = 0.23) using 7 baseline features. Only two cases (0.2%) were not classified by the 12 rules. The most important features for predicting three month HED included baseline alcohol consumption, negative urgency score, and perceived peer drinking. CONCLUSIONS The rules provide interpretable decision-making tools that predict who has higher alcohol consumption following exposure to alcohol text message interventions using baseline participant characteristics (prior to intervention), which highlight the importance of interventions related to negative urgency and peer alcohol use.
Collapse
Affiliation(s)
- Tammy Chung
- Department of Psychiatry, Rutgers, The State University of New Jersey, New Brunswick, NJ, USA
- Institute for Health, Health Care Policy and Aging Research, Rutgers, The State University of New Jersey, New Brunswick, NJ, USA
| | - Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Stanford, CA, USA
| | | | - Trishnee Bhurosy
- Department of Population Health, School of Health Professions and Human Services, Hofstra University, Hempstead, NY, USA
| | - Yanping Jiang
- Institute for Health, Health Care Policy and Aging Research, Rutgers, The State University of New Jersey, New Brunswick, NJ, USA
- Department of Family Medicine and Community Health, Rutgers, The State University of New Jersey, New Brunswick, NJ, USA
| | - Pamela Valera
- Department of Urban-Global Public Health, School of Public Health, Rutgers, The State University of New Jersey, New Brunswick, NJ, USA
| |
Collapse
|
6
|
Einhorn J, Murphy AR, Rogal SS, Suffoletto B, Irizarry T, Rollman BL, Forman DE, Muldoon MF. Automated Messaging Program to Facilitate Systematic Home Blood Pressure Monitoring: Qualitative Analysis of Provider Interviews. JMIR Cardio 2023; 7:e51316. [PMID: 38048147 PMCID: PMC10728784 DOI: 10.2196/51316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 10/25/2023] [Accepted: 11/03/2023] [Indexed: 12/05/2023] Open
Abstract
BACKGROUND Hypertension is a leading cause of cardiovascular and kidney disease in the United States, yet blood pressure (BP) control at a population level is poor and worsening. Systematic home BP monitoring (HBPM) programs can lower BP, but programs supporting HBPM are not routinely used. The MyBP program deploys automated bidirectional text messaging for HBPM and disease self-management support. OBJECTIVE We aim to produce a qualitative analysis of input from providers and staff regarding implementation of an innovative HBPM program in primary care practices. METHODS Semistructured interviews (average length 31 minutes) were conducted with physicians (n=11), nurses, and medical assistants (n=6) from primary care settings. The interview assessed multiple constructs in the Consolidated Framework for Implementation Research domains of intervention characteristics, outer setting, inner setting, and characteristics of individuals. Interviews were transcribed verbatim and analyzed using inductive coding to organize meaningful excerpts and identify salient themes, followed by mapping to the updated Consolidated Framework for Implementation Research constructs. RESULTS Health care providers reported that MyBP has good ease of use and was likely to engage patients in managing their high BP. They also felt that it would directly support systematic BP monitoring and habit formation in the convenience of the patient's home. This could increase health literacy and generate concrete feedback to raise the day-to-day salience of BP control. Providers expressed concern that the cost of BP devices remains an encumbrance. Some patients were felt to have overriding social or emotional barriers, or lack the needed technical skills to interact with the program, use good measurement technique, and input readings accurately. With respect to effects on their medical practice, providers felt MyBP would improve the accuracy and frequency of HBPM data, and thereby improve diagnosis and treatment management. The program may positively affect the patient-provider relationship by increasing rapport and bidirectional accountability. Providers appreciated receiving aggregated HBPM data to increase their own efficiency but also expressed concern about timely routing of incoming HBPM reports, lack of true integration with the electronic health record, and the need for a dedicated and trained staff member. CONCLUSIONS In this qualitative analysis, health care providers perceived strong relative advantages of using MyBP to support patients. The identified barriers suggest the need for corrective implementation strategies to support providers in adopting the program into routine primary care practice, such as integration into the workflow and provider education. TRIAL REGISTRATION ClinicalTrials.gov NCT03650166; https://tinyurl.com/bduwn6r4.
Collapse
Affiliation(s)
| | - Andrew R Murphy
- Division of Cardiology, Department of Medicine, Emory University School of Medicine, Atlanta, GA, United States
| | - Shari S Rogal
- Dissemination and Implementation Science Collaboration, Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
- Division of Gastroenterology, Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
| | - Brian Suffoletto
- Department of Emergency Medicine, Stanford University School of Medicine, Palo Alto, CA, United States
| | - Taya Irizarry
- Department of Advanced Analytics and Population Health, Highmark Health Enterprise, Pittsburgh, PA, United States
| | - Bruce L Rollman
- Center for Behavioral Health, Media and Techology, Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
- Division of General Internal Medicine, Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
| | - Daniel E Forman
- Division of Geriatrics, Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
- Geriatrics, Reseach, Education and Clinical Care (GRECC), VA Pittsburgh Healthcare System, Pittsburgh, PA, United States
| | - Matthew F Muldoon
- Division of Cardiology, Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
- UPMC Hypertension Center, Heart and Vascular Institute, UPMC Healthcare System, Pittsburgh, PA, United States
| |
Collapse
|
7
|
Suffoletto B, Anwar A, Glaister S, Sejdic E. Detection of Alcohol Intoxication Using Voice Features: A Controlled Laboratory Study. J Stud Alcohol Drugs 2023; 84:808-813. [PMID: 37306378 PMCID: PMC10765971 DOI: 10.15288/jsad.22-00375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Accepted: 05/02/2023] [Indexed: 06/13/2023] Open
Abstract
OBJECTIVE Devices such as mobile phones and smart speakers could be useful to remotely identify voice alterations associated with alcohol intoxication that could be used to deliver just-in-time interventions, but data to support such approaches for the English language are lacking. In this controlled laboratory study, we compare how well English spectrographic voice features identify alcohol intoxication. METHOD A total of 18 participants (72% male, ages 21-62 years) read a randomly assigned tongue twister before drinking and each hour for up to 7 hours after drinking a weight-based dose of alcohol. Vocal segments were cleaned and split into 1-second windows. We built support vector machine models for detecting alcohol intoxication, defined as breath alcohol concentration > .08%, comparing the baseline voice spectrographic signature to each subsequent timepoint and examined accuracy with 95% confidence intervals (CIs). RESULTS Alcohol intoxication was predicted with an accuracy of 98% (95% CI [97.1, 98.6]); mean sensitivity = .98; specificity = .97; positive predictive value = .97; and negative predictive value = .98. CONCLUSIONS In this small, controlled laboratory study, voice spectrographic signatures collected from brief recorded English segments were useful in identifying alcohol intoxication. Larger studies using varied voice samples are needed to validate and expand models.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Palo Alto, California
| | - Ayman Anwar
- Department of Electrical & Computer Engineering, University of Toronto, Toronto, Ontario, Canada
| | - Sean Glaister
- Department of Emergency Medicine, Stanford University, Palo Alto, California
| | - Ervin Sejdic
- Department of Electrical & Computer Engineering, University of Toronto, Toronto, Ontario, Canada
- North York General Hospital, Toronto, Ontario, Canada
| |
Collapse
|
8
|
Staton CA, Friedman K, Phillips AJ, Minnig MC, Sakita FM, Ngowi KM, Suffoletto B, Hirshon JM, Swahn M, Mmbaga BT, Vissoci JRN. Feasibility of a pragmatic randomized adaptive clinical trial to evaluate a brief negotiational interview for harmful and hazardous alcohol use in Moshi, Tanzania. PLoS One 2023; 18:e0288458. [PMID: 37535693 PMCID: PMC10399826 DOI: 10.1371/journal.pone.0288458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 06/26/2023] [Indexed: 08/05/2023] Open
Abstract
INTRODUCTION Low-resourced settings often lack personnel and infrastructure for alcohol use disorder treatment. We culturally adapted a Brief Negotiational Interview (BNI) for Emergency Department injury patients, the "Punguza Pombe Kwa Afya Yako (PPKAY)" ("Reduce Alcohol For Your Health") in Tanzania. This study aimed to evaluate the feasibility of a pragmatic randomized adaptive controlled trial of the PPKAY intervention. MATERIALS AND METHODS This feasibility trial piloted a single-blind, parallel, adaptive, and multi-stage, block-randomized controlled trial, which will subsequently be used to determine the most effective intervention, with or without text message booster, to reduce alcohol use among injury patients. We reported our feasibility pilot study using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework, with recruitment and retention rates being our primary and secondary outcomes. We enrolled adult patients seeking care for an acute injury at the Kilimanjaro Christian Medical Center in Tanzania if they (1) exhibited an Alcohol Use Disorder Identification Test (AUDIT) ≥8, (2) disclosed alcohol use prior to injury, or (3) had a breathalyzer ≥0.0 on arrival. Intervention arms were usual care (UC), PPKAY, PPKAY with standard text booster, or a PPKAY with a personalized text booster. RESULTS Overall, 181 patients were screened and 75 enrolled with 80% 6-week, 82.7% 3-month and 84% 6-month follow-up rates showing appropriate Reach and retention. Adoption measures showed an overwhelmingly positive patient acceptance with 100% of patients perceiving a positive impact on their behavior. The Implementation and trial processes were performed with high rates of PPKAY fidelity (76%) and SMS delivery (74%). Intervention nurses believed Maintenance and sustainability of this 30-minute, low-cost intervention and adaptive clinical trial were feasible. CONCLUSIONS Our intervention and trial design are feasible and acceptable, have evidence of good fidelity, and did not show problematic deviations in protocol. Results suggest support for undertaking a full trial to evaluate the effectiveness of the PPKAY, a nurse-driven BNI in a low-income country. TRIAL REGISTRATION Trial registration number NCT02828267. https://classic.clinicaltrials.gov/ct2/show/NCT02828267.
Collapse
Affiliation(s)
- Catherine A. Staton
- Division of Emergency Medicine, Duke University School of Medicine, Durham, NC, United States of America
- Duke Global Health Institute, Duke University, Durham, NC, United States of America
| | - Kaitlyn Friedman
- Duke Global Health Institute, Duke University, Durham, NC, United States of America
| | - Ashley J. Phillips
- Division of Emergency Medicine, Duke University School of Medicine, Durham, NC, United States of America
| | | | | | | | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittbsurgh, PA, United States of America
| | - Jon Mark Hirshon
- Department of Emergency Medicine, University of Maryland School of Medicine, Baltimore MD, United States of America
| | - Monica Swahn
- Department of Epidemiology, Georgia State University School of Public Health, Atlanta, GA, United States of America
| | - Blandina T. Mmbaga
- Duke Global Health Institute, Duke University, Durham, NC, United States of America
- Kilimanjaro Christian Medical Centre, Moshi, Tanzania
- Kilimanjaro Clinical Research Institute, Moshi, Tanzania
- Kilimanjaro Christian Medical University College, Moshi, Tanzania
| | - Joao Ricardo Nickenig Vissoci
- Division of Emergency Medicine, Duke University School of Medicine, Durham, NC, United States of America
- Duke Global Health Institute, Duke University, Durham, NC, United States of America
| |
Collapse
|
9
|
Suffoletto B, Chung T. Goal commitment and goal confidence mediate the path between desire to get drunk and binge drinking among young adults receiving text message goal-related feedback. Alcohol Clin Exp Res 2023. [PMID: 36974483 DOI: 10.1111/acer.15065] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 03/17/2023] [Accepted: 03/21/2023] [Indexed: 03/29/2023]
Abstract
BACKGROUND This study sought to determine whether drinking limit goal commitment and goal confidence mediate the association between desire to get drunk and binge drinking (4+ drinks for a woman and 5+ drinks for a man on a given occasion) among young adults exposed to text message goal-related feedback. METHODS Participants were 297 young adults with hazardous drinking randomized to one of two text-message interventions incorporating drinking limit goal-related assessments and feedback who also completed at least two days of assessments over 12 weeks of intervention exposure. On the two days per week they typically drank alcohol, participants were asked to report plans to drink (yes/no). If a drinking plan was endorsed, participants reported desire to get drunk (0 [not at all] to 8 [completely]), willingness to commit to a drinking limit goal (yes/no), and (contingent on goal commitment) goal confidence (0 [not at all] to 8 [completely]). The next day, participants reported drinking quantity, coded as a binge drinking day (yes/no). Mediation was tested using path models of simultaneous between- and within-person effects using Maximum Likelihood. RESULTS At both within- and between-person levels, we found significant indirect path effects of goal commitment and goal confidence between desire to get drunk and binge drinking. Greater than usual desire to get drunk was associated with lower drinking limit goal commitment and confidence, whereas greater than usual goal commitment and confidence were associated with lower likelihood of same day binge drinking. DISCUSSION Findings support a mechanistic model where contextual variations in same day drinking limit goal commitment and confidence mitigate the path between desire to get drunk and binge drinking among young adults. Employing just-in-time strategies to reinforce drinking limit goal commitment and goal confidence could reduce hazardous drinking and related harms.
Collapse
Affiliation(s)
| | - Tammy Chung
- Institute for Health, Health Care Policy and Aging Research, Rutgers University
| |
Collapse
|
10
|
Suffoletto B, Chung T. Desire to get drunk partially mediates effects of a combined text message-based alcohol intervention for young adults. Drug Alcohol Depend 2023; 246:109848. [PMID: 36989707 DOI: 10.1016/j.drugalcdep.2023.109848] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 03/08/2023] [Accepted: 03/14/2023] [Indexed: 03/31/2023]
Abstract
BACKGROUND This study aimed to test the causal effect of different text message interventions on reducing alcohol consumption indirectly by altering desire to get drunk. METHODS Participants were young adults randomized to interventions with different behavior change techniques: self-monitoring alone (TRACK); pre-drinking plan feedback (PLAN); post-drinking alcohol consumption feedback (USE); pre- and post-drinking goal feedback (GOAL); and a combination of techniques (COMBO) who completed at least 2 days of both pre- and post-drinking assessments over 12 weeks of intervention exposure. On the two days per week they planned to drank alcohol, participants were asked to report desire to get drunk (0 "none" to 8 "completely"). The next day, participants reported drinking quantity. Outcomes included binge drinking (defined as 4+ drinks for a woman and 5+ drinks for a man) and drinks per drinking day. Mediation was tested using path models of simultaneous between-person and within-person effects using maximum likelihood estimation. RESULTS At the between-person level, controlling for race and baseline AUDIT-C and within-person associations, 35.9 % of the effects of USE and 34.4 % of the effects of COMBO on reducing binge drinking were mediated through desire to get drunk. 60.8 % of the effects of COMBO on reducing drinks per drinking day were mediated through desire to get drunk. We did not find significant indirect effects for any other text-message intervention. DISCUSSION Findings support the hypothesized mediation model where desire to get drunk partially mediates the effects of a text message intervention using a combination of behavior change techniques on reducing alcohol consumption.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, Stanford University, United States.
| | - Tammy Chung
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, United States
| |
Collapse
|
11
|
Bae SW, Suffoletto B, Zhang T, Chung T, Ozolcer M, Islam MR, Dey A. Leveraging Mobile Phone Sensors, Machine Learning and Explainable Artificial Intelligence to Predict Imminent Same-Day Binge Drinking Events to Support Just-In-Time Adaptive Interventions: A Feasibility Study. JMIR Form Res 2023; 7:e39862. [PMID: 36809294 DOI: 10.2196/39862] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 01/05/2023] [Accepted: 02/13/2023] [Indexed: 02/16/2023] Open
Abstract
BACKGROUND Digital Just-In-Time Adaptive Interventions (JITAIs) can reduce binge drinking events (BDEs: consuming 4+/5+ drinks per occasion for women/men) in young adults, but need to be optimized for timing and content. Delivering just-in-time support messages in the hours prior to BDEs could improve intervention impact. OBJECTIVE We determined the feasibility of developing a machine learning model to accurately predict future, that is, same-day, 1 to 6-hours prior BDEs using smartphone sensor data. We aimed to identify the most informative phone sensor features associated with BDEs on weekend and weekdays, respectively, to determine the key features that explain prediction model performance. METHODS We collected phone sensor data from 75 young adults (ages 21-25; mean =22.4, SD=1.9) with risky drinking behavior who reported drinking behavior over 14 weeks. Participants in this secondary analysis were enrolled in a clinical trial. We developed machine learning models testing different algorithms (e.g., XGBoost, decision tree) to predict same-day BDEs (versus low-risk drinking events and non-drinking periods) using smartphone sensor data (e.g., accelerometer, GPS). We tested various "prediction distance" time windows (more proximal: 1-hour; to distant: 6-hour) from drinking onset. We also tested various analysis time windows (i.e., amount of data to be analyzed), ranging from 1 to 12 hours prior to drinking onset, because this determines the amount of data that needs to be stored on the phone to compute the model. Explainable AI (XAI) was used to explore interactions between the most informative phone sensor features contributing to BDEs. RESULTS The XGBoost model performed best in predicting imminent same-day BDE, with 95.0% accuracy on weekends and 94.3% accuracy on weekdays (F1 score = 0.95 and 0.94, respectively). This XGBoost model needed 12- and 9-hours of phone sensor data at 3- and 6- hours prediction distance from the onset of drinking, on weekends and weekdays, respectively, prior to predicting same-day BDEs. The most informative phone sensor features for BDE prediction were time (e.g., time of day) and GPS-derived, such as radius of gyration (an indicator of travel). Interactions among key features (e.g., time of day, GPS-derived features) contributed to prediction of same-day BDE. CONCLUSIONS We demonstrated the feasibility and potential use of smartphone sensor data and machine learning to accurately predict imminent (same-day) BDEs in young adults. The prediction model provides "windows of opportunity" and with the adoption of XAI, we identified "key contributing features" to trigger JITAI prior to the onset of BDEs, with the potential to reduce the likelihood of BDEs in young adults. CLINICALTRIAL
Collapse
Affiliation(s)
- Sang Won Bae
- Stevens Institute of Technology, Human-Computer Interaction and Human-Centered AI Systems Lab. AI for Healthcare Lab, 1 Castle Point Terrace, Hoboken, US
| | - Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Stanford, US
| | - Tongze Zhang
- Stevens Institute of Technology, Human-Computer Interaction and Human-Centered AI Systems Lab. AI for Healthcare Lab, 1 Castle Point Terrace, Hoboken, US
| | - Tammy Chung
- Institute for Health, Healthcare Policy and Aging Research, Rutgers University, Newark, US
| | - Melik Ozolcer
- Stevens Institute of Technology, Human-Computer Interaction and Human-Centered AI Systems Lab. AI for Healthcare Lab, 1 Castle Point Terrace, Hoboken, US
| | - Mohammad Rahul Islam
- Stevens Institute of Technology, Human-Computer Interaction and Human-Centered AI Systems Lab. AI for Healthcare Lab, 1 Castle Point Terrace, Hoboken, US
| | - Anind Dey
- Information School, University of Washington, Seattle, US
| |
Collapse
|
12
|
Suffoletto B, Pacella M, Huber J, Chung T. Effectiveness of text message interventions with different behavior change techniques on alcohol consumption among young adults: a five-arm randomized controlled trial. Addiction 2023; 118:265-275. [PMID: 36305694 DOI: 10.1111/add.16074] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 10/05/2022] [Indexed: 01/05/2023]
Abstract
AIMS This studys aim is to test the effectiveness of five interventions each utilizing a unique set of behavior change techniques on reducing alcohol consumption at 3 and 6 months among young adults with hazardous drinking. DESIGN, SETTING AND PARTICIPANTS This study used a five-arm parallel randomized controlled trial with 3- and 6-month follow-ups. Recruitment occurred at four emergency departments in Pittsburgh, PA, USA. Participants were non-treatment-seeking young adults (mean age = 22.1 years; 68.5% female; 37.1% black) who reported hazardous drinking. INTERVENTIONS Participants were randomized to one of five automated text message interventions for 12 weeks that interacted with participants on the 2 days per week that they typically drank: assisted self-monitoring (TRACK: control condition; n = 245), pre-drinking cognition feedback (PLAN; n = 226), alcohol consumption feedback (USE; n = 235), adaptive goal support (GOAL; n = 214) and a combination of interventions (COMBO; n = 221). MEASUREMENTS Primary outcome was number of past month binge drinking days at 3-month post-randomization calculated from a 30-day time-line follow-back. Primary intention-to-treat analysis compared PLAN, USE, GOAL and COMBO against TRACK (control condition). The four active conditions were not compared against each other. A secondary outcome, durability of effects, was measured at 6 months. FINDINGS From baseline to 3-month follow-up (retention = 81.1%), compared with TRACK, in which past-month mean binge drinking days increased from 2.7 to 3.4, mean binge drinking days decreased in COMBO from 3.0 to 2.3 [adjusted β = -0.52; 95% confidence interval (CI) = -0.77, -0.26], GOAL from 3.0 to 2.6 (adjusted β = -0.34; 95% CI = -0.59, -0.10) and USE from 3.3 to 2.9 (adjusted β = -0.38; 95% CI = -0.62, -0.14). At 6 months (retention = 73.8%), COMBO, GOAL, USE and PLAN had significantly lower mean binge drinking days compared with TRACK. CONCLUSION Text message interventions incorporating feedback on either drinking plans and/or alcohol consumption and/or drinking limit goal support produced small yet durable reductions in binge drinking days in non-treatment-seeking young adults with hazardous drinking.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Stanford, CA, USA.,Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Maria Pacella
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - James Huber
- University of West Virginia School of Medicine, Morgantown, WV, USA
| | - Tammy Chung
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, USA
| |
Collapse
|
13
|
Staton CA, Minnig MC, Phillips AJ, Kozhumam AS, Pesambili M, Suffoletto B, Mmbaga BT, Ngowi K, Vissoci JRN. Feasibility of SMS booster for alcohol reduction in injury patients in Tanzania. PLOS Glob Public Health 2022; 2:e0000410. [PMID: 36962731 PMCID: PMC10022354 DOI: 10.1371/journal.pgph.0000410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Accepted: 10/29/2022] [Indexed: 12/02/2022]
Abstract
Alcohol use is associated with 3 million annual deaths globally. Harmful alcohol use, which is associated with a high burden of disease in low- and middle-income countries (LMICs), often increases the probability of traumatic injury. Treatments for harmful alcohol use in LMICs, such as Tanzania, lack trained personnel and adequate infrastructure. The aim of this study was to assess the feasibility of using SMS boosters to augment a hospital based brief negotiational intervention (BNI) in this low resourced setting. We conducted a three stage, four arm feasibility trial of a culturally adapted BNI for injury patients with harmful and hazardous drinking admitted to Kilimanjaro Christian Medical Centre (KCMC) in Moshi, Tanzania. Post hospital discharge, two of the four arms included patients receiving either a standard or personalized short message service (SMS) booster to enhance and or perpetuate the effect of the in-hospital BNI. Text messages were sent weekly throughout a 3-month follow-up period. SMS feasibility was assessed according to the TIDier checklist evaluating what, when, how much, tailoring processes, modifications and how well (intervention fidelity). Data was collected with SMS logs and short answer surveys to participants. A total of 41 study participants were assigned to each receive 12 SMS over a three-month period; 38 received messages correctly, 3 did not receive intended messages, and 1 received a message who was not intended to. Of the 258 attempted texts, 73% were successfully sent through the messaging system. Of the messages that failed delivery, the majority were not able to be sent due to participants traveling out of cellular service range or turning off their phones. Participants interviewed in both booster arms reported that messages were appropriate, and that they would appreciate the continuation of such reminders. At 6-month follow-up, 100% (n = 11) of participants interviewed believed that the boosters had a positive impact on their behavior, with 90% reporting a large impact. This study demonstrated feasibility and acceptability of the integration of SMS mobile health technology to supplement this type of nurse-led BNI. SMS booster is a practical tool that can potentially prolong the impact of a brief hospital based intervention to enact behavioral change in injury patients with AUD.
Collapse
Affiliation(s)
- Catherine A. Staton
- Department of Emergency Medicine, Duke University School of Medicine, Durham, North Carolina, United States of America
- Duke Global Health Institute, Duke University, Durham, North Carolina, United States of America
| | - Mary Catherine Minnig
- Duke Global Health Institute, Duke University, Durham, North Carolina, United States of America
| | - Ashley J. Phillips
- Department of Emergency Medicine, Duke University School of Medicine, Durham, North Carolina, United States of America
| | - Arthi S. Kozhumam
- Duke Global Health Institute, Duke University, Durham, North Carolina, United States of America
| | | | - Brian Suffoletto
- Department of Emergency Medicine, Stanford University, California, United States of America
| | - Blandina T. Mmbaga
- Duke Global Health Institute, Duke University, Durham, North Carolina, United States of America
- Kilimanjaro Christian Medical Center, Moshi, Tanzania
- Kilimanjaro Clinical Research Institute, Moshi, Tanzania
- Kilimanjaro Christian Medical University College, Moshi, Tanzania
| | - Kennedy Ngowi
- Kilimanjaro Clinical Research Institute, Moshi, Tanzania
| | - Joao Ricardo Nickenig Vissoci
- Department of Emergency Medicine, Duke University School of Medicine, Durham, North Carolina, United States of America
- Duke Global Health Institute, Duke University, Durham, North Carolina, United States of America
| |
Collapse
|
14
|
Suffoletto B, Pacella-LaBarbara ML, Huber J, Delgado MK, McDonald C. Effectiveness of a Text Message Intervention to Reduce Texting While Driving Among Targeted Young Adults: A Randomized Controlled Trial. J Adolesc Health 2022; 71:423-431. [PMID: 35725538 DOI: 10.1016/j.jadohealth.2022.05.016] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 05/10/2022] [Accepted: 05/13/2022] [Indexed: 10/18/2022]
Abstract
PURPOSE This randomized clinical trial tested the efficacy of a 6-week text message program to reduce texting while driving (TWD) for young adults. METHODS Eligible individuals recruited from four emergency departments from December 2019 to June 2021 were aged 18-25 years who reported TWD in the past 2 weeks. Participants were randomly assigned 1:1 to intervention:assessment control. The intervention arm (n = 57) received an automated interactive text message program, including weekly queries about TWD for 6 weeks with feedback and goal support to promote cessation of TWD. The assessment control arm (n = 55) received identical weekly TWD queries but no additional feedback. Outcomes were collected via web-based self-assessments at 6- and 12 weeks and analyzed under intent-to-treat models, presented as adjusted odds ratios (ORs) with 95% confidence intervals (CIs). RESULTS The mean (SD) age was 21.7 (2.1) years, 73 (65%) were female, and 40 (36%) were White. The 6-week follow-up rate was 77.7% (n = 87) and 12-week follow-up rate was 64.3% (n = 72). At 6 weeks, 52.6% (95% CI, 39.0%-66.0%) of intervention participants reported TWD versus 63.6% (95% CI, 49.6%-76.2%) of control participants (adjusted OR, 0.71; 95% CI, 0.32-1.59). At 12 weeks, 38.2% (95% CI, 22.8%-53.5%) of intervention participants reported TWD versus 69.3% (95% CI, 53.8%-84.7%) of control participants (adjusted OR, 0.29; 95% CI, 0.11-0.80). DISCUSSION An interactive text message intervention was more effective at reducing self-reported TWD among young adults than assessment control at 12 weeks.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Palo Alto, California; Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania.
| | | | - James Huber
- University of West Virginia School of Medicine, Morgantown, West Virginia
| | - M Kit Delgado
- Department of Emergency Medicine and Department of Biostastistics, Epidemiology, and Informatics, University of Pennsylvania, Philadelphia, Pennsylvania; PENN Injury Science Center, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Catherine McDonald
- Department of Family & Community Health, University of Pennsylvania School of Nursing, Philadelphia, Pennsylvania; PENN Injury Science Center, University of Pennsylvania, Philadelphia, Pennsylvania
| |
Collapse
|
15
|
Suffoletto B, Pacella-LaBarbara ML, Huber J, Delgado MK, McDonald C. Effectiveness of a Text Message Intervention Promoting Seat Belt Use Among Young Adults: A Randomized Clinical Trial. JAMA Netw Open 2022; 5:e2231616. [PMID: 36129713 PMCID: PMC9494210 DOI: 10.1001/jamanetworkopen.2022.31616] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/02/2022] Open
Abstract
IMPORTANCE Approximately 1 in 10 adults do not always wear a seat belt, with the lowest use rates reported among young adults. OBJECTIVE To determine the efficacy of a 6-week automated behavioral text message program promoting seat belt use compared with an attention control. DESIGN, SETTING, AND PARTICIPANTS This parallel, 2-group, single-blind, individually randomized clinical trial included a convenience sample of patients recruited from 4 emergency departments in 2 cities in Pennsylvania from December 2019 to September 2021, with follow-ups at 6 and 12 weeks after randomization. Patients in stable condition aged 18 to 25 years who, in standardized screening, reported driving or being a passenger in a car without always using a seat belt in the past 2 weeks were eligible for recruitment. Participants who completed a 2-week trial run-in phase were randomly assigned 1:1 to the intervention or the assessment control. Data were analyzed from October 2019 to January 2020. INTERVENTIONS The intervention group received Safe Vehicle Engagement (SAVE), a 6-week automated interactive text message program, including weekly seat belt use queries with feedback and goal support to promote consistent use of a seat belt. The control group received identical weekly seat belt use queries but no additional feedback. MAIN OUTCOMES AND MEASURES The primary outcome was the proportion of young adults reporting always wearing a seat belt over the past 2 weeks, collected at 6 weeks (after a 2-week run-in) via web-based self-assessments and analyzed under intent-to-treat models using multiple imputation procedures. Sensitivity analyses included complete-case analyses of ordered categorical outcomes by vehicle seat position. Secondary outcomes included seatbelt use at 12 weeks and select cognitive constructs related to seat belt use. RESULTS A total of 218 participants (mean [SD] age, 21.5 [2.1] years; 139 [63.8%] women) were randomized, with 110 randomized to SAVE and 108 randomized to the control group. A total of 158 individuals (72.4%) were included in the 6-week follow-up. The rate of always using a seat belt over the past 2 weeks at the 6-week follow-up was 41.3% (95% CI, 30.6%-52.0%) among SAVE participants and 20.0% (95% CI, 10.6%-29.3%) among control participants (odds ratio [OR], 2.8; 95% CI, 1.4-5.8; P = .005). A total of 140 individuals (64.2%) participated in the 12-week follow-up. At 12 weeks, the rate of always using a seat belt over the past 2-weeks was 42.8% (95% CI, 31.2%-54.2%) among SAVE participants and 30.7% (95% CI, 19.6%-41.6%) among control participants (OR, 1.7; 95% CI, 0.9-3.4; P = .13). When examining ordered categories of seat belt use by seat position, there were significantly greater odds of wearing a seat belt at 6 and 12 weeks among SAVE participants vs control participants (eg, 6 weeks for driver: OR, 5.2; 95% CI, 2.6-10.5; 6 weeks for front passenger: OR, 4.3; 95% CI, 2.2-8.2; 6 weeks for back passenger: OR, 4.3; 95% CI, 2.2-8.2). CONCLUSIONS AND RELEVANCE In this randomized clinical trial, an interactive text message intervention was more effective at promoting seat belt use among targeted young adults than an attention control at 6 weeks. There was no significant difference between groups in always wearing a seat belt at 12 weeks. These findings, if replicated in a larger sample, suggest a scalable approach to improve seat belt use. TRIAL REGISTRATION ClinicalTrials.gov Identifier: NCT03833713.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Palo Alto, California
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania
| | | | - James Huber
- University of West Virginia School of Medicine, Morgantown
| | - M. Kit Delgado
- Department of Family & Community Health, University of Pennsylvania School of Nursing, Philadelphia
| | | |
Collapse
|
16
|
Dasgupta P, Frisch A, Huber J, Sejdic E, Suffoletto B. Predicting falls within 3 months of emergency department discharge among community-dwelling older adults using self-report tools versus a brief functional assessment. Am J Emerg Med 2022; 53:245-249. [PMID: 35085878 PMCID: PMC9231635 DOI: 10.1016/j.ajem.2021.12.071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 12/23/2021] [Accepted: 12/31/2021] [Indexed: 11/25/2022] Open
Abstract
BACKGROUND Identifying older adults with risk for falls prior to discharge home from the Emergency Department (ED) could help direct fall prevention interventions, yet ED-based tools to assist risk stratification are under-developed. The aim of this study was to assess the performance of self-report and functional assessments to predict falls in the 3 months post-ED discharge for older adults. METHODS A prospective cohort of community-dwelling adults age 60 years and older were recruited from one urban ED (N = 134). Participants completed: a single item screen for mobility (SIS-M), the 12-item Stay Independent Questionnaire (SIQ-12), and the Timed Up and Go test (TUG). Falls were defined through self-report of any fall at 1- and 3-months and medical record review for fall-related injury 3-months post-discharge. We developed a hybrid-convolutional recurrent neural network (HCRNN) model of gait and balance characteristics using truncal 3-axis accelerometry collected during the TUG. Internal validation was conducted using bootstrap resampling with 1000 iterations for SIS-M, FRQ, and GUG and leave-one-out for the HCRNN. We compared performance of M-SIS, FRQ, TUG time, and HCRNN by calculating the area under the receiver operating characteristic area under the curves (AUCs). RESULTS 14 (10.4%) of participants met our primary outcome of a fall or fall-related injury within 3-months. The SIS-M had an AUC of 0.42 [95% confidence interval (CI) 0.19-0.65]. The SIQ-12 score had an AUC of 0.64 [95% confidence interval (CI) 0.49-0.80]. The TUG had an AUC of 0.48 (95% CI 0.29-0.68). The HCRNN model using generated accelerometer features collected during the TUG had an AUC of 0.99 (95% CI 0.98-1.00). CONCLUSION We found that self-report and functional assessments lack sufficient accuracy to be used in isolation in the ED. A neural network model using accelerometer features could be a promising modality but research is needed to externally validate these findings.
Collapse
Affiliation(s)
- Pritika Dasgupta
- Epidemiology Data Center, Graduate School of Public Health, University of Pittsburgh
| | - Adam Frisch
- Department of Emergency Medicine, School of Medicine, University of Pittsburgh
| | - James Huber
- School of Medicine, West Virginia University
| | - Ervin Sejdic
- Department of Engineering, University of Toronto
| | - Brian Suffoletto
- Department of Emergency Medicine, School of Medicine, Stanford University, USA.
| |
Collapse
|
17
|
Humphreys K, Shover CL, Andrews CM, Bohnert ASB, Brandeau ML, Caulkins JP, Chen JH, Cuéllar MF, Hurd YL, Juurlink DN, Koh HK, Krebs EE, Lembke A, Mackey SC, Larrimore Ouellette L, Suffoletto B, Timko C. Responding to the opioid crisis in North America and beyond: recommendations of the Stanford-Lancet Commission. Lancet 2022; 399:555-604. [PMID: 35122753 PMCID: PMC9261968 DOI: 10.1016/s0140-6736(21)02252-2] [Citation(s) in RCA: 157] [Impact Index Per Article: 78.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 08/01/2021] [Accepted: 10/06/2021] [Indexed: 02/07/2023]
Affiliation(s)
- Keith Humphreys
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA; Veterans Affairs Palo Alto Health Care System, Palo Alto, CA, USA.
| | - Chelsea L Shover
- Division of General Internal Medicine and Health Services Research, University of California Los Angeles David Geffen School of Medicine, Los Angeles, CA, USA
| | - Christina M Andrews
- Department of Health Services Policy and Management, Arnold School of Public Health, University of South Carolina, Columbia, SC, USA
| | - Amy S B Bohnert
- Department of Psychiatry and Department of Anesthesiology, University of Michigan Health System, Ann Arbor, MI, USA; Veterans Affairs Center for Clinical Management Research, Veterans Affairs Ann Arbor Healthcare System, Ann Arbor, MI, USA
| | - Margaret L Brandeau
- Department of Management Science and Engineering, Huang Engineering Center, Stanford University, Stanford, CA USA
| | | | - Jonathan H Chen
- Stanford Center for Biomedical Informatics Research, Stanford University School of Medicine, Stanford, CA, USA; Division of Hospital Medicine, Stanford University School of Medicine, Stanford, CA, USA
| | | | - Yasmin L Hurd
- Addiction Institute, Icahn School of Medicine, New York, NY, USA
| | - David N Juurlink
- Sunnybrook Health Sciences Centre, Toronto, ON, Canada; Department of Medicine, University of Toronto, Toronto, ON, Canada
| | - Howard K Koh
- Department of Health Policy and Management, Harvard T H Chan School of Public Health, Boston, MA, USA
| | - Erin E Krebs
- Department of Medicine, University of Minnesota, Minneapolis, MN, USA; Center for Care Delivery and Outcomes Research, Veterans Affairs Minneapolis Health Care System, Minneapolis, MN, USA
| | - Anna Lembke
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Sean C Mackey
- Department of Anesthesiology, Perioperative and Pain Medicine, Stanford University School of Medicine, Palo Alto, CA, USA
| | | | - Brian Suffoletto
- Department of Emergency Medicine, Stanford University School of Medicine, Stanford, CA, USA
| | - Christine Timko
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA; Veterans Affairs Palo Alto Health Care System, Palo Alto, CA, USA
| |
Collapse
|
18
|
Linakis JG, Thomas SA, Bromberg JR, Casper TC, Chun TH, Mello MJ, Richards R, Ahmad F, Bajaj L, Brown KM, Chernick LS, Cohen DM, Dean JM, Fein J, Horeczko T, Levas MN, McAninch B, Monuteaux MC, Mull CC, Grupp-Phelan J, Powell EC, Rogers A, Shenoi RP, Suffoletto B, Vance C, Spirito A. Adolescent alcohol use predicts cannabis use over a three year follow-up period. Subst Abus 2022; 43:514-519. [PMID: 34236277 PMCID: PMC8759759 DOI: 10.1080/08897077.2021.1949665] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Background: Alcohol and cannabis use frequently co-occur, which can result in problems from social and academic impairment to dependence (i.e., alcohol use disorder [AUD] and/or cannabis use disorder [CUD]). The Emergency Department (ED) is an excellent site to identify adolescents with alcohol misuse, conduct a brief intervention, and refer to treatment; however, given time constraints, alcohol use may be the only substance assessed due to its common role in unintentional injury. The current study, a secondary data analysis, assessed the relationship between adolescent alcohol and cannabis use by examining the National Institute of Alcohol Abuse and Alcoholism (NIAAA) two question screen's (2QS) ability to predict future CUD at one, two, and three years post-ED visit. Methods: At baseline, data was collected via tablet self-report surveys from medically and behaviorally stable adolescents 12-17 years old (n = 1,689) treated in 16 pediatric EDs for non-life-threatening injury, illness, or mental health condition. Follow-up surveys were completed via telephone or web-based survey. Logistic regression compared CUD diagnosis odds at one, two, or three-year follow-up between levels constituting a single-level change in baseline risk categorization on the NIAAA 2QS (nondrinker versus low-risk, low- versus moderate-risk, moderate- versus high-risk). Receiver operating characteristic curve methods examined the predictive ability of the baseline NIAAA 2QS cut points for CUD at one, two, or three-year follow-up. Results: Adolescents with low alcohol risk had significantly higher rates of CUD versus nondrinkers (OR range: 1.94-2.76, p < .0001). For low and moderate alcohol risk, there was no difference in CUD rates (OR range: 1.00-1.08). CUD rates were higher in adolescents with high alcohol risk versus moderate risk (OR range: 2.39-4.81, p < .05). Conclusions: Even low levels of baseline alcohol use are associated with risk for a later CUD. The NIAAA 2QS is an appropriate assessment measure to gauge risk for future cannabis use.
Collapse
Affiliation(s)
| | | | - Julie R. Bromberg
- The Warren Alpert Medical School of Brown University;,Rhode Island Hospital
| | | | - Thomas H. Chun
- The Warren Alpert Medical School of Brown University;,Rhode Island Hospital
| | - Michael J. Mello
- The Warren Alpert Medical School of Brown University;,Rhode Island Hospital
| | | | - Fahd Ahmad
- St. Louis Children’s Hospital/ Washington University
| | | | | | | | | | | | - Joel Fein
- The Children’s Hospital of Philadelphia
| | - Timothy Horeczko
- Los Angeles Biomedical Research Institute at Harbor-UCLA Medical Center
| | | | - B McAninch
- University of Pittsburgh/ Children’s Hospital of Pittsburgh of UPMC
| | | | - Colette C. Mull
- Sidney Kimmel Medical College at Jefferson University/ Nemours Alfred I. duPont Hospital for Children
| | | | | | | | | | - Brian Suffoletto
- University of Pittsburgh/ Children’s Hospital of Pittsburgh of UPMC
| | | | - Anthony Spirito
- The Warren Alpert Medical School of Brown University;,Address correspondence to: Anthony Spirito, PhD, Alpert Medical School of Brown University, Department of Psychiatry and Human Behavior, Box G-BH, Providence, RI 02912, United States,
| | | |
Collapse
|
19
|
Suffoletto B, Goldstein T, Brent D. A Text Message Intervention for Adolescents With Depression and Their Parents or Caregivers to Overcome Cognitive Barriers to Mental Health Treatment Initiation: Focus Groups and Pilot Trial. JMIR Form Res 2021; 5:e30580. [PMID: 34751665 PMCID: PMC8663469 DOI: 10.2196/30580] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Accepted: 08/12/2021] [Indexed: 12/20/2022] Open
Abstract
BACKGROUND Many adolescents with depression do not pursue mental health treatment following a health care provider referral. We developed a theory-based automated SMS text message intervention (Text to Connect [T2C]) that attempts to reduce cognitive barriers to the initiation of mental health care. OBJECTIVE In this two-phase study, we seek to first understand the potential of T2C and then test its engagement, usability, and potential efficacy among adolescents with depression and their parents or caregivers. METHODS In phase 1, we conducted focus groups with adolescents with depression (n=9) and their parents or caregivers (n=9) separately, and transcripts were examined to determine themes. In phase 2, we conducted an open trial of T2C comprising adolescents with depression referred to mental health care (n=43) and their parents or caregivers (n=28). We assessed usability by examining program engagement, usability ratings, and qualitative feedback at the 4-week follow-up. We also assessed potential effectiveness by examining changes in perceived barriers to treatment and mental health care initiation from baseline to 4 weeks. RESULTS In phase 1, we found that the themes supported the T2C approach. In phase 2, we observed high engagement with daily negative affect check-ins, high usability ratings, and decreased self-reported barriers to mental health treatment over time among adolescents. Overall, 52% (22/42) of the adolescents who completed follow-up reported that they had attended an appointment with a mental health care specialist. Of the 20 adolescents who had not attended a mental health care appointment, 5% (1/20) reported that it was scheduled for a future date, 10% (2/20) reported that the primary care site did not have the ability to help them schedule a mental health care appointment, and 15% (3/20) reported that they were no longer interested in receiving mental health care. CONCLUSIONS The findings from this study suggest that T2C is acceptable to adolescents with depression and most parents or caregivers; it is used at high rates; and it may be helpful to reduce cognitive barriers to mental health care initiation.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Palo Alto, CA, United States
| | - Tina Goldstein
- Department of Psychology, University of Pittsburgh, Pittsburgh, PA, United States
| | - David Brent
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
| |
Collapse
|
20
|
Bae SW, Chung T, Islam R, Suffoletto B, Du J, Jang S, Nishiyama Y, Mulukutla R, Dey A. Mobile phone sensor-based detection of subjective cannabis intoxication in young adults: A feasibility study in real-world settings. Drug Alcohol Depend 2021; 228:108972. [PMID: 34530315 PMCID: PMC8595824 DOI: 10.1016/j.drugalcdep.2021.108972] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 07/19/2021] [Accepted: 07/23/2021] [Indexed: 01/02/2023]
Abstract
BACKGROUND Given possible impairment in psychomotor functioning related to acute cannabis intoxication, we explored whether smartphone-based sensors (e.g., accelerometer) can detect self-reported episodes of acute cannabis intoxication (subjective "high" state) in the natural environment. METHODS Young adults (ages 18-25) in Pittsburgh, PA, who reported cannabis use at least twice per week, completed up to 30 days of daily data collection: phone surveys (3 times/day), self-initiated reports of cannabis use (start/stop time, subjective cannabis intoxication rating: 0-10, 10 = very high), and continuous phone sensor data. We tested multiple models with Light Gradient Boosting Machine (LGBM) in distinguishing "not intoxicated" (rating = 0) vs subjective cannabis "low-intoxication" (rating = 1-3) vs "moderate-intensive intoxication" (rating = 4-10). We tested the importance of time features (i.e., day of the week, time of day) relative to smartphone sensor data only on model performance, since time features alone might predict "routines" in cannabis intoxication. RESULTS Young adults (N = 57; 58 % female) reported 451 cannabis use episodes, mean subjective intoxication rating = 3.77 (SD = 2.64). LGBM, the best performing classifier, had 60 % accuracy using time features to detect subjective "high" (Area Under the Curve [AUC] = 0.82). Combining smartphone sensor data with time features improved model performance: 90 % accuracy (AUC = 0.98). Important smartphone features to detect subjective cannabis intoxication included travel (GPS) and movement (accelerometer). CONCLUSIONS This proof-of-concept study indicates the feasibility of using phone sensors to detect subjective cannabis intoxication in the natural environment, with potential implications for triggering just-in-time interventions.
Collapse
Affiliation(s)
- Sang Won Bae
- School of Systems and Enterprises, Stevens Institute of Technology, USA
| | - Tammy Chung
- Institute for Health, Healthcare Policy and Aging Research, Rutgers University, USA.
| | - Rahul Islam
- School of Systems and Enterprises, Stevens Institute of Technology, USA
| | | | - Jiameng Du
- Computer Science Department, Carnegie Mellon University, USA
| | - Serim Jang
- Computer Science Department, Carnegie Mellon University, USA
| | | | - Raghu Mulukutla
- Computer Science Department, Carnegie Mellon University, USA
| | - Anind Dey
- Information School, University of Washington, Seattle, USA
| |
Collapse
|
21
|
Lee CM, Cadigan JM, Kilmer JR, Cronce JM, Suffoletto B, Walter T, Fleming C, Lewis MA. Brief Alcohol Screening and Intervention for Community College Students (BASICCS): Feasibility and preliminary efficacy of web-conferencing BASICCS and supporting automated text messages. Psychol Addict Behav 2021; 35:840-851. [PMID: 34110840 PMCID: PMC8942086 DOI: 10.1037/adb0000745] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
Objective: The Brief Alcohol Screening and Intervention for College Students (BASICS; Dimeff et al., 1999) is an evidence-based approach to reduce high-risk drinking and associated harms; however, implementation may present challenges for community colleges (CCs) that have limited budgets and mostly non-residential students. We examined feasibility, acceptability, and efficacy of BASICS for CC students (BASICCS) delivered remotely via web-conferencing with supporting automated text messages. Method: Participants included 142 CC students who reported exceeding National Institute on Alcohol Abuse and Alcoholism (NIAAA's) weekly low-risk drinking recommendations and/or heavy episodic drinking (HED). Participants were randomized to BASICCS or assessment-only control (AOC) and completed 1- and 3-month follow-up assessments. Results: Most students liked the personalized information in the program and found the web-conferencing platform useful, however intervention completion rate was 56%. Significant differences were found between BASICCS and AOC. At 1-month, individuals in BASICCS had 33% fewer alcohol consequences than those in AOC. At 3-month follow-up, individuals in BASICCS had lower estimated peak blood alcohol concentration, 29% fewer drinks per week, 62% fewer episodes of HED, and 24% fewer consequences than those in AOC. Conclusions: BASICCS showed evidence of being acceptable and the technology proved feasible, although the intervention completion rate in the non-treatment-seeking volunteer sample was modest. Preliminary evidence does suggest BASICCS shows promise in reducing alcohol use and consequences. Technology-based platforms could be a viable prevention solution for CC students. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
Affiliation(s)
- Christine M. Lee
- Department of Psychiatry and Behavioral Sciences, University of Washington
| | | | - Jason R. Kilmer
- Department of Psychiatry and Behavioral Sciences, University of Washington
| | - Jessica M. Cronce
- Department of Counseling Psychology and Human Services, University of Oregon
| | | | - Theresa Walter
- Department of Psychiatry and Behavioral Sciences, University of Washington
| | - Charles Fleming
- Department of Psychiatry and Behavioral Sciences, University of Washington
| | - Melissa A. Lewis
- Department of Health Behavior and Health Systems, University of North Texas Health Sciences Center, Fort Worth TX
| |
Collapse
|
22
|
Suffoletto B, Goldstein T, Gotkiewicz D, Gotkiewicz E, George B, Brent D. Acceptability, Engagement, and Effects of a Mobile Digital Intervention to Support Mental Health for Young Adults Transitioning to College: Pilot Randomized Controlled Trial. JMIR Form Res 2021; 5:e32271. [PMID: 34647893 PMCID: PMC8554670 DOI: 10.2196/32271] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Revised: 08/03/2021] [Accepted: 08/03/2021] [Indexed: 01/07/2023] Open
Abstract
Background The transition from high school to college can exacerbate mental health problems in young adults yet barriers prevent seamless mental health care. Existing digital support tools show promise but are not yet designed to optimize engagement or implementation. Objective The goal of the research was to test acceptability and effects of an automated digital Mobile Support Tool for Mental Health (MoST-MH) for young adults transitioning to college. Methods Youths aged 18 years and older with a current mental health diagnosis preparing to transition to college (n=52; 85% female [45/52], 91% White [48/52]) were recruited from a primary care (n=31) and a mental health clinic (n=21). Participants were randomized 2:1 to either receive MoST-MH (n=34) or enhanced Usual Care (eUC; n=18). MoST-MH included periodic text message and web-based check-ins of emotional health, stressors, negative impacts, and self-efficacy that informed tailored self-care support messages. Both eUC and MoST-MH participants received links to a library of psychoeducational videos and were asked to complete web-based versions of the Mental Health Self-Efficacy Scale (MHSES), College Counseling Center Assessment of Psychological Symptoms (CCAPS), and Client Service Receipt Inventory for Mental Health (C-SRI) monthly for 3 months and the Post-Study System Usability Scale (PSSUQ) at 3-months. Results MoST-MH participants were sent a median of 5 (range 3 to 10) text message check-in prompts over the 3-month study period and 100% were completed; participants were sent a median of 2 (range 1 to 8) web-based check-in prompts among which 78% (43/55) were completed. PSSUQ scores indicate high usability (mean score 2.0). Results from the completer analysis demonstrated reductions in mental health symptoms over time and significant between-group effects of MoST-MH compared to eUC on depressive symptom severity (d=0.36, 95% CI 0.08 to 0.64). No significant differences in mental health self-efficacy or mental health health care use were observed. Conclusions In this pilot trial, we found preliminary evidence that MoST-MH was engaged with at high rates and found to be highly usable and reduced depression symptoms relative to eUC among youth with mental health disorders transitioning to college. Findings were measured during the COVID-19 pandemic, and the study was not powered to detect differences in outcomes between groups; therefore, further testing is needed. Trial Registration ClinicalTrials.gov NCT04560075; https://clinicaltrials.gov/ct2/show/NCT04560075
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Palo Alto, CA, United States
| | - Tina Goldstein
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
| | - Dawn Gotkiewicz
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
| | | | - Brandie George
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
| | - David Brent
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
| |
Collapse
|
23
|
Pacella-LaBarbara ML, Maltese C, McConaghy M, Porter J, Young ML, Suffoletto B. Distress Tolerance Among Emergency Department Patients in Acute Pain: Associations with Substance Use Treatment. Stress Health 2021; 37:588-595. [PMID: 33369098 PMCID: PMC8713510 DOI: 10.1002/smi.3020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/20/2020] [Revised: 12/14/2020] [Accepted: 12/17/2020] [Indexed: 11/08/2022]
Abstract
Managing acute pain in individuals with a history of substance use disorders (SUD) is complex. Distress tolerance (DT) (e.g., the ability to handle uncomfortable sensations) may serve as an ideal non-pharmacological intervention target in this population. Among 293 emergency department (ED) patients seeking treatment for pain (Mage = 41; 42% Female; 43% Black), we examined rates of SUD treatment and DT, whether an objective DT task is feasible to conduct in the ED, and relationships between DT and SUD. Patients completed a self-report DT survey, an objective DT task, and brief surveys of pain, drug use, current or past SUD treatment, and depression/anxiety. Average DT was 18.50 (SD = 9.4) out of 50; patients with past or current SUD treatment (n = 43; 14.7%) reported lower DT than patients with no SUD treatment history (n = 250; 85.3%). Controlling for demographics, depression/anxiety, and pain severity, lower subjective DT (adjusted odds ratio [aOR] = 1.05) and objective DT (aOR = 1.02) was associated a current or past history or SUD treatment. Assessing subjective and objective DT in ED patients with acute pain is feasible; interventions aimed at boosting DT may improve outcomes among patients with acute pain and SUD.
Collapse
Affiliation(s)
| | - Caroline Maltese
- University of Pittsburgh School of Medicine, Department of Emergency Medicine
| | - Madelyn McConaghy
- University of Pittsburgh School of Medicine, Department of Emergency Medicine
| | - James Porter
- University of Pittsburgh School of Medicine, Department of Emergency Medicine
| | - Michael L. Young
- University of Pittsburgh School of Medicine, Department of Emergency Medicine
| | | |
Collapse
|
24
|
Suffoletto B, Landau A. Nudging Emergency Care Providers to Reduce Opioid Prescribing Using Peer Norm Comparison Feedback: A Pilot Randomized Trial. Pain Med 2021; 21:1393-1399. [PMID: 31846029 DOI: 10.1093/pm/pnz314] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
OBJECTIVE To determine the feasibility, acceptability, and potential impact of using audit and feedback (A&F) with or without peer norm comparison on opioid prescribing by emergency medicine providers. METHODS A convenience sample of 37 emergency medicine providers were recruited from 16 emergency departments in Western Pennsylvania for a pilot randomized controlled trial. Participants completed a baseline survey, were randomly allocated to A&F (N = 17) or A&F with peer norm comparison (N = 20), and were asked to complete a postintervention survey. We matched each participant 1:1 to a control who was not exposed to either intervention. RESULTS At baseline, 57% of participants perceived that they prescribed opioids at the same frequency as their peers, whereas 32% perceived prescribing less than and 11% perceived prescribing more than their peers. Most participants rated the interventions as helpful, with no differences between conditions. For the A&F with peer norm comparison condition, from pre- to postintervention, there was a relative increase of 20% in the percentage of participants who perceived that they prescribed more opioids than their peers but no change in the A&F condition (P = 0.02). 56.8% of controls, 52.9% of A&F participants, and 75.5% of A&F with peer norm comparison participants reduced their opioid prescribing (P = 0.33). The mean reduction in opioid prescriptions (SD) was 3.3. (9.6) for controls, 3.9 (10.5) for A&F, and 7.3 (7.8) for A&F with peer norm comparison (P = 0.31). CONCLUSIONS Audit and feedback interventions with peer norm comparisons are helpful to providers, can alter perceptions about prescribing norms, and are a potentially effective way to alter ED providers' opioid prescribing behavior.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| | - Aaron Landau
- School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| |
Collapse
|
25
|
Tobias A, Sobehart R, Doshi AA, Suffoletto B. Implementation of a Web-Based Tool With Text Message Prompts to Improve End-of-Shift Assessments for Emergency Medicine Residents. J Grad Med Educ 2020; 12:753-758. [PMID: 33391600 PMCID: PMC7771609 DOI: 10.4300/jgme-d-20-00204.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/15/2020] [Revised: 06/05/2020] [Accepted: 09/10/2020] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND End-of-shift assessments (ESA) can provide representative data on medical trainee performance but do not occur routinely and are not documented systematically. OBJECTIVE To evaluate the implementation of a web-based tool with text message prompts to assist mobile ESA (mESA) in an emergency medicine (EM) residency program. METHODS mESA used timed text messages to prompt faculty/trainees to expect in-person qualitative ESA in a milestone content area and for the faculty to record descriptive performance data through a web-based platform. We assessed implementation between January 2018 and November 2019 using the RE-AIM framework (reach, effectiveness, adoption, implementation, and maintenance). RESULTS Reach: 96 faculty and 79 trainees participated in the mESA program. Effectiveness: From surveys, approximately 72% of faculty and 58% of trainees reported increases in providing and receiving ESA feedback after program implementation. From ESA submissions, trainees reported receiving in-person feedback on 90% of shifts. Residency leadership confirmed perceived utility of the mESA program. Adoption: mESA prompts were sent on 7792 unique shifts across 4 EDs, all days of week, and different times of day. Faculty electronically submitted ESA feedback on 45% of shifts. Implementation quality: No technological errors occurred. Maintenance: Completion of in-person ESA feedback and electronic submission of feedback by faculty was stable over time. CONCLUSIONS We found mixed evidence in support of using a web-based tool with text message prompts for mESA for EM trainees.
Collapse
Affiliation(s)
- Adam Tobias
- Associate Professor of Emergency Medicine, University of Pittsburgh School of Medicine
| | - Robert Sobehart
- Medical Director, Department of Emergency Medicine, Allegheny Health Network
| | - Ankur A Doshi
- Associate Professor of Emergency Medicine, University of Pittsburgh School of Medicine
| | - Brian Suffoletto
- Associate Professor, Department of Emergency Medicine, Stanford University School of Medicine
| |
Collapse
|
26
|
Pacella-LaBarbara M, Larsen SE, Jaramillo S, Suffoletto B, Callaway C. Event centrality following treatment for physical injury in the emergency department: Associations with posttraumatic outcomes. Gen Hosp Psychiatry 2020; 67:77-82. [PMID: 33065405 PMCID: PMC7722005 DOI: 10.1016/j.genhosppsych.2020.09.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2020] [Revised: 09/16/2020] [Accepted: 09/17/2020] [Indexed: 11/23/2022]
Abstract
BACKGROUND The relationship between event centrality (i.e., the degree to which a stressful event is integrated into one's identity) and acute posttraumatic outcomes after relatively minor physical injury is unknown. We examined pre-injury and Emergency Department (ED) predictors of event centrality at 6-weeks post-injury, and whether event centrality is uniquely associated with 6-week posttraumatic outcomes. METHODS In the EDs of two Level I trauma centers, 149 patients completed surveys regarding demographic, psychological and injury-related factors within 24 h post-injury; 84 patients (51% male) completed 6-week surveys of event centrality, posttraumatic stress symptoms (PTSS) and trauma-specific QOL (T-QoL). Data were analyzed using linear regression modeling. RESULTS At least 20% of patients agreed or strongly agreed that the injury changed their life. Hospitalization status and peritraumatic dissociation were significant predictors of event centrality at 6-weeks. After controlling for demographics, ED-related factors and pre-injury PTSS, event centrality was uniquely associated with PTSS (p < .001) and T-QOL (p < .001) at 6 weeks. CONCLUSION Over and above the effects of the injury itself, event centrality conveyed important information for posttraumatic outcomes at 6 weeks post-injury. The centrality scale is brief and feasible to administer; future work is needed to determine the predictive utility of event centrality on post-injury outcomes.
Collapse
Affiliation(s)
- Maria Pacella-LaBarbara
- Clement J Zablocki VA Medical Center, Department of Psychiatry, Medical College of Wisconsin, Behavioral Health Center, 1155 North Mayfair Road, Wauwatosa, WI 53226, United States of America
| | - Sadie E Larsen
- Clement J Zablocki VA Medical Center, Department of Psychiatry, Medical College of Wisconsin, Behavioral Health Center, 1155 North Mayfair Road, Wauwatosa, WI 53226, United States of America.
| | - Stephany Jaramillo
- Clement J Zablocki VA Medical Center, Department of Psychiatry, Medical College of Wisconsin, Behavioral Health Center, 1155 North Mayfair Road, Wauwatosa, WI 53226, United States of America
| | - Brian Suffoletto
- Clement J Zablocki VA Medical Center, Department of Psychiatry, Medical College of Wisconsin, Behavioral Health Center, 1155 North Mayfair Road, Wauwatosa, WI 53226, United States of America
| | - Clifton Callaway
- Clement J Zablocki VA Medical Center, Department of Psychiatry, Medical College of Wisconsin, Behavioral Health Center, 1155 North Mayfair Road, Wauwatosa, WI 53226, United States of America
| |
Collapse
|
27
|
Suffoletto B, Ram N, Chung T. In-Person Contacts and Their Relationship With Alcohol Consumption Among Young Adults With Hazardous Drinking During a Pandemic. J Adolesc Health 2020; 67:671-676. [PMID: 32943290 PMCID: PMC7489992 DOI: 10.1016/j.jadohealth.2020.08.007] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Revised: 08/10/2020] [Accepted: 08/11/2020] [Indexed: 01/15/2023]
Abstract
PURPOSE Social distancing strategies such as "stay-at-home" (SAH) orders can slow the transmission of contagious viruses like the SARS-CoV-2 virus, but require population adherence to be effective. This study explored adherence to SAH orders by young adults with hazardous drinking, and the role of alcohol consumption with in-person contacts on adherence. METHODS Analyses included young adults with hazardous drinking (i.e., AUDIT-C score ≥3/4 for women/men; n = 50; ages 18-25) participating in a randomized trial in Pittsburgh, PA. Participants provided experience sampling reports on drinking twice per week from the week before SAH orders started on April 1, 2020 through 6 weeks during the SAH period. We examined how in-person contact with non-household friends changed over time and event-level relationships between alcohol consumption and in-person contacts. RESULTS The percentage of participants with any in-person contact in the week before SAH was 44% (95% confidence interval [CI] 30%-59%), which decreased to 29% (95% CI 15%-43%) in the first SAH week and increased to 65% (95% CI 46%-85%) by SAH week 6. Controlling for average levels of alcohol consumption, on days when young adults drank, participants reported more in-person contacts compared to nondrinking days. CONCLUSIONS Preliminary data indicate that, among young adults with hazardous drinking, adherence to public policies like SAH orders is suboptimal, declines over time, and is associated with drinking events. Interventions aimed at enhancing young adults' adherence to social distancing policies are urgently needed.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, Stanford University, Palo Alto, California.
| | - Nilam Ram
- Department of Psychology and Department of Communication, Stanford University, Palo Alto, California
| | - Tammy Chung
- Department of Psychiatry, Robert Wood Johnson School of Medicine, Rutgers University, Brunswick, New Jersey
| |
Collapse
|
28
|
Suffoletto B, Dasgupta P, Uymatiao R, Huber J, Flickinger K, Sejdic E. A Preliminary Study Using Smartphone Accelerometers to Sense Gait Impairments Due to Alcohol Intoxication. J Stud Alcohol Drugs 2020; 81:505-510. [PMID: 32800088 PMCID: PMC7437548 DOI: 10.15288/jsad.2020.81.505] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Accepted: 03/25/2020] [Indexed: 02/08/2024] Open
Abstract
OBJECTIVE Sensing the effects of alcohol consumption in real time could offer numerous opportunities to reduce related harms. This study sought to explore accuracy of gait-related features measured by smartphone accelerometer sensors on detecting alcohol intoxication (breath alcohol concentration [BrAC] > .08%). METHOD In a controlled laboratory study, participants (N = 17; 12 male) were asked to walk 10 steps in a straight line, turn, and walk 10 steps back before drinking and each hour, for up to 7 hours after drinking a weight-based dose of alcohol to reach a BrAC of .20%. Smartphones were placed on the lumbar region and 3-axis accelerometer data was recorded at a rate of 100 Hz. Accelerometer data were segmented into task segments (i.e., walk forward, walk backward). Features were generated for each overlapping 1-second windows, and the data set was split into training and testing data sets. Logistic regression models were used to estimate accuracy for classifying BrAC ≤ .08% from BrAC > .08% for each subject. RESULTS Across participants, BrAC > .08% was predicted with a mean accuracy of 92.5% using logistic regression, an improvement from a naive model accuracy of 88.2% (mean sensitivity = .89; specificity = .92; positive predictive value = .77; and negative predictive value = .97). The two most informative accelerometer features were mean signal amplitude and variance of the signal in the x-axis (i.e., gait sway). CONCLUSIONS We found preliminary evidence supporting use of gait-related features measured by smartphone accelerometer sensors to detect alcohol intoxication. Future research should determine whether these findings replicate in situ.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
| | - Pritika Dasgupta
- Department of Biomedical Informatics, School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Ray Uymatiao
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
| | - James Huber
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
| | - Kate Flickinger
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
| | - Ervin Sejdic
- Department of Electrical and Computer Engineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, Pennsylvania
| |
Collapse
|
29
|
Demirci JR, Suffoletto B, Doman J, Glasser M, Chang JC, Sereika SM, Bogen DL. The Development and Evaluation of a Text Message Program to Prevent Perceived Insufficient Milk Among First-Time Mothers: Retrospective Analysis of a Randomized Controlled Trial. JMIR Mhealth Uhealth 2020; 8:e17328. [PMID: 32347815 PMCID: PMC7221632 DOI: 10.2196/17328] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2019] [Revised: 01/24/2020] [Accepted: 01/26/2020] [Indexed: 12/11/2022] Open
Abstract
Background Several recent trials have examined the feasibility and efficacy of automated SMS text messaging to provide remote breastfeeding support to mothers, but these texting systems vary in terms of design features and outcomes examined. Objective This study examined user engagement with and feedback on a theory-grounded SMS text messaging intervention intended to prevent perceived insufficient milk (PIM)—the single, leading modifiable cause of unintended breastfeeding reduction and cessation. Methods We recruited 250 nulliparous individuals intending to breastfeed between 13 and 25 weeks of pregnancy in southwestern Pennsylvania. Participants were randomly assigned with equal allocation to either an SMS intervention to prevent PIM and unintended breastfeeding reduction or cessation (MILK, a Mobile, semiautomated text message–based Intervention to prevent perceived Low or insufficient milK supply; n=126) or a control group receiving general perinatal SMS text messaging–based support via the national, free Text4Baby system (n=124). Participants in both groups received SMS text messages 3 to 7 times per week from 25 weeks of pregnancy to 8 weeks postpartum. The MILK intervention incorporated several automated interactivity and personalization features (eg, keyword texting for more detailed information on topics and branched response logic) as well as an option to receive one-on-one assistance from an on-call study lactation consultant. We examined participant interactions with the MILK system, including response rates to SMS text messaging queries. We also sought participant feedback on MILK content, delivery preferences, and overall satisfaction with the system via interviews and a remote survey at 8 weeks postpartum. Results Participants randomized to MILK (87/124, 70.2% white and 84/124, 67.7% college educated) reported that MILK texts increased their breastfeeding confidence and helped them persevere through breastfeeding problems. Of 124 participants, 9 (7.3%) elected to stop MILK messages, and 3 (2.4%) opted to reduce message frequency during the course of the study. There were 46 texts through the MILK system for individualized assistance from the study lactation consultant (25/46, 54% on weekends or after-hours). The most commonly texted keywords for more detailed information occurred during weeks 4 to 6 postpartum and addressed milk volume intake and breastfeeding and sleep patterns. MILK participants stated a preference for anticipatory guidance on potential breastfeeding issues and less content addressing the benefits of breastfeeding. Suggested improvements included extending messaging past 8 weeks, providing access to messaging for partners, and tailoring content based on participants’ pre-existing breastfeeding knowledge and unique breastfeeding trajectory. Conclusions Prenatal and postpartum evidence–based breastfeeding support delivered via semiautomated SMS text messaging is a feasible and an acceptable intervention for first-time mothers. To optimize engagement with digital breastfeeding interventions, enhanced customization features should be considered. Trial Registration ClinicalTrials.gov NCT02724969; https://clinicaltrials.gov/ct2/show/NCT02724969
Collapse
Affiliation(s)
- Jill R Demirci
- Department of Health Promotion & Development, University of Pittsburgh School of Nursing, Pittsburgh, PA, United States
| | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
| | - Jack Doman
- Office of Academic Computing, Western Psychiatric Institute and Clinic, University of Pittsburgh, Pittsburgh, PA, United States
| | - Melissa Glasser
- Department of Health Promotion & Development, University of Pittsburgh School of Nursing, Pittsburgh, PA, United States
| | - Judy C Chang
- Department of Obstetrics, Gynecology & Reproductive Sciences, and Internal Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
| | - Susan M Sereika
- Department of Health & Community Systems, Center for Research and Evaluation, University of Pittsburgh School of Nursing, Pittsburgh, PA, United States
| | - Debra L Bogen
- Department of Pediatrics, Children's Hospital of Pittsburgh, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
| |
Collapse
|
30
|
Suffoletto B, Zeigler A. Risk and protective factors for repeated overdose after opioid overdose survival. Drug Alcohol Depend 2020; 209:107890. [PMID: 32058246 PMCID: PMC7127977 DOI: 10.1016/j.drugalcdep.2020.107890] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/23/2019] [Revised: 01/27/2020] [Accepted: 01/27/2020] [Indexed: 12/28/2022]
Abstract
BACKGROUND Nonfatal opioid overdose (OD) is an opportunity to identify patients who may benefit from interventions to reduce repeated overdose (rOD). In this study, we sought to determine risk and protective factors associated with rOD. METHODS In this retrospective cohort study of 4,155 patients aged 18-64 who presented to one of 16 emergency departments in a single Western Pennsylvania health system between July 2015 and January 2018 for index opioid overdose (iOD) and survived to discharge, we identified demographic and clinical factors association with rOD within one-year. Relative risk of repeated opioid overdose was estimated using adjusted Cox proportional hazard ratios (aHRs). RESULTS 14.9 % of patients (95 % CI 13.9-16.1) had a rOD, with 29 % occurring within 30 days from iOD. The adjusted hazard of opioid overdose was increased for male patients (aHR = 1.19; 95 % CI 1.01, 1.41), those with pre-iOD diagnoses of anxiety (aHR = 1.41; 95 % CI1.13, 1.77), depression (aHR = 1.44; 95 % CI 1.17, 1.78), substance use disorders (aHR = 1.30; 95 % CI 1.09, 1.55), and alcohol use disorder (aHR = 1.52; 95 % CI 1.02, 2.25). The hazard was lower for individuals prescribed an opioid in the 90 days prior to iOD (aHR = 0.59; 95 % CI 0.37, 0.97) and those admitted to the hospital for iOD (aHR = 0.56; 95 % CI 0.37, 0.86). CONCLUSION We found that, among ED patients who survive an initial OD, mental health and substance use diagnoses are associated with a higher hazard of repeated overdoses whereas opioids prescriptions and admission are associated with lower hazards.
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Iroquois Building, Suite 400A, 3600 Forbes Avenue, Pittsburgh, PA 15261, United States.
| | | |
Collapse
|
31
|
Chernick LS, Chun TH, Richards R, Bromberg JR, Ahmad FA, McAninch B, Mull C, Shenoi R, Suffoletto B, Casper C, Linakis J, Spirito A. Sex Without Contraceptives in a Multicenter Study of Adolescent Emergency Department Patients. Acad Emerg Med 2020; 27:283-290. [PMID: 31596987 DOI: 10.1111/acem.13867] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2019] [Revised: 09/15/2019] [Accepted: 10/06/2019] [Indexed: 12/28/2022]
Abstract
OBJECTIVES In the United States, rates of teenage pregnancy and sexually transmitted infections (STIs) remain exceptionally high, and racial and ethnic disparities persist. Emergency departments (EDs) care for over 19 million adolescents each year, the majority being minority and low socioeconomic status. Single-center studies demonstrate infrequent use of contraceptives among adolescent ED patients and an association between risky sex and behaviors such as alcohol and drug use; however, no multicenter ED data exist. The objectives of this study were to 1) determine the prevalence of sex without contraceptives in a large multicenter adolescent ED study and 2) assess patient demographic and risky behaviors associated with sex without contraceptives. METHODS Participants aged 14 to 17 years (n = 3,247) in 16 pediatric EDs across the United States completed an electronic survey. Questions focused on validated measures of risky sex; use of alcohol, tobacco, marijuana, and other drugs; and depression and violence. In this secondary analysis, we constructed univariable and multivariable models to identify demographic and behavioral factors associated with sex without contraceptives (our primary outcome), separately for adolescent males and females. RESULTS In the prior year, 17.4% (236/1,356) of males and 15.8% (299/1,891) of females had sex without contraceptives. In the multivariable model, sex without contraceptives for both genders was more likely among teens who were black, with conduct problems and participated in casual sex, binge drinking, or cannabis use. Sex without contraceptives was also more likely among Hispanic and cigarette-smoking males, as well as depressed females. CONCLUSIONS Adolescent ED patients across the United States are participating in risky sexual behaviors that increase their likelihood of pregnancy and STI acquisition. These adolescents report a number of problem behaviors, including substance use, which are strongly correlated with unprotected sex. The ED visit may be an opportunity to identify at-risk adolescent patients, address risky behaviors, and intervene to improve adolescent health.
Collapse
Affiliation(s)
- Lauren S. Chernick
- Division of Pediatric Emergency Medicine Department of Emergency Medicine Columbia University Medical Center New York NY
| | - Thomas H. Chun
- Department of Pediatrics and Emergency Medicine The Warren Alpert Medical School of Brown UniversityRhode Island Hospital ProvidenceRI
| | - Rachel Richards
- Division of Pediatric Critical Care Department of Pediatrics University of Utah Health Sciences Center Salt Lake City UT
| | - Julie R. Bromberg
- Department of Emergency Medicine The Warren Alpert Medical School of Brown UniversityRhode Island Hospital ProvidenceRI
| | - Fahd A. Ahmad
- Department of Pediatrics Washington University School of Medicine St. Louis MO
| | - Brett McAninch
- Division of Pediatric Emergency Medicine Department of Pediatrics University of Pittsburgh Medical Center Children’s Hospital of Pittsburgh PittsburghPA
| | - Colette Mull
- Division of Pediatric Emergency Medicine Department of Pediatrics Nemours/Alfred I. duPont Hospital for Children Wilmington DE
| | - Rohit Shenoi
- Section of Emergency Medicine Department of Pediatrics Baylor College of Medicine Houston TX
| | - Brian Suffoletto
- Department of Emergency Medicine University of Pittsburgh Pittsburgh PA
| | - Charlie Casper
- Division of Pediatric Critical Care Department of Pediatrics University of Utah Health Sciences Center Salt Lake City UT
| | - James Linakis
- Department of Pediatrics and Emergency Medicine The Warren Alpert Medical School of Brown UniversityRhode Island Hospital ProvidenceRI
| | - Anthony Spirito
- Department of Psychiatry and Human Behavior Alpert Medical School of Brown University Providence RI
| | | |
Collapse
|
32
|
Chung T, Bae SW, Mun EY, Suffoletto B, Nishiyama Y, Jang S, Dey AK. Mobile Assessment of Acute Effects of Marijuana on Cognitive Functioning in Young Adults: Observational Study. JMIR Mhealth Uhealth 2020; 8:e16240. [PMID: 32154789 PMCID: PMC7093776 DOI: 10.2196/16240] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2019] [Revised: 12/01/2019] [Accepted: 01/28/2020] [Indexed: 12/29/2022] Open
Abstract
Background Mobile assessment of the effects of acute marijuana on cognitive functioning in the natural environment would provide an ecologically valid measure of the impacts of marijuana use on daily functioning. Objective This study aimed to examine the association of reported acute subjective marijuana high (rated 0-10) with performance on 3 mobile cognitive tasks measuring visuospatial working memory (Flowers task), attentional bias to marijuana-related cues (marijuana Stroop), and information processing and psychomotor speed (digit symbol substitution task [DSST]). The effect of distraction as a moderator of the association between the rating of subjective marijuana high and task performance (ie, reaction time and number of correct responses) was explored. Methods Young adults (aged 18-25 years; 37/60, 62% female) who reported marijuana use at least twice per week were recruited through advertisements and a participant registry in Pittsburgh, Pennsylvania. Phone surveys and mobile cognitive tasks were delivered 3 times per day and were self-initiated when starting marijuana use. Completion of phone surveys triggered the delivery of cognitive tasks. Participants completed up to 30 days of daily data collection. Multilevel models examined associations between ratings of subjective marijuana high (rated 0-10) and performance on each cognitive task (reaction time and number of correct responses) and tested the number of distractions (rated 0-4) during the mobile task session as a moderator of the association between ratings of subjective marijuana high and task performance. Results Participants provided 2703 data points, representing 451 reports (451/2703, 16.7%) of marijuana use. Consistent with slight impairing effects of acute marijuana use, an increase in the average rating of subjective marijuana high was associated with slower average reaction time on all 3 tasks—Flowers (B=2.29; SE 0.86; P=.008), marijuana Stroop (B=2.74; SE 1.09; P=.01), and DSST (B=3.08; SE 1.41; P=.03)—and with fewer correct responses for Flowers (B=−0.03; SE 0.01; P=.01) and DSST (B=−0.18; SE 0.07; P=.01), but not marijuana Stroop (P=.45). Results for distraction as a moderator were statistically significant only for certain cognitive tasks and outcomes. Specifically, as hypothesized, a person’s average number of reported distractions moderated the association of the average rating of subjective marijuana high (over and above a session’s rating) with the reaction time for marijuana Stroop (B=−52.93; SE 19.38; P=.006) and DSST (B=−109.72; SE 42.50; P=.01) and the number of correct responses for marijuana Stroop (B=−0.22; SE 0.10; P=.02) and DSST (B=4.62; SE 1.81; P=.01). Conclusions Young adults’ performance on mobile cognitive tasks in the natural environment was associated with ratings of acute subjective marijuana high, consistent with slight decreases in cognitive functioning. Monitoring cognitive functioning in real time in the natural environment holds promise for providing immediate feedback to guide personal decision making.
Collapse
Affiliation(s)
- Tammy Chung
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
| | - Sang Won Bae
- School of Systems and Enterprises, Stevens Institute of Technology, Hoboken, NJ, United States
| | - Eun-Young Mun
- Department of Health Behavior and Health Systems, University of North Texas Health Science Center, Fort Worth, TX, United States
| | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States
| | - Yuuki Nishiyama
- Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
| | - Serim Jang
- Dietrich College of Humanities and Social Sciences, Carnegie Mellon University, Pittsburgh, PA, United States
| | - Anind K Dey
- Information School, University of Washington, Seattle, WA, United States
| |
Collapse
|
33
|
Landau A, Lynch M, Callaway C, Suffoletto B. How Are Real-time Opioid Prescribing Cognitions by Emergency Providers Influenced by Reviewing the State Prescription Drug Monitoring Program? Pain Med 2020; 20:955-960. [PMID: 29762757 DOI: 10.1093/pm/pny083] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
OBJECTIVE To understand how real-time opioid prescribing cognitions by emergency medicine (EM) providers are influenced by review of the state prescription drug monitoring program (PDMP). METHODS We collected prospective data from a convenience sample of 103 patient encounters for pain from 23 unique EM providers. After seeing the patient, before and immediately after reviewing the PDMP, EM providers answered how much they thought "the patient need[ed] an opioid to help manage their pain?", how concerned they were "about drug abuse and/or diversion?", and whether they planned to prescribe an opioid (yes/no). If they changed their decision to prescribe after querying the PDMP, they were asked to provide comments. We categorized encounters by opioid prescribing plan before/after PDMP review (e.g., O+/O- means plan changed from "yes" to "no") and examined changes in cognitions across categories. RESULTS Ninety-two of 103 (89.3%) encounters resulted in no change in opioid prescribing plan (61/92 [66.3%] O+/O+; 31/92 [33.7%] O-/O-). For the four O+/O- encounters, perceived patient opioid need decreased 75% of the time and concern for opioid abuse and/or diversion increased 75% of time. For the seven O-/O+ encounters, providers reported increased perceived patient opioid need 28.6% of the time and decreased concern for opioid abuse and/or diversion 14.3% of time. CONCLUSIONS PDMP data rarely alter plans to prescribe an opioid among emergency providers. When changes in opioid prescribing plan were made, this was reflected by changes in cognitions. Findings support the need for a properly powered study to identify how specific PDMP findings alter prescribing cognitions.
Collapse
Affiliation(s)
- Aaron Landau
- School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Michael Lynch
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Clifton Callaway
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| |
Collapse
|
34
|
Suffoletto B, Field M, Chung T. Attentional and approach biases to alcohol cues among young adult drinkers: An ecological momentary assessment study. Exp Clin Psychopharmacol 2019; 28:649-658. [PMID: 31886700 PMCID: PMC7326641 DOI: 10.1037/pha0000343] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Alcohol-specific attentional biases (AttB) and approach biases (AppB) are postulated to play a role in alcohol use disorders but their association with drinking in young adults remains unknown. A subsample of young adults with risky alcohol use (N = 296) enrolled in a randomized trial, testing different text message interventions completed weekly tasks via a mobile app for up to 14 weeks: Alcohol Stroop was used to measure AttB and Approach-Avoidance Task was used to measure AppB. Participants also provided reports of their alcohol consumption up to twice per week. We analyzed feasibility of measuring alcohol biases on mobile phones, whether repeated testing and conditions of testing affected mean reaction times (RTs), and whether mean AttB and AppB scores were associated with baseline alcohol use severity and same-day binge drinking (4+/5+ drinks per occasion for women/men). Task completion decreased from 93% on Week 1% to 39% by Week 14 with a mean of 8.2 weeks completed. Mean RTs for Alcohol Stroop decreased over weeks assessed. RTs to Stroop and Approach-Avoid tasks were longer when participants reported distractions or after alcohol and/or drug use. Mean AttB and AppB scores were not associated with baseline drinking, and within-day fluctuations of AttB and AppB scores did not predict same day binge drinking. Barriers to measuring alcohol biases in the natural environment include learning effects, contextual influences of distractions and prior alcohol/drug use, and absence of robust associations of RTs to alcohol cues with either baseline or same-day alcohol consumption. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
Affiliation(s)
- Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine
| | - Matt Field
- Department of Psychology, University of Sheffield
| | - Tammy Chung
- Department of Psychiatry, University of Pittsburgh School of Medicine
| |
Collapse
|
35
|
Suffoletto B, Huber J, Kirisci L, Clark D, Chung T. The effect of SMS behavior change techniques on event-level desire to get drunk in young adults. Psychol Addict Behav 2019; 34:320-326. [PMID: 31750698 DOI: 10.1037/adb0000534] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Text messaging (SMS) interventions incorporating a combination of behavior change techniques can assist reductions in alcohol consumption among young adult hazardous drinkers, but mechanisms of action remain unknown. In this secondary analysis, we test the hypothesis that desire to get drunk (DD) recorded prior to drinking episodes would mediate SMS intervention effects on the likelihood of event-level heavy drinking (4 +/5 + drinks for women/men). We recruited young adult hazardous drinkers to a trial where they were randomized to 1 of 5 SMS interventions: TRACK (self-monitoring of alcohol use), PLAN (feedback on drinking plans and DD), USE (postdrinking feedback on alcohol consumed), GOAL (goal prompts/support), and COMBO (i.e., 4 interventions combined). Up to 3 days per week for 14 weeks, when participants reported a plan to drink, they were asked to report DD on a scale from 0 (none) to 8 (completely) and next day asked to recall drink quantity. Multilevel structural equation models showed that DD mediated the treatment effect of GOAL on heavy drinking. This work illustrates the importance of goal support features in digital alcohol interventions and the utility of measuring desire to get drunk as a key mediator in alcohol studies. (PsycINFO Database Record (c) 2020 APA, all rights reserved).
Collapse
|
36
|
Whitt ZT, Bernstein M, Spillane N, Stein LAR, Suffoletto B, Neighbors C, Schick MR, Cyders MA. Positive urgency worsens the impact of normative feedback on 21st birthday drinking. Drug Alcohol Depend 2019; 204:107559. [PMID: 31563804 PMCID: PMC6878139 DOI: 10.1016/j.drugalcdep.2019.107559] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/26/2018] [Revised: 11/01/2018] [Accepted: 11/15/2018] [Indexed: 10/26/2022]
Abstract
BACKGROUND The 21st birthday is associated with more alcohol consumption and negative consequences than any other occasion. The current study investigated how positive urgency, the tendency to act rashly in response to positive emotions, influences 21st birthday drinking and the effectiveness of a single event text message intervention designed to reduce 21st birthday drinking and related negative consequences. METHODS Participants were 183 undergraduate students (69% female, 86% white) about to turn 21. Participants were randomly assigned to either a text message intervention or control condition. Those in the intervention condition received one text message the day before their 21st birthday that provided personalized normative feedback and one text message on the day of their 21st birthday. Participants reported actual alcohol consumption the day after their 21st birthday celebration. RESULTS Hierarchical linear regression found that, after controlling for sex, intervention condition, and planned drinking, positive urgency was associated with greater number of drinks (β = .15, p = .031) and drinking problems (β = .25, p = .001). A moderated-mediation model was significant (B = 0.42, CI95 [.10, .76]): At high levels of positive urgency, the intervention condition was associated with drinking more than planned, which significantly mediated the relationship between intervention and alcohol-related consequences; the mediation was not significant at mean or low levels of positive urgency. CONCLUSIONS These findings are the first to link positive urgency with 21st birthday drinking and to empirically demonstrate that positive urgency negatively impacts the effectiveness of an intervention aimed at reducing alcohol consumption.
Collapse
Affiliation(s)
- Zachary T Whitt
- Department of Psychology, Indiana University - Purdue University Indianapolis, Indianapolis, IN, United States.
| | - Michael Bernstein
- Brown University, Center for Alcohol and Addiction Studies, Providence, RI, United States
| | - Nichea Spillane
- Department of Psychology, University of Rhode Island, Kingston, RI, United States
| | - L A R Stein
- Brown University, Center for Alcohol and Addiction Studies, Providence, RI, United States; Department of Psychology, University of Rhode Island, Kingston, RI, United States; Rhode Island Training School, Department of Children, Youth and Families, Cranston, RI, United States
| | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, United States
| | - Clayton Neighbors
- Department of Psychology, University of Houston, Houston, TX, United States
| | - Melissa R Schick
- Department of Psychology, University of Rhode Island, Kingston, RI, United States
| | - Melissa A Cyders
- Department of Psychology, Indiana University - Purdue University Indianapolis, Indianapolis, IN, United States
| |
Collapse
|
37
|
Jaramillo S, Suffoletto B, Callaway C, Pacella-LaBarbara M. Early Screening for Posttraumatic Stress Disorder and Depression Among Injured Emergency Department Patients: A Feasibility Study. Acad Emerg Med 2019; 26:1232-1244. [PMID: 31179590 PMCID: PMC7294865 DOI: 10.1111/acem.13816] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2019] [Revised: 06/03/2019] [Accepted: 06/05/2019] [Indexed: 12/15/2022]
Abstract
BACKGROUND Despite the risk of developing posttraumatic stress disorder (PTSD) and associated comorbidities after physical injury, few emergency departments (EDs) in the United States screen for the presence of psychological symptoms and conditions. Barriers to systematic screening could be overcome by using a tool that is both comprehensive and brief. This study aimed to determine 1) the feasibility of screening for posttraumatic sequelae among adults with minor injury in the ED and 2) the relationship between ED screening and later psychological symptoms and poor quality of life (QOL) at 6 weeks postinjury. METHODS In the EDs of two Level I trauma centers, we enrolled injured patients (n = 149) who reported serious injury and/or life threat in the past 24 hours. Subjects completed the Posttraumatic Adjustment Scale (PAS) to screen for PTSD and depression in the ED, and 6 weeks later they completed assessments for symptoms of PTSD, depression, and trauma-specific QOL (T-QoL). RESULTS Our retained sample at 6 weeks was 84 adults (51.2% male; mean ± SD age = 33 ± 11.88 years); 38% screened positive for PTSD, and 76% screened positive for depression in the ED. Controlling for age, hospital admission, and ED pain score, regression analyses revealed that a positive ED screen for both PTSD and depression was significantly associated with 6 weeks PTSD (p = 0.027, 95% confidence interval [CI] = 0.92 to 15.14) and depressive symptoms (p = 0.001, 95% CI = 2.20 to 7.74), respectively. Further, a positive ED screen for depression (p = 0.043, 95% CI = -16.66 to -0.27) and PTSD (p = 0.015, 95% CI = -20.35 to -2.24) was significantly associated with lower T-QoL. CONCLUSIONS These results suggest that it is feasible to identify patients at risk for postinjury sequelae in the ED; screening for mental health risk may identify patients in need of early intervention and further monitoring.
Collapse
Affiliation(s)
- Stephany Jaramillo
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Clifton Callaway
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Maria Pacella-LaBarbara
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| |
Collapse
|
38
|
Marino R, Landau A, Lynch M, Callaway C, Suffoletto B. Do electronic health record prompts increase take-home naloxone administration for emergency department patients after an opioid overdose? Addiction 2019; 114:1575-1581. [PMID: 31013394 DOI: 10.1111/add.14635] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/03/2019] [Revised: 02/21/2019] [Accepted: 04/15/2019] [Indexed: 01/18/2023]
Abstract
BACKGROUND AND AIMS Distribution of take-home naloxone (THN) to emergency department (ED) patients who have survived an opioid overdose (OD) could reduce future opioid mortality, but is not commonly performed. We examined whether electronic health record (EHR) prompts provided to ED physicians when discharging a patient after an OD could improve THN distribution. DESIGN Interrupted time-series analysis to compare the percentage of OD patients who received THN during the 11 months before and after implementation of an EHR prompt on 18 June 2017. SETTING AND PARTICIPANTS A total of 3492 adult patients with diagnoses of OD discharged from nine EDs in a single health system in Western Pennsylvania from July 2016 to April 2018. INTERVENTION AND COMPARATOR The EHR prompt was triggered by the presence of specific terms in the nurse's initial assessment note. The EHR displayed a pop-up window during the ED physician discharge process asking the physician to consider prescribing or providing naloxone to the patient. The comparator was 'no EHR prompt'. MEASUREMENTS Measurements were based on standard criteria from ICD diagnostic codes and chief complaint keywords. FINDINGS In July 2016, 16.3% [95% confidence interval (CI) = 14.0, 18.5] of OD patients received THN, which decreased every month through June 2017 by 1.2% (P < 0.0001, 95% CI = 0.8,1.7). For each month post-EHR prompt there was an increase of 2.8% of OD patients receiving THN (P < 0.001, 95% CI = 2.0, 3.5). No increases occurred in the ED with the highest pre-EHR prompt THN distribution. Rates of THN distribution varied by patient age and race prior to, but not after, implementation of EHR prompts. CONCLUSIONS Electronic health record prompts are associated with increased take-home naloxone distribution for emergency department patients discharged after opioid overdoses.
Collapse
Affiliation(s)
- Ryan Marino
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Aaron Landau
- School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Michael Lynch
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Clifton Callaway
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| |
Collapse
|
39
|
Suffoletto B, Kirisci L, Clark DB, Chung T. Which behavior change techniques help young adults reduce binge drinking? A pilot randomized clinical trial of 5 text message interventions. Addict Behav 2019; 92:161-167. [PMID: 30640148 DOI: 10.1016/j.addbeh.2019.01.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2018] [Revised: 11/27/2018] [Accepted: 01/08/2019] [Indexed: 12/22/2022]
Abstract
Text message (SMS) interventions can reduce binge drinking in young adults, but optimal behavior change techniques (BCTs) remain unknown. The present study tests the acceptability and preliminary efficacy of different combinations of SMS-delivered BCTs. 149 young adults who screened positive for hazardous drinking completed a baseline survey in the Emergency Department. For the following 2-weeks, on days they typically drank (1 to 3 days per week), participants received ecological momentary assessments (EMA) of drinking plans and desire to get drunk; the next day they were prompted to report recall of number of drinks consumed the prior day. Participants who responded to at least 50% these EMA (N = 127) were randomized to one of five 12-week interventions: Cued Self-Monitoring (TRACK); Drinking Intentions Feedback (PLAN); Drinking Performance Feedback (USE); Adaptive Goal Support (GOAL); and a combination of BCTs (COMBO). 79% of all EMA were completed over 12 weeks, which decreased from around 93% on week 1 to 65% by week 12. Using EMA data, relative to TRACK, only COMBO showed significant reductions in binge drinking and max drinks per drinking episode over time. Using TLFB data, there were no significant differences between groups from baseline to 14- and 28-weeks follow-up. Results lay the groundwork for a larger trial testing the effects of BCTs on binge drinking for young adults.
Collapse
|
40
|
Linakis JG, Bromberg JR, Casper TC, Chun TH, Mello MJ, Richards R, Mull CC, Shenoi RP, Vance C, Ahmad F, Bajaj L, Brown KM, Chernick LS, Cohen DM, Fein J, Horeczko T, Levas MN, McAninch B, Monuteaux MC, Grupp-Phelan J, Powell EC, Rogers A, Suffoletto B, Dean JM, Spirito A. Predictive Validity of a 2-Question Alcohol Screen at 1-, 2-, and 3-Year Follow-up. Pediatrics 2019; 143:e20182001. [PMID: 30783022 PMCID: PMC6398369 DOI: 10.1542/peds.2018-2001] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 12/13/2018] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND The National Institute on Alcohol Abuse and Alcoholism (NIAAA) 2-question screen is a valid adolescent alcohol screening tool. No studies have examined if this tool predicts future alcohol problems. We conducted a study at 16 pediatric emergency departments to determine the tool's predictive validity for alcohol misuse and alcohol use disorders (AUDs). METHODS Participants (N = 4834) completed a baseline assessment battery. A subsample of participants completed the battery at 1, 2, and 3 years follow up. RESULTS Of the 2209 participants assigned to follow-up, 1611 (73%) completed a 1-year follow-up, 1591 (72%) completed a 2-year follow-up, and 1377 (62%) completed a 3-year follow-up. The differences in AUDs between baseline NIAAA screen nondrinkers and lower-risk drinkers were statistically significant at 1 year (P = .0002), 2 years (P <.0001), and 3 years (P = .0005), as were the differences between moderate- and highest-risk drinkers at 1 and 2 years (P < .0001 and P = .0088, respectively) but not at 3 years (P = .0758). The best combined score for sensitivity (86.2% at 1 year, 75.6% at 2 years, and 60.0% at 3 years) and specificity (78.1% at 1 year, 79.2% at 2 years, and 80.0% at 3 years) was achieved by using "lower risk" and higher as a cutoff for the prediction of a Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition diagnosis. CONCLUSIONS The NIAAA 2-question screen can accurately characterize adolescent risk for future AUDs. Future studies are needed to determine optimaluse of the screen.
Collapse
Affiliation(s)
- James G. Linakis
- The Warren Alpert Medical School, Brown University, Providence, Rhode Island
- Rhode Island Hospital, Providence, Rhode Island
| | - Julie R. Bromberg
- The Warren Alpert Medical School, Brown University, Providence, Rhode Island
- Rhode Island Hospital, Providence, Rhode Island
| | | | - Thomas H. Chun
- The Warren Alpert Medical School, Brown University, Providence, Rhode Island
- Rhode Island Hospital, Providence, Rhode Island
| | - Michael J. Mello
- The Warren Alpert Medical School, Brown University, Providence, Rhode Island
- Rhode Island Hospital, Providence, Rhode Island
| | | | - Colette C. Mull
- Nemours/Alfred I. duPont Hospital for Children, Wilmington, Delaware
- Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania
| | - Rohit P. Shenoi
- Texas Children’s Hospital and College of Medicine, Baylor University, Houston, Texas
| | - Cheryl Vance
- University of California, Davis, Davis, California
| | - Fahd Ahmad
- St Louis Children’s Hospital and School of Medicine, Washington University in St Louis, St Louis, Missouri
| | - Lalit Bajaj
- Children’s Hospital Colorado, Aurora, Colorado
| | - Kathleen M. Brown
- Children’s National Medical Center, Washington, District of Columbia
| | | | | | - Joel Fein
- Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania
| | | | | | - Brett McAninch
- University of Pittsburg Medical Center Children’s Hospital of Pittsburgh and School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania
| | | | | | - Elizabeth C. Powell
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, Illinois; and
| | | | - Brian Suffoletto
- University of Pittsburg Medical Center Children’s Hospital of Pittsburgh and School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania
| | | | - Anthony Spirito
- The Warren Alpert Medical School, Brown University, Providence, Rhode Island
| | - for the Pediatric Emergency Care Applied Research Network
- The Warren Alpert Medical School, Brown University, Providence, Rhode Island
- Rhode Island Hospital, Providence, Rhode Island
- University of Utah, Salt Lake City, Utah
- Nemours/Alfred I. duPont Hospital for Children, Wilmington, Delaware
- Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania
- Texas Children’s Hospital and College of Medicine, Baylor University, Houston, Texas
- University of California, Davis, Davis, California
- St Louis Children’s Hospital and School of Medicine, Washington University in St Louis, St Louis, Missouri
- Children’s Hospital Colorado, Aurora, Colorado
- Children’s National Medical Center, Washington, District of Columbia
- Columbia University Irving Medical Center, New York City, New York
- Nationwide Children’s Hospital, Columbus, Ohio
- Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania
- Los Angeles Biomedical Research Institute, Torrance, California
- Medical College of Wisconsin, Milwaukee, Wisconsin
- University of Pittsburg Medical Center Children’s Hospital of Pittsburgh and School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania
- Boston Children’s Hospital, Boston, Massachusetts
- Cincinnati Children’s Hospital Medical Center, Cincinnati, Ohio
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, Illinois; and
- University of Michigan, Ann Arbor, Michigan
| |
Collapse
|
41
|
Kmiec J, Suffoletto B. Implementations of a text-message intervention to increase linkage from the emergency department to outpatient treatment for substance use disorders. J Subst Abuse Treat 2019; 100:39-44. [PMID: 30898326 DOI: 10.1016/j.jsat.2019.02.005] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2019] [Revised: 02/15/2019] [Accepted: 02/20/2019] [Indexed: 10/27/2022]
Abstract
AIM To determine acceptability and explore potential usefulness of a text messaging (SMS) program aimed at increasing attendance at outpatient treatment for substance use disorders (SUD) after emergency department (ED) referral. METHOD A retrospective analysis of 377 adult patients from 2 urban EDs seeking treatment for SUD (opioids (n = 168), alcohol (n = 188), benzodiazepines (n = 21)) referred to outpatient treatment and offered an SMS program which included daily (1) motivational messages focused on positive thinking, (2) ecological momentary assessments (EMA) related to craving with tailored behavioral strategy messages, (3) EMA of drug use with tailored feedback to reduce abstinence violation effects, and (4) reminders about treatment location and phone number. We assessed acceptability by examining opt-in rates, EMA completion rates over the first week and end-of-program qualitative feedback. We assessed how individuals who opt in differ in outcomes from those who opt out by examining rates of outpatient SUD treatment attendance recorded from the medical record. RESULTS 167 patients (44%) opted in to the SMS program. Over 7 days, around 33% of EMA were completed. Median helpfulness score was 8 (IQR 6 to 10) out of 10 and 84% would recommend the SMS program to someone else. Individuals who opted in to the SMS program had higher rates of SUD treatment initiation than individuals who did not opt-in (70.7% vs. 40.9%). CONCLUSIONS We found evidence supporting acceptability and potential usefulness of an automated text message program to assist treatment attendance for some individuals with SUDs discharged from the ED. A controlled trial is needed to examine whether SMS program exposure is associated with improved treatment attendance compared to standard care.
Collapse
Affiliation(s)
- Julie Kmiec
- Department of Psychiatry, University of Pittsburgh, United States of America
| | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh School of Medicine, United States of America.
| |
Collapse
|
42
|
Spirito A, Bromberg JR, Casper TC, Chun T, Mello MJ, Mull CC, Shenoi RP, Vance C, Ahmad F, Bajaj L, Brown KM, Chernick LS, Cohen DM, Fein J, Horeczko T, Levas MN, McAninch B, Monuteaux MC, Grupp-Phelan J, Powell EC, Rogers A, Suffoletto B, Linakis JG. Screening for Adolescent Alcohol Use in the Emergency Department: What Does It Tell Us About Cannabis, Tobacco, and Other Drug Use? Subst Use Misuse 2019; 54:1007-1016. [PMID: 30727811 PMCID: PMC6476662 DOI: 10.1080/10826084.2018.1558251] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
BACKGROUND The pediatric emergency department (PED) represents an opportune time for alcohol and drug screening. The National Institute of Alcohol Abuse and Alcoholism (NIAAA) recommends a two-question alcohol screen for adolescents as a predictor of alcohol and drug misuse. OBJECTIVE A multi-site PED study was conducted to determine the association between the NIAAA two-question alcohol screen and adolescent cannabis use disorders (CUD), cigarette smoking, and lifetime use of other drugs. METHODS Participants included 12-17-year olds (n = 4834) treated in one of 16 participating PEDs. An assessment battery, including the NIAAA two-question screen and other measures of alcohol, tobacco and drug use, was self-administered on a tablet computer. RESULTS A diagnosis of CUD, lifetime tobacco use or lifetime drug use was predicted by any self-reported alcohol use in the past year, which indicates a classification of moderate risk for middle school ages and low risk for high school ages on the NIAAA two-question screen. Drinking was most strongly predictive of a CUD, somewhat weaker for lifetime tobacco use, and weakest for lifetime drug use. This same pattern held for high school and middle school students and was stronger for high school students over middle school students for all three categories. This association was also found across gender, ethnicity and race. The association was strongest for CUD for high school students, sensitivity 81.7% (95% CI, 77.0, 86.5) and specificity 70.4% (95% CI, 68.6, 72.1). Conclusions/Importance: A single question about past year alcohol use can provide valuable information about other substance use, particularly marijuana.
Collapse
Affiliation(s)
- Anthony Spirito
- a The Warren Alpert Medical School of Brown University, Departments of Psychiatry and Human Behavior, Pediatrics, Emergency Medicine, Providence, Rhode Island, USA
| | - Julie R Bromberg
- a The Warren Alpert Medical School of Brown University, Departments of Psychiatry and Human Behavior, Pediatrics, Emergency Medicine, Providence, Rhode Island, USA.,b Rhode Island Hospital, Department of Emergency Medicine, Providence, Rhode Island, USA
| | - T Charles Casper
- c University of Utah, Department of Pediatrics, Salt Lake City, Utah, USA
| | - Thomas Chun
- a The Warren Alpert Medical School of Brown University, Departments of Psychiatry and Human Behavior, Pediatrics, Emergency Medicine, Providence, Rhode Island, USA.,b Rhode Island Hospital, Department of Emergency Medicine, Providence, Rhode Island, USA
| | - Michael J Mello
- a The Warren Alpert Medical School of Brown University, Departments of Psychiatry and Human Behavior, Pediatrics, Emergency Medicine, Providence, Rhode Island, USA.,b Rhode Island Hospital, Department of Emergency Medicine, Providence, Rhode Island, USA
| | - Colette C Mull
- d Nemours/Alfred I. duPont Hospital for Children, Department of Pediatrics, Wilmington, Delaware, USA
| | - Rohit P Shenoi
- e Baylor College of Medicine/Texas Children's Hospital, Departments of Emergency Medicine and Pediatrics, Houston, Texas, USA
| | - Cheryl Vance
- f University of California , Davis, Department of Pediatrics, Davis , California, USA
| | - Fahd Ahmad
- g St. Louis Children's Hospital/Washington University, Department of Emergency Medicine, St. Louis, Washington, USA
| | - Lalit Bajaj
- h Children's Hospital - Colorado, Departments of Pediatric Emergency Medicine and Pediatrics, Aurora, Colorado, USA
| | - Kathleen M Brown
- i Children's National Medical Center, Department of Emergency Medicine and Trauma Services, Washington, DC, USA
| | - Lauren S Chernick
- j Columbia University Medical Center, Department of Pediatric Emergency Medicine, New York, New York, USA
| | - Daniel M Cohen
- k Nationwide Children's Hospital, Departments of Pediatrics and Emergency Medicine, Columbus, Ohio, USA
| | - Joel Fein
- l The Children's Hospital of Philadelphia, Departments of Pediatrics and Emergency Medicine, Philadelphia, Pennsylvania, USA
| | - Timothy Horeczko
- m Los Angeles Biomedical Research Institute at Harbor-UCLA Medical Center, Department of Emergency and Pediatric Emergency Medicine, Los Angeles, California, USA
| | - Michael N Levas
- n Medical College of Wisconsin, Department of Pediatric Emergency Medicine, Milwaukee, Wisconsin, USA
| | - B McAninch
- o University of Pittsburgh/Children's Hospital of Pittsburgh of UPMC, Division of Pediatric Emergency Medicine, Pittsburgh, Pennsylvania, USA
| | - Michael C Monuteaux
- p Boston Children's Hospital, Department of Pediatrics, Boston, Massachusetts, USA
| | - Jackie Grupp-Phelan
- q University of California , San Francisco, Department of Pediatric Emergency Medicine, San Francisco , California, USA
| | - Elizabeth C Powell
- r Lurie Children's Hospital of Chicago, Department of Pediatric Emergency Medicine, Chicago, Illinois, USA
| | - Alexander Rogers
- s University of Michigan, Department of Emergency Medicine, Ann Arbor, Michigan, USA
| | - Brian Suffoletto
- o University of Pittsburgh/Children's Hospital of Pittsburgh of UPMC, Division of Pediatric Emergency Medicine, Pittsburgh, Pennsylvania, USA
| | - James G Linakis
- a The Warren Alpert Medical School of Brown University, Departments of Psychiatry and Human Behavior, Pediatrics, Emergency Medicine, Providence, Rhode Island, USA.,b Rhode Island Hospital, Department of Emergency Medicine, Providence, Rhode Island, USA
| | | |
Collapse
|
43
|
Marino R, Lynch M, Suffoletto B. 390 Increasing Utilization of Take-Home Naloxone Program for At-Risk Emergency Department Patients Using Computerized Clinical Decision Support. Ann Emerg Med 2018. [DOI: 10.1016/j.annemergmed.2018.08.395] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
44
|
Allen M, Irizarry T, Einhorn J, Suffoletto B, Kamarck T, Burke L, Rollman B, Muldoon MF. Abstract P228: Text-Facilitated Home Blood Pressure Monitoring: A Qualitative Analysis of Health Behavior Change. Hypertension 2018. [DOI: 10.1161/hyp.72.suppl_1.p228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Uncontrolled hypertension constitutes a major challenge for healthcare systems. Home blood pressure monitoring (HBPM) is widely recommended and may lower BP when combined with other supports. However, scalable and systematic HBPM interventions are lacking and the behavioral mechanism(s) through which BP is lowered remain poorly understood. Our team designed the
MyBP
program with video-based education and a fully automated, bi-directional texting to facilitate longitudinal HBPM. Exit interviews conducted after six-weeks of
MyBP
revealed that most participants made at least one healthy behavior change. The current study examines why participants made healthy behavior changes, and what specific components of the
MyBP
program facilitated those changes. Adults with hypertension were recruited from either an urban emergency department, a primary care office, or a hypertension referral center. The 40 enrolled participants were widely representative: age range 34-70, 23 women, 24 minority, 14 completed only high school, BP range 110-250/70-130 mm Hg, and prescribed BP medications range 0-5. A thematic analysis of transcribed exit interview audio-recordings identified three themes contributing to patients’ decision to initiate a behavior change: 1) improved hypertension literacy from viewing educational videos; 2) increased day-to-day salience of one’s BP as a result of consistent HBPM; and 3) use of BP readings as feedback on participants’ health behaviors, with high readings often triggering intrinsic motivations to make behavior changes. These themes and associated sub-themes were found to have analogous constructs in the Health Belief Model and Social Cognitive Theory. The presentation of educational materials at baseline, followed by regular BP self-monitoring, increased confidence and motivation to initiate changes in health behaviors. The receipt of bi-weekly reports then acted as feedback fueling participants’ motivation to maintain or add healthy behaviors. Facilitation of HBPM with automated texting, in conjunction with educational videos and regular feedback, appears to stimulate improvements in hypertension self-management via mechanisms consistent with recognized models of behavior change.
Collapse
|
45
|
Bae S, Chung T, Ferreira D, Dey AK, Suffoletto B. Mobile phone sensors and supervised machine learning to identify alcohol use events in young adults: Implications for just-in-time adaptive interventions. Addict Behav 2018; 83:42-47. [PMID: 29217132 PMCID: PMC5963979 DOI: 10.1016/j.addbeh.2017.11.039] [Citation(s) in RCA: 57] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2017] [Revised: 11/22/2017] [Accepted: 11/25/2017] [Indexed: 11/17/2022]
Abstract
BACKGROUND Real-time detection of drinking could improve timely delivery of interventions aimed at reducing alcohol consumption and alcohol-related injury, but existing detection methods are burdensome or impractical. OBJECTIVE To evaluate whether phone sensor data and machine learning models are useful to detect alcohol use events, and to discuss implications of these results for just-in-time mobile interventions. METHODS 38 non-treatment seeking young adult heavy drinkers downloaded AWARE app (which continuously collected mobile phone sensor data), and reported alcohol consumption (number of drinks, start/end time of prior day's drinking) for 28days. We tested various machine learning models using the 20 most informative sensor features to classify time periods as non-drinking, low-risk (1 to 3/4 drinks per occasion for women/men), and high-risk drinking (>4/5 drinks per occasion for women/men). RESULTS Among 30 participants in the analyses, 207 non-drinking, 41 low-risk, and 45 high-risk drinking episodes were reported. A Random Forest model using 30-min windows with 1day of historical data performed best for detecting high-risk drinking, correctly classifying high-risk drinking windows 90.9% of the time. The most informative sensor features were related to time (i.e., day of week, time of day), movement (e.g., change in activities), device usage (e.g., screen duration), and communication (e.g., call duration, typing speed). CONCLUSIONS Preliminary evidence suggests that sensor data captured from mobile phones of young adults is useful in building accurate models to detect periods of high-risk drinking. Interventions using mobile phone sensor features could trigger delivery of a range of interventions to potentially improve effectiveness.
Collapse
Affiliation(s)
- Sangwon Bae
- Human Computer Interaction Institute, Carnegie Mellon University, United States
| | - Tammy Chung
- Department of Psychiatry, University of Pittsburgh, United States
| | - Denzil Ferreira
- Center for Ubiquitous Computing, University of Oulu, Finland
| | - Anind K Dey
- Human Computer Interaction Institute, Carnegie Mellon University, United States
| | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh, United States.
| |
Collapse
|
46
|
Lewis MA, Cadigan JM, Cronce JM, Kilmer JR, Suffoletto B, Walter T, Lee CM. Developing Text Messages to Reduce Community College Student Alcohol Use. Am J Health Behav 2018; 42:70-79. [PMID: 29973312 DOI: 10.5993/ajhb.42.4.7] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Objectives The aim of this study is to evaluate how community college students with hazardous drinking perceived the usefulness of alcohol protective behavioral strategy text messages (TM-PBS). Methods Community college students with past hazardous single occasion or weekly drinking (N = 48; 60% female) were randomized to receive 2 TM-PBS on 3 typical drinking days per week for 2 weeks selected by: (1) research investigators (ie, based on clinical and theoretical application); (2) participants (ie, messages highly rated at baseline by the participants); or (3) a random process. Prior to 2 typical drinking days per week, immediately after receiving TMs, we asked: "How useful do you think this strategy will be for you when you drink? Text a number from 1 (not useful) to 5 (very useful)." Results Response rates for the 12 messages ranged from 72.9% to 87.5%, with no differences in response rates across selection categories (ie, investigator, participant, random). Investigator-selected messages were rated as less useful than messages that were self-selected by participants or messages that were selected at random. Conclusions TM-PBS chosen a priori by students were perceived as more useful than TM-PBS chosen by investigators, supporting this form of tailoring in alcohol interventions to optimize usefulness.
Collapse
|
47
|
Suffoletto B, Goyal A, Puyana JC, Chung T. Can an app help identify psychomotor function impairments during drinking occasions in the real world? A mixed-method pilot study. Subst Abus 2018; 38:438-449. [PMID: 28723276 DOI: 10.1080/08897077.2017.1356797] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
BACKGROUND Being able to measure the acute effects of alcohol consumption on psychomotor functions in natural settings could be useful in injury prevention interventions. This study examined the feasibility and acceptability of collecting app-based measures of information processing, working memory, and gait stability during times of typical alcohol consumption among young adults. METHODS Ten young adults (aged 21-26) with hazardous drinking completed a baseline assessment and ecological momentary assessments (EMA) on 4 consecutive Fridays and Saturdays, every hour from 8 pm to 12 am. EMA assessed alcohol consumption and perceived intoxication, followed by a digit symbol substitution task (DSST), a visuospatial working memory task (VSWMT), and a 5-step tandem gait task (TGT). Exit interviews probed user experiences. Multilevel models explored relationships between estimated blood alcohol concentration (eBAC; mg/dL) and DSST and VSWMT performance. RESULTS Participants completed 32% of EMA. Higher rates of noninitiation occurred later in the evening and over time. In multilevel models, higher eBAC was associated with lower DSST scores. Eight out of 10 individuals had at least 1 drinking occasion when they did not perceive any intoxication. Lower DSST scores would identify impairment in 45% of these occasions. Exit interviews indicated that adding real-time feedback on task performance could increase awareness of alcohol effects. CONCLUSIONS Collecting app-based psychomotor performance data from young adults during drinking occasions is feasible and acceptable, but strategies to reduce barriers to task initiation are needed. Mobile DSST is sensitive to eBAC levels and could identify occasions when an individual may not perceive impairments.
Collapse
Affiliation(s)
- Brian Suffoletto
- a Department of Emergency Medicine , University of Pittsburgh School of Medicine , Pittsburgh , Pennsylvania , USA
| | - Akash Goyal
- a Department of Emergency Medicine , University of Pittsburgh School of Medicine , Pittsburgh , Pennsylvania , USA
| | - Juan Carlos Puyana
- a Department of Emergency Medicine , University of Pittsburgh School of Medicine , Pittsburgh , Pennsylvania , USA
| | - Tammy Chung
- b Department of Psychiatry , University of Pittsburgh , Pittsburgh , Pennsylvania , USA
| |
Collapse
|
48
|
Suffoletto B, Scaglione S. Using Digital Interventions to Support Individuals with Alcohol Use Disorder and Advanced Liver Disease: A Bridge Over Troubled Waters. Alcohol Clin Exp Res 2018; 42:1160-1165. [PMID: 29750368 DOI: 10.1111/acer.13771] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2018] [Accepted: 05/04/2018] [Indexed: 01/12/2023]
Affiliation(s)
- Brian Suffoletto
- Emergency Medicine , School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Steve Scaglione
- Division of Hepatology , Department of Internal Medicine, Loyola University Medical Center, Maywood, Illinois.,Hines VA Medical Center , Hines, Illinois
| |
Collapse
|
49
|
Pacella M, Prabhu A, Morley J, Huang S, Suffoletto B. Postconcussive Symptoms Over the First 14 Days After Mild Traumatic Brain Injury: An Experience Sampling Study. J Head Trauma Rehabil 2018; 33:E31-E39. [DOI: 10.1097/htr.0000000000000335] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
50
|
Brienza A, Gianforcaro A, Suffoletto B, Callaway CW, Pacella ML. The utility of assessing for pain interference and psychological factors among emergency department patients who present with pain. Gen Hosp Psychiatry 2018. [PMID: 29518742 DOI: 10.1016/j.genhosppsych.2018.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Ashley Brienza
- Department of Emergency Medicine, University of Pittsburgh, Iroquois Building, Suite 400A, 3600 Forbes Ave, Pittsburgh, PA 15261, United States.
| | - Alexandro Gianforcaro
- Department of Emergency Medicine, University of Pittsburgh, Iroquois Building, Suite 400A, 3600 Forbes Ave, Pittsburgh, PA 15261, United States.
| | - Brian Suffoletto
- Department of Emergency Medicine, University of Pittsburgh, Iroquois Building, Suite 400A, 3600 Forbes Ave, Pittsburgh, PA 15261, United States.
| | - Clifton W Callaway
- Department of Emergency Medicine, University of Pittsburgh, Iroquois Building, Suite 400A, 3600 Forbes Ave, Pittsburgh, PA 15261, United States.
| | - Maria L Pacella
- Department of Emergency Medicine, University of Pittsburgh, Iroquois Building, Suite 400A, 3600 Forbes Ave, Pittsburgh, PA 15261, United States.
| |
Collapse
|