1
|
Pfledderer CD, von Klinggraeff L, Burkart S, da Silva Bandeira A, Lubans DR, Jago R, Okely AD, van Sluijs EMF, Ioannidis JPA, Thrasher JF, Li X, Beets MW. Consolidated guidance for behavioral intervention pilot and feasibility studies. Pilot Feasibility Stud 2024; 10:57. [PMID: 38582840 PMCID: PMC10998328 DOI: 10.1186/s40814-024-01485-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Accepted: 03/26/2024] [Indexed: 04/08/2024] Open
Abstract
BACKGROUND In the behavioral sciences, conducting pilot and/or feasibility studies (PFS) is a key step that provides essential information used to inform the design, conduct, and implementation of a larger-scale trial. There are more than 160 published guidelines, reporting checklists, frameworks, and recommendations related to PFS. All of these publications offer some form of guidance on PFS, but many focus on one or a few topics. This makes it difficult for researchers wanting to gain a broader understanding of all the relevant and important aspects of PFS and requires them to seek out multiple sources of information, which increases the risk of missing key considerations to incorporate into their PFS. The purpose of this study was to develop a consolidated set of considerations for the design, conduct, implementation, and reporting of PFS for interventions conducted in the behavioral sciences. METHODS To develop this consolidation, we undertook a review of the published guidance on PFS in combination with expert consensus (via a Delphi study) from the authors who wrote such guidance to inform the identified considerations. A total of 161 PFS-related guidelines, checklists, frameworks, and recommendations were identified via a review of recently published behavioral intervention PFS and backward/forward citation tracking of a well-known PFS literature (e.g., CONSORT Ext. for PFS). Authors of all 161 PFS publications were invited to complete a three-round Delphi survey, which was used to guide the creation of a consolidated list of considerations to guide the design, conduct, and reporting of PFS conducted by researchers in the behavioral sciences. RESULTS A total of 496 authors were invited to take part in the three-round Delphi survey (round 1, N = 46; round 2, N = 24; round 3, N = 22). A set of twenty considerations, broadly categorized into six themes (intervention design, study design, conduct of trial, implementation of intervention, statistical analysis, and reporting) were generated from a review of the 161 PFS-related publications as well as a synthesis of feedback from the three-round Delphi process. These 20 considerations are presented alongside a supporting narrative for each consideration as well as a crosswalk of all 161 publications aligned with each consideration for further reading. CONCLUSION We leveraged expert opinion from researchers who have published PFS-related guidelines, checklists, frameworks, and recommendations on a wide range of topics and distilled this knowledge into a valuable and universal resource for researchers conducting PFS. Researchers may use these considerations alongside the previously published literature to guide decisions about all aspects of PFS, with the hope of creating and disseminating interventions with broad public health impact.
Collapse
Affiliation(s)
- Christopher D Pfledderer
- Department of Health Promotion and Behavioral Sciences, The University of Texas Health Science Center at Houston, School of Public Health in Austin, Austin, TX, 78701, USA.
- Michael and Susan Dell Center for Healthy Living, The University of Texas Health Science Center at Houston, School of Public Health in Austin, Austin, TX, 78701, USA.
| | | | - Sarah Burkart
- Arnold School of Public Health, University of South Carolina, Columbia, SC, 29205, USA
| | | | - David R Lubans
- College of Human and Social Futures, The University of Newcastle Australia, Callaghan, NSW, 2308, Australia
| | - Russell Jago
- Bristol Medical School, Population Health Sciences, University of Bristol, Bristol, BS8 1QU, UK
| | - Anthony D Okely
- Faculty of Arts, Social Sciences and Humanities, School of Health and Society, University of Wollongong, Wollongong, NSW, 2522, Australia
| | | | - John P A Ioannidis
- Department of Medicine, Stanford University, Stanford, CA, USA
- Department of Epidemiology and Population Health, Stanford University, Stanford, CA, USA
- Department of Biomedical Data Science, Stanford University, Stanford, CA, USA
- Department of Statistics, Stanford University, Stanford, CA, USA
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA
| | - James F Thrasher
- Arnold School of Public Health, University of South Carolina, Columbia, SC, 29205, USA
| | - Xiaoming Li
- Arnold School of Public Health, University of South Carolina, Columbia, SC, 29205, USA
| | - Michael W Beets
- Arnold School of Public Health, University of South Carolina, Columbia, SC, 29205, USA
| |
Collapse
|
2
|
Saulnier KG, Koscinski B, Flynt S, Accorso C, Allan NP. Brief observable anxiety sensitivity treatment: intervention development and a pilot randomized-controlled acceptability and feasibility trial to evaluate a brief intervention for anxiety sensitivity social concerns. Cogn Behav Ther 2024; 53:190-206. [PMID: 38014462 DOI: 10.1080/16506073.2023.2288551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Accepted: 11/20/2023] [Indexed: 11/29/2023]
Abstract
Social anxiety disorder is one of the most prevalent anxiety disorders. There is a need to develop brief, virtual, single-session interventions targeting constructs associated with social anxiety, such as anxiety sensitivity social concerns (ASSC). ASSC is the maladaptive belief about consequences arising from observable symptoms of anxious arousal. This study was designed to evaluate the initial acceptability and feasibility of a brief ASSC reduction program (Brief Observable Anxiety Sensitivity Treatment [BOAST]) which included a single clinician-led intervention session followed by a two-week ecological momentary intervention (EMI), delivered via mobile app. Participants (N = 36) were adults with elevated ASSC who were randomly assigned to receive BOAST (n = 19) or a waitlist control (n = 17). The trial was prospectively registered at clinicaltrials.gov (NCT04859790). Results supported the acceptability of BOAST with mixed findings for feasibility. Feasibility metrics for the EMI component were below pre-defined thresholds; however, there was evidence that homework completion was associated with symptom reduction. Preliminary efficacy metrics indicated that participants in the BOAST condition had large reductions in ASSC and one measure of social anxiety at 1-month follow-up. This study provides preliminary support for the acceptability of BOAST and elucidates avenues for future clinical and research efforts.
Collapse
Affiliation(s)
- Kevin G Saulnier
- VA Serious Mental Illness Treatment Resource and Evaluation Center, Ann Arbor, MI, USA
- Department of Psychiatry, University of Michigan Medical School, Ann Arbor, MI, USA
| | | | - Sierra Flynt
- Psychology Department, Ohio University, Athens, OH, USA
| | | | - Nicholas P Allan
- Department of Psychiatry and Behavioral Health, Ohio State University, Columbus, OH, USA
- VA Center of Excellence for Suicide Prevention, VA Finger Lakes Health Care System, Finger Lakes, NY, USA
| |
Collapse
|
3
|
Pfledderer CD, von Klinggraeff L, Burkart S, da Silva Bandeira A, Lubans DR, Jago R, Okely AD, van Sluijs EM, Ioannidis JP, Thrasher JF, Li X, Beets MW. Expert Perspectives on Pilot and Feasibility Studies: A Delphi Study and Consolidation of Considerations for Behavioral Interventions. RESEARCH SQUARE 2023:rs.3.rs-3370077. [PMID: 38168263 PMCID: PMC10760234 DOI: 10.21203/rs.3.rs-3370077/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2024]
Abstract
Background In the behavioral sciences, conducting pilot and/or feasibility studies (PFS) is a key step that provides essential information used to inform the design, conduct, and implementation of a larger-scale trial. There are more than 160 published guidelines, reporting checklists, frameworks, and recommendations related to PFS. All of these publications offer some form of guidance on PFS, but many focus on one or a few topics. This makes it difficult for researchers wanting to gain a broader understanding of all the relevant and important aspects of PFS and requires them to seek out multiple sources of information, which increases the risk of missing key considerations to incorporate into their PFS. The purpose of this study was to develop a consolidated set of considerations for the design, conduct, implementation, and reporting of PFS for interventions conducted in the behavioral sciences. Methods To develop this consolidation, we undertook a review of the published guidance on PFS in combination with expert consensus (via a Delphi study) from the authors who wrote such guidance to inform the identified considerations. A total of 161 PFS-related guidelines, checklists, frameworks, and recommendations were identified via a review of recently published behavioral intervention PFS and backward/forward citation tracking of well-know PFS literature (e.g., CONSORT Ext. for PFS). Authors of all 161 PFS publications were invited to complete a three-round Delphi survey, which was used to guide the creation of a consolidated list of considerations to guide the design, conduct, and reporting of PFS conducted by researchers in the behavioral sciences. Results A total of 496 authors were invited to take part in the Delphi survey, 50 (10.1%) of which completed all three rounds, representing 60 (37.3%) of the 161 identified PFS-related guidelines, checklists, frameworks, and recommendations. A set of twenty considerations, broadly categorized into six themes (Intervention Design, Study Design, Conduct of Trial, Implementation of Intervention, Statistical Analysis and Reporting) were generated from a review of the 161 PFS-related publications as well as a synthesis of feedback from the three-round Delphi process. These 20 considerations are presented alongside a supporting narrative for each consideration as well as a crosswalk of all 161 publications aligned with each consideration for further reading. Conclusion We leveraged expert opinion from researchers who have published PFS-related guidelines, checklists, frameworks, and recommendations on a wide range of topics and distilled this knowledge into a valuable and universal resource for researchers conducting PFS. Researchers may use these considerations alongside the previously published literature to guide decisions about all aspects of PFS, with the hope of creating and disseminating interventions with broad public health impact.
Collapse
Affiliation(s)
| | | | - Sarah Burkart
- University of South Carolina Arnold School of Public Health
| | | | | | - Russ Jago
- University of Bristol Population Health Sciences
| | | | | | | | | | - Xiaoming Li
- University of South Carolina Arnold School of Public Health
| | | |
Collapse
|
4
|
Wang Q, Ng SM, Zhou X. The mechanism and effectiveness of mindfulness-based intervention for reducing the psychological distress of parents of children with autism spectrum disorder: A protocol of randomized control trial of ecological momentary intervention and assessment. PLoS One 2023; 18:e0291168. [PMID: 37703248 PMCID: PMC10499232 DOI: 10.1371/journal.pone.0291168] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 08/23/2023] [Indexed: 09/15/2023] Open
Abstract
BACKGROUND Existing studies have unequivocally demonstrated that parents of children with autism spectrum disorder (ASD) experience various stressful daily life events and suffer from psychological distress. Mindfulness level is found to be an effective buffer between parents' appraisal of stress life events and psychological distress. However, the mechanism behind the function of mindfulness is unclear, and traditional mindfulness-based intervention (MBI) in experimental settings is not tailored to personal real-life needs. This study proposes to conduct a randomized controlled trial (RCT) to examine the effectiveness of MBI delivered by ecological momentary intervention (EMI) and assessed by ecological momentary assessment (EMA) in changing participants' cognitive appraisal of stressful life events and thus reducing the psychological distress of parents of children with ASD. METHOD The proposed study will recruit 670 parents of children with ASD and randomly assign them to the intervention and control groups (335 in each group). Participants in the intervention group will install the EMI/A app on their smartphones. In the app, participants can receive practice prompts daily, browse and practice different mindfulness exercises in the intervention library at any time, talk to a virtual counselor (chatbot) when feeling stressed, complete EMA on the cognitive appraisal of life events, and receive the log of change of psychological status daily. Participants in the control group will only receive audio-based standardized mindfulness practice instructions three times per week. The effects of MBI will be assessed based on the EMA data, right after the intervention and at the 2-month follow-up. The primary outcome will be participants' psychological distress measured by the depression anxiety stress scale. The secondary outcomes will include participants' subjective well-being, measured by the satisfaction with life scale, and level of resilience, measured by the psychological empowerment scale. Multilevel structural equational modelling will be applied to examine the pathways of the relationship between daily life events, cognitive appraisal, and psychological distress. DISCUSSION The potential benefit of the proposed study is to increase the psychological well-being of parents of children with ASD, and the method may extend to participants suffering from other psychological issues in the future. Trial registration: This trial has been registered on clinicaltrials.gov with the ID of NCT05746468.
Collapse
Affiliation(s)
- Qi Wang
- School of Graduate Studies, Lingnan University, Hong Kong SAR, China
| | - Siu-man Ng
- Department of Social Work and Social Administration, The University of Hong Kong, Hong Kong SAR, China
| | - Xiaochen Zhou
- Department of Social Work and Social Administration, The University of Hong Kong, Hong Kong SAR, China
| |
Collapse
|
5
|
Ecological momentary interventions for mental health: A scoping review. PLoS One 2021; 16:e0248152. [PMID: 33705457 PMCID: PMC7951936 DOI: 10.1371/journal.pone.0248152] [Citation(s) in RCA: 61] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Accepted: 02/19/2021] [Indexed: 12/20/2022] Open
Abstract
BACKGROUND The development of mobile computing technology has enabled the delivery of psychological interventions while people go about their everyday lives. The original visions of the potential of these "ecological momentary interventions" were presented over a decade ago, and the widespread adoption of smartphones in the intervening years has led to a variety of research studies exploring the feasibility of these aspirations. However, there is a dearth of research describing the different dimensions, characteristics, and features of these interventions, as constructed. OBJECTIVE To provide an overview of the definitions given for "ecological momentary interventions" in the treatment of common mental health disorders, and describe the set of technological and interaction possibilities which have been used in the design of these interventions. METHODS A systematic search identified relevant literature published between 2009 and 2020 in the PubMed, PsycInfo, and ACM Guide to the Computing Literature databases. Following screening, data were extracted from eligible articles using a standardized extraction worksheet. Selected articles were then thematically categorized. RESULTS The search identified 583 articles of which 64 met the inclusion criteria. The interventions target a range of mental health problems, with diverse aims, intervention designs and evaluation approaches. The studies employed a variety of features for intervention delivery, but recent research is overwhelmingly comprised of studies based on smartphone apps (30 of 42 papers that described an intervention). Twenty two studies employed sensors for the collection of data in order to provide just-in-time support or predict psychological states. CONCLUSIONS With the shift towards smartphone apps, the vision for EMIs has begun to be realised. Recent years have seen increased exploration of the use of sensors and machine learning, but the role of humans in the delivery of EMI is also varied. The variety of capabilities exhibited by EMIs motivates development of a more precise vocabulary for capturing both automatic and human tailoring of these interventions.
Collapse
|
6
|
Lucas-Thompson RG, Rayburn S, Seiter NS, Broderick PC, Smyth JM, Coatsworth JD, Henry KL. Learning to BREATHE "Plus": A Multi-Modal Adaptive Supplement to an Evidence-Based Mindfulness Intervention for Adolescents. Front Public Health 2020; 8:579556. [PMID: 33282814 PMCID: PMC7705247 DOI: 10.3389/fpubh.2020.579556] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Accepted: 10/19/2020] [Indexed: 01/03/2023] Open
Abstract
Incorporating technological supplements into existing group mindfulness-based interventions (MBIs), particularly for use with adolescents, is an important next step in the implementation of MBIs. Yet there is little available content. Herein we present the development and content of a technological supplement for MBIs, which incorporates multiple technological elements to support (a) skill transfer from the group MBI to daily life, (b) the establishment of a formal mindfulness practice, and (c) the use of mindfulness during periods of high stress. A mixed-methods approach was used to develop this multi-method adaptive supplement. Findings about the use of this supplement will be disseminated scientifically and/or publicly as appropriate.
Collapse
Affiliation(s)
- Rachel G Lucas-Thompson
- Department of Human Development and Family Studies, Colorado State University, Fort Collins, CO, United States
| | - Stephanie Rayburn
- Department of Human Development and Family Studies, Colorado State University, Fort Collins, CO, United States
| | - Natasha S Seiter
- Department of Human Development and Family Studies, Colorado State University, Fort Collins, CO, United States
| | - Patricia C Broderick
- Bennett-Pierce Prevention Research Center, Pennsylvania State University, University Park, PA, United States
| | - Joshua M Smyth
- Biobehavioral Health and Medicine, Pennsylvania State University, University Park, PA, United States
| | - J Douglas Coatsworth
- Department of Human Development and Family Studies, Colorado State University, Fort Collins, CO, United States
| | - Kimberly L Henry
- Department of Psychology, Colorado State University, Fort Collins, CO, United States
| |
Collapse
|