Telehealth Training and Provider Experience of Delivering Behavioral Health Services

Delivery of Comprehensive Medication Management and Other Clinical Services via Telehealth by Pharmacy Type

Background: The recent coronavirus pandemic accelerated the need to deliver pharmacy-related services remotely. Objective: To describe experiences with providing comprehensive medication management (CMM) and other clinical services via telehealth by pharmacy type, before and during the COVID-19 pandemic. Methods: An online survey of pharmacists, representing 27 pharmacies, was conducted to capture telehealth usage in three pharmacy types: independently owned, integrated into a clinical setting, and retail chain. A sub-analysis was performed to assess if providing CMM services via telehealth helped, resulted in no change, or worsened the care of different patient groups (e.g., those with diabetes, were low-income, aged 65+ years). Results: During the pandemic, telehealth usage among independently owned pharmacies and those integrated into a clinical setting increased, but no change occurred among retail chain pharmacies. This usage increase in the first two pharmacy types occurred despite limited investments in connectivity-related resources to support telehealth services. Pharmacists from both independently owned pharmacies (63%) and those integrated into a clinical setting (89%) reported CMM via telehealth reached patients they would not otherwise have been able to reach during the pandemic. Most pharmacists/pharmacies found telehealth to be a feasible and acceptable method of delivering CMM. Conclusion: Pharmacists and pharmacies are now experienced with and have interest in continuing CMM via telehealth, even as the pandemic recedes. However, investments in telecommunications resources, training support, technical assistance, and continued telehealth reimbursement from health plans are needed to sustain this service delivery model.

Implementing digital sexual and reproductive health care services in youth clinics: a qualitative study on perceived barriers and facilitators among midwives in Stockholm, Sweden

BACKGROUND

Digital health care services have the potential to improve access to sexual and reproductive health care for youth but require substantial implementation efforts to translate into individual and public health gains. Health care providers are influential both regarding implementation and utilization of the services, and hence, their perceptions of digital health care services and the implementation process are essential to identify and address. The aim of this study was to explore midwives' perception of digital sexual and reproductive health care services for youth, and to identify perceived barriers and facilitators of the implementation of digital health care provision in youth clinics.

METHODS

We performed semi-structured interviews with midwives (n = 16) working at youth clinics providing both on-site and digital sexual and reproductive health care services to youth in Stockholm, Sweden. Interview data were analyzed using a content analysis approach guided by the Consolidated Framework for Implementation Research (CFIR).

RESULTS

Midwives acknowledged that the implementation of digital health care improved the overall access and timeliness of the services at youth clinics. The ability to accommodate the needs of youth regarding their preferred meeting environment (digital or on-site) and easy access to follow-up consultations were identified as benefits of digital health care. Challenges to provide digital health care included communication barriers, privacy and confidentiality concerns, time constraints, inability to offer digital appointments for social counselling, and midwives' preference for in person consultations. Experiencing organizational support during the implementation was appreciated but varied between the respondents.

CONCLUSION

Digital sexual and reproductive health care services could increase access and are valuable complements to on-site services in youth clinics. Sufficient training for midwives and organizational support are crucial to ensure high quality health care. Privacy and safety concerns for the youth might aggravate implementation of digital health care. Future research could focus on equitable access and youth' perceptions of digital health care services for sexual and reproductive health.

Barriers and facilitators to the implementation of digital technologies in mental health systems: a qualitative systematic review to inform a policy framework

BACKGROUND

Despite the potential for improved population mental health and wellbeing, the integration of mental health digital interventions has been difficult to achieve. In this qualitative systematic review, we aimed to identify barriers and facilitators to the implementation of digital technologies in mental healthcare systems, and map these to an implementation framework to inform policy development.

METHODS

We searched Medline, Embase, Scopus, PsycInfo, Web of Science, and Google Scholar for primary research articles published between January 2010 and 2022. Studies were considered eligible if they reported barriers and/or facilitators to the integration of any digital mental healthcare technologies. Data were extracted using EPPI-Reviewer Web and analysed thematically via inductive and deductive cycles.

RESULTS

Of 12,525 references identified initially, 81 studies were included in the final analysis. Barriers and facilitators were grouped within an implementation (evidence-practice gap) framework across six domains, organised by four levels of mental healthcare systems. Broadly, implementation was hindered by the perception of digital technologies as impersonal tools that add additional burden of care onto both providers and patients, and change relational power asymmetries; an absence of resources; and regulatory complexities that impede access to universal coverage. Facilitators included person-cantered approaches that consider patients' intersectional features e.g., gender, class, disability, illness severity; evidence-based training for providers; collaboration among colleagues; appropriate investment in human and financial resources; and policy reforms that tackle universal access to digital health.

CONCLUSION

It is important to consider the complex and interrelated nature of barriers across different domains and levels of the mental health system. To facilitate the equitable, sustainable, and long-term digital transition of mental health systems, policymakers should consider a systemic approach to collaboration between public and private sectors to inform evidence-based planning and strengthen mental health systems.

PROTOCOL REGISTRATION

The protocol is registered on PROSPERO, CRD42021276838.

Perceptions of pre-licensure nursing students toward telecare and telenursing

Telehealth transforms the healthcare system and provides the population with equal access to healthcare services at distance. This study aimed to investigate nursing students' perceptions toward telenursing. Students' knowledge, attitudes, advantages, disadvantages, barriers, and factors that affect the intention toward telenursing implementation were addressed. This study was conducted using a descriptive design. The study participants were 313 undergraduate nursing students. Data were gathered through a web-based survey from June to August 2022 and analyzed using SPSS version 22. Fifty-four-point-six percent (54.6%) of the students were male and 45.4% were female. Around one-fourth were internship students. Most students had access to the internet 97.4%. The results revealed that nursing students have positive perceptions toward telenursing. Their overall competencies in terms of knowledge, proficiency, awareness, and familiarity were moderate. Students raised some disadvantages and difficulties regarding telenursing; meanwhile, more advantages and suggestions to overcome the disadvantages were reported. It is of utmost importance that nursing education integrates telenursing content and practice to prepare future nurses for the successful implementation of telenursing. More research is still needed to examine the impact of telenursing on nursing practice. Nursing administrators must develop appropriate and prompt interventions to respond to the dramatically changing healthcare environment.

Telehealth and the Psychiatric Mental Health Nurse Practitioner: Beyond the COVID-19 Pandemic

OBJECTIVE

Examine the advantages, disadvantages, and challenges of telehealth for the psychiatric mental health nurse practitioner (PMHNP) in practice and student education. Describe areas for future research and policy development regarding telehealth in PMHNP practice and training during and beyond the COVID-19 pandemic.

METHODS

Review current evidence, standards of practice, and education for the PMHNP.

RESULTS

Recent rapid pandemic-related shifts in utilization of telehealth for clinical practice and student education have highlighted the advantages, disadvantages, and areas in need of additional study.

CONCLUSIONS

Postpandemic telehealth care delivery will likely persist or expand. PMHNPs must advocate for high practice and education standards.

Online Physician-Patient Interaction and Patient Satisfaction: Empirical Study of the Internet Hospital Service

BACKGROUND

In China, a form of online health service called the internet hospital became a prominent means of patient care when face-to-face visits were not possible during the COVID-19 pandemic to minimize transmission of the SARS-CoV-2 virus. Patients' internet hospital experiences largely depend on online physician-patient interaction. Yet, little is known about how physicians can improve patient satisfaction by using specific communication strategies online.

OBJECTIVE

This study aimed to identify specific communication strategies to help physicians deliver better quality internet hospital services. We also outline recommendations for hospitals to operate internet hospital platforms more effectively.

METHODS

A longitudinal data set was collected from an internet hospital platform operated by a top hospital in China. By extracting communication patterns from approximately 20,000 records of online health care services and by controlling the features of service requests, we tested the impacts of response load, more detailed style, and emotional comfort on patient satisfaction. We further explored the effects of these communication patterns in different service contexts.

RESULTS

Physicians with a low response load, a more detailed style, and expressions of emotional comfort received more positive patient feedback. Response load did not affect patient satisfaction with free online health service, whereas a more detailed style and emotional comfort enhanced satisfaction with free service. Response load significantly reduced patient satisfaction with paid online health service, while a more detailed style had no effect. Compared with free service, emotional comfort more strongly promoted patient satisfaction with paid service.

CONCLUSIONS

The communication strategies identified can help physicians provide patients with a better internet hospital experience. These strategies require hospitals to schedule each physician's online service period more appropriately. In addition, tailoring the strategies to service situations can facilitate more targeted and effective internet hospital service for patients.

Barriers and Facilitators to Psychologists' Telepsychology Uptake during the Beginning of the COVID-19 Pandemic

The COVID-19 pandemic transformed the delivery of psychological services as many psychologists adopted telepsychology for the first time or dramatically increased their use of it. The current study examined qualitative and quantitative data provided by 2619 practicing psychologists to identify variables facilitating and impeding the adoption of telepsychology in the U.S. at the beginning of the COVID-19 pandemic. The top five reported barriers were: inadequate access to technology, diminished therapeutic alliance, technological issues, diminished quality of delivered care or effectiveness, and privacy concerns. The top five reported facilitators were: increased safety, better access to patient care, patient demand, efficient use of time, and adequate technology for telepsychology use. Psychologists' demographic and practice characteristics robustly predicted their endorsement of telepsychology barriers and facilitators. These findings provide important context into the implementation of telepsychology at the beginning of the pandemic and may serve future implementation strategies in clinics and healthcare organizations attempting to increase telepsychology utilization.

Family Engagement in Services During COVID-19: A Mixed-Methods Study of Caregiver and Staff Perspectives

INTRODUCTION

We examined changes in family engagement before versus during the pandemic in pediatric and family services and perceived facilitators and barriers to family engagement.

METHOD

We employed a mixed-methods assessment of staff and caregiver perspectives related to pediatric and family medicine clinics and family resource centers in rural northern New England. We used narrative synthesis to analyze qualitative interviews (n = 29) and descriptive statistics for quantitative surveys (n = 108).

RESULTS

Staff felt they were not doing as well at engaging families during versus prepandemic, identifying numerous facilitators and barriers. We found differences in resources used by families before versus during the pandemic. We identified discordant perspectives between caregivers and staff regarding how well clinics and centers identified and responded to family needs.

DISCUSSION

Leaders in pediatrics, advanced practice nursing, and related fields can draw on our findings to decide what services and modalities they provide for postpandemic.

Designing and Implementing TeleBehavioral Health Training to Support Rapid and Enduring Transition to Virtual Care in the COVID Era

As telebehavioral health continues to advance and become part of routine care, there is a need to develop effective training methods. While a consensus on how to best train telebehavioral health has not yet been achieved, this commentary will describe how evidence-based implementation strategies were used to develop a framework to create and implement a telebehavioral health training program that is relevant and enduring for a given audience. Evidence-based implementation strategies included the PARiHS criteria which were used to organize the project. Re-AIM criteria was used to organize chosen outcome measures. Important partnerships were formed to help support infrastructure as well as regional and national reach. A series of Plan-Do-Study-Act loops were used to inform progressive training series. Since April 2020, the Behavioral Health Institute has developed and offered 6 unique telebehavioral health training series, employing both webinar and online formats, and addressing core components as well as more advanced concepts. These series have provided over 19,100 accredited continuing education hours of training through June 2022, to almost 3000 unique learners via webinar and nearly 6800 unique online learners, across 45 states. Evaluations rated these trainings as high quality, relevant, and that material would likely be implemented. Feedback from attendees was considered vital in series planning. This commentary discusses how evidence-based implementation strategies can be used to create a framework upon which to base a training program for health care providers. An example is given on how this framework was used to create successful, relevant, and enduring telebehavioral health training.

Virtual Care Adoption-Challenges and Opportunities From the Lens of Academic Primary Care Practitioners

Telehealth and virtual care quickly became important tools in caring for patients while the COVID-19 pandemic evolved. Telehealth implementation can increase affordability for patients, eliminate access barriers, and improve patient satisfaction. Multiple challenges to successful telehealth implementation have been documented in the literature and are generally categorized as structural barriers of the health system, clinical barriers of the provider, and patient-centered barriers. In this study, we sought to collect themes and observations about this rapid transition to telehealth from practicing primary care clinicians, with the goal of identifying opportunities to improve adoption of telehealth. Themes reported in this article emerged from physician and physician assistant fellows of 2 HRSA-funded grants: (1) Primary Care Training and Enhancement (PCTE) and (2) Primary Care Training and Enhancement Training Primary Care Champions (Champions). The PCTE participants consisted of 8 providers from The MetroHealth System (MHS). The Champions participants consisted of 20 providers from MHS and Federally Qualified Health Centers in Northeast Ohio and Michigan. Participants identified 5 major themes that affected telehealth delivery in an academic medical system: reimbursement and productivity; social determinants of health; privacy and environment of care concerns; teaching; and communication skills. Examples within each theme are provided along with an identified improvement opportunity. As we create solutions to address these challenges, our hope is to pool our experience with others so that we can collectively learn how to best evolve and improve the telehealth experience for all.

Virtual training and technical assistance: a shift in behavioral health workforce access and perceptions of services during emergency restrictions

BACKGROUND

To respond to the COVID-19 pandemic, the Substance Abuse and Mental Health Services Administration-funded Technology Transfer Centers had to rapidly adapt to ensure that the behavioral health workforce had continuous access to remote training and technical assistance (TTA). Although the Technology Transfer Centers have historically relied partially upon virtual methods for delivering TTA, the shift to a strictly virtual approach necessitated by COVID-19 restrictions has raised new questions for how to best proceed with services when social distancing guidelines are relaxed. The objective of this exploratory paper was to compare TTA provision in the six-month period prior to (9/1/19 thru 2/28/20) and during (4/1/20 thru 9/30/20) early COVID-19 restrictions to determine the extent to which the shift to virtual service provision impacted the behavioral health and medical workforce. Specifically, we examined participants' access to TTA, geographic reach of TTA, and workforce perceptions of satisfaction and utility with TTA provision.

METHOD

Participant and event-level data were analyzed to compare the following metrics before and during the COVID pandemic: number of events and attendees; participant demographics; zip codes reached; coverage of rural, suburban, and urban areas; and perceptions of satisfaction with and utility of training.

RESULTS

Findings showed a 40% increase in the number of events delivered (p < .001) and a 270% increase in the number of attendees (p < .001) during the COVID period when TTCs relied exclusively on virtual delivery. Geospatial analyses linking zip codes to a schematic of rural, suburban, and urban classifications throughout the United States revealed significant increases in the number of zip codes reached during the COVID time period. Satisfaction levels were comparable before and during the pandemic.

CONCLUSIONS

Findings show that expanded access to TTA services via virtual formats resulted in reach to more diverse attendees and regions, and did not come at the expense of satisfaction. Results suggest that virtual TTA should continue to be an important component of TTA offerings post-pandemic.

Online Teaching Self-efficacy of Group Counseling Instructors during the COVID-19 Pandemic

Due to the COVID-19 pandemic, many counseling-related programs switched to online teaching modalities. Group counseling instructors may face various challenges in teaching group counseling courses online. With a mixed-method design, this study explored group counseling instructors' online teaching self-efficacy by collecting survey responses from 39 group counseling instructors and interviewing eight instructors from the programs accredited by the Council for Accreditation of Counseling and Related Educational Programs (CACREP). The instructors demonstrated a general high teaching self-efficacy with concerns about students' engagement. Facilitating and hindering factors related to online teaching self-efficacy are identified. Implications and recommendations for instructors, counseling-related programs, and the counseling profession are also discussed.

Power on: The rapid transition of a large interdisciplinary behavioral health department to telemental health during the COVID-19 pandemic

Background

The COVID-19 pandemic necessitated a rapid transition to telemental health (TMH) for behavioral health services in the behavioral health department of a large integrated primary care organization. Although the COVID-19 pandemic was the initial trigger for rapid organizational change, systems were developed with a focus on longer term scalability and sustainability.

Methods

This paper discusses the process of organizational change within our healthcare delivery system using the Strengths, Opportunities, Aspirations, and Results (SOAR) framework. Within this framework a structured mixed methods survey of 38 clinicians representing 5 different disciplines was conducted. Internal and survey data were analyzed to evaluate and guide the iterative change process.

Results

The majority of BH clinicians reported that they were as or more effective with TMH. The transition to TMH in our organization resulted in increased access to care, with a 10.3% increase in BH visit completions. The transition to TMH may benefit clinician work-life balance, but requires resources to support clinical, technological, and communication/teamwork changes.

Implications/conclusions

TMH is a feasible treatment modality for integrated care settings. It is cost-effective and well-accepted by clinicians. The SOAR framework can be used to guide rapid organizational change and ongoing QI processes.

Educating for the Future: a Preliminary Investigation of Doctoral-Level Clinical Psychology Training Program's Implementation of Telehealth Education

Literature has reinforced the importance of telehealth-focused education to foster provider competence and optimal patient care. As clinical psychology evolves to meet field needs, many have suggested graduate school as an optimal time to offer comprehensive telehealth education. Despite the rapid expansion of telehealth post-COVID-19, the extent of telehealth-specific doctoral-level programming, as well as the foci of available trainings, has remained unclear. To address this gap and inform future work, the current study evaluated doctoral-level clinical psychology training programs throughout the USA. Fourteen doctoral-level training programs completed author-created REDCap-hosted demographic and telehealth training surveys. Pre-COVID-19, three of fourteen programs reported implementing some form of telehealth-focused education, with a majority of the information being viewed as optional targets for instructors. Contrastingly, thirteen programs indicated implementing telehealth-focused education post-COVID-19, with a majority of the information being indicated as mandatory educational targets. Despite increases in educational activities, a large number of programs endorsed a desire for additional telehealth-focused education for students as they transition into future roles. Educational foci, methods of training, and instructor preparation are discussed. While participation was limited, the current study demonstrated positive trends in the development of telehealth-focused education. Nevertheless, there remains an ongoing need for both specialized coursework and a wider range of educational topics. Ultimately, the current study is believed to have provided a preliminary evaluation of the types and foci of telehealth-focused education among doctoral-level clinical psychology training programs.

Telehealth in chronic obstructive pulmonary disease: before, during, and after the coronavirus disease 2019 pandemic

PURPOSE OF REVIEW

Many healthcare systems rapidly implemented telehealth as a substitute for in-person care during the coronavirus disease 2019 (COVID-19) pandemic. The purpose of this review is to describe the evidence base supporting the use of telehealth for chronic obstructive pulmonary disease (COPD) prior to the COVID-19 pandemic, discuss the barriers to implementing telehealth during the pandemic, and share our opinion about the future of telehealth in COPD.

RECENT FINDINGS

The evidence from randomized clinical trials in COPD completed prior to the COVID-19 pandemic indicate that the effectiveness of telehealth interventions compared to in-person usual care on clinical outcomes is inconclusive. Recent experience during the COVID-19 pandemic indicates that telehealth may increase access to healthcare and satisfaction with care when delivered in addition to usual in-person care. While some reimbursement-related barriers to telehealth have been alleviated during the COVID-19 pandemic, several patient, provider, and health-system barriers to implementation remain.

SUMMARY

There is a need to further evaluate the delivery of telehealth services as an adjunct to traditional in-person models of COPD care. Standardization and reporting of core clinical, satisfaction, accessibility, and quality of care outcomes are needed to promote cross-study learning and more rapid translation of research evidence into practice.

Modified Training Experiences for Psychology Interns and Fellows During COVID-19: Use of Telepsychology and Telesupervision by Child and Adolescent Training Programs

Coronavirus (COVID-19) has affected opportunities available to psychology interns and postdoctoral fellows completing capstone training experiences during culminating training years. While research supports COVID-19 has increased the use of telepsychology services amongst psychologists, there is a paucity of research regarding how COVID-19 has altered training and use of telepsychology by psychology trainees. The current study includes survey responses from 59 psychology training directors and 58 psychology internship and postdoctoral fellowship trainees at pediatric sites throughout the United States. Results support changes in telepsychology training provided during COVID-19, including increased use of telepsychology for clinical service delivery and increased use of telesupervision for training. As expected, findings suggest novel training experiences in telepsychology for trainees within the last two years as a result of COVID-19. Given ongoing need for telepsychology services to assure access to psychological care during the pandemic and beyond, results provide support for graduate and advanced training programs to provide formal training in best-practices for utilization of telepsychology and telesupervision.

Telehealth Utilization in Response to the COVID-19 Pandemic: Current State of Medical Provider Training

Background: The COVID-19 pandemic accelerated the development of telehealth services and thus the need for telehealth education and training to support rapid implementation at scale. A national survey evaluating the current state of the telehealth landscape was deployed to organizational representatives, and included questions related to education and training. Materials and Methods: In the summer of 2020, 71 survey participants (31.8%) completed an online survey seeking to determine the utilization of telehealth services across institutional types and locations. This included data collected to specifically compare the rates and types of formal telehealth education provided before and during the pandemic. Results: Thirty percent of organizations reported no telehealth training before COVID-19, with those in suburban/rural settings significantly less likely to provide any training (55% vs. 82%) compared with urban. Pandemic-related training changes applied to 78% of organizations, with more change happening to those without any training before COVID-19 (95%). Generally, organizations offering training before the pandemic reported deploying COVID-19-related telehealth services, while a higher percentage of those without any training beforehand reported that they either did not plan on providing these services or were in the early planning stages. Discussion: Telehealth education is moving from elective to essential based on the need to prepare and certify the workforce to support high-quality telehealth services. Conclusions: As telehealth continues to evolve to meet the future health care service needs of patients and providers, education and training will advance to meet the needs of everyday clinical encounters and broader public health initiatives.

Transitions to virtual early childhood home visitation during COVID-19

COVID-19 has disrupted many of the preventive service sectors designed to promote infant mental health. The purpose of this study is to examine provider and supervisor transition strategies as well as maternal-child outcomes during the transition from in-person to virtual early childhood home visitation services in Los Angeles County. Los Angeles County is one of the largest home visitation sectors in the U.S. and disproportionately impacted by the COVID-19 pandemic. Transitioning from in-person to virtual home visitation was an important step in ensuring the continuity of infant mental health services. Home visitors reported relative ease in transitioning to virtual services themselves but noted that families encountered greater difficulty. The most helpful strategies to support this transition included training, ongoing reflective supervision, and provision of technology. Family level analysis revealed that positive screening rates for anxiety and depression decreased during the pandemic as did referrals for most support services. These findings likely highlight challenges in delivering virtual home visitation. Understanding how transitions in a key infant serving sector were managed serves an important role in forecasting for the future and preparing for future public heath emergencies.

Social Determinants of Health Discussed with Mothers During Personal Visits Before and During the COVID-19 Pandemic

Purpose: This report describes the social determinants of health (SDOH) discussed during personal visits at the time leading up to and during the first 4 months of the pandemic from families across the United States. Methods: This is a secondary analysis from a cluster randomized trial that embeds Healthy Eating and Active Living Taught at Home within Parents as Teachers (PAT). PAT is a national organization serving families prenatal through kindergarten, delivered by parent educators. After parent educators complete visits with mothers in the trial, they complete brief surveys including the question "Did issues with any of these come up during the visit?" with yes/no options for "Transportation," "Housing," "Food insecurity," "Childcare," "Financial constraint," or "Other." Results: Among the 60 mothers with visit records in the months before and during (March-July 2020) COVID-19, 55% identified as Hispanic or Latino and 52% reported food insecurity at baseline. During COVID-19, financial constraints and other SDOH were as common as they were before COVID-19; childcare issues were discussed less frequently and food security was discussed more frequently. When comparing the number of SDOH parent educators reported discussing with mothers in visits that took place before COVID-19 with the number of SDOH discussed in visits during COVID-19, the number of SDOH increased for 41% for mothers identifying as Hispanic or Latino and only 8% for non-Hispanic or Latino mothers. Conclusions: This study can help build an understanding of how COVID-19 is impacting families, and how these impacts may be inequitable. Clinical Trial Registration Number: NCT03758638.

Evaluation of a Systems-Wide Telebehavioral Health Training Implementation in Response to COVID-19

In response to the Coronavirus disease 2019 pandemic, it became important to rapidly train mental health providers to provide telebehavioral health services (TBH) within a pediatric care setting. This study examined the perceived usefulness of various TBH training materials; provider motivation, comfort, and confidence in implementation of TBH services; and perceived benefits and barriers of TBH. After completing various training options and implementing TBH services for 1 month, providers indicated all training materials were helpful, with the recorded webinar being identified as the most helpful resource. This study describes the rapid training of mental health providers in preparation of system-wide TBH services.

Rapid, Full-Scale Change to Virtual PCIT During the COVID-19 Pandemic: Implementation and Clinical Implications

Health agencies call for the immediate mobilization of existing interventions in response to numerous child and family mental health concerns that have arisen as result of the COVID-19 pandemic. Answering this call, this pilot study describes the rapid, full-scale change from a primarily clinic-based Parent–Child Interaction Therapy (PCIT) model to a virtual service model (i.e., I-PCIT) in an academic and community-based program in Miami, Florida. First, we describe the virtual service training model our program developed and its implementation with 17 therapists (M_Age = 32.35, 88.2% female, 47.1% Hispanic) to enable our clinic to shift from providing virtual services to a small portion of the families served (29.1%) to all of the families served. Second, we examine the effect of I-PCIT on child and caregiver outcomes during the 2-month stay-at-home period between March 16, 2020, and May 16, 2020, in 86 families (M_ChildAge = 4.75, 71% Hispanic). Due to the rapid nature of the current study, all active participants were transferred to virtual services, and therefore there was no comparison or control group, and outcomes represent the most recently available scores and not treatment completion. Results reveal that I-PCIT reduced child externalizing and internalizing problems and caregiver stress, and increased parenting skills and child compliance with medium to large effects even in the midst of the COVID-19 pandemic. Finally, the study examined components of our virtual service training model associated with the greatest improvements in child and caregiver outcomes. Preliminary findings revealed that locally and collaboratively developed strategies (e.g., online communities of practice, training videos and guides) had the strongest association with child and caregiver outcomes. Implications for virtual service delivery, implementation, and practice in the midst of the COVID-19 pandemic are discussed.

Rapid Implementation and Evaluation of Virtual Health Training in a Subspecialty Hospital in British Columbia, in Response to the COVID-19 Pandemic

Introduction: Adoption of virtual health (VH) solutions in healthcare has been challenging; this changed rapidly after implementation of physical distancing measures due to the COVID-19 pandemic. In response to the pandemic, British Columbia's Children's and Women's sub-specialty hospitals rapidly trained and scaled up support to equip staff and clinicians to use VH. Methods: Ninety-minute live online training workshops and frequently updated online support materials were offered for 6 weeks. Training was monitored via feedback collected at training sessions and a brief post-training survey. After training completion, a second survey was circulated to measure utilization outcomes and experiences with VH. Results: Eight hundred and ninety-five participants representing 82% of staff requiring support were trained through 101 sessions; 348 (38.9%) and 272 (30.4%) responses were collected for the monitoring and outcome surveys, respectively. Overall, 89% agreed that training was relevant to their needs; participants indicated average 58.1% (SD = 26.6) and 60.6% (SD = 25.2) increase in knowledge and confidence in VH after training; 90.1% had booked or conducted VH sessions. Increase in confidence was more pronounced in participants with lesser previous exposure to VH, but number of sessions conducted post-training and percentage of successful sessions were independent of previous exposure. For future training and support, participants suggested subject-tailored trainings, asynchronous trainings, and availability of experienced users. Discussion: Training is key to success of VH implementation. Moving forward, core competencies in VH should be developed to support standardization and allow for evaluation and quality improvement. Incorporation of VH training in continuous professional development and onboarding is also highly recommended.

Co-designing multidisciplinary telehealth education for online learning

Purpose

There are growing expectations that students graduating from health courses and current health professionals have some proficiency in using telehealth. However, there is limited accessibility to multidisciplinary-based material to meet this need. This paper describes the development of an online telehealth education resource using a co-design approach and the strengths and challenges of embedding authentic learning principles in an open-access online course with a broad target audience.

Design/methodology/approach

The authors first describe the co-design process of the course and discuss the pedagogy underpinning the course design. Then learner enrolment data is discussed to evidence uptake across key characteristics. Finally, the authors assess the efficacy of the co-design approach by analysing feedback collected from learners at the end of the course.

Findings

The course is structured across four modules and comprises interactive content, reflective tasks, case studies and purposefully developed digital material. Responses from the working group and from learner feedback indicate that the course is an authentic and relevant introduction to telehealth practice for both health students and current health professionals, despite some limitations.

Originality/value

This case study demonstrates the value of a co-design process and key learning design choices in online course development to meet the educational needs of learners from broad disciplinary backgrounds, in various stages of learning/understanding of telehealth and/or requiring a practice-based resource in the context of a rapidly changing policy environment.