Health science staff and student experiences of teaching and assessing clinical skills using digital tools: a qualitative study

INTRODUCTION

Once considered a supplement to traditional teaching approaches, digital tools now play a pivotal role in building core clinical competencies. This study aims to explore staff and student experiences of navigating the challenges of teaching and assessing clinical skills using digital technology. It also aims to provide insight into what skills, or aspects of skills, may be best suited to digitally enhanced teaching, thereby advancing the future of health science education.

METHODS

This qualitative study comprises the second phase of data generation for a mixed-methods research project entitled DEPTH (Digitally Enhanced Practical Teaching in Health Science). Health science staff and students expressed interest in taking part in the current study during the first stage of data collection. Qualitative data was collected in January 2022 through semi-structured group interviews and individual semi-structured interviews. An interpretivist qualitative research design underpinned by a critical realist epistemological position was used. Themes were generated following Braun and Clarke's 6-step process for reflexive thematic analysis.

RESULTS

Overall, 10 staff and 8 students across 11 health science disciplines participated in this research. Fourteen hours of transcripts were analysed and 4 themes generated. Our findings highlight the suitability of digitally enhanced teaching for low-stake skills requiring visual and auditory training, while skills requiring tactile training require in-person practice to build student competency. Importantly, our findings indicate a desire for increased remote teaching. While our work was not specifically aimed at documenting experiences related to the Covid-19 pandemic, all participants had lived experience teaching or learning during the pandemic and many spoke specifically about this.

CONCLUSIONS

The timing of this paper captures a novel moment in the history of clinical pedagogy. Staff and students advocate for the continued integration of technology into health science education generally, and clinical skills teaching specifically. For this to be successful, judicious selection of methods, skills, skill components and technology, that can be appropriately mapped onto specific learning outcomes, is required.

Twelve tips for co-production of online learning

In the digital age, experts in digital learning tools, or learning technologists (LTs), play an increasingly important role in the creation and delivery of online learning in health professions education. However, their expertise in the selection, curation and implementation of digital tools is often underutilized due to imbalanced relationships and lack of effective collaboration between faculty and LTs. Here, we describe how the co-production model can be applied to build equal and synergistic partnerships between faculty and LTs, so as to optimize the use of digital affordances and enhance online learning.

Improving Home-Based Scoliosis Therapy: Findings From a Web-Based Survey

BACKGROUND

Conservative scoliosis therapy in the form of assisted physiotherapeutic scoliosis exercises is supplemented by self-contained training at home, depending on the approach (eg, Schroth, the Scientific Exercises Approach to Scoliosis). Complex exercises, lack of awareness of the importance of training, and missing supervision by therapists often lead to uncertainty and reduced motivation, which in turn reduces the success of home-based therapy. Increasing digitalization in the health care sector offers opportunities to close this gap. However, research is needed to analyze the requirements and translate the potential of digital tools into concrete solution concepts.

OBJECTIVE

The aim of this study is to evaluate the potential for optimizing home-based scoliosis therapy in terms of motivation, assistive devices, and digital tools.

METHODS

In collaboration with the Institute of Physiotherapy at the Jena University Hospital, a survey was initiated to address patients with scoliosis and physical therapists. A digital questionnaire was created for each target group and distributed via physiotherapies, scoliosis forums, the Bundesverband für Skoliose Selbsthilfe e. V. newsletter via a link, and a quick response code. The survey collected data on demographics, therapy, exercise habits, motivation, assistive devices, and digital tools. Descriptive statistics were used for evaluation.

RESULTS

Of 141 survey participants, 72 (51.1%; n=62, 86.1%, female; n=10, 13.9%, male) patients with scoliosis with an average age of 40 (SD 17.08) years and 30 scoliosis therapists completed the respective questionnaires. The analysis of home-based therapy showed that patients with scoliosis exercise less per week (2 times or less; 45/72, 62.5%) than they are recommended to do by therapists (at least 3 times; 53/72, 73.6%). Patients indicated that their motivation could be increased by practicing together with friends and acquaintances (54/72, 75%), a supporting therapy device (48/72, 66.7%), or a digital profile (46/72, 63.9%). The most important assistive devices, which are comparatively rarely used in home-based therapy, included balance boards (20/72, 27.8%), wall bars (23/72, 31.9%), mirrors (36/72, 50%), and long bars (40/72, 55.6%). Therapists saw the greatest benefit of digital tools for scoliosis therapy in increasing motivation (26/30, 87%), improving home therapy (25/30, 83%), monitoring therapy progress (25/30, 83%), and demonstrating exercise instructions (24/30, 80%).

CONCLUSIONS

In this study, we investigated whether there is any potential for improvement in home-based scoliosis therapy. For this purpose, using online questionnaires, we asked patients with scoliosis and therapists questions about the following topics: exercise habits, outpatient and home-based therapy, motivation, supportive devices, and digital tools. The results showed that a lack of motivation, suitable training equipment, and tools for self-control leads to a low training workload. From the perspective of the patients surveyed, this problem can be addressed through community training with friends or acquaintances, a supportive therapy device, and digital elements, such as apps, with training instructions and user profiles.

The Role of Novel Digital Clinical Tools in the Screening or Diagnosis of Obstructive Sleep Apnea: Systematic Review

BACKGROUND

Digital clinical tools are a new technology that can be used in the screening or diagnosis of obstructive sleep apnea (OSA), notwithstanding the crucial role of polysomnography, the gold standard.

OBJECTIVE

This study aimed to identify, gather, and analyze the most accurate digital tools and smartphone-based health platforms used for OSA screening or diagnosis in the adult population.

METHODS

We performed a comprehensive literature search of PubMed, Scopus, and Web of Science databases for studies evaluating the validity of digital tools in OSA screening or diagnosis until November 2022. The risk of bias was assessed using the Joanna Briggs Institute critical appraisal tool for diagnostic test accuracy studies. The sensitivity, specificity, and area under the curve (AUC) were used as discrimination measures.

RESULTS

We retrieved 1714 articles, 41 (2.39%) of which were included in the study. From these 41 articles, we found 7 (17%) smartphone-based tools, 10 (24%) wearables, 11 (27%) bed or mattress sensors, 5 (12%) nasal airflow devices, and 8 (20%) other sensors that did not fit the previous categories. Only 8 (20%) of the 41 studies performed external validation of the developed tool. Of these, the highest reported values for AUC, sensitivity, and specificity were 0.99, 96%, and 92%, respectively, for a clinical cutoff of apnea-hypopnea index (AHI)≥30. These values correspond to a noncontact audio recorder that records sleep sounds, which are then analyzed by a deep learning technique that automatically detects sleep apnea events, calculates the AHI, and identifies OSA. Looking at the studies that only internally validated their models, the work that reported the highest accuracy measures showed AUC, sensitivity, and specificity values of 1.00, 100%, and 96%, respectively, for a clinical cutoff AHI≥30. It uses the Sonomat-a foam mattress that, aside from recording breath sounds, has pressure sensors that generate voltage when deformed, thus detecting respiratory movements, and uses it to classify OSA events.

CONCLUSIONS

These clinical tools presented promising results with high discrimination measures (best results reached AUC>0.99). However, there is still a need for quality studies comparing the developed tools with the gold standard and validating them in external populations and other environments before they can be used in clinical settings.

TRIAL REGISTRATION

PROSPERO CRD42023387748; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=387748.

The NYCKidSeq randomized controlled trial: Impact of GUÍA digitally enhanced genetic counseling in racially and ethnically diverse families

Background

Digital solutions are needed to support rapid increases in the application of genetic and genomic tests (GT) in diverse clinical settings and patient populations. We developed GUÍA, a bi-lingual web-based platform that facilitates disclosure of GT results. The NYCKidSeq randomized controlled trial evaluated GUÍA's impact on understanding of GT results.

Methods

NYCKidSeq enrolled diverse children with neurologic, cardiac, and immunologic conditions who underwent GT. Families were randomized to genetic counseling with GUÍA (intervention) or standard of care (SOC) genetic counseling for results disclosure. Parents/legal guardians (participants) completed surveys at baseline, post-results disclosure, and 6-months later. Survey measures assessed the primary study outcomes of perceived understanding of and confidence in explaining their child's GT results and the secondary outcome of objective understanding. We used regression models to evaluate the association between the intervention and the study outcomes.

Results

The analysis included 551 participants, 270 in the GUÍA arm and 281 in SOC. Participants' mean age was 41.1 years and 88.6% were mothers. Most participants were Hispanic/Latino(a) (46.3%), White/European American (24.5%), or Black/African American (15.8%). Participants in the GUÍA arm had significantly higher perceived understanding post-results (OR=2.8, CI[1.004,7.617], P=0.049) and maintained higher objective understanding over time (OR=1.1, CI[1.004, 1.127], P=0.038) compared to those in the SOC arm. There was no impact on perceived confidence. Hispanic/Latino(a) individuals in the GUÍA arm maintained higher perceived understanding (OR=3.9, CI[1.6, 9.3], P=0.003), confidence (OR=2.7, CI[1.021, 7.277], P=0.046), and objective understanding (OR=1.1, CI[1.009, 1.212], P=0.032) compared to SOC .

Conclusions

This trial demonstrates that GUÍA positively impacts understanding of GT results in diverse parents of children with suspected genetic conditions. These findings build a case for utilizing GUÍA to deliver complex and often ambiguous genetic results. Continued development and evaluation of digital applications in diverse populations are critical for equitably scaling GT offerings in specialty clinics.

Trial Registration

Clinicaltrials.gov identifier NCT03738098.

Facilitating person-centred care: integrating an electronic client feedback tool into continuous quality improvement processes to deliver client-responsive HIV services in the Democratic Republic of Congo

INTRODUCTION

Engaging communities in the design, implementation and monitoring of health services is critical for delivering high-quality, person-centred services that keep people living with HIV engaged in care. The USAID-funded Integrated HIV/AIDS Project in Haut-Katanga (IHAP-HK) integrated an electronic client feedback tool into continuous quality improvement (CQI) processes. We aimed to demonstrate this system's impact on identifying and improving critical quality-of-care gaps.

METHODS

Through stakeholder and empathy mapping, IHAP-HK co-designed a service quality monitoring system-comprising anonymous exit interviews and ongoing monitoring through CQI cycles-with people living with HIV, facility-based providers and other community stakeholders. IHAP-HK trained 30 peer educators to administer oral, 10- to 15-minute exit interviews with people living with HIV following clinic appointments, and record responses via the KoboToolbox application. IHAP-HK shared client feedback with facility CQI teams and peer educators; identified quality-of-care gaps; discussed remediation steps for inclusion in facility-level improvement plans; and monitored implementation of identified actions. IHAP-HK tested this system at eight high-volume facilities in Haut-Katanga province from May 2021 through September 2022.

RESULTS

Findings from 4917 interviews highlighted wait time, stigma, service confidentiality and viral load (VL) turnaround time as key issues. Solutions implemented included: (1) using peer educators to conduct preparatory tasks (pre-packaging and distributing refills; pulling client files) or escort clients to consultation rooms; (2) limiting personnel in consultation rooms during client appointments; (3) improving facility access cards; and (4) informing clients of VL results via telephone or home visits. Due to these actions, between initial (May 2021) and final interviews (September 2022), client satisfaction with wait times improved (76% to 100% reporting excellent or acceptable wait times); reported cases of stigma decreased (5% to 0%); service confidentiality improved (71% to 99%); and VL turnaround time decreased (45% to 2% informed of VL results 3 months after sample collection).

CONCLUSIONS

Our results showed the feasibility and effectiveness of using an electronic client feedback tool embedded in CQI processes to collect client perspectives to improve service quality and advance client-responsive care in the Democratic Republic of Congo. IHAP-HK recommends further testing and expansion of this system to advance person-centred health services.

Mindcraft, a Mobile Mental Health Monitoring Platform for Children and Young People: Development and Acceptability Pilot Study

BACKGROUND

Children and young people's mental health is a growing public health concern, which is further exacerbated by the COVID-19 pandemic. Mobile health apps, particularly those using passive smartphone sensor data, present an opportunity to address this issue and support mental well-being.

OBJECTIVE

This study aimed to develop and evaluate a mobile mental health platform for children and young people, Mindcraft, which integrates passive sensor data monitoring with active self-reported updates through an engaging user interface to monitor their well-being.

METHODS

A user-centered design approach was used to develop Mindcraft, incorporating feedback from potential users. User acceptance testing was conducted with a group of 8 young people aged 15-17 years, followed by a pilot test with 39 secondary school students aged 14-18 years, which was conducted for a 2-week period.

RESULTS

Mindcraft showed encouraging user engagement and retention. Users reported that they found the app to be a friendly tool helping them to increase their emotional awareness and gain a better understanding of themselves. Over 90% of users (36/39, 92.5%) answered all active data questions on the days they used the app. Passive data collection facilitated the gathering of a broader range of well-being metrics over time, with minimal user intervention.

CONCLUSIONS

The Mindcraft app has shown promising results in monitoring mental health symptoms and promoting user engagement among children and young people during its development and initial testing. The app's user-centered design, the focus on privacy and transparency, and a combination of active and passive data collection strategies have all contributed to its efficacy and receptiveness among the target demographic. By continuing to refine and expand the app, the Mindcraft platform has the potential to contribute meaningfully to the field of mental health care for young people.

Digital Devices Use and Fine Motor Skills in Children between 3-6 Years

(1) Background: The principal aim of our research was to explore the relationship between digital devices use and fine motor skills in children aged three to six years and to explore the effect of some socio-demographic factors. (2) Methods: we enrolled 185 children aged between three to six years. The parents of all the participants fulfilled a questionnaire to explore the digital device use, and their children performed a standardized test to assess fine motor skills (APCM-2). We performed the Spearman correlation test to explore the relationship between different variables. (3) Results: the children spent an average of 3.08 ± 2.30 h/day on digital devices. We did not find a significant association between the time of use of digital devices and fine motor skills (p = 0.640; r = -0.036). The youngest children experienced digital tools earlier than older ones (p < 0.001; r = 0.424) and they were also the ones who used digital tools more time afterwards (p = 0.012; -0.202). The children who had working parents spent more time on digital devices (p = 0.028; r = 0.164/p = 0.037; r = 0.154) and used digital devices earlier (p = 0.023; r = 0.171). (4) Conclusions: This data suggest that it would be useful to monitor the use of digital tools, especially in the very first years of life. Future studies are needed to further explore this topic.

Integrative Digital Tools to Strengthen Data Management for Antimicrobial Resistance Surveillance in the "One Health" Domain in Nepal

Antimicrobial resistance (AMR) is increasing and represents one of the greatest public health challenges of our time, accounting for considerable morbidity and mortality globally. A "One Health" surveillance strategy, which integrates data concerning the resistant organisms circulating in humans, animals, and the environment, is required to monitor this issue and enable effective interventions. The timely collection, processing, analysis, and reporting of AMR surveillance data are necessary for the effective delivery of the information generated from such surveillance. Nepal has greatly improved its surveillance activities through a network of human and animal health laboratories; however, the data reported by sentinel laboratories are often inconsistent, incomplete, and delayed, causing challenges in terms of data cleaning, standardization, and visualization on a national level. To overcome these issues, innovative methods and procedures have been adopted in Nepal, with the development and customization of digital tools that reduce the human time and effort spent on data cleaning and standardization, with concomitant improvements in the accuracy of data. These standardized data can be uploaded to the district health information system 2 (DHIS2) One Health AMR surveillance portal, enabling the generation of reports that will help decision-makers and policy planners to combat the global problem of AMR.

How Interactive Visualizations Compare to Ethical Frameworks as Stand-Alone Ethics Learning Tools for Health Researchers and Professionals

BACKGROUND

Despite the bourgeoning of digital tools for bioethics research, education, and engagement, little research has empirically investigated the impact of interactive visualizations as a way to translate ethical frameworks and guidelines. To date, most frameworks take the format of text-only documents that outline and offer ethical guidance on specific contexts. This study's goal was to determine whether an interactive-visual format supports frameworks in transferring ethical knowledge by improving learning, deliberation, and user experience.

METHODS

An experimental comparative study was conducted with a pre-, mid-, and post-test design using the online survey platform Qualtrics. Participants were university based early-stage health researchers who were randomly assigned to either the control condition (text-only document) or the experimental condition (interactive-visual). The primary outcome variables were learning, (measured using a questionnaire), deliberation (using cases studies) and user experience (measured using the SED/UD Scale). Analysis was conducted using descriptive statistics and mixed-effects linear regression.

RESULTS

Of the 80 participants, 44 (55%) used the text-only document and 36 (45%) used the interactive-visual. Results of the knowledge-test scores showed a statistically significant difference between participants' post-test scores, indicating that the interactive-visual format better supported understanding, acquisition, and application of the framework's knowledge. Findings from the case studies showed both formats supported ethical deliberation. Results further indicated the interactive-visual provided an overall better episodic and remembered user experience compared with the text-only document.

CONCLUSIONS

Our findings show that ethical frameworks formatted with interactive and visual qualities provide a more pleasing user experience and are effective formats for ethics learning and deliberation. These findings have implications for practitioners developing and deploying ethical frameworks and guidelines (e.g., in educational or employee-onboarding settings), in that the knowledge generated can lead to more effective dissemination practices of normative guidelines and health data ethics concepts.

The Nature, Patterns and Consequences of Technology-Facilitated Domestic Abuse: A Scoping Review

Women are increasingly at risk of gender-based violence through technology and digital tools. Some digital devices and apps such as GPS location tracking, spyware, mobile phones and social media platforms have become new tools for perpetrators to monitor, harass and abuse victims. However, the nature and impacts of technology on intimate partner violence (IPV) have remained perplexing and ambiguous. Hence, this scoping review was conducted to explore the nature, patterns and consequences of technology-facilitated domestic abuse (TFDA). All journal articles and grey literature exploring the TFDA phenomenon, its nature and impacts on victims and services providers were scanned, and twenty-two papers were included in this scoping review. Overall, findings showed that digital devices, online applications and social media accounts facilitated IPV and exacerbated the consequences of abuse. Yet, many victims and frontline workers found understanding the nature and impacts of TFDA difficult. They faced many challenges addressing this form of abuse. Thus, several strategies are needed to adequately tackle TFDA, including conducting further research on the issue, developing appropriate policy and addressing gender inequality in the online environment.

Technology, Training, and Task Shifting at the World's Largest Mass Gathering in 2025: An Opportunity for Antibiotic Stewardship in India

The role of antibiotic overuse in intensifying selection pressures and contributing to the emergence of antimicrobial resistance is well established. The Kumbh Mela, a religious festival that occurs in 4 Indian cities of spiritual significance, is the world's largest mass gathering, attracting over 80 million pilgrims in 2013. Digital syndromic surveillance from the 2013 and 2015 Melas demonstrated a consistent pattern of antibiotic overuse, with an antibiotic prescribing rate of up to 31% for all patient encounters. As preparations for the 2025 Kumbh Mela begin, task shifting, point-of-care diagnostic and digital tools, robust clinician training, and community awareness can promote the restrained and evidence-based use of antibiotics, minimizing the potential for the emergence of antimicrobial resistance at the world's largest mass gathering.

Cost-effectiveness of Digital Tools for Behavior Change Interventions Among People With Chronic Diseases: Systematic Review

BACKGROUND

Chronic diseases, including cardiovascular diseases, diabetes, chronic obstructive pulmonary disease, and cerebrovascular diseases, contribute to the most significant disease burden worldwide, negatively impacting patients and their family members. People with chronic diseases have common modifiable behavioral risk factors, including smoking, alcohol overconsumption, and unhealthy diets. Digital-based interventions for promoting and sustaining behavioral changes have flourished in recent years, although evidence of the cost-effectiveness of such interventions remains inconclusive.

OBJECTIVE

In this study, we aimed to investigate the cost-effectiveness of digital health interventions for behavioral changes among people with chronic diseases.

METHODS

This systematic review evaluated published studies focused on the economic evaluation of digital tools for behavioral change among adults with chronic diseases. We followed the Population, Intervention, Comparator, and Outcomes framework to retrieve relevant publications from 4 databases: PubMed, CINAHL, Scopus, and Web of Science. We used the Joanna Briggs Institute's criteria for economic evaluation and randomized controlled trials to assess the risk of bias in the studies. Two researchers independently screened, assessed the quality, and extracted data from the studies selected for the review.

RESULTS

In total, 20 studies published between 2003 and 2021 fulfilled our inclusion criteria. All the studies were conducted in high-income countries. These studies used telephones, SMS text messaging, mobile health apps, and websites as digital tools for behavior change communication. Most digital tools for interventions focused on diet and nutrition (17/20, 85%) and physical activity (16/20, 80%), and a few focused on smoking and tobacco control (8/20, 40%), alcohol reduction (6/20, 30%), and reduction of salt intake (3/20, 15%). Most studies (17/20, 85%) used the health care payer perspective for economic analysis, and only 15% (3/20) used the societal perspective. Only 45% (9/20) of studies conducted a full economic evaluation. Most studies (7/20, 35%) based on full economic evaluation and 30% (6/20) of studies based on partial economic evaluation found digital health interventions to be cost-effective and cost-saving. Most studies had short follow-ups and failed to include proper indicators for economic evaluation, such as quality-adjusted life-years, disability-adjusted life-years, lack of discounting, and sensitivity analysis.

CONCLUSIONS

Digital health interventions for behavioral change among people with chronic diseases are cost-effective in high-income settings and can therefore be scaled up. Similar evidence from low- and middle-income countries based on properly designed studies for cost-effectiveness evaluation is urgently required. A full economic evaluation is needed to provide robust evidence for the cost-effectiveness of digital health interventions and their potential for scaling up in a wider population. Future studies should follow the National Institute for Health and Clinical Excellence recommendations to take a societal perspective, apply discounting, address parameter uncertainty, and apply a lifelong time horizon.

The changing landscape in nephrology education in India

Digital tools have revolutionized education in nephrology in India. All forms of in-person learning are moving online. Social media have taken over the world, with clinicians learning and promoting multidirectional education methods. E-learning is better equipped to keep up with the rapid pace of new knowledge generation and dissemination. The use of digital multimedia tools to enhance rapid learning is backed by science, viz., dual-coding theory. Digital tools such as Twitter, blogs, podcasts, YouTube, and Nephrology Simulator (NephSIM) have had an impact in facilitating nephrology education among medical professionals and the general public. Digital tools, such as NephMadness, have resulted in the gamification of nephrology learning. Social media usage by the nephrology community in India is growing at a rapid pace. Everyday Cases in Nephrology (#ECNeph), a monthly Twitter-based discussion focused on academically challenging clinical cases, has its origins in India. The Women in Nephrology, India (WIN-India) initiative is very active in facilitating digital education in India and has, in a short space of time, created phenomenal momentum. Furthermore, non-governmental organizations in India, such as the Kidney Warriors Foundation and the Multi Organ Harvesting Aid Network (MOHAN) Foundation, have successfully tapped into social media to educate and aid kidney disease patients. All technologies come with some drawbacks. Despite their acceptance and validation, digital tools have their own pitfalls. These relate to (1) accessibility and connectivity, (2) accuracy of the scientific information, (3) social media noise, and (4) patient privacy. All pitfalls of digital education can be addressed by avoiding excessive social media overload and adopting an appropriate peer-review process. It is advisable to seek written consent from patients whenever patient data are posted online, to avoid privacy issues.

The necessary, albeit belated, transition to computerized cognitive assessment

Cognitive assessment is a common and daily process in educational, clinical, or research settings, among others. Currently, most professionals use classic pencil-and-paper screenings, tests, and assessment batteries. However, as the SARS-CoV-2 health crisis has shown, the pencil-and-paper format is becoming increasingly outdated and it is necessary to transition to new technologies, using computerized cognitive assessments (CCA). This article discusses the advantages, disadvantages, and implications of this necessary transition that professionals should face in the immediate future, and encourages careful adoption of this change to ensure a smooth transition.

Opportunities and Challenges to Advance Health Equity Using Digital Health Tools in Underserved Communities in Southeast US: A Mixed Methods Study

INTRODUCTION

Over the last 30 years, the adoption of health information technology and digital health tools (DHTs) into the US health system has been instrumental to improving access to care, especially for people living in rural, underserved, and underrepresented communities. Despite widespread adoption of DHTs by primary care clinicians, documented challenges have contributed to inequitable use and benefit. The COVID-19 pandemic necessitated rapid adoption of DHTs, accelerated by state and federal policy changes, in order to meet patient needs and ensure access to care.

METHODS

The Digital Health Tools Study employed a mixed methods approach to assess adoption and use of DHTs by primary care clinicians in southeastern states and identify individual- and practice-level barriers and facilitators to DHT implementation. A survey was conducted using a multi-modal recruitment strategy: newsletters, meeting/conference presentations, social media, and emails/calls. Focus groups were conducted to assess priorities, barriers, and facilitators and were recorded/transcribed verbatim. Descriptive statistics were calculated for survey results, produced for the whole sample, and stratified by state. Thematic analysis was conducted of focus group transcripts.

RESULTS

There were 1215 survey respondents. About 55 participants who had missing demographic information were excluded from the analysis. About 99% of clinicians used DHTs in the last 5 years, modalities included: telehealth (66%), electronic health records (EHRs; 66%), patient portals (49%), health information exchange (HIE; 41%), prescription drug monitoring programs (39%), remote/home monitoring (27%), and wearable devices (22%). Time (53%) and cost (51%) were identified as barriers. About 61% and 75% of clinicians reported being "satisfied" to "very satisfied" with telemedicine and EHRs, respectively. Seven focus groups with 25 clinicians were conducted and indicated COVID-19 and the use of supplemental tools/apps to connect patients to resources as major motivators for adopting DHTs. Challenges included incomplete and difficult-to-utilize HIE interfaces for providers and internet/broadband access and poor connectivity for patients.

CONCLUSIONS

This study describes the impact adopting DHTs by primary care clinicians has on expanded access to healthcare and reducing health disparities in regions with longstanding health and social inequities. The findings identify opportunities to leverage DHTs to advance health equity and highlight opportunities for policy improvement.

Effects of the COVID-19 pandemic on self-reported 12-month pneumococcal vaccination series completion rates in Canada

Routine childhood vaccination improves health and prevents morbidity and mortality from vaccine-preventable diseases. There are indications that the COVID-19 pandemic has negatively impacted immunization rates globally, but systematic studies on this are still lacking in Canada. This study aims to add knowledge on the pandemic's effect on children's immunization rates with pneumococcal vaccine using self-reported immunization data from CANImmunize. An interrupted time series analysis was conducted on aggregated monthly enrollment of children on the platform (2016-2021) and their pneumococcal immunization series completion rates (2016-2020). Predicted trends before and after the onset of the COVID19-related restriction (March 1, 2020) were compared by means of an Autoregressive Integrated Moving Average (ARIMA). The highest monthly enrollment was 3,474 new infant records observed in January 2020, and the lowest was 100 records in December 2021. The highest Self-reported pneumococcal immunization series completion rate was 78.89%, observed in February 2017, and the lowest was 6.94% in December 2021. Enrollment decreased by 1177.52 records (95% CI: -1865.47, -489.57), with a continued decrease of 80.84 records each month. Completion rates had an immediate increase of 14.57% (95% CI 4.64, 24.51), followed by a decrease of 3.54% each month. The onset of the COVID-19 related restrictions impacted the enrollment of children in the CANImmunize digital immunization platform and an overall decrease in self-reported pneumococcal immunization series completion rates. Our findings support efforts to increase catch-up immunization campaigns so that children who could not get scheduled immunization during the pandemic are not missed.

Innovative Methods Used in Monitoring COVID-19 in Europe: A Multinational Study

Several innovative methods have been deployed worldwide to curb the COVID-19 pandemic. The aim of the study is to investigate which innovative methods are used to monitor COVID-19 health issues in Europe and related legislative and ethical aspects. An online questionnaire was administered to European countries' representatives of the project Population Health Information Research Infrastructure. Additional information was obtained from websites and documents provided by the respondents; an overview of the literature was also performed. Respondents from 14 countries participated in the study. Digital tools are used to monitor the spread of COVID-19 (13/14 countries) and vaccination coverage (12/14); for research, diagnostics, telehealth (14/14); to fight disinformation (11/14) and forecast the pandemic spread (4/14). The level of implementation of telehealth applications was mostly low/medium. Legislative and ethical issues were encountered in many countries, leading to institutional distrust. The COVID-19 pandemic has highlighted the need for timely and accurate health data for research purposes and policy planning. However, the use of innovative methods for population health monitoring and timely data collection has posed challenges to privacy and online security globally. Adequate regulatory oversight, targeted public health interventions, and fight against disinformation could improve the uptake rate and enhance countries' emergency preparedness.

An etude for post-pandemic practice: The impact of the COVID-19 pandemic on practice methods and instrumental technique

This paper considers how the pandemic-related concert-free time affected musicians' practice, specifically in relation to technique. A semi-structured interview was carried out on 22 musicians based in Switzerland (11 males, 11 females; 7 students, 15 non-students; 11 with school-aged children, 11 without school-aged children; 16 with teaching duties and 6 non-teachers). The amount of practice during the pandemic-related concert-free time was reported as different to usual by 91% and usual for only 9% of participants (p = 0.002). Forty-one percent of participants reported reduced, and 41% "fluctuating" amounts of practice. The proportion of practice time spent on technique was reported by 55% of participants to have increased and by only 9% to have decreased (p = 0.019). Of those who reported an increase in technique practice, 75% agreed this had a positive impact on technique, and only 8% disagreed (p = 0.037). Moreover, 58% considered this work to have changed their current and future practice. Participants were statistically more likely to report "never" watching online tutorials than "often" (p = 0.014), but, of those that did watch such material, 75% agreed that it had a positive impact upon their practice. Most participants created digital content during this period; only 5% produced no such material. An increased use of digital tools was reported by 55% of participants, 92% of whom described this as having a positive effect upon practice and only 8% were unsure (p = 0.022). However, in the unstructured discussion, the use of digital tools appears to be associated with mixed outcomes. Men reported significantly more frequent use of digital tools (91% vs. 45% describing this use as often, p = 0.038) and spent a larger proportion of time on technique relative to their pre-pandemic habits than women (p = 0.065); moreover, a trend indicated that more women than men created digital content in the form of tutorials (p = 0.095). The exceptional situation musicians experienced during the pandemic, which introduced new aspects to musical instrument practice, and accelerated changes already underway, could lead to future work that improves practice under "normal" conditions, and exposes discrepancies between certain demographic groups.

Introducing an implementation framework for augmenting care with digital technology for early psychosis patients: theory and motivation

BACKGROUND

Treatment programs for early-course psychosis are evidence-based interventions that provide specialty care to improve outcomes in patients. Digital technologies offer the potential to augment services and meet the growing demand for care.

AIMS

We introduce a framework to guide the assessment of site readiness for technology and their ability to successfully introduce, implement, and sustain digital technology use. While broader in use that early course psychosis, we focus on this use case to introduce the theory and clinical application.

METHODS

Adapting the replicating effective programs framework, we present an early psychosis focused model. Considering the unique opportunities and challenges of these programs, we present a five-stage evaluation framework. Informed by our clinical experience and recent literature, we present tools and examples to help programs plan and execute successful technology implementation.

RESULTS

The AACCS framework is comprised of five stages: (1) Access (e.g. identifying access to and comfort with technology), (2) Align (e.g. understanding aspects technology can augment), (3) Connect (e.g. customizing technology to stakeholder needs), (4) Care (e.g. implementing technology into treatment), and (5) Sustain (e.g. creating sustainable services). Site visits revealed patients have access to digital tools and are open to implementation into care, while staff prefers digital skills training.

CONCLUSIONS

This framework assists programs in identifying clinical targets to be augmented with technology, stages of implementation, and recommendations for sustaining meaningful technology use.

A Lesson from the Pandemic: Utilizing Digital Tools To Support Student Engagement during Instructional Assistant-Led Sessions

Student instructional assistants (IAs) are an integral part of most students' college experience in higher education. When properly trained, IAs can improve students' grades, engagement with course content, persistence, and retention. Recently, the COVID-19 pandemic forced the transition of nearly all instructional practices online. At the University of Alabama at Birmingham, IAs, including Biology Learning Assistants (BLAs), began hosting their instructional sessions virtually, outside of class time. The goals of these sessions were to reinforce fundamental concepts using active learning strategies and to address student questions by building a supportive learning community. In this article, we summarize the training and guidance we provided to the BLAs regarding how best to adapt digital educational tools to engage students during their virtual sessions. We recommend that institutions of higher education recognize the expansion of digital educational tools as an opportunity to increase the technological literacy and competence of their IAs to best serve their student body in this increasingly digital age of education.

The role of digital tools in providing youth mental health: results from an international multi-center study

Since the traditional mental health system showed significant limitations in the early identification, diagnosis and treatment of the current new youth psychopathological trajectories, by substantially failing in targeting the needs of the current young generation, there is the demand to redesign and digitally adapt youth mental health care and systems. Indeed, the level of digital literacy and the level of digital competency and knowledge in the field of digital psychiatry is still under-investigated among mental health professionals, particularly in youth mental health. Therefore, we aimed at: (a) carrying out a post-hoc analysis of an international multi-centre study, to investigate the opinions of mental health professionals regarding the feasibility, efficacy and clinical experience in delivering digital mental health interventions (DMHIs) in youths; (b) providing a comprehensive overview on the integrated digitally-based youth mental health care models and innovations. Mental health professionals declared the lack of a formal training in digital psychiatry, particularly in youth mental health. Subjects who received a formal theoretical/practical training on DMHIs displayed a statistical trend towards a positive feasibility of digital psychiatry in youth mental health (p = 0.053) and a perceived increased efficacy of digital psychiatry in youths (p = 0.051). Respondents with higher Digital Psychiatry Opinion (DPO) scores reported a positive perceived feasibility of DMHIs in youths (p < 0.041) and are more prone to deliver DMHIs to young people (p < 0.001). Respondents with higher knowledge scores (KS) declared that DMHIs are more effective in youth mental health (p < 0.001). Overall, the digitalisation indeed allowed young people to keep in touch with a mental health professional, facilitating a more dynamic and fluid mental health care access and monitoring, generally preferred and considered more feasible by post-Millennial youngsters. Accordingly, our findings demonstrated that mental health professionals are more prone to offer DMHIs in youth mental health, particularly whether previously trained and knowledgeable on the topic.

Digital skin imaging applications, part II: a comprehensive survey of post-acquisition image utilization features and technology standards

BACKGROUND

Despite the increasing ubiquity and accessibility of teledermatology applications, few studies have comprehensively surveyed their features and technical standards. Importantly, features implemented after the point of capture are often intended to augment image utilization, while technical standards affect interoperability with existing healthcare systems. We aim to comprehensively survey image utilization features and technical characteristics found within publicly discoverable digital skin imaging applications.

MATERIALS AND METHODS

Applications were identified and categorized as described in Part I. Included applications were then further assessed by three independent reviewers for post-imaging content, tools, and functionality. Publicly available information was used to determine the presence or absence of relevant technology standards and/or data characteristics.

RESULTS

A total of 20 post-image acquisition features were identified across three general categories: (1) metadata attachment, (2) functional tools (i.e., those that utilized images or in-app content to perform a user-directed function), and (3) image processing. Over 80% of all applications implemented metadata features, with nearly half having metadata features only. Individual feature occurred and feature richness varied significantly by primary audience (p < 0.0001) and function (p < 0.0001). On average, each application included under three features. Less than half of all applications requested consent for user-uploaded photos and fewer than 10% provided clear data use and privacy policies.

CONCLUSION

Post-imaging functionality in skin imaging applications varies significantly by primary audience and intended function, though nearly all applications implemented metadata labeling. Technical standards are often not implemented or reported consistently. Gaps in the provision of clear consent, data privacy, and data use policies should be urgently addressed.

Using a digital personal recovery resource in routine mental health practice: feasibility, acceptability and outcomes

BACKGROUND

Digital technologies enable the dissemination of multimedia resources to support adults with serious mental illness in their self-management and personal recovery. However, delivery needs to accommodate engagement and accessibility challenges.

AIMS

We examined how a digital resource, designed for mental health workers and consumers to use together in session, would be used in routine practice.

METHODS

Thirty consumers and their workers participated. The web-based resource, Self-Management And Recovery Technology (SMART), was available to use within and between sessions, for a 6-month period. Workers initiated in-session use where relevant. Feasibility was explored via uptake and usage data; and acceptability and impact via questionnaires. A pre-post design assessed recovery outcomes for consumers and relationship outcomes for consumers and workers.

RESULTS

In participating mental health practitioner-consumer dyads, consumers gave strong acceptability ratings, and reported improved working relationships. However, the resource was typically used in one-third or fewer appointments, with consumers expressing a desire for greater in-session use. Improvements in self-rated personal recovery were not observed, possibly contributed to by low usage.

CONCLUSIONS

In-session use was found helpful by consumers but may be constrained by other demands in mental health care delivery: collaborative use may require dedicated staff time or more formal implementation.

Widening or narrowing inequalities? The equity implications of digital tools to support COVID-19 contact tracing: A qualitative study

Background

As digital tools are increasingly used to support COVID‐19 contact tracing, the equity implications must be considered. As part of a study to understand the public's views of digital contact tracing tools developed for the national ‘Test and Protect’ programme in Scotland, we aimed to explore the views of groups often excluded from such discussions. This paper reports on their views about the potential for contact tracing to exacerbate inequalities.

Methods

A qualitative study was carried out; interviews were conducted with key informants from organizations supporting people in marginalized situations, followed by interviews and focus groups with people recruited from these groups. Participants included, or represented, minority ethnic groups, asylum seekers and refugees and those experiencing multiple disadvantage including severe and enduring poverty.

Results

A total of 42 people participated: 13 key informants and 29 members of the public. While public participants were supportive of contact tracing, key informants raised concerns. Both sets of participants spoke about how contact tracing, and its associated digital tools, might increase inequalities. Barriers included finances (inability to afford smartphones or the data to ensure access to the internet); language (digital tools were available only in English and required a degree of literacy, even for English speakers); and trust (many marginalized groups distrusted statutory organizations and there were concerns that data may be passed to other organizations). One strength was that NHS Scotland, the data guardian, is seen as a generally trustworthy organization. Poverty was recognized as a barrier to people's ability to self‐isolate. Some participants were concerned about giving contact details of individuals who might struggle to self‐isolate for financial reasons.

Conclusions

The impact of contact tracing and associated digital tools on marginalized populations needs careful monitoring. This should include the contact tracing process and the ability of people to self‐isolate. Regular clear messaging from trusted groups and community members could help maintain trust and participation in the programme.

Patient and Public Contribution

Our patient and public involvement coapplicant, L. L., was involved in all aspects of the study including coauthorship. Interim results were presented to our local Public and Patient Involvement and Engagement Group, who commented on interpretation and made suggestions about further recruitment.