Smartphones, trainees, and mobile education: implications for graduate medical education

Design, Development and Evaluation of an Application based on Clinical Decision Support Systems (CDSS) for Over-The-Counter (OTC) Therapy: An Educational Interventions in Community Pharmacists

INTRODUCTION

Mobile health (mHealth) technology-based applications provide strong medical health-care support. Applications have an important impact as tools to improve the knowledge and support the health-care team practice. In this study, an over-the-counter (OTC) therapy application was developed based on Clinical Decision Support Systems (CDSS). CDSS is a key to improve health-related decisions and healthcare delivery. Furthermore, the quality and effectiveness of this application were evaluated among community pharmacists.

METHODS

The application was designed and developed for 10 topics of OTC therapy. After the approval of the expert panel, 40 pharmacists affiliated with Tehran University of Medical Science (TUMS) participated in this before and after quasi-experimental study. The related scenarios and checklists were designed for the ten topics. The participants had to manage the scenarios first by their knowledge and then with the application. The knowledge and pharmaceutical skills in OTC therapy were evaluated based on the obtained scores and the time recorded. The quality of the application was evaluated by pharmacists using user version of mobile application rating scale (uMARS) questionnaire. To compare before/after measurements of parametric and non-parametric data, we used the paired t-test and Wilcoxon matched-pairs test, respectively. Besides, the variables was compared using Mann-Whitney test. The statistical significance was considered at P<0.05. The analyses were performed using the statistical software Stata (ver. 13).

RESULTS

All scores after using the application increased, and the P-value was not significant. Also, the recorded time was increased after the use of the application, and the P-value was not significant. The minimum mean scores of the six uMARS questionnaire sections were 3. It means that acceptable scores were obtained in all sections of the questionnaire. The "App quality score" section of the application was reported 3.45±0.94. No relationship was found between gender and the median score of each section of the uMARS questionnaire.

CONCLUSION

The OTC therapy application developed in this study will help Persian-speaking pharmacists to increase their knowledge and pharmaceutical skills.

Educational Podcast Impact on Student Study Habits and Exam Performance

BACKGROUND

Emerging technologies, trainees' proficiency with digital resources, and the COVID-19 pandemic have increased the role of mobile and asynchronous learning methods in medical education. Educational podcasts have gained popularity in both formal curricula and independent learning, but their impact on educational outcomes has not been well studied.

METHODS

We conducted a prospective cohort study of third-year medical students during pediatrics clerkship. An educational podcast series titled "Peds Soup" was introduced to students as a voluntary study resource. We surveyed students at the end of the rotation to assess study habits and perceptions of the podcast. We compared survey responses from podcast users and nonusers, and used standardized pediatrics subject examination scores to measure knowledge differences between groups.

RESULTS

Eighty-three students participated in the study. Peds Soup listeners (n=43) reported spending significantly more time studying during clerkship (M=16.5, SD=9.0 vs M=12.4, SD=9.2 hours/week, P=.009) than nonlisteners. Users expressed positive views toward the podcast's impact on introducing, reinforcing, and helping apply knowledge, and endorsed that Peds Soup made it easier to find time to study. Examination scores did not differ between the two groups.

DISCUSSION

The podcast demonstrated a reaction-level impact, with users reporting positive attitudes toward the podcast's impact and spending more time studying during pediatrics clerkship. Podcasts have strong potential as a supplement to existing curricula, where they can fill a need for interested learners. Future research should focus on the relationship between time spent and knowledge gain or utilize alternative measures of knowledge.

Systematic Review of Pelvic Anatomy iOS and Android Applications for Obstetricians and Gynecologists

IMPORTANCE

Resources for learning and enhancing knowledge in medicine, such as mobile applications (apps), have dramatically increased in recent years; however, there is lack of a valid source for identifying the best and most reliable mobile apps.

OBJECTIVES

The goal of this study was to identify the highest scoring available pelvic anatomy apps based on quality, content, and functionality for obstetrician-gynecologists using a validated tool.

STUDY DESIGN

This was a systematic evaluation of anatomy apps in the Apple iTunes (iOS) and Google Play (Android) stores. Exclusions included apps that had nonhuman, nonanatomy content, did not include female pelvic anatomy or were deemed inappropriate for postgraduate level. The validated Mobile App Rating Scale (MARS), a mobile-health (mHealth) app scoring system was used to evaluate apps based on both objective and subjective quality. The authors' MARS scores for each variable were compiled, and the objective, subjective, and overall scores were calculated.

RESULTS

The search criteria yielded 2,432 apps: 952 (39%) Apple iTunes store and 1,480 (60.8%) Google Play Store apps. After applying the exclusion criteria, 35 (14 iOS, 8 Android, and 13 iOS/Android) apps were included for evaluation using the MARS system. "Complete Anatomy" app, available for both iOS and Android systems, obtained the highest objective, subjective, and overall MARS score.

CONCLUSIONS

Although there are numerous anatomy apps available, only a few meet prespecified criteria for functionality, content, quality, and are appropriate for obstetrician-gynecologists. Using a validated scoring system, we present a scored list of female pelvic anatomy apps most appropriate for obstetrician-gynecologists.

Impact of Living Conditions on Online Education: Evidence from China

Students need to maintain certain living conditions in order to pursue online learning at home. However, there is a lack of a scientific explanation for the extent to which students’ performance in online at-home education is influenced by living conditions. Students from 2002 low-income households in China were surveyed, and a multivariate logistic regression analysis was conducted in order to explore the impact of living conditions on online education. The results showed that, rather than computers and smartphones, broadband Internet at home can affect students’ performance in online learning. The larger the residence area, the better the children’s performance in at-home e-learning. Moreover, children living in dilapidated houses are unable to satisfactorily perform in an e-learning environment. Contrarily, children who live in families with separate rooms and tap water show better performances. Additionally, the performance will be worse in the case of unattended students. Furthermore, children from low-income and -status families in the community are often at a disadvantage in an at-home e-learning environment. Cognition regarding the connection between living conditions and online education can be crucial for the improvement of the living conditions of low-income families in order to achieve online education equity.

A mobile app to promote alcohol and drug SBIRT skill translation among multi-disciplinary health care trainees: Results of a randomized controlled trial

BACKGROUND

Adherence to clinical practice guidelines for alcohol and drug screening, brief intervention, and referral to treatment (SBIRT) is often inadequate. Mobile apps developed as clinical translation tools could improve the delivery of high fidelity SBIRT.

Methods: This study tested the effectiveness of an SBIRT mobile app conceptually aligned with the Theory of Planned Behavior (TPB) to support SBIRT delivery by health care trainees (nursing, social work, internal medicine, psychiatry, and psychology) working in clinical settings (N = 101). Bivariate analyses examined the rate of SBIRT delivery between trainees assigned to the experimental (app) and control (no app) study conditions; as well as the relationship between TPB-based constructs, intention to deliver SBIRT, and screening rates.

Results: No significant differences were identified between the study conditions in SBIRT delivery. Significant correlations were found between intent to screen and TPB variables including attitudes/behavioral beliefs concerning substance use treatment (r = .49, p = .01); confidence in clinical skills (r = .36, p = .01); subjective norms (r = .54, p = .01) and perceived behavioral control over appointment time constraints (r = .42, p = .01). Also significant were correlations between percent of patients screened and confidence (r = .24, p = .05); subjective norms (r = .22, p = .05) and perceived behavioral control (r = .28, p = .01).

Conclusions: The negative results of the study condition comparisons indicate the need for further investigation of strategies to optimize mobile app utilization, engagement, and effectiveness as a clinical translation tool. Findings of significant correlations between substance use screening rates and both norms and confidence support the potential value of the TPB model in explaining behavior of health care learners in SBIRT delivery.

Semiprivate space and access to online education during COVID-19: empirical tests from China

Purpose

Although the use of online technology has generated excitement over its potential to increase access to education, most existing research has focused on comparing online and in-person student performance. This study provides empirical evidence that semiprivate space at the family level affects students' access to online education.

Design/methodology/approach

Students from 1,565 low-income households in China were surveyed, and a multivariate logistic regression analysis was conducted on the hypothesized factors that affect access to online education at home.

Findings

The results show that the absence of computers, smartphones and broadband networks at home severely hinders children's access to online education, and even leads to their exclusion from it. Children with their fathers or paternal grandfathers as guardians have a lower probability of receiving online education at home. It was also found that the higher the education level of the head of the household, the more likely it is that children will receive online education at home.

Originality/value

This study is one of the first to examine online accessibility at the family level. It also demonstrates that the semiprivate space at the family level may limit opportunities for students who would otherwise pursue online education at home.

Diagnosis in a snap: a pilot study using Snapchat in radiologic didactics

Purpose

To evaluate Snapchat, an image-based social media platform, as a tool for emergency radiologic didactics comparing image interpretation on mobile devices with conventional analysis on a classroom screen.

Materials and methods

Seven radiology residents (4 juniors, 3 seniors;4 males, 3 females; 28.4 years old, ± 1.7 years) were shown 5 emergent radiologic cases using Snapchat and 5 cases of similar content and duration on a classroom projector over 4 weeks. All images depicted diagnoses requiring immediate communication to ordering physicians. Performance was scored 0–2 (0 = complete miss, 1 = major finding, but missed the diagnosis, 2 = correct diagnosis) by two attending radiologists in consensus.

Results

All residents performed better on Snapchat each week. In weeks 1–4, juniors scored 21/40 (52.5%), 23/40 (57.5%), 19/40 (47.5%), and 18/40 (45%) points using Snapchat compared with 13/40 (32.5%), 23/40 (57.5%), 14/40 (35%), and 13/40 (32.5%), respectively, each week by projector, while seniors scored 19/30 (63.3%), 21/30 (70%), 27/30 (90%), and 21/30 (70%) on Snapchat versus 16/30 (53.3%), 19/30 (63.3%), 20/30 (66.7%), and 20/30 (66.7%) on projector. Four-week totals showed juniors scoring 81/160 (50.6%) on Snapchat and 63/160 (39.4%) by projector compared with seniors scoring 88/120 (73.3%) and 75/120 (62.5%), respectively. Performance on Snapchat was statistically, significantly better than via projector during weeks 1 and 3 (p values 0.0019 and 0.0031).

Conclusion

Radiology residents interpreting emergency cases via Snapchat showed higher accuracy compared with using a traditional classroom screen. This pilot study suggests that Snapchat may have a role in the digital radiologic classroom’s evolution.

A Cardiology Handbook App to Improve Medical Education for Internal Medicine Residents: Development and Usability Study

BACKGROUND

At most institutions, internal medicine residents struggle with balancing clinical duties and learning opportunities, particularly during busy cardiology ward rotations. To improve learning experiences for residents, we helped develop a cardiology handbook app to supplement cardiology education.

OBJECTIVE

The aim of this study was to report the development, implementation, and preliminary impact of the Krannert Cardiology Handbook app on graduate medical education.

METHODS

In June 2017, 122 residents at Indiana University were invited to download the digital handbook in the Krannert app. The Krannert app featured a total of 13 chapters written by cardiology fellows and faculty at Indiana University. Residents were surveyed on their self-reported improvement in cardiology knowledge and level of satisfaction after using the Krannert app. Residents were also surveyed regarding their preference for a digital handbook app versus a paper handbook.

RESULTS

Of the 122 residents, 38 trainees (31.1%) participated in survey evaluations. Among all respondents, 31 app users (82%) reported that the app helped improve their cardiology knowledge base. The app had an overall favorable response.

CONCLUSIONS

The Krannert app shows promise in augmenting clinical education in cardiology with mobile learning. Future work includes adding new topics, updating the content, and comparing the app to other learning modalities.

Unsupervised Machine Learning Algorithms Examine Healthcare Providers' Perceptions and Longitudinal Performance in a Digital Neonatal Resuscitation Simulator

Background: Frequent simulation-based education is recommended to improve health outcomes during neonatal resuscitation but is often inaccessible due to time, resource, and personnel requirements. Digital simulation presents a potential alternative; however, its effectiveness and reception by healthcare professionals (HCPs) remains largely unexplored. Objectives: This study explores HCPs' attitudes toward a digital simulator, technology, and mindset to elucidate their effects on neonatal resuscitation performance in simulation-based assessments. Methods: The study was conducted from April to August 2019 with 2-month (June-October 2019) and 5-month (September 2019-January 2020) follow-up at a tertiary perinatal center in Edmonton, Canada. Of 300 available neonatal HCPs, 50 participated. Participants completed a demographic survey, a pretest, two practice scenarios using the RETAIN neonatal resuscitation digital simulation, a posttest, and an attitudinal survey (100% response rate). Participants repeated the posttest scenario in 2 months (86% response rate) and completed another posttest scenario using a low-fidelity, tabletop simulator (80% response rate) 5 months after the initial study intervention. Participants' survey responses were collected to measure attitudes toward digital simulation and technology. Knowledge was assessed at baseline (pretest), acquisition (posttest), retention (2-month posttest), and transfer (5-month posttest). Results: Fifty neonatal HCPs participated in this study (44 females and 6 males; 27 nurses, 3 nurse practitioners, 14 respiratory therapists, and 6 doctors). Most participants reported technology in medical education as useful and beneficial. Three attitudinal clusters were identified by a hierarchical clustering algorithm based on survey responses. Although participants exhibited diverse attitudinal paths, they all improved neonatal resuscitation performance after using the digital simulator and successfully transferred their knowledge to a new medium. Conclusions: Digital simulation improved HCPs' neonatal resuscitation performance. Medical education may benefit by incorporating technology during simulation training.

Case-Based Curriculum With Integrated Smartphone Applications Improves Internal Medicine Resident Knowledge Of Contraceptive Care

BACKGROUND

Contraception is an essential preventive service for all women. However, the literature suggests that internal medicine residents have low levels of confidence and knowledge of contraceptive care.

OBJECTIVE

We designed and implemented a novel contraception curriculum promoting active, collaborative learning. We sought to evaluate whether this curriculum improved internal medicine resident knowledge of and comfort with contraceptive care through the administration of pre-/post-surveys.

METHODS

Our curriculum was delivered in a two-hour session as part of the mandatory ambulatory curriculum for internal medicine interns at our institution in the academic year 2017-2018. Interns were provided with select online resources and two smartphone applications at the beginning of the session, which they then used in case-based small group work. Small group work was followed by a large group case review, co-facilitated by OB/GYN and internal medicine faculty.

RESULTS

Thirty-eight participants completed surveys assessing knowledge of and comfort with contraceptive care immediately before and after the curriculum; 20 participants completed surveys assessing the same domains 4-6 months after the curriculum. Data from surveys administered immediately post-curriculum demonstrated significant improvements in knowledge about and comfort with counseling about, assessing medical eligibility for, and initiating multiple forms of contraception. Many of these improvements in knowledge and comfort were maintained on follow-up surveys 4-6 months following the curriculum.

CONCLUSION

Our case-based curriculum with integrated smartphone applications resulted in significant improvements in internal medicine resident knowledge of and comfort with the key skills of contraceptive care. In contrast to active, collaborative learning methodologies such as the flipped classroom, our methodology supports active, collaborative learning without requiring advance learner preparation, and is thus well suited to the time constraints of the graduate medical education setting. Our methodology is readily translatable to other clinical topics and residency curricula.

The 'connectaholic' behind the curtain: medical student use of computer devices in the clinical setting and the influence of patients

BACKGROUND

The use of mobile devices such as tablets and laptops by students to support their learning is now ubiquitous. The clinical setting is an environment, which lends itself to the use of mobile devices as students are exposed to novel clinical scenarios that may require rapid location of information to address knowledge gaps. It is unknown what preferences students have for these devices and how they are used in the clinical environment.

METHODS

In this study we explored medical students' choices and their use of different devices in their first year of clinical attachments. We sought to evaluate learners' experiences with these devices using a mixed methods approach. All students newly entered into the clinical years were given the option of a MacBook Air or iPad. We surveyed these students using an online survey tool followed by individual semi-structured interviews to explore survey findings in more depth.

RESULTS

Students owned a multitude of devices however their preferences were for the 11 in. MacBook Air Laptop over the iPad mini. Students made constant use of online information to support their clinical learning, however three major themes emerged from the interview data: connection and devices (diverse personal ownership of technology by students and how this is applied to source educational materials), influence and interaction with patients (use of any device in a clinical setting) and influence and interaction with staff. In general students preferred to use their device in the absence of patients however context had a significant influence.

CONCLUSIONS

These mobile devices were useful in the clinical setting by allowing access to online educational material. However, the presence of patients, and the behaviour of senior teaching staff significantly influenced their utilisation by students. Understanding the preferences of students for devices and how they use their preferred devices can help inform educational policy and maximise the learning from online educational content.

The Use of Smart Devices by Care Providers in Emergency Departments: Cross-Sectional Survey Design

BACKGROUND

The use of smart devices (SDs) by health care providers in care settings is a common practice nowadays. Such use includes apps related to patient care and often extends to personal calls and applications with frequent prompts and interruptions. These prompts and interruptions enhance the risk of distractions caused by SDs and raise concerns about service quality and patient safety. Such concerns are exacerbated in complex care settings such as the emergency department (ED).

OBJECTIVE

The objective of this study was to measure the frequency and patterns of SD use among health care providers in the ED of a large academic health center in Lebanon. The perceived consequences of care providers using SDs on provider-to-provider communication and the care quality of patients in the ED were assessed. Additionally, factors associated with the use of SDs and the approval for regulating such use were also investigated.

METHODS

The study was carried out at the ED of an academic health center with the highest volume of patient visits in Lebanon. The data were collected using a cross-sectional electronic survey sent to all ED health care providers (N=236). The target population included core ED faculty members, attending physicians, residents, medical students, and the nursing care providers. The regression model developed in this study was used to find predictors of medical errors in the ED because of the use of SDs.

RESULTS

Half of the target population responded to the questionnaire. A total of 83 of 97 respondents (86%) used one or more medical applications on their SDs. 71 out of 87 respondents (82%) believed that using SDs in the ED improved the coordination among the care team, and 71 out of 90 (79%) respondents believed that it was beneficial to patient care. In addition, 37 out of 90 respondents (41%) acknowledged that they were distracted when using their SDs for nonwork purposes. 51 out of 93 respondents (55%) witnessed a colleague committing a near miss or an error owing to the SD-caused distractions. Regression analysis revealed that age (P=.04) and missing information owing to the use of SDs (P=.02) were major predictors of committing an error in the ED. Interestingly, more than 40% of the respondents were significantly addicted to using SDs and more than one-third felt the need to cut down their use.

CONCLUSIONS

The findings of this study make it imperative to ensure the safety and wellbeing of patients, especially in high intensity, high volume departments like the ED. Irrespective of the positive role SDs play in the health care process, the negative effects of their use mandate proper regulation, in particular, an ethical mandate that takes into consideration the significant consequences that the use of SDs may have on care processes and outcomes.

The role of the smartphone in the transition from medical student to foundation trainee: a qualitative interview and focus group study

BACKGROUND

The transition from medical student to junior doctor is one of the most challenging in medicine, affecting both doctor and patient health. Opportunities to support this transition have arisen from advances in mobile technology and increased smartphone ownership.

METHODS

This qualitative study consisted of six in-depth interviews and two focus groups with Foundation Year 1 Trainees (intern doctors) and final year medical students within the same NHS Trust. A convenience sample of 14 participants was recruited using chain sampling. Interviews and focus groups were recorded, transcribed verbatim, analysed in accordance with thematic analysis and presented below in keeping with the standards for reporting qualitative research.

RESULTS

Participants represented both high and low intensity users. They used their smartphones to support their prescribing practices, especially antimicrobials through the MicroGuide™ app. Instant messaging, via WhatsApp, contributed to the existing bleep system, allowing coordination of both work and learning opportunities across place and time. Clinical photographs were recognised as being against regulations but there had still been occasions of use despite this. Concerns about public and colleague perceptions were important to both students and doctors, with participants describing various tactics employed to successfully integrate phone use into their practices.

CONCLUSION

This study suggests that both final year medical students and foundation trainees use smartphones in everyday practice. Medical schools and healthcare institutions should seek to integrate such use into core curricula/training to enable safe and effective use and further ease the transition to foundation training. We recommend juniors are reminded of the potential risks to patient confidentiality associated with smartphone use.

Increasing Physical Exam Teaching on Family-Centered Rounds Utilizing a Web-Based Tool

Introduction

Millennial trainees prefer innovative, multimodal education on topics including the physical exam (PE). Attendings inconsistently meet these needs on family-centered rounds. To enhance PE teaching, a Web site (PEToolkit) was created, but its use was infrequent. We aimed to increase PEToolkit use from 2 to 5 page counts per week in 7 months.

Methods

This quality improvement project took place at a large academic center in 1 Hospital Medicine team. Key drivers informed interventions, and an annotated run chart tracked progress. We tracked secondary measures, including changes in perception of teaching skill among attendings and resident-observed methods of PE teaching, through survey methodology.

Results

Median page counts increased to 5 counts per week in 7 months. The most impactful interventions included training senior residents to teach with the PEToolkit Web site and team feedback on Web site usage midweek. Survey responses from 37 attendings showed that those with more exposure to PEToolkit had increased self-perceived skill of PE teaching (P = 0.02). Survey responses from 52 residents showed that those on the intervention team reported more use of video for PE teaching (P < 0.001) and higher frequency of PE teaching (P = 0.02), compared with those on the nonintervention team.

Conclusions

We increased PEToolkit Web site use during family-centered rounds, thereby emphasizing the importance of PE teaching in this setting in an innovative way. Engagement of learners, frequent feedback, and coaching should be considered when incorporating technology in teaching.

A Randomized Educational Interventional Trial of Spaced Education During a Pediatric Rotation

OBJECTIVE

Spacing of educational material over time has been shown to improve learning efficiency and long-term knowledge retention. We evaluated the impact of adding a spaced education curriculum to a month-long pediatric rotation.

METHODS

This was a randomized controlled educational intervention trial of residents on a rotation in a pediatric emergency department. Participants were randomized to the standard curriculum or the standard curriculum with integrated spaced education. The intervention used an automated platform to electronically deliver questions to user e-mail or mobile devices and provided instant feedback. Our primary outcome was proportion of correctly answered questions following the rotation. Our secondary outcomes included test performance at 3 months, change in clinical confidence, and satisfaction with the spaced learning. Learner opinion of the platform was assessed by postrotation survey.

RESULTS

Of 194 eligible trainees, 122 were enrolled and randomized. A total of 107 of the enrolled residents (88%) completed the immediate postrotation assessment, 48 of whom received spaced education. Sixty residents completed the 3-month follow-up. There were no differences between the control and intervention groups in baseline knowledge. The intervention group performed better than the control group on the postrotation assessment (mean difference = 5.4%, 95% confidence interval = 0.1-10.7) when controlled for didactic attendance and clinical exposure. Change in confidence did not differ between groups. Eighty-seven percent of spaced education learners would participate in a similar model in the future.

CONCLUSION

Spaced education during a pediatric emergency medicine rotation is an effective adjunct to a standard curriculum. Participants showed improvement on postrotation knowledge performance and enjoyed this educational approach.

An Assessment of Pathology Resident Access to and Use of Technology: A Nationwide Survey

Context.—

Current technologies including digital slide scanners and handheld devices can revolutionize clinical practice and pathology graduate medical education (GME). The extent to which these technologies are used in pathology GME is unknown.

Objectives.—

To determine the types of technologies used, usage amount, and how they are integrated into pathology residency/fellowship programs nationwide.

Design.—

A 40-question online survey for residents/fellows was developed and administered via the Research Electronic Data Capture System after institutional review board approval.

Results.—

Fifty-two program directors (37%) gave permission for participation. One-hundred seventy-one responses were received (18% response rate). Most respondents have access to personal technology (laptop = 78% [134 of 171]), smartphone = 81% [139 of 171], tablet = 49% [84 of 171]), and Web-based digital slide collections (82%, 141 of 171). Few residents are provided electronic devices by their programs (laptop = 22% [38 of 171], smartphone = 0.5% [1 of 171], and tablet = 12% [21 of 171]). Fifty-nine percent have access to digital slide scanners, 33% have access to a program-created database of digitized slides, and 52% use telepathology. Fifteen percent have access to asynchronous learning. Of those with access to video-recorded conferences, 89% review them. Program size was significantly positively correlated with resident access to program-provided laptops (P = .02) and tablets (P &lt; .001), digital slide scanners (P = .01), and telepathology (P = .001). Of all devices, program-provided laptops are used most for professional work (60.5% use this device for more than 5 hours per day).

Conclusions.—

Most residents report access to multiple types of innovative technology, but incorporation of these tools within pathology training programs is highly variable. Opportunities for incorporating innovative technologies exist and could be further explored.

Enhancing Pharmacy Student Learning and Perceptions of Medical Apps

BACKGROUND

The use of mobile apps in health care is growing. Current and future practitioners must be equipped with the skills to navigate and utilize apps in patient care, yet few strategies exist for training health care professional students on the usage of apps.

OBJECTIVE

To characterize first-year pharmacy student use of medical apps, evaluate first-year pharmacy student's perception of skills in finding, evaluating, and using medical apps before and after a focused learning experience, and assess student satisfaction and areas for improvement regarding the learning experience.

METHODS

Students listened to a recorded, Web-based lecture on finding, evaluating, and using mobile apps in patient care. A 2-hour, interactive workshop was conducted during which students were led by an instructor through a discussion on strategies for finding and using apps in health care. The students practiced evaluating 6 different health care-related apps. Surveys were conducted before and after the focused learning experience to assess students' perceptions of medical apps and current use and perspectives on satisfaction with the learning experience and role of technology in health care.

RESULTS

This educational intervention is the first described formal, interactive method to educate student pharmacists on medical apps. With a 99% response rate, surveys conducted before and after the learning experience displayed perceived improvement in student skills related to finding (52/119, 44% before vs 114/120, 95% after), evaluating (18/119, 15% before vs 112/120, 93% after), and using medical apps in patient care (31/119, 26% before vs 108/120, 90% after) and the health sciences classroom (38/119, 32% before vs 104/120, 87% after). Students described satisfaction with the educational experience and agreed that it should be repeated in subsequent years (89/120, 74% agreed or strongly agreed). Most students surveyed possessed portable electronic devices (107/119, 90% mobile phone) and agreed with the concept of medical apps being an important part of the health care profession in the future (112/119, 94% before and 115/120, 96% after).

CONCLUSIONS

Student pharmacists recognize the key role technology plays in the future of health care. A medical apps workshop was successful in improving student pharmacists' perceptions of ability to find, evaluate, and use medical apps.

Measuring Participants' Attitudes Toward Mobile Device Conference Applications in Continuing Medical Education: Validation of an Instrument

INTRODUCTION

Mobile device applications (apps) may enhance live CME courses. We aimed to (1) validate a measure of participant attitudes toward using a conference app and (2) determine associations between participant characteristics and attitudes toward CME apps with conference app usage.

METHODS

We conducted a cross-sectional validation study of participants at the Mayo Clinic Selected Topics in Internal Medicine Course. A conference app was developed that included presentation slides, note-taking features, search functions, social networking with other attendees, and access to presenter information. The CME app attitudes survey instrument (CMEAPP-10) was designed to determine participant attitudes toward conference apps.

RESULTS

Of the 602 participants, 498 (82.7%) returned surveys. Factor analysis revealed a two-dimensional model for CMEAPP-10 scores (Cronbach α, 0.97). Mean (SD) CMEAPP-10 scores (maximum possible score of five) were higher for women than for men (4.06 [0.91] versus 3.85 [0.92]; P = .04). CMEAPP-10 scores (mean [SD]) were significantly associated (P = .02) with previous app usage as follows: less than once per month, 3.73 (1.05); monthly, 3.41 (1.16); weekly, 4.03 (0.69); and daily or more, 4.06 (0.89). Scores were unrelated to participant age, specialty, practice characteristics, or previous app use.

DISCUSSION

This is the first validated measure of attitudes toward CME apps among course participants. App usage was higher among younger participants who had previously used educational or professional apps. Additionally, attitudes were more favorable among women and those who had previously used apps. These findings have important implications regarding efforts to engage participants with portable and accessible technology.

Educational Tools: Thinking Outside the Box

The understanding, study, and use of educational tools and their application to the education of adults in professional fields are increasingly important. In this review, we have compiled a description of educational tools on the basis of the teaching and learning setting: the classroom, simulation center, hospital or clinic, and independent learning space. When available, examples of tools used in nephrology are provided. We emphasize that time should be taken to consider the goals of the educational activity and the type of learners and use the most appropriate tools needed to meet the goals. Constant reassessment of tools is important to discover innovation and reforms that improve teaching and learning.