Serious games are more than just games

Serious games (SG) or educational games are complete games designed for a specific purpose that fulfill both their classic function of entertainment and promote the learning of specific concepts or skills and optimize health care in general. In the pediatric setting, these games combine strategies to educate about health issues, promote healthy behaviors, provide therapy or medical treatment. SG have been shown to promote adherence to treatment in children with chronic diseases, reduce anxiety in those undergoing invasive medical procedures, and stimulate the development of cognitive, emotional, or psychomotor skills. However, it is important to emphasize that the success of SG in pediatrics depends to a large extent on game quality, their design based on clear objectives, and their accurate adaptation to the individual needs and preferences of patients.

A comparative analysis of game-based learning and conventional learning in dental education

OBJECTIVES

To evaluate the efficacy of traditional teaching versus traditional teaching supplemented by serious gaming in imparting knowledge of periodontal indices among dentistry students. Additionally, the study seeks to measure the level of satisfaction among students engaging with the assessed teaching method.

MATERIALS AND METHOD

This comparative study was approved by the ethics committee of the University of Valencia with file number: 2479311. A sample of 61 subjects was divided randomly into two groups: the test group (n = 36) and the control group (n = 25). Baseline knowledge of community index of periodontal treatment need was assessed through a questionnaire completed by both groups before receiving a comprehensive explanation of the topic. The test group, in addition to the conventional explanation, received supplementary training via an educational gaming experience. Both groups underwent a final evaluation and, subsequently, a satisfaction survey was completed by the test group. Descriptive and inferential analyses were performed using a non-parametric Brunner-Langer model. The relationship between scores was examined using Mann-Whitney and Wilcoxon tests, with a significance level set at α = 0.05.

RESULTS

The training, in general, was effective as both the test group (p = 0.003) and the control group (p = 0.015) demonstrated an increase in scores with both teaching modalities, but no significant difference was observed between the groups. The test group expressed a high level of satisfaction with the instructional approach.

CONCLUSION

No statistically significant difference in learning outcomes was identified between the traditional lecture teaching method and the approach supplemented by gaming. There was an elevated level of student satisfaction with the gaming method.

Analysis of occlusal clearance of crown preparations in a predoctoral clinical setting

PURPOSE

This study sought to assess the presence and location of inadequate tooth preparation performed by predoctoral dental students by scanning mounted casts submitted for monolithic zirconia crown fabrication METHODS: An intraoral scanner capable of volumetric measurements of crown preparations was used to analyze 56 crown preparations on mounted stone casts before submission to a lab for crown fabrication. The mounted casts were scanned individually and then a buccal bite was scanned to stitch the models together into virtual occlusion. The distance between the crown preparations and opposing dentition was displayed volumetrically, and the minimum clearance of each preparation was recorded for both the functional and non-functional cusps. Preparations were evaluated for adequate interocclusal clearance and comparisons were made using a Chi-square test with α = 0.05 with respect to tooth location, functional versus nonfunctional cusp, and or single versus multi-unit preparation.

RESULTS

Over 47% of mounted casts with crown preparations analyzed for the study exhibited a lack of occlusal clearance in at least one area. Functional cusps were more often under-reduced than non-functional (p < 0.001). No other comparisons were statistically significant.

CONCLUSIONS

The present study demonstrates a high percentage of under-reduced crown preparations in a predoctoral clinic and emphasizes the utility of quality control and analysis via digital scanning of crown preparations prior to crown fabrication.

Enhancing Lessons on the Internet of Things in Science, Technology, Engineering, and Medical Education with a Remote Lab

Integrating remote Internet of Things (IoT) laboratories into project-based learning (PBL) in higher education institutions (HEIs) while exploiting the approach of technology-enhanced learning (TEL) is a challenging yet pivotal endeavor. Our proposed approach enables students to interact with an IoT-equipped lab locally and remotely, thereby bridging theoretical knowledge with practical application, creating a more immersive, adaptable, and effective learning experience. This study underscores the significance of combining hardware, software, and coding skills in PBL, emphasizing how IoTRemoteLab (the remote lab we developed) supports a customized educational experience that promotes innovation and safety. Moreover, we explore the potential of IoTRemoteLab as a TEL, facilitating and supporting the understanding and definition of the requirements of remote learning. Furthermore, we demonstrate how we incorporate generative artificial intelligence into IoTRemoteLab's settings, enabling personalized recommendations for students leveraging the lab locally or remotely. Our approach serves as a model for educators and researchers aiming to equip students with essential skills for the digital age while addressing broader issues related to access, engagement, and sustainability in HEIs. The practical findings following an in-class experiment reinforce the value of IoTRemoteLab and its features in preparing students for future technological demands and fostering a more inclusive, safe, and effective educational environment.

Evaluation of the Effect of a Mobile Application on Glycated Hemoglobin in Older Adults with Type 2 Diabetes Mellitus-Protocol of a Randomized Clinical Trial

BACKGROUND

Digital educational technologies in health have been an important instrument for promoting learning, self-care, self-esteem, and security regarding prevention and health promotion actions that lead to changes in behavior, mainly for non-communicable disease patients, such as type 2 Diabetes Mellitus (DM 2).

OBJECTIVE

This study aimed to describe a protocol for evaluating the effect of an app for cell phones and tablets on the blood glucose of older adults with DM 2.

METHODS

The protocol will be used to compare the effectiveness of an application for mobile devices concerning the educational booklet in reducing Glycated Hemoglobin in older adults with DM 2 in Primary Health Care. This protocol is part of a Randomized Clinical Trial project entitled Effectiveness of a Mobile Device Application on Glycated Hemoglobin in Elderly People with Type 2 Diabetes Mellitus: a Randomized Clinical Trial.

RESULTS

The protocol was structured in the following phases: (i) sample calculation, (ii) invitation to participate in the study according to the eligibility criteria; (iii) participant registration; (iv) randomization and allocation of participants into groups (double blinding); (v) application of the intervention; (vi) post-intervention procedures (post-test); (vii) data analysis.

CONCLUSION

It is expected that encouraging studies on the impact of a mobile application will improve and enhance health education focused on self-care for older adults with DM 2, potentially influencing the local health system by reducing hospitalizations due to conditions that are sensitive to primary care, since health promotion and prevention of DM-related illnesses will be the main focus of the application and booklet developed.

Exploring barriers to the effective use of computer-based simulation in pharmacy education: a mixed-methods case study

Background

At the University of Tasmania (UTAS), pharmacy education traditionally relies on placements to provide students with hands-on experience. However, these placements have become increasingly limited due to logistical challenges and growing student numbers. Computer-based simulation (CBS) has the potential to offer a scalable, effective alternative to enhance learning and critical thinking. However, integrating CBS in pharmacy education faces several barriers that must be addressed for successful implementation.

Objective

To gain insight into pharmacy educators' and students' views regarding the barriers, and potential solutions, to integrating CBS in pharmacy practice education.

Methods

This mixed-methods case study involved semi-structured interviews with pharmacy educators and quantitative surveys with pharmacy students. The data underwent thematic coding for interview transcripts and statistical analysis for survey responses. The findings were integrated by examining convergence, complementarity, and discrepancy, revealing insights into how pharmacy students and educators perceive implementation barriers and improvement strategies for CBS.

Results

Ten interviews were conducted, and 75 survey responses were collected, with a 62.5% response rate. Key barriers to CBS integration included educators' heavy workload, scepticism about CBS's educational value, and general integration challenges. Students, however, showed high acceptance of CBS, with 70.7% agreeing that CBS could assess their knowledge, 69.3% emphasising its role in developing problem-solving skills, and 80% viewing CBS as a complement to classroom study. Proposed solutions for enhancing CBS uptake included additional institutional support by appointing dedicated simulation technicians, leveraging champions to advocate for CBS, and aligning CBS with educational objectives.

Conclusion

A significant gap between students' readiness and educators' hesitancy to use CBS in pharmacy education was identified. While students are eager to adopt new technologies, educators expressed reservations, primarily due to workload concerns and uncertainties about the efficacy of CBS. The feedback from educators suggests that institutions may see improved uptake by employing dedicated support personnel and initiating targeted training programs. Future research should focus on exploring barriers and facilitators, using larger and more diverse samples, and gaining deeper insights into decision-makers' perspectives to enhance the integration and efficacy of CBS in pharmacy education.

Smart Classrooms: How Sensors and AI Are Shaping Educational Paradigms

The integration of advanced technologies is revolutionizing classrooms, significantly enhancing their intelligence, interactivity, and personalization. Central to this transformation are sensor technologies, which play pivotal roles. While numerous surveys summarize research progress in classrooms, few studies focus on the integration of sensor and AI technologies in developing smart classrooms. This systematic review classifies sensors used in smart classrooms and explores their current applications from both hardware and software perspectives. It delineates how different sensors enhance educational outcomes and the crucial role AI technologies play. The review highlights how sensor technology improves the physical classroom environment, monitors physiological and behavioral data, and is widely used to boost student engagements, manage attendance, and provide personalized learning experiences. Additionally, it shows that combining sensor software algorithms with AI technology not only enhances the data processing and analysis efficiency but also expands sensor capabilities, enriching their role in smart classrooms. The article also addresses challenges such as data privacy protection, cost, and algorithm optimization associated with emerging sensor technologies, proposing future research directions to advance educational sensor technologies.

Software evaluation on infant development to support teaching and professional training

OBJECTIVE

evaluate the functional performance and technical quality of the Wise Infant Development® educational software with experts.

METHOD

methodological research that followed the software evaluation process according to the ISO/IEC 25010 and NBR ISO-IEC 14598-6 standards. The software's functional performance was assessed by a group of nurse experts and its technical quality by information technology experts. The Content Validity Index and the Binomial test were used for statistical analysis.

RESULTS

in both expert groups, agreement was greater than 70%, indicating that the software is suitable and pertinent to what was proposed in all its evaluated characteristics: functional suitability, reliability, usability, performance efficiency, compatibility, security, maintainability, and portability. The technology received suggestions for improvement, which were accepted.

CONCLUSION

the Wise Infant Development® software was well evaluated by the experts and could contribute to teaching about infant development, both in undergraduate nursing courses and in professional training.

HIGHLIGHTS

(1) The software presents satisfactory technical quality and functional performance. (2) Technology is useful in the students' teaching-learning process. (3) The software can be used to train child health professionals.

The Evolving Stethoscope: Insights Derived from Studying Phonocardiography in Trainees

Phonocardiography (PCG) is used as an adjunct to teach cardiac auscultation and is now a function of PCG-capable stethoscopes (PCS). To evaluate the efficacy of PCG and PCS, the authors investigated the impact of providing PCG data and PCSs on how frequently murmurs, rubs, and gallops (MRGs) were correctly identified by third-year medical students. Following their internal medicine rotation, third-year medical students from the Georgetown University School of Medicine completed a standardized auscultation assessment. Sound files of 10 different MRGs with a corresponding clinical vignette and physical exam location were provided with and without PCG (with interchangeable question stems) as 10 paired questions (20 total questions). Some (32) students also received a PCS to use during their rotation. Discrimination/difficulty indexes, comparative chi-squared, and McNemar test p-values were calculated. The addition of phonocardiograms to audio data was associated with more frequent identification of mitral stenosis, S4, and cardiac friction rub, but less frequent identification of ventricular septal defect, S3, and tricuspid regurgitation. Students with a PCS had a higher frequency of identifying a cardiac friction rub. PCG may improve the identification of low-frequency, usually diastolic, heart sounds but appears to worsen or have little effect on the identification of higher-frequency, often systolic, heart sounds. As digital and phonocardiography-capable stethoscopes become more prevalent, insights regarding their strengths and weaknesses may be incorporated into medical school curricula, bedside rounds (to enhance teaching and diagnosis), and telemedicine/tele-auscultation efforts.

A Quarter-Century of Online Informatics Education: Learners Served and Lessons Learned

The value and methods of online learning have changed tremendously over the last 25 years. The goal of this paper is to review a quarter-century of experience with online learning by the author in the field of biomedical and health informatics, describing the learners served and the lessons learned. The author details the history of the decision to pursue online education in informatics, describing the approaches taken as educational technology evolved over time. A large number of learners have been served, and the online learning approach has been well-received, with many lessons learned to optimize the educational experience. Online education in biomedical and health informatics has provided a scalable and exemplary approach to learning in this field.

Educational technology for multidisciplinary training for managing waiting lists for elective patients

OBJECTIVES

to construct and assess an educational technology for managing patient waiting lists for multidisciplinary training.

METHODS

study supported by Instructional Design - ADDIE model, whose stages of construction of educational technology were developed in the form of a multi-professional training course. Its respective content assessment was carried out by a committee of experts from 2021 to 2022. The analysis occurred based on the proportion of content adequacy with 95% Confidence Interval.

RESULTS

seventeen products were created as educational technology learning objects: five storyboards; four videos; three comic books; two pedagogical action plans; a mind map; and a YouTube® playlist. Nine experts assessed content adequacy, which reached 0.89.

CONCLUSIONS

this educational technology contributes to the performance of professionals who manage waiting lists by reducing inequalities, alleviating differences, in addition to promoting equity in care and good health for patients in the Brazilian Health System.

Profile of scientific production on nursing technology construction, validity and application: a bibliometric study

OBJECTIVE

to analyze the profile of scientific production on nursing technology construction, validity and application.

METHODS

this is a bibliometric study, carried out in six databases, based on the Methodi Ordinatio application, arranged in nine stages. To represent the findings, the VOSviewer® software was used.

RESULTS

346 studies were identified, obtained from BDENF, CINAHL, EMBASE, LILACS, PubMed/MEDLINE, Scopus and Web of Science. There was a predominance of the English language, and 20% of the authors hold more than 25% of studies. Only two journals account for 25% of studies in the period studied. Twenty-six studies were selected for the InOrdinatio classification. Nursing Process (23%) stood out among the studies. The most produced technology was software (27%), and 50% of works describe construction and validity.

CONCLUSIONS

there is an emphasis on the creation of educational technologies, especially information technology. The data demonstrates opportunities for future research in the area.

Development and integration of a clinical dashboard within a dental school setting

PURPOSE

To describe the development and integration of an electronic health record-driven, student dashboard that displays real-time data relative to the students' patient management and clinic experiences at the University of Illinois Chicago, College of Dentistry.

MATERIALS AND METHODS

Following development and implementation of the student dashboard, various objective metrics were evaluated to identify any improvements in the clinical patient management. A cross-sectional retrospective chart review was completed of the electronic health record (axiUm, Exan, Coquitlam, BC, Canada) from January 2019 to April 2022 evaluating four performance metrics: student lockouts, note/code violations, overdue active patients, and overdue recall patients. Descriptive statistics were analyzed. The Kolmogorov-Smirnov test was applied to assess the normal distribution of data. Data were analyzed by the Kruskal-Wallis tests for potential differences between pre-dashboard and post-dashboard implementation years with the mean overdue active/recall patient to student ratio variables. Mann-Whitney U-tests for between-groups comparisons with Bonferroni correction for multiple comparisons were performed (α = 0.05). Descriptive statistics were performed to analyze the student utilization frequency of the dashboard.

RESULTS

Post-implementation analysis indicated a slight decrease in the number of lockouts and note/code violation; and a statistically significant decrease in overdue active patients post-dashboard (P < 0.001). On average, students accessed their dashboards 3.3 times a week.

CONCLUSIONS

Implementation of a student dashboard through the electronic health record platform within an academic dental practice has the potential to assist students with patient management and is utilized regularly by the students.

Advancing dental care access for patients with disabilities: A global scoping review of predoctoral training

OBJECTIVE

To examine predoctoral training programs that address the unique needs of patients with special healthcare needs (SHCN) and provide an overview of current global training initiatives, while exploring innovative approaches to enhance dental students' preparation in managing SHCN patients.

METHODS

A scoping review (SR) was conducted focusing on three key concepts: dental education, pre-doctoral training, and intellectual disability/developmental disability. The search encompassed five databases including Medline, Embase, Dentistry and Oral Sciences Source (EBSCO), Global Health (EBSCO), and WHO Global Index Medicus, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. EndNote and Covidence were utilized to prevent duplication and facilitate title/abstract screening.

RESULTS

After screening abstracts, a total of 2309 articles were initially identified with 28 articles meeting eligibility criteria for data extraction relevant to the research question. Two major categories characterized the key findings included in the review: 12 interventional studies and 16 perception-based studies.

CONCLUSION

This SR revealed that dental students are not adequately trained to treat special needs populations; consequentially, dental students lack confidence in providing high-quality care to this demographic. The absence of standardized training poses a global challenge, exacerbating care disparities. Addressing this issue is crucial to better prepare dental students and advance equitable access and quality care for underserved populations.

Development of a Website for Disseminating Knowledge About listening Effort for Professionals

Introduction  Permanent education in health aims to ensure that professionals are constantly learning in the workplace and in the last few years institutions resorted to the technology-mediated education modality and new teaching possibilities were explored. In Brazil, between 2017 and 2021, only six articles and five monographs were published about listening effort. Objective  The objective of this study was to develop a website with scientific content on the topic listening effort for Speech -Language Therapist and Audiologist with free online access. Methods  The study was carried out in five stages: Analysis, contemplating the search for scientific materials to prepare the material. Design, in which the writing and design of the website was carried out. Development, carrying out the adequacy of the online material. Implementation, a stage in which professionals in the area evaluated the quality of the material after consenting to participation through a free and informed consent term. Review, stage in which the researcher analyzed the evaluators' responses. Results  The five stages of elaboration of the website were carried out, which was evaluated by professionals in the area. The average of responses to all applied questions rated the website as "superior". Conclusion  The website development was validated for online availability.

The effect of augmented reality book on the proficiency of local anesthesia administration of the inferior alveolar nerve

BACKGROUND/OBJECTIVE

Advancements in augmented reality (AR) technology enable developers to create augmented reality books (AR Books). AR Books can show interactive 3D objects and multimedia content to the user. The purpose of this study was to investigate the effect of a developed AR Book on the theoretical and practical abilities in the administration of local anesthesia of the inferior alveolar nerve block.

METHODS

An exclusive AR Book was developed based on Chapter 14, Handbook of Local Anesthesia, seventh edition, Stanley F. Malamed, which enabled students to use their book (printed or electronic) as an AR Book. Forty dental students were randomly divided into control and study groups. In the control group, students were asked to use regular books, while in the study group, students were instructed to use interactive AR Books. All students took the written exam, scoring 0 to 10. Also, the administration of mandibular local anesthesia was evaluated in students. The level of concentration during the study, the written exam score, the practical score, the success rate of local anesthesia, and the needed time for injection were compared between the two groups.

RESULTS

There was a significant difference in the level of concentration during the study (p < 0.001), practical skill score (p = 0.037), and needed time for injection (p = 0.040) between the two groups. Conversely, the success rate of local anesthesia was almost similar (p = 0.705). Although the written exam score was higher in the study group than in the control group, the difference was not significant (p = 0.414).

CONCLUSION

Using AR Books can engage students and help them to remain focused during the study. AR Books may be beneficial in enhancing the practical abilities of dental students.

Website for families of non-breastfed children: development and validation of content and interface

OBJECTIVES

to develop and validate the content and interface of a guidance website to support families in promoting Food and Nutrition Security for children under six months who are not breastfed.

METHODS

methodological study, Knowledge Translation, in two stages of creation: 1) content and validation on the criterion of accuracy in a panel of experts; 2) interface and validation on the criteria of content, language, illustrations, layout, motivation, culture and applicability.

RESULTS

the "Milky Way" website is freely available: https://www.ufsm.br/pet/ciencia-da-computacao/alimentacao-lactea. The content was structured in a decision tree made up of types of milk: milk formula, whole cow's milk and powdered milk; and utensils: bottle, cup and measuring spoon. There were 46 illustrations to elucidate the content, facilitate understanding and engage the target population. The Content Validity Index was 0.91.

CONCLUSIONS

the website is a validated technology with evidence-based written and pictorial content translated for use with families.

Health education website on home care for newborns: construction, validation, and evaluation

OBJECTIVE

to build, validate, and evaluate an educational health website on home care for newborns for use by pregnant women, postpartum women, and family members.

METHOD

methodological study developed according to the Analyze, Design, Develop, Implement, and Evaluate model. After construction, the website was validated by 20 experts and evaluated by 20 individuals from the target audience, and the data wasanalyzed according to the Concordance Index with a cut-off point equal to or greater than 0.7 (70%).

RESULTS

in the validation, the Concordance Index for all the items was higher than 0.7 (70%), with a variation between 0.75 (75%) and 1 (100%), reaching an overall average value of 0.91 (91%). In the evaluation, all the items got top marks, with anoverall average value of 1 (100%).

CONCLUSION

the educational website was built, validated, and evaluated in a satisfactory manner. It can be considered an appropriate tool for its purpose, with benefits in the teaching-learning process for families regarding postnatal home care fornewborns through its use. It can also be used to educate students and health professionals. The website is available for free access via laptops, computers, smartphones, or tablets.

Construction and Validation of an Educational Technology to Promote the Health of Postmenopausal Women with Dry Eye Syndrome

The climacteric heralds a transition from reproductive to non-reproductive life in women, often accompanied by various clinical manifestations such as dry eye, impacting their quality of life. This study focuses on systematically developing and suitability an educational digital booklet to promote eye health practices and prevent problems among postmenopausal women. The methodological approach encompassed semi-structured interviews with women diagnosed with Dry Eye Syndrome (DES), then constructing the material integrating content, script, illustrations, and layout informed by the interview findings. Subsequent validation involved assessment by 24 health experts for content, appearance, and evaluation by a target audience of 22 women. The booklet attained high suitability scores, with a Global Content Validity Index (CVI) of 0.96, indicating superior suitability as judged by experts. Additionally, it achieved a Global CVI of 0.98 for validation by the target audience. In conclusion, the educational booklet emerges as a suitable and reliable resource for promoting eye heath among DES and non-syndrome women, offering significant potential for broader application in relevant populations.

Educational technology to promote self-efficacy in newborn care: a validation study

Objective

To build and validate an educational technology consisting of a flipchart to promote self-efficacy in newborn care.

Methods

A methodological study was carried out in two stages: (i) creation of the flipchart and (ii) validation by 25 experts and 50 people who could be the target audience (pregnant women, mothers or family members of newborns). Clarity, language, practical relevance and theoretical relevance were reviewed using the Suitability Assessment of Materials (SAM) instrument. The Content Validity Index and the Flesch Readability Index were calculated.

Results

The serial album "Can you take care of your baby" consists of 30 pages. The overall Content Validity Index was 0.93 among experts and 1.0 among the target audience. The flipchart was considered superior quality material, reaching an agreement percentage of 94.9, indicating that it is suitable as an educational technology. Participants suggested adjustments, incorporated into the material for printed production.

Conclusion

The flipchart developed and with content validated by experts is suitable for use in health education activities that aim to promote self-efficacy in caring for newborns.

Assessment of educational technology in lactation physiology by health students

OBJECTIVES

to assess the suitability, facilitators, and barriers of using a video clip for teaching lactation physiology to health students.

METHODS

a cross-sectional study was conducted with online data collection at a higher education institution, using the Assistive Technology Assessment Instrument and open-ended questions. The sample consisted of 88 students.

RESULTS

the video clip was deemed suitable in all attributes. Facilitators identified included attractiveness, musicality, and ease of access. Barriers noted were the music's speed and the necessity for prior knowledge. The video clip achieved adequate scores for interactivity (1.71), purpose (1.77), relevance (1.64), and clarity (1.77). The overall average of the attributes was 1.72.

CONCLUSIONS

the video clip can serve as an effective learning strategy to enhance hybrid education, potentially contributing to the promotion and support of breastfeeding. However, some barriers underscore the importance of prior knowledge for a complete understanding of the content.

Effectiveness of "Escape Room" Educational Technology in Nurses' Education: A Systematic Review

Escape room games are educational gamification technologies that consist of introducing a team of players into a physical or digital space in search of clues to answer puzzles, riddles or enigmas and solve a mystery or problem. This study aims to determine the effectiveness of escape room games on the training of nursing students in an international context. A systematic review was carried out in MEDLINE, WOS, SCOPUS, CINAHL and LILACS databases using the MeSH terms "Education, Nursing" and "Educational Technology", and the free term "Escape room", combined with Boolean operators AND/OR. Intervention studies in Spanish, English and Portuguese were included, without limitation for the year of publication. Selection and critical appraisal were conducted by two independent reviewers. A total of n = 13 interventional studies were included (n = 2 Randomized Clinical Trials and n = 11 quasi-experimental design). Escape rooms are a recent and growing educational methodology, increasingly used in academia and in the training of nurses and nursing students. However, it is necessary to expand their use and the quality of the studies in a greater number of contexts. Furthermore, it is necessary to homogenize and standardize validated instruments to evaluate the effectiveness of escape rooms in the nursing education area.

Enhancing educational technology practical course: Designing and validating tools for evaluating knowledge, performance, and satisfaction of public health students

Background

The present study was conducted with the aim of designing and validating questionnaires for evaluating the public health students' knowledge, performance, and satisfaction (KPS) in the course of educational technology.

Methods

The present study was conducted with qualitative-quantitative approach. Qualitative stage was done based on experts' opinion and related articles and questionnaires for developing, designing, and validating the tools. For validating the tools, face validity and content validity was done based on the opinion of the 10 expert panel. In quantitative stage, all initial validated tools were implemented on 50 students of public health for determining the reliability. The reliability of the tools was calculated using the internal consistency method of the items with Cronbach's ⍺ coefficient, and Kuder-Richardson. All analyses were conducted using SPSS-19 software.

Results

In the field of qualitative research, an assessment tool consisting of 20 four-option questions was designed. The content validity of this tool was confirmed based on the opinions of 10 educational experts, with CVI Total = 0.862 and CVR = 0.885. Additionally, the reliability of the tool was validated through testing on 50 public health students, resulting in a reliability coefficient of r = 0.780. Furthermore, for performance evaluation, four assessment tools each comprising 20 questions (totaling 80 questions) were designed. The validity values for these tools in the areas of PowerPoint (CVI = 0.981, CVR = 0.960), pamphlet (CVI = 0.866, CVR = 0.877), poster (CVI = 0.871, CVR = 0.906), role-playing (CVI = 0.871, CVR = 0.980), and the reliability of the tools with Cronbach's ⍺ r > 0.80 were confirmed. In the satisfaction assessment section, a researcher-made questionnaire consisting of 18 questions across seven domains was designed, with confirmed content validity (CVI = 0.949, CVR = 0.861) and reliability (r = 0.928).

Conclusions

It seems that this tool can be used to measure the KPS of students from the educational technology course of the health field and similar fields.

Efficacy of a Technology-Based Early Language Comprehension Intervention: A Randomized Control Trial

We examined the efficacy of a Technology-Based Early Language Comprehension Intervention (TeLCI) designed to teach inferencing in a non-reading context. A group of Grades 1 and 2 students from 2 elementary schools in the U.S. Midwest identified as at risk of comprehension difficulties were assigned randomly to a business-as-usual control group or to use TeLCI over an 8-week period. TeLCI comprised three learning modules per week that involved (a) learning new vocabulary, (b) watching fiction or nonfiction videos, and (c) answering inferential questions. Students also engaged in small-group read-alouds with their teachers once per week. Students who experienced TeLCI improved their inferencing and benefited from scaffolding and feedback provided during the intervention. Students' pre- to posttest inferencing gains were comparable with those of control students. Female students and those receiving special education services appeared less likely to benefit from TeLCI, whereas multilingual students were more likely to respond. Further work is needed to determine the optimal conditions under which TeLCI will benefit young children.

Exploring the Performance of ChatGPT-4 in the Taiwan Audiologist Qualification Examination: Preliminary Observational Study Highlighting the Potential of AI Chatbots in Hearing Care

Background

Artificial intelligence (AI) chatbots, such as ChatGPT-4, have shown immense potential for application across various aspects of medicine, including medical education, clinical practice, and research.

Objective

This study aimed to evaluate the performance of ChatGPT-4 in the 2023 Taiwan Audiologist Qualification Examination, thereby preliminarily exploring the potential utility of AI chatbots in the fields of audiology and hearing care services.

Methods

ChatGPT-4 was tasked to provide answers and reasoning for the 2023 Taiwan Audiologist Qualification Examination. The examination encompassed six subjects: (1) basic auditory science, (2) behavioral audiology, (3) electrophysiological audiology, (4) principles and practice of hearing devices, (5) health and rehabilitation of the auditory and balance systems, and (6) auditory and speech communication disorders (including professional ethics). Each subject included 50 multiple-choice questions, with the exception of behavioral audiology, which had 49 questions, amounting to a total of 299 questions.

Results

The correct answer rates across the 6 subjects were as follows: 88% for basic auditory science, 63% for behavioral audiology, 58% for electrophysiological audiology, 72% for principles and practice of hearing devices, 80% for health and rehabilitation of the auditory and balance systems, and 86% for auditory and speech communication disorders (including professional ethics). The overall accuracy rate for the 299 questions was 75%, which surpasses the examination's passing criteria of an average 60% accuracy rate across all subjects. A comprehensive review of ChatGPT-4's responses indicated that incorrect answers were predominantly due to information errors.

Conclusions

ChatGPT-4 demonstrated a robust performance in the Taiwan Audiologist Qualification Examination, showcasing effective logical reasoning skills. Our results suggest that with enhanced information accuracy, ChatGPT-4's performance could be further improved. This study indicates significant potential for the application of AI chatbots in audiology and hearing care services.