Multiple-Choice versus Open-Ended Questions in Advanced Clinical Neuroanatomy: Using a National Neuroanatomy Assessment to Investigate Variability in Performance Using Different Question Types

Performance of GPT-4 on Chinese Nursing Examination: Potentials for AI-Assisted Nursing Education Using Large Language Models

BACKGROUND

The performance of GPT-4 in nursing examinations within the Chinese context has not yet been thoroughly evaluated.

OBJECTIVE

To assess the performance of GPT-4 on multiple-choice and open-ended questions derived from nursing examinations in the Chinese context.

METHODS

The data sets of the Chinese National Nursing Licensure Examination spanning 2021 to 2023 were used to evaluate the accuracy of GPT-4 in multiple-choice questions. The performance of GPT-4 on open-ended questions was examined using 18 case-based questions.

RESULTS

For multiple-choice questions, GPT-4 achieved an accuracy of 71.0% (511/720). For open-ended questions, the responses were evaluated for cosine similarity, logical consistency, and information quality, all of which were found to be at a moderate level.

CONCLUSION

GPT-4 performed well at addressing queries on basic knowledge. However, it has notable limitations in answering open-ended questions. Nursing educators should weigh the benefits and challenges of GPT-4 for integration into nursing education.

Spot(ters) the difference: Bringing traditional anatomical examinations online

The COVID-19 pandemic caused a shift in anatomy education forcing institutions to find innovative ways to teach and assess online. This study details the development of an online spotter across multiple modules that allowed students to sit the examination at home whilst still maintaining the integrity of the assessment. The online spotter consisted of individual, Zoom calls between students and examiners whereby slides with images and questions were screen shared. To examine the viability of this spotter in non-lockdown scenarios several parameters were considered. Mean marks were compared to traditional versions and Pearson's r correlation coefficients were calculated between online and traditional spotters and between online spotters and overall performance in anatomy modules. A survey was carried out to determine the students' view of the assessment. Pearson's r was between 0.33 and 0.49 when comparing online spotters to the traditional format, and between 0.65 and 0.75 (p < 0.01) when compared to a calculated anatomy score. The survey indicated overall student satisfaction as 82.5% reported that it was a fair way to test their knowledge and 55% reported the same or lower levels of anxiety when compared to traditional spotters. However, there was nothing to indicate that the students preferred this format over laboratory-based spotters. These results indicate that this new exam format would be useful for small cohorts who are undertaking online or hybrid courses, or in circumstances when running a full spotter is too costly, and represents a fair and robust way to assess practical anatomical knowledge online.

Natural product-based pharmacological studies for neurological disorders

Central nervous system (CNS) disorders and diseases are expected to rise sharply in the coming years, partly because of the world's aging population. Medicines for the treatment of the CNS have not been successfully made. Inadequate knowledge about the brain, pharmacokinetic and dynamic errors in preclinical studies, challenges with clinical trial design, complexity and variety of human brain illnesses, and variations in species are some potential scenarios. Neurodegenerative diseases (NDDs) are multifaceted and lack identifiable etiological components, and the drugs developed to treat them did not meet the requirements of those who anticipated treatments. Therefore, there is a great demand for safe and effective natural therapeutic adjuvants. For the treatment of NDDs and other memory-related problems, many herbal and natural items have been used in the Ayurvedic medical system. Anxiety, depression, Parkinson's, and Alzheimer's diseases (AD), as well as a plethora of other neuropsychiatric disorders, may benefit from the use of plant and food-derived chemicals that have antidepressant or antiepileptic properties. We have summarized the present level of knowledge about natural products based on topological evidence, bioinformatics analysis, and translational research in this review. We have also highlighted some clinical research or investigation that will help us select natural products for the treatment of neurological conditions. In the present review, we have explored the potential efficacy of phytoconstituents against neurological diseases. Various evidence-based studies and extensive recent investigations have been included, which will help pharmacologists reduce the progression of neuronal disease.