ChatGPT's adherence to otolaryngology clinical practice guidelines

OBJECTIVES

Large language models, including ChatGPT, has the potential to transform the way we approach medical knowledge, yet accuracy in clinical topics is critical. Here we assessed ChatGPT's performance in adhering to the American Academy of Otolaryngology-Head and Neck Surgery guidelines.

METHODS

We presented ChatGPT with 24 clinical otolaryngology questions based on the guidelines of the American Academy of Otolaryngology. This was done three times (N = 72) to test the model's consistency. Two otolaryngologists evaluated the responses for accuracy and relevance to the guidelines. Cohen's Kappa was used to measure evaluator agreement, and Cronbach's alpha assessed the consistency of ChatGPT's responses.

RESULTS

The study revealed mixed results; 59.7% (43/72) of ChatGPT's responses were highly accurate, while only 2.8% (2/72) directly contradicted the guidelines. The model showed 100% accuracy in Head and Neck, but lower accuracy in Rhinology and Otology/Neurotology (66%), Laryngology (50%), and Pediatrics (8%). The model's responses were consistent in 17/24 (70.8%), with a Cronbach's alpha value of 0.87, indicating a reasonable consistency across tests.

CONCLUSIONS

Using a guideline-based set of structured questions, ChatGPT demonstrates consistency but variable accuracy in otolaryngology. Its lower performance in some areas, especially Pediatrics, suggests that further rigorous evaluation is needed before considering real-world clinical use.

How Does ChatGPT Perform on the Italian Residency Admission National Exam Compared to 15,869 Medical Graduates?

PURPOSE

The study aims to assess ChatGPT performance on the Residency Admission National Exam to evaluate ChatGPT's level of medical knowledge compared to graduate medical doctors in Italy.

METHODS

ChatGPT3 was used in June 2023 to undertake the 2022 Italian Residency Admission National Exam-a 140 multiple choice questions computer-based exam taken by all Italian medical graduates yearly, used to assess basic science and applied medical knowledge. The exam was scored using the same criteria defined by the national educational governing body. The performance of ChatGPT was compared to the performance of the 15,869 medical graduates who took the exam in July 2022. Lastly, the integrity and quality of ChatGPT's responses were evaluated.

RESULTS

ChatGPT answered correctly 122 out of 140 questions. The score ranked in the top 98.8th percentile among 15,869 medical graduates. Among the 18 incorrect answers, 10 were evaluating direct questions on basic science medical knowledge, while 8 were evaluating candidates' applied clinical knowledge and reasoning under the form of case presentation. Errors were logical (2 incorrect answers) and informational in nature (16 incorrect answers). Explanations to the correct answers were all evaluated as "appropriate." Comparison to national statistics related to the minimal score needed to match into each specialty, demonstrated that the performance of ChatGPT would have granted the candidate a match into any specialty.

CONCLUSION

ChatGPT proved to be proficient in basic science medical knowledge and applied clinical knowledge. Future research should assess the impact and reliability of ChatGPT in clinical practice.

Cost awareness among intensivists in their daily clinical practice: a prospective multicentre study

BACKGROUND

Better cost-awareness is a prerogative in achieving the best benefit/risk/cost ratio in the care. We aimed to assess the cost-awareness of intensivists in their daily clinical practice and to identify factors associated with accurate estimate of cost (50-150% of the real cost).

METHODS

We performed a prospective observational study in seven French ICUs. We compared the estimate of intensivists of the daily costs of caring with the real costs on a given day. The estimates covered five categories (drugs, laboratory tests, imaging modalities, medical devices, and waste) whose sum represented the overall cost.

RESULTS

Of the 234 estimates made by 65 intensivists, 70 (29.9%) were accurate. The median overall cost estimate (€330 [170; 620]) was significantly higher than the real cost (€178 [124; 239], p < 0.001). This overestimation was found in four categories, in particular for waste (€40 [15; 100] vs. €1.1 [0.6; 2.3], p < 0.001). Only the laboratory tests were underestimated (€65 [30; 120] vs. €106 [79; 138], p < 0.001). Being aware of the financial impact of prescriptions was factor associated with accurate estimate (OR: 5.05, 95%CI:1.47-17.4, p = 0.01). However, feeling able to accurately perform estimation was factor negatively associated with accurate estimate (OR: 0.11, 95%CI: 0.02-0.71, p = 0.02).

CONCLUSION

French intensivists have a poor awareness of costs in their daily clinical practice. Raising awareness of the financial impact of prescriptions, and of the cost of laboratory tests and waste are the main areas for improvement that could help achieve the objective of the best care at the best cost.

Enhancing Human Papillomavirus Vaccination Rates through Better Knowledge? Insights from a Survey among German Medical Students

INTRODUCTION

Vaccination against human papillomavirus (HPV) significantly reduces the risk for malignant diseases like cervix, anal, or penile cancer. However, although vaccination rates are rising, they are still too low mirroring a lack of disease awareness in the community. This study aims to evaluate knowledge about HPV vaccination as well as the vaccination rate among German medical students.

MATERIAL AND METHODS

Medical students were surveyed during a German medical students' sports event. The self-designed survey on HPV vaccination consisted of 24 items. The data collection was anonymous.

RESULTS

Among 974 participating medical students 64.9% (632) were women, 335 (34.4%) were male and 7 (0.7%) were nonbinary. Mean age was 23.1 ± 2.7 (± standard deviation; range 18-35) years. Respondents had studied mean 6.6 ± 3.3 (1-16) semesters and 39.4% (383) had completed medical education in urology. 613 (64%) respondents reported that HPV had been discussed during their studies. 7.6% (74) had never heard of HPV. In a multivariate model female gender, the knowledge about HPV, and having worked on the topic were significantly associated with being HPV-vaccinated. Older students were vaccinated less likely.

CONCLUSIONS

Better knowledge and having worked on the topic of HPV were associated with a higher vaccination rate. However, even in this highly selected group the knowledge about HPV vaccination was low. Consequently, more information and awareness campaigns on HPV vaccination are needed in Germany to increase vaccination rates.

A method for structuring complex clinical knowledge and its representational formalisms to support composite knowledge interoperability in healthcare

INTRODUCTION

The use and interoperability of clinical knowledge starts with the quality of the formalism utilized to express medical expertise. However, a crucial challenge is that existing formalisms are often suboptimal, lacking the fidelity to represent complex knowledge thoroughly and concisely. Often this leads to difficulties when seeking to unambiguously capture, share, and implement the knowledge for care improvement in clinical information systems used by providers and patients.

OBJECTIVES

To provide a systematic method to address some of the complexities of knowledge composition and interoperability related to standards-based representational formalisms of medical knowledge.

METHODS

Several cross-industry (Healthcare, Linguistics, System Engineering, Standards Development, and Knowledge Engineering) frameworks were synthesized into a proposed reference knowledge framework. The framework utilizes IEEE 42010, the MetaObject Facility, the Semantic Triangle, an Ontology Framework, and the Domain and Comprehensibility Appropriateness criteria. The steps taken were: 1) identify foundational cross-industry frameworks, 2) select architecture description method, 3) define life cycle viewpoints, 4) define representation and knowledge viewpoints, 5) define relationships between neighboring viewpoints, and 6) establish characteristic definitions of the relationships between components. System engineering principles applied included separation of concerns, cohesion, and loose coupling.

RESULTS

A "Multilayer Metamodel for Representation and Knowledge" (M*R/K) reference framework was defined. It provides a standard vocabulary for organizing and articulating medical knowledge curation perspectives, concepts, and relationships across the artifacts created during the life cycle of language creation, authoring medical knowledge, and knowledge implementation in clinical information systems such as electronic health records (EHR).

CONCLUSION

M*R/K provides a systematic means to address some of the complexities of knowledge composition and interoperability related to medical knowledge representations used in diverse standards. The framework may be used to guide the development, assessment, and coordinated use of knowledge representation formalisms. M*R/K could promote the alignment and aggregated use of distinct domain-specific languages in composite knowledge artifacts such as clinical practice guidelines (CPGs).

Evaluation of a fertility awareness-based shared decision-making tool part 1: Study design and impact on clinician knowledge

Objective

To assess the impact of a Shared Decision-Making (SDM) tool for fertility awareness-based methods (FABMs) of family planning.

Methods

Clinicians familiar with at least one FABM were randomly invited to participate in a prospective cross-over study to compare usual practice to the use of the SDM tool when discussing FABMs with patients. Patients completed surveys pre- and post-office visit and six months later. The primary outcome explored the effect of online education on use of the SDM tool on clinicians' knowledge of FABMs.

Results

Of 278 clinicians contacted, 54% could not be reached, and 15% did not provide women's health services. The 26 clinicians enrolled were experienced, with more than half recommending FABMs for ≥10 years, and 73% recommending more than one FABM to patients. Knowledge scores significantly improved after online training and use of the SDM tool (baseline mean score = 9.54 (scale of 0-12); post-training mean score = 10.73, p < 0.002).

Conclusions

Education about FABMs and training on use of the SDM tool improved knowledge scores even among an experienced cohort of clinicians.

Innovation

The novel SDM tool can better equip clinicians to meet the rising patient interest in FABMs.

Knowledge of neonatal brachial plexus palsy among medical professionals in North America

PURPOSE

Early referral of neonatal brachial plexus palsy (NBPP) patients to multidisciplinary clinics is critical for timely diagnosis, treatment, and improved functional outcomes. In Saudi Arabia, inadequate knowledge regarding NBPP is a reason for delayed referral. We aimed to evaluate the knowledge of North American healthcare providers (HCPs) regarding the diagnosis, management, and prognosis of NBPP.

METHODS

A 12-question survey regarding NBPP was distributed via electronic and paper formats to North American providers from various referring and treating specialties. NBPP knowledge was compared between Saudi Arabian vs. North American providers, referring vs. treating specialties, academic vs. community hospitals, and providers with self-reported confidence vs. nonconfidence in NBPP knowledge.

RESULTS

Of the 273 surveys collected, 45% were from referring providers and 55% were from treating providers. Saudi Arabian and North American HCPs demonstrated similar NBPP knowledge except for potential etiologies for NBPP and surgery timing. In North America, referring and treating providers had similar overall knowledge of NBPP but lacked familiarity with its natural history. A knowledge gap existed between academic and community hospitals regarding timing of referral/initiation of physical/occupational therapy (PT/OT) and Horner's syndrome. Providers with self-reported confidence in treating NBPP had greater knowledge of types of NBPP and timing for PT/OT initiation.

CONCLUSIONS

Overall, North American providers demonstrated adequate knowledge of NBPP. However, both eastern and western physicians remain overly optimistic in believing that most infants recover spontaneously. This study revealed a unique and universal knowledge gap in NBPP diagnosis, referral, and management worldwide. Continuous efforts to increase NBPP knowledge are indicated.

Using the Flipped Classroom Model in Surgical Education: Efficacy and Trainee Perception

OBJECTIVE

To describe the feasibility, efficacy, and learner perception of the flipped classroom model for teaching conferences within surgical training programs.

DESIGN

For the flipped classroom conferences, video lectures were prepared by a faculty member, and sent to all attendees at least 2 days prior to lecture. The conference time was then spent going over cases and questions, rather than traditional lecture. We conducted a qualitative survey to assess learner's perceptions and pre-lecture quizzes to assess trainee preparedness.

SETTING

The comparison of pre-conference quizzes between flipped classroom and traditional models was carried out at Brooke Army Medical Center (BAMC) in San Antonio, TX, a tertiary care facility with a general surgery residency program. The survey was conducted at BAMC and within the Complex General Surgical Oncology fellowship program at University of Texas MD Anderson Cancer Center, where a flipped classroom model was similarly employed.

PARTICIPANTS

Surgical residents BAMC participated in pre-lecture quizzes. BAMC residents and MD Anderson fellows were invited to complete the online survey.

RESULTS

Lecture videos did not increase mean preparation time (1.53 vs. 1.46 hours without vs. with video, p = 0.858), but did increase mean quiz scores from 67% to 80% (p = 0.031) with 32/35 learners utilizing videos. Videos increased the proportion of learners who self-reported preparing at all from 42% to 95% (p = 0.28), and preparing for at least one hour for conference from 23% to 49% (p = 0.014). Of survey respondents, 90% said videos were very helpful, 90% would use them weekly if available, and 90% prefer this format to traditional lecture.

CONCLUSIONS

Utilization of a flipped classroom method was well received and preferred by surgical trainees, and it increased performance on pre-conference quizzes without increasing preparation time. Although creation of video lectures is work-intensive for lecturers, these results suggest it is more effective for learner preparation. These results could be generalizable to surgical residents nationwide as technology utilization increases in surgical education.

KeMRE: Knowledge-enhanced medical relation extraction for Chinese medicine instructions

Medicine instructions usually contain rich medical relations, and extracting them is very helpful for many downstream tasks such as medicine knowledge graph construction and medicine side-effect prediction. Existing relation extraction (RE) methods usually predict relations between entities from their contexts and do not consider medical knowledge. However, understanding a part of medical relations may need some expert knowledge in the medical field, making it challenging for existing methods to achieve satisfying performances of medical RE. In this paper, we propose a knowledge-enhanced framework for medical RE, which can exploit medical knowledge of medicines to better conduct medical RE on Chinese medicine instructions. We first propose a BERT-CNN-LSTM based framework for text modeling and learn representations of characters from their contexts. Then we learn representations of each entity by aggregating representations of their characters. Besides, we propose a CNN-LSTM based framework for entity modeling and learn entity representations from their relatedness. In addition, there are usually many different instructions for the same medicine, which usually share general knowledge on this medicine. Thus, to obtain medical knowledge of medicines, we annotate relations on a randomly-sampled instruction of each medicine. Then we build knowledge embeddings to represent potential relations between entities from knowledge of medicines. Finally, we use an MLP network to predict relations between entities from their representations and knowledge embeddings. Extensive experiments on a real-world dataset show that our method can significantly outperform existing methods.

Are different medical school admission tests associated with the outcomes of a simulation-based OSCE?

BACKGROUND

Medical school admission procedures have the common goal to select applicants with the greatest potential of becoming successful physicians. Hamburg Medical Faculty selects medical students by grade point average (GPA) and employs a two-step selection process of a natural sciences test (HAM-Nat), in some cases followed by multiple mini-interviews (HAM-Int). Multiple mini-interviews can predict non-cognitive outcomes, while GPA has predictive validity for cognitive outcomes. The aim of our study was to explore communication skills and clinical knowledge of advanced medical students according to their respective admission procedure.

METHODS

In July 2019, 146 students grouped according to their admission procedure into GPA-only (19.2 %), HAM-Nat (33.6 %), HAM-Int (30.8 %), and Waiting List (16.4 %) participated in four OSCE stations which equally assessed students' communication skills (OSCE part 1) and clinical knowledge (OSCE part 2) in simulated patient encounters, rated by physicians with checklists. Additionally, psychosocial assessors ranked communication skills with a global rating scale (GR). The students also participated in a multiple choice (MC) exam testing clinical knowledge. Kruskal-Wallis analyses of variance of test performance and Spearman correlation of instruments were calculated.

RESULTS

Students from the Waiting List group performed significantly worse on the MC exam compared to GPA-only and HAM-Int (adjusted p = .029 and 0.018, respectively). No significant differences were found between the admission groups with respect to communication skills. Global Rating and OSCE part 1 (communication) correlated significantly (ρ = 0.228, p = .006) as did OSCE part 2 (clinical knowledge) and MC exam (ρ = 0.242, p = .003), indicating criterion validity. Constructs did not overlap, indicating divergent validity.

CONCLUSIONS

Advanced medical students selected for undergraduate studies by multiple mini-interviews assessing psychosocial skills showed similar communication skills compared to students admitted to medical school by other entryways. It is unclear whether these similarities are due to an effective undergraduate longitudinal communication curriculum. Assessing baseline communication skills of all medical students at entry-level may aid with this question.

Let's Not Throw the Baby Out with the Bath Water - Keep the ABSITE a Numerically Scored Exam

The American Board of Surgery In-Training Examination (ABSITE) is a low-stakes, validated, objective measure of the medical knowledge of our surgical residents and is an important predictor of ABS Qualifying Exam (QE) passage. It was never intended to serve as a global assessment of resident performance or aptitude, to assess any competency other than medical knowledge, or to serve as the sole criterion by which to judge resident promotion to the next PGY level. Though the scoring of the ABSITE and the use of the exam by some PDs and fellowship directors may be imperfect, let's not throw the baby out with the bath water and destroy the utility of the ABSITE by changing its grading to pass/fail. Rather, let's set rigorous, high standards for our residents in preparation for the ABSITE, as well as for PDs and fellowship directors in the proper interpretation of the ABSITE as a formative assessment of resident knowledge progression as opposed to a high-stakes summative exam.

Ab-10%υ¯ Mans .-10%υ¯r ῌasan Qamar: Promoter of the Medical School of Rāz (Rhazes)

The medical history of Iran and Islam is marked by the presence of renowned physicians, some of whom are not well known outside Iran. Abυ¯ Man⋅υ¯r ῌasan ibn Nυ¯ḥ Qamarī Bukhārā 'ī was an Iranian physician living in the fourth century AH (10th century CE). The scientific works of this sage indicate his skill and expertise in medical science. He was a man of such scientific stature that the renowned Iranian philosopher and physician, Avicenna, use may have been one of his disciples. Qamarī may be credited as one of the promoters of the medical school of Muḥammad Ibn Zakarīyyā Rāzī. Some of his works, including Al-Tanwīr Fī 'Isṭilāḥāt Al-Ṭibbīyyah and Al-Ghinā and Al-Munā are still extant. In this paper, his scientific life and works, based on primary sources, have been studied in order to shed light on his role in formation of the Muslim Medical School.

Medical heuristics and action-research: professionalism versus science

BACKGROUND

Professional knowledge aims at improving practice. It reduces uncertainty in decision-making, improves effectiveness in action and relevance in evaluation, stimulates reflexivity, and subjects practice to ethical standards. Heuristics is an approach to problem-solving, learning, and discovery employing a practical methodology that, although not optimal, is sufficient for achieving immediate goals. This article identifies the desirable, heuristic particularities of research in professional, medical practice; and it identifies what distinguishes this research from scientific research.

MAIN TEXT

We examine the limits of biomedical and sociological research to produce professional knowledge. Then, we derive the heuristic characteristics of professional research from a meta-analysis of two action-research projects aimed at securing access to essential generic drugs in Senegal and improving physicians' self-assessment and healthcare coordination in Belgium. To study healthcare, biomedical sciences ignore how clinical decisions are implemented. Decisions are built into an articulated knowledge system, such as (clinical) epidemiology, where those studied are standardisable - while taking care of patients is an idiosyncratic, value-based, person-to-person process that largely eludes probabilistic methodologies. Social sciences also reach their limits here because descriptive, interpretative methods cannot help with gesture and speech quality, while the management of the patient's suffering and risks makes each of them unique. Research into medical professionalism is normative as it is intended to formulate recommendations. Scientific data and descriptions are useful to the practitioner randomly, only from the similarities in the environment of the authors and their readers. Such recommendations can be conceived of as strategies, i.e., multi-resource and multi-stage action models to improve clinical and public health practice. Action learning and action-research are needed to design and implement these strategies, because their complexity implies trial and error. To validate a strategy, repeated experiences are needed. Its reproducibility assumes the description of the context. To participate in medical action-research, the investigator needs professional proficiency - a frequent difficulty in academic settings.

CONCLUSION

Some criteria to assess the relevance of publicly funded clinical and public health research can be derived from the difference between scientific and professional knowledge, i.e. the knowledge gained with real-life experience in the field.

From anatomy to patient experience in pelvic floor surgery: Mindlines, evidence, responsibility, and transvaginal mesh

Beginning in the late 1990s, surgeons around the world widely adopted the transvaginal placement of permanent synthetic mesh for the treatment of several common pelvic floor disorders in women. By 2012 it had become the subject of extensive litigation, including one of the biggest mass-tort cases in U.S. history, with litigants reporting debilitating and unexpected complications. Based on qualitative research that includes interviews with surgeons, observations of medical conferences, and analysis of archival materials, we argue the adoption of transvaginal mesh cannot be fully explained without recognizing the role of mindlines, or collective moral-epistemological ways of knowing and acting responsibly. The adoption of mesh was anchored in a mindline focused on repairing anatomy. The harms that resulted from transvaginal mesh necessitated a shift to a focus on patient experience. We analyze the role of evidence-based medicine (EBM) in the re-organization of these surgeons' mindlines, showing that mindlines are not reducible to evidence as defined by EBM and that evidence thus defined facilitated the adoption of transvaginal mesh.

Epileptic psychoses are underrecognized by French neurologists and psychiatrists

This study evaluates the knowledge about psychotic disorders associated with epilepsy among medical practitioners in France. A self-report questionnaire was sent, and responses of 486 participants were collected. Results showed the rate of correct responses being higher among neurologists compared to psychiatrists, respectively 70.6% and 58.3% (p < 10^-11). The highest rate of correct responses was found for the participants trained in epileptology (71%), and a regression analysis confirmed that epilepsy-training was the most influential variable. However, we found that knowledge about epileptic psychosis was imprecise among all participants: current classification was not known to most participants (77%), there were false beliefs concerning postictal confusion and psychosis (41%), and both prevalence and duration of postictal psychosis were not well-known. There is the first survey to highlight such gaps of knowledge, and hopefully lead to measures to remedy this, especially specialists such as psychiatrists, neurologists, and epileptologists who may be called upon to treat such patients.

Assessment of Doctors' Knowledge and Attitudes Towards Confidentiality in Hospital Care

The physician's duty of confidentiality is based on the observance of the patient's privacy and intimacy and on the importance of respecting both of these rights, thus creating a relationship of confidence and collaboration between doctor and patient. The main objective of this work consists of analyzing the aspects that are related to the confidentiality of patients' data with respect to the training, conduct and opinions of doctors from different Clinical Management Units of a third-level hospital via a questionnaire. The present study aimed to define the problem and determine whether the opinions of these professionals correspond to those observed in a previous work conducted at the same center. Of the 200 questionnaires that were collected, 62.5% were from consultants and the rest were from residents (37.5%) with an average of 14.4 ± 12.5 years in professional practice. The respondents noted habitual situations in which confidentiality was breached in the reference hospital (74%). The section on their attitudes and behaviors towards situations related to confidentiality showed a slightly lower average score than that of their medical knowledge; significant differences in these scores were observed between the consultants and residents as well as between the extreme age groups (≤ 30 vs. ≥ 51 years) and years of professional practice, thus more inadequate attitudes were consistently noted in younger doctors who had fewer years of experience. Finally, the respondents answered that the training of doctors in the aspects of healthcare law and ethics was the most important measure that the hospital could adopt regarding confidentiality practices.

Using an Adaptive, Self-Directed Web-Based Learning Module to Enhance Residents' Medical Knowledge Prior to a New Clinical Rotation

BACKGROUND

The effect of self-directed adaptive learning on internal medicine residents' knowledge prior to a new clinical rotation is not known.

METHODS

We developed an adaptive, online, self-directed spaced repetition module and determined the effect on medical knowledge acquisition. We randomized postgraduate year 1 internal medicine residents into two groups. The intervention group (n = 27) received an electronic version of the clinical rotation curriculum as portable document format (PDF) files and participated in the online module, delivered via Moodle, a free, open-source learning management system. The non-intervention group (n = 27) only received the PDF files. All residents participated in a medical knowledge test at baseline and 3 months later.

RESULTS

Both groups were similar at study baseline in terms of age, trainee type, years since graduation, results at United States Medical Licensing Examination (USMLE) Step 1, 2, In-Training Examination (ITE), and pre-intervention evaluation. There was a statistically significant improvement in scores on the post-intervention medical knowledge assessment for the intervention group when compared with the non-intervention group (24.2 ± 15.4% vs. 8.6 ± 9.9%, p < 0.001).

CONCLUSION

An online, self-directed, adaptive spaced repetition-learning module can offer a simple and effective method to increase the medical knowledge present at the start of residents' clinical rotations.

A Romanian experience of syphilis in pregnancy and childbirth

OBJECTIVE

to establish the incidence of syphilis in a group of childbearing women and their newborn babies in Romania and to identify the major risk factors of materno-fetal transmission in order for midwives to develop strategies to help prevent congenital syphilis.

MATERIAL AND METHODS

a descriptive study of a group of 982 childbearing women who gave birth during a three-month period at an Obstetrics and Gynaecology Hospital in Romania. The women completed a questionnaire, which consisted of three sections: general data, general knowledge of syphilis and birth and pregnancy data. After admission to hospital, the women were investigated for syphilis using serological tests.

RESULTS

there was a syphilis frequency of 0.91649% (n = 9) among the surveyed women. Among the nine infected women, two were not aware that they had a syphilis infection when initially admitted to hospital. The maternal profile with the highest risk of being diagnosed with syphilis was a young woman who had not had adequate prenatal care, who had elementary sex education and who lacked knowledge of personal health and hygiene. A significant percentage of the respondents, namely 11.9% (n = 117), were aged 15 to 20.

CONCLUSIONS

in certain population groups, syphilis is still an important health care problem, especially in vulnerable individuals, such as childbearing women and newborns babies. More attention needs to be paid to primary prevention; the number of cases of congenital syphilis could be reduced by more involvement of midwifes and family doctors in antenatal care.

An ensemble learning method for asthma control level detection with leveraging medical knowledge-based classifier and supervised learning

Approximately 300 million people are afflicted with asthma around the world, with the estimated death rate of 250,000 cases, indicating the significance of this disease. If not treated, it can turn into a serious public health problem. The best method to treat asthma is to control it. Physicians recommend continuous monitoring on asthma symptoms and offering treatment preventive plans based on the patient's control level. Therefore, successful detection of the disease control level plays a critical role in presenting treatment plans. In view of this objective, we collected the data of 96 asthma patients within a 9-month period from a specialized hospital for pulmonary diseases in Tehran. A new ensemble learning algorithm with combining physicians' knowledge in the form of a rule-based classifier and supervised learning algorithms is proposed to detect asthma control level in a multivariate dataset with multiclass response variable. The model outcome resulting from the balancing operations and feature selection on data yielded the accuracy of 91.66%. Our proposed model combines medical knowledge with machine learning algorithms to classify asthma control level more accurately. This model can be applied in electronic self-care systems to support the real-time decision and personalized warnings on possible deterioration of asthma control level. Such tools can centralize asthma treatment from the current reactive care models into a preventive approach in which the physician's therapeutic actions would be based on control level.

Sociocultural dynamics that influence Chagas disease health care in Colombia

Chagas disease (CD) is a Latin America endemic and neglected tropical disease that affects primarily poor people living in rural areas. Its current low profile leads to many diagnostic, treatment, and control challenges. This study aimed to identify and characterize the sociocultural dynamics that influence CD health care in Colombia. Data for our ethnographic study was collected in 2013 and included participant observation in two main endemic areas in Colombia. In addition, 81 people belonging to four groups (patients and family members; health care workers; researchers; and officers) were recruited through snowball sampling technique and participated in informal and semi-structured interviews. People from the first two groups also participated in social cartography excercises. Data analysis resulted in the identification of three main sociocultural dynamics. Local Understandings: Patients reported confusions around disease transmission, treatment effectiveness and development of future complications. Providers' Knowledge and Training: Failures in professional's knowledge and training mostly affect the primary level of care in rural areas. Professionals undergo minimal training during medical school and lack access to continuous education. In contrast, clinicians working at tertiary university hospitals or at the CD unit of the Colombian National Institute of Health (NIH) exhibited great knowledge and competency. Health Care System Barriers: The Colombian market-based health care reform augmented access barriers, which impacted CD care greatly. We identified geographic and bureaucratic itineraries that depended on type of insurance plan, insurance contracts with service providing institutions, and levels of care. This study shows that people's experience of these sociocultural dynamics vary depending on their mobility from rural to urban contexts. It unveils the importance of analyzing the structure of the health care system. In the Colombian case, its for-profit orientation has become one of the most important obstacles for comprehensive, integrated, and timely health care responses.

Critical gaps in the medical knowledge base of eating disorders

Eating disorders are unique in that they inherently have much medical comorbidity both as a part of restricting-type eating disorders and those characterized by purging behaviors. Over the last three decades, remarkable progress has been made in the understanding and treatment of the medical complications of eating disorders. Yet, unfortunately, there is much research that is sorely needed to bridge the gap between current medical knowledge and more effective and evidence-based medical treatment knowledge. These gaps exist in many different clinical areas including cardiology, electrolytes, gastrointestinal and bone disease. In this paper, we discuss some of the knowledge gap areas, which if bridged would help develop more effective medical intervention for this population of patients.

Ear Disease Knowledge and Otoscopy Skills Transfer to Real Patients: A Randomized Controlled Trial

OBJECTIVE

To determine which teaching method-otoscopy simulation (OS), web-based module (WM), or standard classroom instruction (SI)-produced greater translation of knowledge and otoscopy examination skills to real patients.

DESIGN

In a prospective randomized controlled nonclinical trial, medical students were randomized to 1 of 3 interventional arms: (1) OS, (2) WM, or (3) SI. Students were assessed at baseline for diagnostic accuracy and otoscopy skills on 5 volunteer patients (total of 10 ears), followed by the intervention. Testing was repeated immediately after intervention on the same patients. Student reported confidence in diagnostic accuracy and otoscopy examination were also captured. Assessors were blinded to the intervention group, and whether students were pre- or post-intervention.

SETTING

Clinical Teaching Centre, Queen's University.

PARTICIPANTS

Twenty-nine participants were initially randomized. Two students were unable to attend their specific intervention sessions and withdrew. Final group sizes were: OS-10, WM-9, SI-8. Five patients with external/middle ear pathologies were voluntarily recruited to participate as testing subjects.

RESULTS

Baseline diagnostic accuracy and otoscopy clinical skills did not differ across the groups. Post-intervention, there were improvements in diagnostic accuracy from all groups: OS (127.78%, 2.30 ± 1.42, p = 0.0006), WM (76.40%, 1.44 ± 1.88, p = 0.0499), and SI (100.00%, 1.50 ± 1.20, p = 0.0093). For otoscopy skills, post-intervention improvements were noted from OS (77.00%, 3.85 ± 2.55, p < 0.0001) and SI (22.20%, 1.25 ± 1.20, p = 0.0011), with no significant improvement from WM (13.46%, 0.78 ± 1.92, p = 0.1050). Students across all groups reported significantly improved confidence in diagnostic accuracy (p < 0.0001) and otoscopy skill (p < 0.0001) after the intervention.

CONCLUSION

All 3 teaching modalities showed an improvement in diagnostic accuracy immediately post-intervention. Otoscopy clinical skills were found to have increased only in OS and SI, with the OS group demonstrating the largest improvement. Simulation-based medical education in Otolaryngology may provide the greatest transfer of medical knowledge and technical skills when evaluated with real patients.

Medical Knowledge Assessment by Hematology and Medical Oncology In-Training Examinations Are Better Than Program Director Assessments at Predicting Subspecialty Certification Examination Performance

The Accreditation Council for Graduate Medical Education's Next Accreditation System requires training programs to demonstrate that fellows are achieving competence in medical knowledge (MK), as part of a global assessment of clinical competency. Passing American Board of Internal Medicine (ABIM) certification examinations is recognized as a metric of MK competency. This study examines several in-training MK assessment approaches and their ability to predict performance on the ABIM Hematology or Medical Oncology Certification Examinations. Results of a Hematology In-Service Examination (ISE) and an Oncology In-Training Examination (ITE), program director (PD) ratings, demographic variables, United States Medical Licensing Examination (USMLE), and ABIM Internal Medicine (IM) Certification Examination were compared. Stepwise multiple regression and logistic regression analyses evaluated these assessment approaches as predictors of performance on the Hematology or Medical Oncology Certification Examinations. Hematology ISE scores were the strongest predictor of Hematology Certification Examination scores (β = 0.41) (passing odds ratio [OR], 1.012; 95 % confidence interval [CI], 1.008-1.015), and the Oncology ITE scores were the strongest predictor of Medical Oncology Certification Examination scores (β = 0.45) (passing OR, 1.013; 95 % CI, 1.011-1.016). PD rating of MK was the weakest predictor of Medical Oncology Certification Examination scores (β = 0.07) and was not significantly predictive of Hematology Certification Examination scores. Hematology and Oncology ITEs are better predictors of certification examination performance than PD ratings of MK, reinforcing the effectiveness of ITEs for competency-based assessment of MK.

Systematic Review of Voluntary Participation in Simulation-Based Laparoscopic Skills Training: Motivators and Barriers for Surgical Trainee Attendance

OBJECTIVE

To examine and report on evidence relating to surgical trainees' voluntary participation in simulation-based laparoscopic skills training. Specifically, the underlying motivators, enablers, and barriers faced by surgical trainees with regard to attending training sessions on a regular basis.

DESIGN

A systematic search of the literature (PubMed; CINAHL; EMBASE; Cochrane Collaboration) was conducted between May and July 2015. Studies were included on whether they reported on surgical trainee attendance at voluntary, simulation-based laparoscopic skills training sessions, in addition to qualitative data regarding participant's perceived barriers and motivators influencing their decision to attend such training. Factors affecting a trainee's motivation were categorized as either intrinsic (internal) or extrinsic (external).

RESULTS

Two randomised control trials and 7 case series' met our inclusion criteria. Included studies were small and generally poor quality. Overall, voluntary simulation-based laparoscopic skills training was not well attended. Intrinsic motivators included clearly defined personal performance goals and relevance to clinical practice. Extrinsic motivators included clinical responsibilities and available free time, simulator location close to clinical training, and setting obligatory assessments or mandated training sessions. The effect of each of these factors was variable, and largely dependent on the individual trainee. The greatest reported barrier to attending voluntary training was the lack of available free time.

CONCLUSION

Although data quality is limited, it can be seen that providing unrestricted access to simulator equipment is not effective in motivating surgical trainees to voluntarily participate in simulation-based laparoscopic skills training. To successfully encourage participation, consideration needs to be given to the factors influencing motivation to attend training. Further research, including better designed randomised control trials and large-scale surveys, is required to provide more definitive answers to the degree in which various incentives influence trainees' motivations and actual attendance rates.

The ability of older adults to use customized online medical databases to improve their health-related knowledge

INTRODUCTION

Patient compliance with medical advice and recommended treatment depends on perception of health condition, medical knowledge, attitude, and self-efficacy. This study investigated how use of customized online medical databases, intended to improve knowledge in a variety of relevant medical topics, influenced senior adults' perceptions.

METHOD

Seventy-nine older adults in residence homes completed a computerized, tablet-based questionnaire, with medical scenarios and related questions. Following an intervention, control group participants answered questions without online help while an experimental group received internet links that directed them to customized, online medical databases.

RESULTS

Medical knowledge and test scores among the experimental group significantly improved from pre- to post-intervention (p<0.0001) and was higher in comparison with the control group (p<0.0001). No significant change occurred in the control group.

CONCLUSION

Older adults improved their knowledge in desired medical topic areas using customized online medical databases. The study demonstrated how such databases help solve health-related questions among older adult population members, and that older patients appear willing to consider technology usage in information acquisition.

Does Taking the Fellowship In-Service Hematopathology Examination and Performance Relate to Success on the American Board of Pathology Hematology Examination?

OBJECTIVES

The biannual Fellow In-Service Hematopathology Examination (FISHE) assesses knowledge in five content areas. We examined the relationship between taking the FISHE and performance on it with outcomes on the first attempted American Board of Pathology Hematology subspecialty certifying examination (ABP-HE).

METHODS

The pass rate between the ABP-HE candidates who took the spring FISHE and those who did not were compared. The likelihood of fellows passing the ABP-HE based on their percentiles on the FISHE was also assessed.

RESULTS

ABP-HE candidates who took the spring FISHE had a higher pass rate (96.4%) than those who did not (76.1%, P < .001). Spring FISHE performance, including total percentile and percentiles in four of five FISHE content areas, was only a weak predictor of passing the ABP-HE.

CONCLUSIONS

Candidates who take the spring FISHE do better on the ABP-HE than those who do not. Most fellows passed the first attempted ABP-HE regardless of FISHE performance. Whether this is due to fellows making use of the FISHE as a self-evaluation tool to help identify and then correct their knowledge deficiencies remains to be determined.

Predicting and enhancing American Board of Surgery In-Training Examination performance: does writing questions really help?

BACKGROUND

The generative learning model posits that individuals remember content they have generated better than materials created by others. The goals of this study were to evaluate question generation as a study method for the American Board of Surgery In-Training Examination (ABSITE) and determine whether practice test scores and other data predict ABSITE performance.

METHODS

Residents (n = 206) from 6 general surgery programs were randomly assigned to one of the two study conditions. One group wrote questions for practice examinations. All residents took 2 practice examinations.

RESULTS

There was not a significant effect of writing questions on ABSITE score. Practice test scores, United States Medical Licensing Examination Step 1 scores, and previous ABSITE scores were significantly correlated with ABSITE performance.

CONCLUSIONS

The generative learning model was not supported. Performance on practice tests and other data can be used for early identification of residents at risk of performing poorly on the ABSITE.

"Personal Knowledge" in Medicine and the Epistemic Shortcomings of Scientism

In this paper, we outline a framework for understanding the different kinds of knowledge required for medical practice and use this framework to show how scientism undermines aspects of this knowledge. The framework is based on Michael Polanyi's claim that knowledge is primarily the product of the contemplations and convictions of persons and yet at the same time carries a sense of universality because it grasps at reality. Building on Polanyi's ideas, we propose that knowledge can be described along two intersecting "dimensions": the tacit-explicit and the particular-general. These dimensions supersede the familiar "objective-subjective" dichotomy, as they more accurately describe the relationship between medical science and medical practice. Scientism, we argue, excludes tacit and particular knowledge and thereby distorts "clinical reality" and impairs medical practice and medical ethics.

[Familiarity and perceptions of Portuguese cardiologists concerning cardiac magnetic resonance and cardiac computed tomography: the extent of the task ahead]

INTRODUCTION

Rapid advances in cardiac magnetic resonance (CMR) and cardiac computed tomography angiography (CCTA) pose challenges for practicing physicians in terms of awareness of their indications, contraindications, advantages and pitfalls.

METHODS

We conducted a nationwide online survey assessing the familiarity, perceptions and patterns of use concerning these imaging modalities based on a questionnaire sent to all physician members of the Portuguese Society of Cardiology.

RESULTS

The responses from 205 physicians (21% response rate) were analyzed. Roughly half of them requested less than one CMR (51%) or CCTA (52%) per week. Suspected coronary artery disease in symptomatic patients with intermediate pretest probability was considered a good or excellent indication for CCTA by 59% of respondents when performed as a second-line exam, and by 29% as a first-line exam. Cardiac masses, congenital heart disease and cardiomyopathies were considered good or excellent indications for CMR by over 90% of respondents, while assessment of myocardial viability and acute myocardial infarction with normal coronary arteries were considered good or excellent indications by 75% and 65% of respondents, respectively. Less than half (39%) answered all the questions regarding contraindications for CMR correctly, and 15% were unaware that CMR does not involve ionizing radiation. The main reasons for not referring a patient for CMR were limited availability (45%) and cost (36%).

CONCLUSIONS

Portuguese cardiologists appear to be moderately aware of the indications, contraindications and advantages of these new imaging modalities. Greater efforts should be made to improve physician education on this subject in order to improve patient care.

Gaps in exposure to essential competencies in hand surgery fellowship training: a national survey of program directors

BACKGROUND

Graduate medical education has moved towards competency-based training. The aim of this study was to assess hand surgery program directors' opinions of exposure gaps in core competencies rated as essential for hand surgery training.

METHODS

We surveyed the 74 ACGME hand surgery fellowship program directors. Respondents rated their opinion of 9 general areas of practice, 97 knowledge topics, and 172 procedures into one of three categories: essential, exposure needed, or unnecessary. Program directors also rated trainee exposure of each component at their respective program. Moderate and large exposure gaps were respectively defined as presence of at least 25 and 50 % of programs rating trainees as not having proficiency in the component at the end of training.

RESULTS

Sixty-two of 74 program directors (84 %) responded to the survey. For the 76 knowledge topics and 98 procedures rated as essential, a majority of the knowledge topics (61 %; n = 46) and procedures (72 %; n = 71) had at least a moderate exposure gap. In addition, 22 % (n = 17) of the essential knowledge topics and 26 % (n = 25) of the essential procedures had a large exposure gap.

CONCLUSION

This study illuminates the discrepancies between what is believed to be important for practicing hand surgeons and graduates' proficiency as perceived by program directors. The field of hand surgery must work to determine if program directors have unrealistic expectations for what is essential for practicing hand surgeons or if reforms are needed to improve exposure to essential skills in hand surgery training.