An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processing: Algorithm Development and Validation Study

BACKGROUND

Large language models (LLMs) have shown remarkable capabilities in natural language processing (NLP), especially in domains where labeled data are scarce or expensive, such as the clinical domain. However, to unlock the clinical knowledge hidden in these LLMs, we need to design effective prompts that can guide them to perform specific clinical NLP tasks without any task-specific training data. This is known as in-context learning, which is an art and science that requires understanding the strengths and weaknesses of different LLMs and prompt engineering approaches.

OBJECTIVE

The objective of this study is to assess the effectiveness of various prompt engineering techniques, including 2 newly introduced types-heuristic and ensemble prompts, for zero-shot and few-shot clinical information extraction using pretrained language models.

METHODS

This comprehensive experimental study evaluated different prompt types (simple prefix, simple cloze, chain of thought, anticipatory, heuristic, and ensemble) across 5 clinical NLP tasks: clinical sense disambiguation, biomedical evidence extraction, coreference resolution, medication status extraction, and medication attribute extraction. The performance of these prompts was assessed using 3 state-of-the-art language models: GPT-3.5 (OpenAI), Gemini (Google), and LLaMA-2 (Meta). The study contrasted zero-shot with few-shot prompting and explored the effectiveness of ensemble approaches.

RESULTS

The study revealed that task-specific prompt tailoring is vital for the high performance of LLMs for zero-shot clinical NLP. In clinical sense disambiguation, GPT-3.5 achieved an accuracy of 0.96 with heuristic prompts and 0.94 in biomedical evidence extraction. Heuristic prompts, alongside chain of thought prompts, were highly effective across tasks. Few-shot prompting improved performance in complex scenarios, and ensemble approaches capitalized on multiple prompt strengths. GPT-3.5 consistently outperformed Gemini and LLaMA-2 across tasks and prompt types.

CONCLUSIONS

This study provides a rigorous evaluation of prompt engineering methodologies and introduces innovative techniques for clinical information extraction, demonstrating the potential of in-context learning in the clinical domain. These findings offer clear guidelines for future prompt-based clinical NLP research, facilitating engagement by non-NLP experts in clinical NLP advancements. To the best of our knowledge, this is one of the first works on the empirical evaluation of different prompt engineering approaches for clinical NLP in this era of generative artificial intelligence, and we hope that it will inspire and inform future research in this area.

Clinical Profiles of Japanese Patients with Stevens-Johnson Syndrome/Toxic Epidermal Necrolysis Collected by a Nationwide System from 2006 to 2023

Stevens-Johnson syndrome and toxic epidermal necrolysis (SJS/TEN) are potentially life-threatening severe cutaneous adverse drug reactions. These diseases are rare, and their onset is difficult to predict because of their idiosyncratic reactivity. The Japan Severe Adverse Reactions Research Group, led by the National Institute of Health Sciences, has operated a nationwide to collect clinical information and genomic samples from patients with SJS/TEN since 2006. This study evaluated the associations of clinical symptoms with sequelae and specific causative drugs/drug groups in Japanese patients with SJS/TEN to identify clinical clues for SJS/TEN treatment and prognosis. Acetaminophen, antibiotics, and carbocisteine were linked to high frequencies of severe ocular symptoms and ocular sequelae (p < 0.05). For erythema and erosion areas, antipyretic analgesics had higher rates of skin symptom affecting <10% of the skin than the other drugs, suggesting narrower lesions (p < 0.004). Hepatic dysfunction, was common in both SJS and TEN, and antiepileptic drugs carried higher risks of hepatic dysfunction than the other drug groups (p = 0.0032). This study revealed that the clinical manifestations of SJS/TEN vary according to the causative drugs.

Implementing Clinical Information Systems in Sub-Saharan Africa: Report and Lessons Learned From the MatLook Project in Cameroon

BACKGROUND

Yaoundé Central Hospital (YCH), located in the capital of Cameroon, is one of the leading referral hospitals in Cameroon. The hospital has several departments, including the Department of Gynecology-Obstetrics (hereinafter referred to as "the Maternity"). This clinical department has faced numerous problems with clinical information management, including the lack of high-quality and reliable clinical information, lack of access to this information, and poor use of this information.

OBJECTIVE

We aim to improve the management of clinical information generated at the Maternity at YCH and to describe the challenges, success factors, and lessons learned during its implementation and use.

METHODS

Based on an open-source hospital information system (HIS), this intervention implemented a clinical information system (CIS) at the Maternity at YCH and was carried out using the HERMES model-the first part aimed to cover outpatient consultations, billing, and cash management of the Maternity. Geneva University Hospitals supported this project, and several outcomes were measured at the end. The following outcomes were assessed: project management, technical and organizational aspects, leadership, change management, user training, and system use.

IMPLEMENTATION (RESULTS)

The first part of the project was completed, and the CIS was deployed in the Maternity at YCH. The main technical activities were adapting the open-source HIS to manage outpatient consultations and develop integrated billing and cash management software. In addition to technical aspects, we implemented several other activities. They consisted of the implementation of appropriate project governance or management, improvement of the organizational processes at the Maternity, promotion of the local digital health leadership and performance of change management, and implementation of the training and support of users. Despite barriers encountered during the project, the 6-month evaluation showed that the CIS was effectively used during the first 6 months.

CONCLUSIONS

Implementation of the HIS or CIS is feasible in a resource-limited setting such as Cameroon. The CIS was implemented based on good practices at the Maternity at YCH. This project had successes but also many challenges. Beyond project management and technical and financial aspects, the other main problems of implementing health information systems or HISs in Africa lie in digital health leadership, governance, and change management. This digital health leadership, governance, and change management should prioritize data as a tool for improving productivity and managing health institutions, and promote a data culture among health professionals to support a change in mindset and the acquisition of information management skills. Moreover, in countries with a highly centralized political system like ours, a high-level strategic and political anchor for such projects is often necessary to guarantee their success.

Performance of Machine Learning Methods Based on Multi-Sequence Textural Parameters Using Magnetic Resonance Imaging and Clinical Information to Differentiate Malignant and Benign Soft Tissue Tumors

RATIONALE AND OBJECTIVES

To evaluate the performance of a machine learning method to differentiate malignant from benign soft tissue tumors based on textural features on multiparametric magnetic resonance imaging (mpMRI).

MATERIALS AND METHODS

We enrolled 163 patients with soft tissue tumors whose diagnosis was pathologically proven (71 malignant, 92 benign). All patients underwent mpMRI. Twelve histographic and textural parameters were assessed on T1-weighted imaging (T1WI), T2-weighted imaging, diffusion-weighted imaging, apparent diffusion coefficient maps, and contrast-enhanced T1WI imaging. We compared mean signals of all sequences from the malignant and benign tumors using Welch's t-test. Prediction models were developed via a machine learning technique (support vector machine) using textural features of each sequence, clinical information (sex + age + tumor size), and the combined model incorporating all features. Areas under the receiver operating characteristic curves (AUCs) of these models were calculated using fivefold cross validation.

RESULTS

The diagnostic ability of clinical information model (AUC 0.85) was not inferior to the model with textural features of each sequence (AUC 0.79-0.84). The combined model showed the highest diagnostic ability (AUC 0.89). The AUC of the combined model (0.89) was comparable to those of two board-certified radiologists (0.89 and 0.87).

CONCLUSIONS

Machine learning methods based on textural features on mpMRI and clinical information offer adequate diagnostic performance to differentiate between malignant and benign soft tissue tumors.

Value of Clinical Information on Radiology Reports in Oncological Imaging

Radiological reporting errors have a direct negative impact on patient treatment. The purpose of this study was to investigate the contribution of clinical information (CI) in radiological reporting of oncological imaging and the dependence on the radiologists’ experience level (EL). Sixty-four patients with several types of carcinomas and twenty patients without tumors were enrolled. Computed tomography datasets acquired in primary or follow-up staging were independently analyzed by three radiologists (R) with different EL (R1: 15 years; R2: 10 years, R3: 1 year). Reading was initially performed without and 3 months later with CI. Overall, diagnostic accuracy and sensitivity for primary tumor detection increased significantly when receiving CI from 77% to 87%; p = 0.01 and 73% to 83%; p = 0.01, respectively. All radiologists benefitted from CI; R1: 85% vs. 92%, p = 0.15; R2: 77% vs. 83%, p = 0.33; R3: 70% vs. 86%, p = 0.02. Overall, diagnostic accuracy and sensitivity for detecting lymphogenous metastases increased from 80% to 85% (p = 0.13) and 42% to 56% (p = 0.13), for detection of hematogenous metastases from 85% to 86% (p = 0.61) and 46% to 60% (p = 0.15). Specificity remained stable (>90%). Thus, CI in oncological imaging seems to be essential for correct radiological reporting, especially for residents, and should be available for the radiologist whenever possible.

The impact of incomplete clinical information and initial biopsy technique on the histopathological diagnosis of cutaneous melanoma

BACKGROUND/OBJECTIVES

Increased rates of histopathological misdiagnosis of melanoma have been associated with incisional punch more so than shave biopsy when compared with complete excisional biopsy. It is unknown how the increasing utilisation of shave biopsy may impact melanoma diagnosis. The extent to which the provision of clinical information to the pathologist may improve diagnostic accuracy remains unclear. This study assessed the impact of both initial biopsy technique and provision of adequate clinical information to pathologists on the accuracy of histopathological diagnosis of melanoma and disease progression.

METHODS

We conducted a retrospective cohort with nested case-control study of all histopathological false-negative and false-positive melanoma diagnoses from January 2014 to May 2019 from the Victorian Melanoma Service electronic database. Cases were assessed for the initial biopsy type, provision of clinical information on pathology request forms and disease progression associated with false-negative diagnosis.

RESULTS

Partial shave biopsy had higher odds of false-negative (OR 5.19, 95% CI 2.89-9.32; P < 0.001) and false-positive diagnoses (OR 1.95, 95% CI 1.45-2.63; P < 0.001) of melanoma when compared with elliptical excisional biopsy. These odds ratios were comparable with those found with incisional punch biopsy. Providing the suspected clinical diagnosis to pathologists also reduced the odds of false-negative diagnosis with melanoma progression by 3.8-fold (P = 0.02).

CONCLUSION

The choice of initial biopsy technique and providing the suspected clinical diagnosis to pathologists are important for correct histopathological diagnosis of cutaneous melanoma and prevention of further disease progression.

Comprehensive assessment of deceased donor kidneys with clinical characteristics, pre-implant biopsy histopathology and hypothermic mechanical perfusion parameters is highly predictive of delayed graft function

Background: Due to the current high demand for transplant tissue, an increasing proportion of kidney donors are considered extended criteria donors, which results in a higher incidence of delayed graft function (DGF) in organ recipients. Therefore, it is important to fully investigate the risk factors of DGF, and establish a prediction system to assess donor kidney quality before transplantation.Methods: A total of 333 donation after cardiac death kidney transplant recipients were included in this retrospective study. Both univariate and multivariate analyses were used to analyze the risk factors of DGF occurrence. Receiver operating characteristic (ROC) curves were used to analyze the predictive value of variables on DGF posttransplant.Results: The donor clinical scores, kidney histopathologic Remuzzi scores and hypothermic mechanical perfusion (HMP) parameters (flow and resistance index) were all correlated. 46 recipients developed DGF postoperatively, with an incidence of 13.8% (46/333). Multivariate logistic regression analysis of the kidney transplants revealed that the independent risk factors of DGF occurrence post-transplantation included donor score (OR = 1.12, 95% CI 1.06-1.19, p < 0.001), Remuzzi score (OR = 1.21, 95% CI 1.02-1.43, p = 0.029) and acute tubular injury (ATI) score (OR = 4.72, 95% CI 2.32-9.60, p < 0.001). Prediction of DGF with ROC curve showed that the area under the curve was increased to 0.89 when all variables (donor score, Remuzzi score, ATI score and HMP resistance index) were considered together.Conclusions: Combination of donor clinical information, kidney pre-implant histopathology and HMP parameters provide a more accurate prediction of DGF occurrence post-transplantation than any of the measures alone.

[Development of Clinical Information Navigation System Based on 3D Human Model]

A clinical information navigation system based on 3D human body model is designed. The system extracts the key information of diagnosis and treatment of patients by searching the historical medical records, and stores the focus information in a predefined structured patient instance. In addition, the rule mapping is established between the patient instance and the three-dimensional human body model, the focus information is visualized on the three-dimensional human body model, and the trend curve can be drawn according to the change of the focus, meanwhile, the key diagnosis and treatment information and the original report reference function are provided. The system can support the analysis, storage and visualization of various types of reports, improve the efficiency of doctors' retrieval of patient information, and reduce the treatment time.

The effect of clinical information on radiology reporting: A systematic review

INTRODUCTION

The aim of this study was to investigate the effects of clinical information on the accuracy, timeliness, reporting confidence and clinical relevance of the radiology report.

METHODS

A systematic review of studies that investigated a link between primary communication of clinical information to the radiologist and the resultant report was conducted. Relevant studies were identified by a comprehensive search of electronic databases (PubMed, Scopus and EMBASE). Studies were screened using pre-defined criteria. Methodological quality was assessed using the Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Quasi-Experimental Studies. Synthesis of findings was narrative. Results were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.

RESULTS

There were 21 studies which met the inclusion criteria, of which 20 were included in our review following quality assessment. Sixteen studies investigated the effect of clinical information on reporting accuracy, three studies investigated the effect of clinical information on reporting confidence, three studies explored the impact of clinical information on clinical relevance, and two studies investigated the impact of clinical information on reporting timeliness. Some studies explored multiple outcomes. Studies concluded that clinical information improved interpretation accuracy, clinical relevance and reporting confidence; however, reporting time was not substantially affected by the addition of clinical information.

CONCLUSION

The findings of this review suggest clinical information has a positive impact on the radiology report. It is in the best interests of radiologists to communicate the importance of clinical information to reporting via the creation of criteria standards to guide the requesting practices of medical imaging referrers. Further work is recommended to establish these criteria standards.

OSgbm: An Online Consensus Survival Analysis Web Server for Glioblastoma

Glioblastoma (GBM) is the most common malignant tumor of the central nervous system. GBM causes poor clinical outcome and high mortality rate, mainly due to the lack of effective targeted therapy and prognostic biomarkers. Here, we developed a user-friendly Online Survival analysis web server for GlioBlastoMa, abbreviated OSgbm, to assess the prognostic value of candidate genes. Currently, OSgbm contains 684 samples with transcriptome profiles and clinical information from The Cancer Genome Atlas (TCGA), Gene Expression Omnibus (GEO) and Chinese Glioma Genome Atlas (CGGA). The survival analysis results can be graphically presented by Kaplan-Meier (KM) plot with Hazard ratio (HR) and log-rank p value. As demonstration, the prognostic value of 51 previously reported survival associated biomarkers, such as PROM1 (HR = 2.4120, p = 0.0071) and CXCR4 (HR = 1.5578, p < 0.001), were confirmed in OSgbm. In summary, OSgbm allows users to evaluate and develop prognostic biomarkers of GBM. The web server of OSgbm is available at http://bioinfo.henu.edu.cn/GBM/GBMList.jsp.

Miyagi Medical and Welfare Information Network: A Backup System for Patient Clinical Information after the Great East Japan Earthquake and Tsunami

On March 11, 2011, the Great East Japan Earthquake and ensuing tsunami that hit the northeastern coastal region of Japan caused about 18,000 casualties and destroyed numerous buildings. Additionally, many medical facilities were damaged and patient medical records lost. In order to maintain patient clinical information, a prefectural medical network system, the Miyagi Medical and Welfare Information Network (MMWIN), began providing backup data storage services in 2013 for hospitals, clinics, pharmacies, and other care facilities as a precaution for upcoming disasters. This system also facilitates the sharing of clinical information trans-institutionally as long as patients provide consent for this. In the present study, we examined the development of the MMWIN and its efficiency during the 5 years from its launch, and identified general problems to maintain such a backup system. At the end of 2018, the system contained backup data from more than 11 million patients with more than 420 million data items; more than 900 facilities were MMWIN users, and the number of patients consenting to sharing their clinical information reached 90,000. The use of the system has become widespread and the accumulating data should be utilized for research in the future. Maintaining a balance between income and cost is critical to make this project independent from local government subsidies.

National platform for Rare Diseases Data Registry of Japan

INTRODUCTION

In Japan, there are approximately 300 projects conducting research on rare diseases supported by the Ministry of Health, Labour and Welfare of Japan (MHLW) and the Japan Agency for Medical Research and Development (AMED). Diverse data, including clinical, genomic, and sample-related data, are generated by these projects. However, at present, such data are managed individually by each project. This makes it difficult for third parties to ascertain the data generated by projects.

METHODS

Again this background, at the beginning of 2017, the AMED started the National Platform for Rare Diseases Data Registry of Japan (RADDAR-J), whose mission is to construct a cross-sectional data integration platform incorporating projects supported by the AMED and MHLW. RADDAR-J promotes data sharing by the projects in accordance with the data-sharing policy established by the AMED, which classifies data sharing into three categories based on the strategies used to protect the rights of researchers while promoting data sharing. RADDAR-J integrates and analyzes data shared by each project to add value to the resources and promote secondary use by third parties while protecting the rights of the researchers who shared their data. The platform is designed to provide incentives to projects that shared their data by supporting registry construction or genomic analysis to promote data sharing. RADDAR-J also has the function of data identification to securely integrate data originating from the same person. RADDAR-J accelerates clinical research by encouraging each project to utilize a central ethics committee.

RESULTS/CONCLUSION

The use of the platform by projects is expected to lead to streamlined data collection, improved quality assurance, improved access to data, and promotion of joint research and the secondary use of shared data. These benefits will accelerate research into diagnosis and treatment technologies and will hopefully lead to improved quality of life for patients with rare diseases.

Sources of clinical information used in HIV care and treatment: Are providers' choices related to their demographic and practice characteristics?

HIV medical care providers need a wide range of evidence-based clinical information resources to manage their patients' health. We determined whether providers' choice of information sources for HIV care and treatment are associated with their demographic and medical practice characteristics. Data used for this study were obtained from a probability sample of HIV medical care providers in 13 outpatient HIV facilities in Houston/Harris County, Texas, surveyed between June and September 2009. The mean number of information sources used by HIV medical care providers for HIV care and treatment was 5.83 (95% confidence interval: 4.90-6.75). Antiretroviral therapy guidelines (95.6%), medical journals and textbooks (82.6%), and Internet sources (69.5%) were ranked first, second, and third as sources of clinical information. At least one of the providers' demographic or medical practice characteristics was significantly (p ⩽ 0.05) associated with six of the clinical information sources. Integration of these information resources into clinicians' workflow may enhance efficiency of HIV care and treatment and facilitate improved patients' care and health outcomes.

Impact of Clinical Information on the Turnaround Time in Surgical Histopathology: A Retrospective Study

Introduction

Clinical information (CI) is a key requisite to diagnose and report a specimen in histopathology. A timely dispatched report can help a clinician to confirm a diagnosis and initiate a prompt treatment plan while an unnecessary delay in reporting time can compromise patient's healthcare. The aim of this study was to ascertain the impact of the adequacy of CI provided by clinicians on the turnaround time (TAT) and to investigate factors pertinent to specimens, their handling, and diagnosis.

Methods

This retrospective study reviewed a total of 803 surgical specimens reported in a duration of four months (from December 2015 till March 2016) by the Department of Histopathology, FMH College of Medicine & Dentistry, Lahore, Pakistan. Frozen section and cytology specimens were excluded. CI was classified into three categories: short and focused, long and detailed, and deficient CI. Deficient CI was designated where the pathologist had to seek more information from the requesting clinicians. Total time taken by the histopathologist to complete a report was calculated after excluding weekends and holidays. Other factors like type of specimen, special staining, diagnosis of malignancy and source of referral were also studied. The data were entered and analyzed on SPSS 22.0 (IBM, Armonk, NY). Shapiro-Wilk test was used to measure the distribution.

Results

Most of the specimens (46.2%, n = 371) were reported within three days. Of these, most of the specimens (46.9%, n = 174) had a short and focused CI (p < 0.001). Majority of the specimens which were reported within four to five days (42.1%, n = 114) and after five days (62.1%, n = 100) were found to have a long and detailed CI in their requisition forms. Median TAT extended to six (4.00-7.00) days with the use of special stains (p < 0.001). One hundred and sixty-three (20.29%) of the total cases were diagnosed as malignant in which the median TAT significantly prolonged to five days (p < 0.001). Most of the specimens (80%, n = 60) received from the outside laboratories had a long and detailed CI in requisition forms. Endometrial tissue specimen was the predominant type received by the department (24.3%, n = 90).

Conclusion

Adequate CI is necessary for timely and error-free reporting of a specimen in surgical histopathology. A short, focused and concise CI is associated with a shorter TAT. Long and detailed CI is often seen with a complex surgical specimen that requires a longer time to report. Factors like specimen type, special staining, number of special stains and diagnosis of a malignancy also affect TAT.

Comprehensive survey of vitiligo patients in the northeast of China using a predesigned questionnaire

To assess the sociodemographic data and clinical information of outpatients affected by vitiligo in the northeast of China, vitiligo patients or guardians who presented to the clinic were invited to participate in an exploratory questionnaire. The questionnaire consisted of two sections related to vitiligo, including sociodemographic data and clinical information. A total of 983 vitiligo patients answered the questionnaire. The rates of female and male patients were comparable. The investigated patients were mostly young and middle-aged. Most patients suffered from vitiligo in childhood or young adulthood. Vitiligo vulgaris was the most common type of vitiligo in clinic and 53.0% of patients were categorized as body surface area (BSA) of 10% or less. In response to the latest treatment, 43.6% of patients achieved good response (completely stopped or almost disappeared). More patients at active stage showed good response than the patients at stable stage (χ² = 7.866, P < 0.05). Chronic comorbid condition(s) were observed in 12.6% of patients with BSA of more than 10%, whereas those were seen in 6.0% of patients with BSA of 10% or less (χ² = 12.969, P < 0.05). In conclusion, active vitiligo seems to respond better than stable vitiligo and complications with other autoimmune diseases more frequently observed in severe patients than mild patients. The current study presented a comprehensive understanding of vitiligo in the northeast of China.

What Clinical Information Is Valuable to Doctors Using Mobile Electronic Medical Records and When?

Background

There has been a lack of understanding on what types of specific clinical information are most valuable for doctors to access through mobile-based electronic medical records (m-EMRs) and when they access such information. Furthermore, it has not been clearly discussed why the value of such information is high.

Objective

The goal of this study was to investigate the types of clinical information that are most valuable to doctors to access through an m-EMR and when such information is accessed.

Methods

Since 2010, an m-EMR has been used in a tertiary hospital in Seoul, South Korea. The usage logs of the m-EMR by doctors were gathered from March to December 2015. Descriptive analyses were conducted to explore the overall usage patterns of the m-EMR. To assess the value of the clinical information provided, the usage patterns of both the m-EMR and a hospital information system (HIS) were compared on an hourly basis. The peak usage times of the m-EMR were defined as continuous intervals having normalized usage values that are greater than 0.5. The usage logs were processed as an indicator representing specific clinical information using factor analysis. Random intercept logistic regression was used to explore the type of clinical information that is frequently accessed during the peak usage times.

Results

A total of 524,929 usage logs from 653 doctors (229 professors, 161 fellows, and 263 residents; mean age: 37.55 years; males: 415 [63.6%]) were analyzed. The highest average number of m-EMR usage logs (897) was by medical residents, whereas the lowest (292) was by surgical residents. The usage amount for three menus, namely inpatient list (47,096), lab results (38,508), and investigation list (25,336), accounted for 60.1% of the peak time usage. The HIS was used most frequently during regular hours (9:00 AM to 5:00 PM). The peak usage time of the m-EMR was early in the morning (6:00 AM to 10:00 AM), and the use of the m-EMR from early evening (5:00 PM) to midnight was higher than during regular business hours. Four factors representing the types of clinical information were extracted through factor analysis. Factors related to patient investigation status and patient conditions were associated with the peak usage times of the m-EMR (P<.01).

Conclusions

Access to information regarding patient investigation status and patient conditions is crucial for decision making during morning activities, including ward rounds. The m-EMRs allow doctors to maintain the continuity of their clinical information regardless of the time and location constraints. Thus, m-EMRs will best evolve in a manner that enhances the accessibility of clinical information helpful to the decision-making process under such constraints.

Dental Blogs, Podcasts, and Associated Social Media: Descriptive Mapping and Analysis

Background

Studies of social media in both medicine and dentistry have largely focused on the value of social media for marketing to and communicating with patients and for clinical education. There is limited evidence of how dental clinicians contribute to and use social media to disseminate and access information relevant to clinical care.

Objective

The purpose of this study was to inventory and assess the entry, growth, sources, and content of clinically relevant social media in dentistry.

Methods

We developed an inventory of blogs, podcasts, videos, and associated social media disseminating clinical information to dentists. We assessed hosts’ media activity in terms of their combinations of modalities, entry and exit dates, frequency of posting, types of content posted, and size of audience.

Results

Our study showed that clinically relevant information is posted by dentists and hygienists on social media. Clinically relevant information was provided in 89 blogs and podcasts, and topic analysis showed motives for blogging by host type: 55% (49 hosts) were practicing dentists or hygienists, followed by consultants (27 hosts, 30%), media including publishers and discussion board hosts (8 hosts, 9%), and professional organizations and corporations.

Conclusions

We demonstrated the participation of and potential for practicing dentists and hygienists to use social media to share clinical and other information with practicing colleagues. There is a clear audience for these social media sites, suggesting a changing mode of information diffusion in dentistry. This study was a first effort to fill the gap in understanding the nature and potential role of social media in clinical dentistry.

[Complications arising out of insufficient reporting of clinical data to the pathologist investigating placentas]

OBJECTIVE

To inform gynecologists-obstetricians about the problems associated with pathological examination of placentas, with special regard to the possibility of crucial role of complete and relevant clinical data in establishing the correct pathological diagnosis.

DESIGN

Case report and overview of the problems associated with examination of placentas by pathologist.

SETTING

Sikl´s Institute of Pathology, Faculty Hospital and Medical Faculty Pilzen of the Charles University in Prague; Biopticka laborator, s.r.o., Pilzen.

METHODS

Own observation in the setting of routine pathological examination.

RESULTS

Case report representing a typical complication resulting from insufficient interdisciplinary communication describes a case of unsatisfactory result of pathological investigation of placenta due to the missing clinical information about complications of the late phase of pregnancy which eventually led to intrauterine death of the fetus. Due to the absence of the clinical information of paramount importance, the initial investigation of placenta was untargeted and thus imperfect. Therefore, the primary investigation of the placenta did not reveal pathological changes responsible for the complications of pregnancy. It was only the revision of material necessitated by the information additionally conveyed by gynecologist-obstetrician leading to the final correct pathological diagnosis, which even averted the possibility of serious forensic consequences.

CONCLUSION

The basic prerequisite for proper pathological examination of placenta is sharing the available clinical data with the pathologist performing the morphological investigation, mainly focusing on complications of pregnancy. Lack of such information causes examination of placenta more difficult and sometimes even unable to interpret, as the interpretation of morphological changes of placenta have to interpreted in the context of clinical data on the course of pregnancy. Regarding the extreme emotional and possibly even legal consequences of lethal complications of pregnancy or delivery, the correct pathological diagnosis may be of crucial importance.

Disruptive Innovation: Implementation of Electronic Consultations in a Veterans Affairs Health Care System

BACKGROUND

Electronic consultations (e-consults) offer rapid access to specialist input without the need for a patient visit. E-consult implementation began in 2011 at VA Boston Healthcare System (VABHS). By early 2013, e-consults were available for all clinical services. In this implementation, the requesting clinician selects the desired consultation within the electronic health record (EHR) ordering menu, which creates an electronic form that is pre-populated with patient demographic information and allows free-text entry of the reason for consult. This triggers a message to the requesting clinician and requested specialty, thereby enabling bidirectional clinician-clinician communication.

OBJECTIVE

The aim of this study is to examine the utilization of e-consults in a large Veterans Affairs (VA) health care system.

METHODS

Data from the electronic health record was used to measure frequency of e-consult use by provider type (physician or nurse practitioner (NP) and/or physician assistant), and by the requesting and responding specialty from January 2012 to December 2013. We conducted chart reviews for a purposive sample of e-consults and semi-structured interviews with a purposive sample of clinicians and hospital leaders to better characterize the process, challenges, and usability of e-consults.

RESULTS

A total of 7097 e-consults were identified, 1998 from 2012 and 5099 from 2013. More than one quarter (27.56%, 1956/7097) of the e-consult requests originated from VA facilities in New England other than VABHS and were excluded from subsequent analysis. Within the VABHS e-consults (72.44%, 5141/7097), variability in frequency and use of e-consults across provider types and specialties was found. A total of 64 NPs requested 2407 e-consults (median 12.5, range 1-415). In contrast, 448 physicians (including residents and fellows) requested 2349 e-consults (median 2, range 1-116). More than one third (37.35%, 1920/5141) of e-consults were sent from primary care to specialists. While most e-consults reflected a request for specialist input to a generalist's question in diagnosis or management in the ambulatory setting, we identified creative uses of e-consults, including requests for face-to-face appointments and documentation of pre-operative chart reviews; moreover, 7.00% (360/5141) of the e-consults originated from our sub-acute and chronic care inpatient units. In interviews, requesting providers reported high utility and usability. Specialists recognized the value of e-consults but expressed concerns about additional workload.

CONCLUSIONS

The e-consult mechanism is frequently utilized for its initial intended purpose. It has also been adopted for unexpected clinical and administrative uses, developing into a "disruptive innovation" and highlighting existing gaps in mechanisms for provider communication. Further investigation is needed to characterize optimal utilization of e-consults within specialty and the medical center, and what features of the e-consult program, other than volume, represent valid measures of access and quality care.

[Assessment of the completeness of medical imaging request forms in a sub-Saharan African setting]

The technical quality, interpretation, and clinical utility of diagnostic imaging examinations can increase considerably when the request forms are correctly filled out. This study sought to evaluate the completeness of these request forms at the Women and Children's Hospital in Yaoundé, Cameroon, to the 8 criteria established by the French High Health Authority (HAS, France).

METHODS

This cross-sectional study evaluated 118 request forms for ultrasounds, 110 for conventional radiography, and 34 for computed tomography (CT scans), all completed by physicians at our university-affiliated hospital. They were sampled consecutively three days a week for several weeks, on days randomly selected at the beginning of each week, to minimize bias and ensure that as many different physicians as possible were assessed. We doubled the sample size recommended by the HAS. Conformity was defined by the presence of the required data on the request forms (data classified as either administrative or clinical).

RESULTS

Overall, 52 request forms (19.8%) had all 5 administrative items, but only 9.2% had all 3 clinical components. Only 3 forms (1.1%) were 100% complete, including all 8 items; 85% included at least 5 components, and 35.1% had 6. The patient's last name was always included. Only 4.2% of the request forms included the prescriber's telephone number; 8% did not include the date and 17.2% (n = 45) did not state the clinical findings. On 30% of the forms, symptoms were the only clinical information listed; 23.7% (n = 62) stated the purpose of the examination (that is, the diagnosis to be confirmed or ruled out). The rate of missing information was highest in the requests for conventional radiography (49.5% compared to 38% with ultrasound and 12.3% for CT scans).

CONCLUSION

The request forms for imaging examinations provided inadequate administrative and clinical data, especially those for conventional radiography. This missing information makes it harder to perform and interpret these examinations. An electronic request form with mandatory fields might improve the overall quality of the forms.

Investigating the prediction ability of survival models based on both clinical and omics data: two case studies

In biomedical literature, numerous prediction models for clinical outcomes have been developed based either on clinical data or, more recently, on high-throughput molecular data (omics data). Prediction models based on both types of data, however, are less common, although some recent studies suggest that a suitable combination of clinical and molecular information may lead to models with better predictive abilities. This is probably due to the fact that it is not straightforward to combine data with different characteristics and dimensions (poorly characterized high-dimensional omics data, well-investigated low-dimensional clinical data). In this paper, we analyze two publicly available datasets related to breast cancer and neuroblastoma, respectively, in order to show some possible ways to combine clinical and omics data into a prediction model of time-to-event outcome. Different strategies and statistical methods are exploited. The results are compared and discussed according to different criteria, including the discriminative ability of the models, computed on a validation dataset.

Assessment of quality of data provided on Pap test requisitions: implications for quality of care and patient safety

Background:

The reliability of patient history and clinical information on Pap test requisitions has been questioned but not previously objectively determined. The effect of incomplete/inaccurate information on quality of patient care has not been previously quantified. Our objectives were (1) to find out how clinicians and their assistants viewed the requisition slip, and whether they understood the reasons for supplying the information requested, (2) to measure the completeness and accuracy of information on the requisition slips, and (3) to determine whether the clinical information and patient history provided on Pap test requisitions could be relied upon to accurately assign a Pap test to the laboratory's “high-risk rescreen” pool.

Methods:

Clinicians and their assistants were surveyed. A total of 899 consecutive Pap test requisition slips were reviewed. Patient history and clinical information from the slips were compared to data from our laboratory information system and/or electronic patient medical records.

Results:

Most survey respondents felt that proper completion of requisitions was important, but only 17% of clinicians and less staff realized that negative high-risk Pap tests underwent a quality assurance rescreen. Clinicians and/or staff recorded the last menstrual period, specimen source, and clinical information on the requisition slips 96%, 97%, and 88% of the time, respectively. Of 695 Pap tests with applicable computerized records, 172 (25%) qualified for high-risk rescreen based upon information provided on the requisition slip alone. An additional 52 Pap tests (7%), or 23% of the total high-risk Pap tests were discovered to be of high risk only after review of the electronic records.

Conclusions:

Clinicians and staff were receptive to discussions concerning the completion of requisition slips, but laboratory expectations could be better communicated. Requisition slips were properly completed with a high frequency, but the check boxes did not elicit all the information expected, so revision was necessary. The high accuracy of the completion of requisition slips permitted 77% of high-risk Pap tests to be identified via the requisition slip alone. Our findings challenge the conventional anecdotal impressions of “notoriously unreliable” information on Pap test requisition slips, but our experience may not be applicable to other settings.

A study of how urology out-patients like to receive clinical information

INTRODUCTION

As part of the NHS Plan the UK Department of Health has suggested that both patients and general practitioners (GPs) are written to following hospital consultations. We audited the responses of patients and GPs to this practice.

PATIENTS AND METHODS

A total of 160 patients in one consultant urologist's clinic were included. The consultant had never routinely copied GP letters to patients. The SpR in the same clinic had routinely done so in previous posts. Patients who had received letters (group A) and those who had not (group B) were asked to complete a postal questionnaire. GPs were also sent a questionnaire to assess their opinion. The responses were analysed.

RESULTS

Questionnaires were sent out to patients (80 to group A and 80 to group B. From this, 100 (62.5%) responses were received (A 48 [60%]; B 52 [65%]). Of respondents, 81% were male. Overall, 98% of those patients who received a letter agreed with its contents, and stated they would keep the letter and take it to a subsequent doctor's appointment. Of respondents, 83% (A) and 96% (B) had never received a doctor's letter before but 83% (40 [83%, A], 43 [83%, B]; P > 0.05) of respondents would like to receive doctors' letters in the future. some 22 GP practices received and completed questionnaires at a PCT meeting and 74% of GPs agreed with the practice of copying patients their letters.

CONCLUSIONS

The results of this study suggest that patients should be offered a copy of their letter and that their response should be documented in the notes. This may serve to improve communication with the patient but should not be undertaken without their agreement.