Evaluation of Electronic Health Record Implementation in an Academic Oculoplastics Practice

Dr. Google vs. Dr. ChatGPT: Exploring the Use of Artificial Intelligence in Ophthalmology by Comparing the Accuracy, Safety, and Readability of Responses to Frequently Asked Patient Questions Regarding Cataracts and Cataract Surgery

PURPOSE

Patients are using online search modalities to learn about their eye health. While Google remains the most popular search engine, the use of large language models (LLMs) like ChatGPT has increased. Cataract surgery is the most common surgical procedure in the US, and there is limited data on the quality of online information that populates after searches related to cataract surgery on search engines such as Google and LLM platforms such as ChatGPT. We identified the most common patient frequently asked questions (FAQs) about cataracts and cataract surgery and evaluated the accuracy, safety, and readability of the answers to these questions provided by both Google and ChatGPT. We demonstrated the utility of ChatGPT in writing notes and creating patient education materials.

METHODS

The top 20 FAQs related to cataracts and cataract surgery were recorded from Google. Responses to the questions provided by Google and ChatGPT were evaluated by a panel of ophthalmologists for accuracy and safety. Evaluators were also asked to distinguish between Google and LLM chatbot answers. Five validated readability indices were used to assess the readability of responses. ChatGPT was instructed to generate operative notes, post-operative instructions, and customizable patient education materials according to specific readability criteria.

RESULTS

Responses to 20 patient FAQs generated by ChatGPT were significantly longer and written at a higher reading level than responses provided by Google (p < .001), with an average grade level of 14.8 (college level). Expert reviewers were correctly able to distinguish between a human-reviewed and chatbot generated response an average of 31% of the time. Google answers contained incorrect or inappropriate material 27% of the time, compared with 6% of LLM generated answers (p < .001). When expert reviewers were asked to compare the responses directly, chatbot responses were favored (66%).

CONCLUSIONS

When comparing the responses to patients' cataract FAQs provided by ChatGPT and Google, practicing ophthalmologists overwhelming preferred ChatGPT responses. LLM chatbot responses were less likely to contain inaccurate information. ChatGPT represents a viable information source for eye health for patients with higher health literacy. ChatGPT may also be used by ophthalmologists to create customizable patient education materials for patients with varying health literacy.

Measuring Documentation Burden in Healthcare

BACKGROUND

The enactment of the Health Information Technology for Economic and Clinical Health Act and the wide adoption of electronic health record (EHR) systems have ushered in increasing documentation burden, frequently cited as a key factor affecting the work experience of healthcare professionals and a contributor to burnout. This systematic review aims to identify and characterize measures of documentation burden.

METHODS

We integrated discussions with Key Informants and a comprehensive search of the literature, including MEDLINE, Embase, Scopus, and gray literature published between 2010 and 2023. Data were narratively and thematically synthesized.

RESULTS

We identified 135 articles about measuring documentation burden. We classified measures into 11 categories: overall time spent in EHR, activities related to clinical documentation, inbox management, time spent in clinical review, time spent in orders, work outside work/after hours, administrative tasks (billing and insurance related), fragmentation of workflow, measures of efficiency, EHR activity rate, and usability. The most common source of data for most measures was EHR usage logs. Direct tracking such as through time-motion analysis was fairly uncommon. Measures were developed and applied across various settings and populations, with physicians and nurses in the USA being the most frequently represented healthcare professionals. Evidence of validity of these measures was limited and incomplete. Data on the appropriateness of measures in terms of scalability, feasibility, or equity across various contexts were limited. The physician perspective was the most robustly captured and prominently focused on increased stress and burnout.

DISCUSSION

Numerous measures for documentation burden are available and have been tested in a variety of settings and contexts. However, most are one-dimensional, do not capture various domains of this construct, and lack robust validity evidence. This report serves as a call to action highlighting an urgent need for measure development that represents diverse clinical contexts and support future interventions.

Cost minimization analysis of indication-specific osteosynthesis material in oral and maxillofacial surgery

PURPOSE

Following the introduction of the Regulation (EU) 2017/745 by the European Parliament, any bioactive substance or surgical implant introduced into the human body must be documented. The regulation requires any implant to be traced back to the manufacturer. Lot numbers need to be available for every single medical implant. Also, the manufacturer is required by law to provide implants individually packaged and sterilized. Previously, model tray systems (MOS tray) were used for osteosynthesis in oral and maxillofacial surgery, in which the individual implants could not be registered separately. The new regulation made it impossible to use such processes during surgery anymore and a need for a change in the medical practice surged. We examined a possible solution for the new legislation. The aim of this prospective cohort study is to analyze the MOS tray systems to osteosynthesis materials prepackaged in sets. We record and evaluate parameters such as surgical time and documentation time. We perform a short cost analysis of our clinic. The primary aim is to determine how much time is gained or lost by the mandatory increased patient safety. The secondary aim is to describe change in costs.

METHODS

Patients that underwent standard surgical procedures in the clinic of oral and maxillofacial surgery of the faculty hospital Carl Gustav Carus in Dresden were included. We chose open reduction and internal fixation (ORIF) of anterior mandibular corpus fractures as well as mandibular advancement by means of bilateral sagittal split osteotomies (BSSO) as standardized procedures. Both of these procedures require two osteosynthesis plates and at least four screws for each plate. MOS trays were compared to prepackaged sterilized sets. The sets include a drill bit, two plates, and eight 5-mm screws. A total number of 40 patients were examined. We allocated 20 patients to the ORIF group and the other 20 patients to the BSSO group. Each group was evenly subdivided into a MOS tray group and a prepackaged group. Parameters such as the incision-suture time (IST) as well as the documentation time (DT) by the operating room (OR) staff to complete documentation for the implants are the main focus of investigation.

RESULTS

For open reduction, the incision-suture time was significantly different in favor of the MOS tray (p < 0.05). There was no difference in the BSSO groups. However, we observed a significantly different (p < 0.01) documentation time advantage for the prepackaged sets in both the ORIF and BSSO groups. On top of that, we find that by using the prepackaged kits, we are able to reduce sterilization costs by €11.53 per size-reduced container. Also, there is also a total cut of costs of €38.90 and €43.70, respectively, per standardized procedure for implant material.

CONCLUSIONS

By law, a change in the method of approaching surgery is necessary. For standardized procedures, the right choice of implants can lead to a reduction of documentation time and costs for implant material, sterilization, as well as utilizing less instruments. This in turn leads to lower costs for perioperative processing as well as provision of state-of-the-art implant quality implementing higher patient security.

Effect of digitization of medical case files on doctor patient relationship in an Out Patient Department setting of Northern India: A comparative study

Background: Digitization of health records and health delivery processes in health care settings may have an impact on the Patient-Physician communication, wait times, that affect the overall patient satisfaction with the health care services. Aim & Objective: We ascertained the effect of digitization of medical case files on the doctor patient relationship (DPR) domain of patient satisfaction at an urban primary health center in India. Settings and Design: Comparative, cross-sectional study in primary health centres. Methods and Material: The patient satisfaction was compared between the patients attending the Public Health Dispensary (PHD) that uses digitized medical case file system and a Civil Dispensary (CD) which follows the conventional paper based medical records, using a Patient Satisfaction Questionnaire (PSQ). Statistical analysis used: Univariate analysis was done by chi-square test and adjusted analysis was done by multiple linear regression. Results: Patient satisfaction in DPR was found to be same between the digitized medical case files based and conventional OPD (p=0.453). Significantly higher overall patient satisfaction was reported in the conventional paper based OPD than the digitized OPD (p<0.001). Conclusions: Patient satisfaction towards the doctor-patient relationship (DPR) was same between paper based OPD and the digitized medical case files based OPD.