Perspectives of Patients About Immediate Access to Test Results Through an Online Patient Portal

Generating colloquial radiology reports with large language models

OBJECTIVES

Patients are increasingly being given direct access to their medical records. However, radiology reports are written for clinicians and typically contain medical jargon, which can be confusing. One solution is for radiologists to provide a "colloquial" version that is accessible to the layperson. Because manually generating these colloquial translations would represent a significant burden for radiologists, a way to automatically produce accurate, accessible patient-facing reports is desired. We propose a novel method to produce colloquial translations of radiology reports by providing specialized prompts to a large language model (LLM).

MATERIALS AND METHODS

Our method automatically extracts and defines medical terms and includes their definitions in the LLM prompt. Using our method and a naive strategy, translations were generated at 4 different reading levels for 100 de-identified neuroradiology reports from an academic medical center. Translations were evaluated by a panel of radiologists for accuracy, likability, harm potential, and readability.

RESULTS

Our approach translated the Findings and Impression sections at the 8th-grade level with accuracies of 88% and 93%, respectively. Across all grade levels, our approach was 20% more accurate than the baseline method. Overall, translations were more readable than the original reports, as evaluated using standard readability indices.

CONCLUSION

We find that our translations at the eighth-grade level strike an optimal balance between accuracy and readability. Notably, this corresponds to nationally recognized recommendations for patient-facing health communication. We believe that using this approach to draft patient-accessible reports will benefit patients without significantly increasing the burden on radiologists.

Evaluating Expert-Layperson Agreement in Identifying Jargon Terms in Electronic Health Record Notes: Observational Study

BACKGROUND

Studies have shown that patients have difficulty understanding medical jargon in electronic health record (EHR) notes, particularly patients with low health literacy. In creating the NoteAid dictionary of medical jargon for patients, a panel of medical experts selected terms they perceived as needing definitions for patients.

OBJECTIVE

This study aims to determine whether experts and laypeople agree on what constitutes medical jargon.

METHODS

Using an observational study design, we compared the ability of medical experts and laypeople to identify medical jargon in EHR notes. The laypeople were recruited from Amazon Mechanical Turk. Participants were shown 20 sentences from EHR notes, which contained 325 potential jargon terms as identified by the medical experts. We collected demographic information about the laypeople's age, sex, race or ethnicity, education, native language, and health literacy. Health literacy was measured with the Single Item Literacy Screener. Our evaluation metrics were the proportion of terms rated as jargon, sensitivity, specificity, Fleiss κ for agreement among medical experts and among laypeople, and the Kendall rank correlation statistic between the medical experts and laypeople. We performed subgroup analyses by layperson characteristics. We fit a beta regression model with a logit link to examine the association between layperson characteristics and whether a term was classified as jargon.

RESULTS

The average proportion of terms identified as jargon by the medical experts was 59% (1150/1950, 95% CI 56.1%-61.8%), and the average proportion of terms identified as jargon by the laypeople overall was 25.6% (22,480/87,750, 95% CI 25%-26.2%). There was good agreement among medical experts (Fleiss κ=0.781, 95% CI 0.753-0.809) and fair agreement among laypeople (Fleiss κ=0.590, 95% CI 0.589-0.591). The beta regression model had a pseudo-R2 of 0.071, indicating that demographic characteristics explained very little of the variability in the proportion of terms identified as jargon by laypeople. Using laypeople's identification of jargon as the gold standard, the medical experts had high sensitivity (91.7%, 95% CI 90.1%-93.3%) and specificity (88.2%, 95% CI 86%-90.5%) in identifying jargon terms.

CONCLUSIONS

To ensure coverage of possible jargon terms, the medical experts were loose in selecting terms for inclusion. Fair agreement among laypersons shows that this is needed, as there is a variety of opinions among laypersons about what is considered jargon. We showed that medical experts could accurately identify jargon terms for annotation that would be useful for laypeople.

Socioeconomic and demographic patterning of family uptake of a paediatric electronic patient portal innovation

Patient portals allowing access to electronic health care records and services can inform and empower but may widen existing sociodemographic inequities. We aimed to describe associations between activation of a paediatric patient portal and patient race/ethnicity, socioeconomic status and markers of previous engagement with health care. A retrospective single site cross-sectional study was undertaken to examine patient portal adoption amongst families of children receiving care for chronic or complex disorders within the United Kingdom. Descriptive and multivariable regression analysis was undertaken to describe associations between predictors (Race/Ethnicity, age, socio-economic deprivation status based on family residence, and previous non-attendance to outpatient consultations) and outcome. A sample of 3687 children, representative of the diverse 'real world' patient population, was identified. Of these 37% (1364) were from a White British background, 71% (2631) had English as the primary family spoken language (PSL), 14% (532) lived in areas of high deprivation, and 17% (643) had high (>33%) rates of non-attendance. The families of 73% (2682) had activated the portal. In adjusted analyses, English as a PSL (adjusted odds ratio [aOR] 1.58, 95% confidence interval 1.29-1.95) and multi-morbidity (aOR 1.26, 1.22-1.30) was positively associated with portal activation, whilst families from British Black African backgrounds (aOR 0.68, 0.50-0.93), and those with high rates of non-attendance (aOR 0.48, 0.40-0.58) were less likely to use the portal. Family race/ethnicity and previous low engagement with health care services are potentially key drivers of widening inequity in access to health care following the implementation of patient portals, a digital health innovation intended to inform and empower. Health care providers should be aware that innovative human-driven engagement approaches, targeted towards previously underserved communities, are needed to ensure equitable access to high quality patient-centred care.

Prioritizing Patient-Centered Care in a World of Increasingly Advanced Technologies and Disconnected Care

With more treatment options in oncology lead to better outcomes and more favorable side effect profiles, patients are living longer-with higher quality of life-than ever, with a growing survivor population. As the needs of patients and providers evolve, and technology advances, cancer care is subject to change. This review explores the myriad of changes in the current oncology landscape with a focus on the patient perspective and patient-centered care.

Helping patients navigate the immediate release of medical records: MedEd, a novel patient engagement technology

BACKGROUND

Through online health portals, patients receive complex medical reports without interpretation from their healthcare provider. This study evaluated the usability of MedEd, a patient engagement tool providing definitions of medical terminology in breast pathology and radiology reports.

METHODS

Individuals who underwent a normal screening mammogram were invited to complete semi-structured interviews where they downloaded MedEd and discussed their download experience. Acceptability, appropriateness, and feasibility of MedEd were evaluated.

RESULTS

143 individuals were invited to participate, and 14 semi-structured interviews were completed. Participants reported ease of downloading and navigating MedEd with concerns about privacy and others' abilities to download. Participants demonstrated high acceptability (mean 4.48/5, SD 0.95), appropriateness (mean 4.66/5, SD 0.83), and feasibility (mean 4.48/5, SD 1.04) scores.

CONCLUSION

Participants expressed excitement for future use of MedEd and provided suggestions for improvements. Next steps include evaluating comprehension of real breast reports while using MedEd and expanding patient access.

The 21st Century Cures Act: More Harm Than Good for Survivors of Intimate Partner Violence?

The 21st Century Cures Act requires that health organizations make all medical records rapidly available to patients through secure online portals. Referred to as "open notes," this approach is intended to improve health outcomes by facilitating easier and more transparent communication between patients and providers. For patients experiencing intimate partner violence (IPV), however, open notes can create serious safety risks to their physical and mental health when not handled carefully. This clinical note aims to raise awareness of how open notes can be harmful in IPV situations, provide a set of evidence-informed recommendations on how healthcare providers and institutions can help to mitigate this harm, and outline areas for future research.

The CREATE TRUST Communication Framework for Patient Messaging Services

This Viewpoint proposes a messaging framework called CREATE TRUST to improve written communication with patients.

Chatbot for the Return of Positive Genetic Screening Results for Hereditary Cancer Syndromes: a Prompt Engineering Study

Background

The growing demand for genomic testing and limited access to experts necessitate innovative service models. While chatbots have shown promise in supporting genomic services like pre-test counseling, their use in returning positive genetic results, especially using the more recent large language models (LLMs) remains unexplored.

Objective

This study reports the prompt engineering process and intrinsic evaluation of the LLM component of a chatbot designed to support returning positive population-wide genomic screening results.

Methods

We used a three-step prompt engineering process, including Retrieval-Augmented Generation (RAG) and few-shot techniques to develop an open-response chatbot. This was then evaluated using two hypothetical scenarios, with experts rating its performance using a 5-point Likert scale across eight criteria: tone, clarity, program accuracy, domain accuracy, robustness, efficiency, boundaries, and usability.

Results

The chatbot achieved an overall score of 3.88 out of 5 across all criteria and scenarios. The highest ratings were in Tone (4.25), Usability (4.25), and Boundary management (4.0), followed by Efficiency (3.88), Clarity and Robustness (3.81), and Domain Accuracy (3.63). The lowest-rated criterion was Program Accuracy, which scored 3.25.

Discussion

The LLM handled open-ended queries and maintained boundaries, while the lower Program Accuracy rating indicates areas for improvement. Future work will focus on refining prompts, expanding evaluations, and exploring optimal hybrid chatbot designs that integrate LLM components with rule-based chatbot components to enhance genomic service delivery.

Elder abuse geriatrics: describing an important new medical specialist

Elder mistreatment, including elder abuse and neglect, is a difficult diagnosis to make and manage for most providers. To address this, two elder abuse consultation teams were developed for patients in the hospital and emergency department settings. As these teams have developed, the providers involved have obtained specialized training and experience that we believe contributes to a new field of elder abuse geriatrics, a corollary to the well-established field of child abuse pediatrics. Providers working in this field require specialized training and have a specialized scope of practice that includes forensic evaluation, evaluation of cognition and capacity, care coordination and advocacy for victims of abuse, and collaboration with protective services and law enforcement. Here we describe the training, scope of practice, ethical role, and best practices for elder mistreatment medical consultation. We hope this will serve as a starting point for this new and important medical specialty.

Immediate Access to Radiology Reports: Perspectives on X Before and After the Cures Act Information Blocking Provision

OBJECTIVE

The 21st Century Cures Act's information blocking provision mandates that patients have immediate access to their electronic health information, including radiology reports. We evaluated public opinions surrounding this policy on X, a microblogging platform with over 400 million users.

METHODS

We retrieved 27,522 posts related to radiology reports from October 5, 2020, through October 4, 2021. One reviewer performed initial screening for relevant posts. Two reviewers categorized user type and post theme(s) using a predefined coding system. Posts were grouped as "pre-Cures" (6 months before information blocking) and "post-Cures" (6 months after). Descriptive statistics and χ2 tests were performed.

RESULTS

Among 1,155 final posts, 1,028 unique users were identified (64% patients, 11% non-radiologist physicians, 4% radiologists). X activity increased, with 40% (n = 462) pre-Cures and 60% (n = 693) post-Cures. Early result notification before referring providers was the only theme that significantly increased post-Cures (+3%, P = .001). Common negative themes were frustration (33%), anxiety (27%), and delay (20%). Common positive themes were gratitude for radiologists (52%) and autonomy (21%). Of posts expressing opinions on early access, 84% favored and 16% opposed it, with decreased preference between study periods (P = .006). More patients than physicians preferred early access (92% versus 40%, P < .0001).

DISCUSSION

X activity increased after the information blocking provision, partly due to conversation about early notification. Despite negative experiences with reports, most users preferred early access. Although the Cures Act is a positive step toward open access, work remains to improve patients' engagement with their radiology results.

Evaluating Laboratory Communications to NKF-WG Recommended Stakeholders during Implementation of the CKD-EPI 2021 Equation

BACKGROUND

In 2022, the National Kidney Foundation's Laboratory Engagement Working Group (NKF-WG) released recommendations for clinical implementation of the race-free Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) 2021 estimated glomerular filtration rate (eGFR) equation.This study examined laboratory communications during CKD-EPI 2021 implementation including communication methods and delivery, content inclusion, and alignment with stakeholder inclusion as defined by the NKF-WG.

METHODS

An anonymous web-based survey was distributed to members of ADLM (AACC) and the American Society for Clinical Laboratory Science (ASCLS) in November 2022 to solicit laboratory directors of CLIA-licensed clinical laboratories in the United States. Seventeen questions covering topics related to implementation of CKD-EPI 2021, stakeholder inclusion, methods and timing of communications delivery, and content inclusion were surveyed.

RESULTS

All participating laboratories (n = 28) reported including physicians/advanced practitioners in implementation communications, while only 10.7% reported inclusion of patients. When reporting on methods of communication, 81.5% (n = 27) of respondents reported using multiple methods of communication with providers and 88.8% issued provider communications prior to implementation. In contrast, when patient communications were delivered, 87.5% (n = 8) issued these communications exclusively after CKD-EPI 2021 implementation and the majority (6 of 8) reported using only one method of communication during delivery. When reporting on content inclusion, 64.3% (n = 28) of laboratories reported including concerns regarding previous race-based eGFR equations in communications with physicians/advanced practitioners, while only 16.7% (n = 18) of those who included this information did so with patients.

CONCLUSIONS

Participants reported limited engagement in CKD-EPI 2021 laboratory-to-patient implementation communications as well as limited inclusion of additional stakeholder groups, as defined in the NKF-WG recommendations. Laboratories utilized multiple communication methods and deliveries in physician/advanced practitioner communications; however, this strategy was not replicated when engaging with additional NKF-WG stakeholder groups.

When Bad News Comes Through the Portal: Strengthening Trust and Guiding Patients When They Receive Bad Results Before Their Clinicians

Communication in oncology was challenging long before the emergence of the US 21st Century Cures Act. Before 2021, a growing body of evidence had demonstrated the benefits of patients' access to and review of the clinical notes in their charts (open notes); however, studies examining the benefits of immediate access to test results were scarce until the implementation of the Cures Act's Information Blocking Rule. Individuals grappling with cancer today now possess immediate access to their laboratory results, imaging scans, diagnostic tests, and progress notes as mandated by law. To many clinicians, the implementation of the Cures Act felt sudden and presented new challenges and concerns for oncologists surrounding patients' potential emotional reactions to medical notes or lack of control over the careful delivery of potentially life-changing information. Despite data that show most patients want immediate access to information in their records before it is communicated directly by a health care professional, surveys of oncologists showed trepidation. In this chapter, perspectives from a patient with cancer, an oncologist, and a cancer psychiatrist (in that order) are shared to illuminate the adjustments made in clinician-patient communication amid the era of nearly instantaneous results within the electronic health record.

Patient Access of Their Radiology Reports Before and After Implementation of 21st Century Cures Act Information-Blocking Provisions at a Large Multicampus Health System

BACKGROUND. To implement provisions of the 21st Century Cures Act that address information blocking, federal regulations mandated that health systems provide patients with immediate access to elements of their electronic health information, including imaging results. OBJECTIVE. The purpose of this study was to compare patient access of radiology reports before and after implementation of the information-blocking provisions of the 21st Century Cures Act. METHODS. This retrospective study included patients who underwent outpatient imaging examinations from January 1, 2021, through December 31, 2022, at three campuses within a large health system. The system implemented policies to comply with the Cures Act information-blocking provisions on January 1, 2022. Imaging results were released in patient portals after a 36-hour embargo period before implementation versus being released immediately after report finalization after implementation. Data regarding patient report access in the portal and report acknowledgment by the ordering provider in the EMR were extracted and compared between periods. RESULTS. The study included reports for 1,188,692 examinations in 388,921 patients (mean age, 58.5 ± 16.6 [SD] years; 209,589 women, 179,290 men, eight nonbinary individuals, and 34 individuals for whom sex information was missing). A total of 77.5% of reports were accessed by the patient before implementation versus 80.4% after implementation. The median time from report finalization to report release in the patient portal was 36.0 hours before implementation versus 0.4 hours after implementation. The median time from report release to first patient access of the report in the portal was 8.7 hours before implementation versus 3.0 hours after implementation. The median time from report finalization to first patient access was 45.0 hours before implementation versus 5.5 hours after implementation. Before implementation, a total of 18.5% of reports were first accessed by the patient before being accessed by the ordering provider versus 44.0% after implementation. After implementation, the median time from report release to first patient access was 1.8 hours for patients with age younger than 60 years old versus 4.3 hours for patients 60 years old or older. CONCLUSION. After implementation of institutional policies to comply with 21st Century Cures Act information-blocking provisions, the length of time until patients accessed imaging results decreased, and the proportion of patients who accessed their reports before the ordering provider increased. CLINICAL IMPACT. Radiologists should consider mechanisms to ensure timely and appropriate communication of important findings to ordering providers.

Real-Time Electronic Patient Portal Use Among Emergency Department Patients

Importance

Patients with inequitable access to patient portals frequently present to emergency departments (EDs) for care. Little is known about portal use patterns among ED patients.

Objectives

To describe real-time patient portal usage trends among ED patients and compare demographic and clinical characteristics between portal users and nonusers.

Design, Setting, and Participants

In this cross-sectional study of 12 teaching and 24 academic-affiliated EDs from 8 health systems in California, Connecticut, Massachusetts, Ohio, Tennessee, Texas, and Washington, patient portal access and usage data were evaluated for all ED patients 18 years or older between April 5, 2021, and April 4, 2022.

Exposure

Use of the patient portal during ED visit.

Main Outcomes and Measures

The primary outcomes were the weekly proportions of ED patients who logged into the portal, viewed test results, and viewed clinical notes in real time. Pooled random-effects models were used to evaluate temporal trends and demographic and clinical characteristics associated with real-time portal use.

Results

The study included 1 280 924 unique patient encounters (53.5% female; 0.6% American Indian or Alaska Native, 3.7% Asian, 18.0% Black, 10.7% Hispanic, 0.4% Native Hawaiian or Pacific Islander, 66.5% White, 10.0% other race, and 4.0% with missing race or ethnicity; 91.2% English-speaking patients; mean [SD] age, 51.9 [19.2] years). During the study, 17.4% of patients logged into the portal while in the ED, whereas 14.1% viewed test results and 2.5% viewed clinical notes. The odds of accessing the portal (odds ratio [OR], 1.36; 95% CI, 1.19-1.56), viewing test results (OR, 1.63; 95% CI, 1.30-2.04), and viewing clinical notes (OR, 1.60; 95% CI, 1.19-2.15) were higher at the end of the study vs the beginning. Patients with active portal accounts at ED arrival had a higher odds of logging into the portal (OR, 17.73; 95% CI, 9.37-33.56), viewing test results (OR, 18.50; 95% CI, 9.62-35.57), and viewing clinical notes (OR, 18.40; 95% CI, 10.31-32.86). Patients who were male, Black, or without commercial insurance had lower odds of logging into the portal, viewing results, and viewing clinical notes.

Conclusions and Relevance

These findings suggest that real-time patient portal use during ED encounters has increased over time, but disparities exist in portal access that mirror trends in portal usage more generally. Given emergency medicine's role in caring for medically underserved patients, there are opportunities for EDs to enroll and train patients in using patient portals to promote engagement during and after their visits.

Evaluation of a Generative Language Model Tool for Writing Examination Questions

OBJECTIVE

To describe an evaluation of a generative language model tool to write examination questions for a new elective course focused on the interpretation of common clinical laboratory results being developed as an elective for students in a Bachelor of Science in Pharmaceutical Sciences program.

METHODS

A total of 100 multiple-choice questions were generated using a publicly available large language model for a course dealing with common laboratory values. Two independent evaluators with extensive training and experience in writing multiple-choice questions evaluated each question for appropriate formatting, clarity, correctness, relevancy, and difficulty. For each question, a final dichotomous judgment was assigned by each reviewer, usable as written or not usable written.

RESULTS

The major finding of this study was that a generative language model (ChatGPT 3.5) could generate multiple-choice questions for assessing common laboratory value information but only about half the questions (50% and 57% for the 2 evaluators) were deemed usable without modification. General agreement between evaluator comments was common (62% of comments) with more than 1 correct answer being the most common reason for commenting on the lack of usability (N = 27).

CONCLUSION

The generally positive findings of this study suggest that the use of a generative language model tool for developing examination questions is deserving of further investigation.

Contemporary Trends in Reviewing Test Results Through the Electronic Patient Portal Among Patients With Cancer

This cohort study among patients with cancer examines changes in the time from posting of test results in the electronic health record to patient viewing in the patient portal before and after implementation of the 21st Century Cures Act.

Enabling awareness, agency and participation: Haematology patient experiences of an (in)patient portal's information affordances

This study examines patient experiences of an inpatient portal's information affordances, including access to results, notes, vital signs, medication information and a schedule. Patient participants were recruited from an inpatient ward primarily catering to patients with haematological malignancies including leukaemia and bone marrow transplant recipients at the Royal Melbourne Hospital. Although focused on the inpatient experience of a portal's information affordances accessed via a hospital-provided tablet, due to limited patient access to notes in the inpatient context, this study also explored patient experiences of their outpatient portal notes accessed via their smartphone. This study demonstrates the value of an (in)patient portal in enabling patient awareness, agency and participation in their care. It shows how an (in)patient portal not only helps patients make informed decisions in their care, but can also initiate patient conversation and collaboration with clinicians. This study points how the digital mediation of healthcare can provide greater transparency in the patient-clinician relationship and address the information asymmetry that typically characterises this relationship, particularly in the Australian context, where inpatient portals are still in their infancy.

Information transparency with immediate release: Oncology clinician and patient perceptions

INTRODUCTION

As part of the 21st Century Cures Act (April 2021), electronic health information (EHI) must be immediately released to patients. In this study, we sought to evaluate clinician and patient perceptions regarding this immediate release.

METHODS

After surveying 33 clinicians and 30 patients, semi-structured interviews were conducted with a subset of the initial sample, comprising 8 clinicians and 12 patients. Open-ended questions explored clinicians' and patients' perceptions of immediate release of EHI and how they adjusted to this change.

RESULTS

Ten themes were identified: Interpreting Results, Strategies for Patient Interaction, Patient Experiences, Communication Strategies, Provider Limitations, Provider Experiences, Health Information Interfaces, Barriers to Patient Understanding, Types of Results, and Changes due to Immediate Release. Interviews demonstrated differences in perceived patient distress and comprehension, emphasizing the impersonal nature of electronic release and necessity for therapeutic clinician-patient communication.

CONCLUSIONS

Clinicians and patients have unique insights on the role of immediate release. Understanding these perspectives will help improve communication and develop patient-centered tools (glossaries, summary pages, additional resources) to aid patient understanding of complex medical information.

Progress and Persistent Disparities in Patient Access to Electronic Health Information

Importance

Patient access to electronic health information (EHI) available via online medical records and through patient portals has been shown to help individuals make informed health decisions, which are associated with better health outcomes.

Objective

To assess progress in patient engagement with EHI and to identify racial or ethnic disparities in access to patient portals.

Design, Setting, and Participants

This was a repeated cross-sectional study using data from the US Health Information National Trends Survey (HINTS), a nationally representative survey of US adults that tracks individuals' access and use of their health information. Six cycles of HINTS were included (2014, 2017-2020, 2022); data for the disparities analysis came from the 2022 HINTS. Data analyses were performed in April 2023.

Main Outcomes and Measures

Patient reports of (1) being offered portal access by a health care provider (HCP); (2) being encouraged by the HCP to use the portal; (3) accessing their portal; and (4) using the portal for various purposes. Additional key measures included methods used to access portals and self-reported ease of understanding information contained in the online medical records or portals.

Results

The total study population included 22 266 individuals (mean [SE] age, 49.9 [0.15] years) of whom 13 348 (54%) were female; 909 (5%) self-identified as Asian, 3523 (12%) as Black, 3178 (14%) as Hispanic, 13 555 (66%) as White, and 785 (3%) as another or more than 1 race. Nationally, patient portal access increased each year from 2014 through 2022, with a 46% increase observed between 2020 (n = 3319) and 2022 (n = 5437). However, in 2022, Black and Hispanic individuals reported being offered access to a portal by their HCP at significantly lower rates compared with White individuals (73% vs 81%; χ21 = 22.24; P < .001; and 62% vs 81%; χ21 = 135.57; P < .001, respectively) as well as accessing a patient portal at lower rates (60% vs 70%; χ21 = 23.80; P < .001; and 57% vs 70%; χ21 = 49.02; P < .001, respectively).

Conclusions and Relevance

The findings of this repeated cross-sectional study of US adult respondents to the HINTS suggest that access to and engagement with patient portals increased significantly from 2014 through 2022, but racial and ethnic disparities in patient access persisted in 2022. However, there were no significant differences in use or understanding of information available in the online medical records among those who accessed them, which suggests that efforts to promote equitable opportunities to access EHI would likely be associated with increased patient access.

Automation in health care: the need for an ergonomics-based approach

Healthcare quality and efficiency challenges degrade outcomes and burden multiple stakeholders. Workforce shortage, burnout, and complexity of workflows necessitate effective support for patients and providers. There is interest in employing automation, or the use of 'computer[s] [to] carry out… functions that the human operator would normally perform', in health care to improve delivery of services. However, unique aspects of health care require analysis of workflows across several domains and an understanding of the ways work system factors interact to shape those workflows. Ergonomics has identified key work system issues relevant to effective automation in other industries. Understanding these issues in health care can direct opportunities for the effective use of automation in health care. This article illustrates work system considerations using two example workflows; discusses how those considerations may inform solution design, implementation, and use; and provides future directions to advance the essential role of ergonomics in healthcare automation.

Impact of notification policy on patient-before-clinician review of immediately released test results

The 21st Century Cures Act mandates immediate availability of test results upon request. The Cures Act does not require that patients be informed of results, but many organizations send notifications when results become available. Our medical center implemented 2 sequential policies: immediate notifications for all results, and notifications only to patients who opt in. We used over 2 years of data from Vanderbilt University Medical Center to measure the effect of these policies on rates of patient-before-clinician result review and patient-initiated messaging using interrupted time series analysis. When releasing test results with immediate notification, the proportion of patient-before-clinician review increased 4-fold and the proportion of patients who sent messages rose 3%. After transition to opt-in notifications, patient-before-clinician review decreased 2.4% and patient-initiated messaging decreased 0.4%. Replacing automated notifications with an opt-in policy provides patients flexibility to indicate their preferences but may not substantially alleviate clinicians' messaging workload.

Taking It to the States: Adapting Information Blocking Legislation to Oncology

Oncologists have successfully pushed for new state laws on how we release life-changing test results

Oncology Clinicians' Perspectives on Online Patient Portal Use in Pediatric and Adolescent Cancer

PURPOSE

Online patient portals represent widely available communication tools in pediatric oncology. Previous studies have not evaluated clinicians' perspectives on portal use, including issues related to access to adolescents' portals.

METHODS

We performed semistructured interviews with physicians and advanced practice providers (APPs) who care for children or adolescents with cancer. We performed thematic analysis of benefits, problems, and accommodations related to portal use in oncology.

RESULTS

We interviewed 29 physicians and 24 APPs representing 26 institutions. Participants described five themes of benefits provided by portals: (1) empowering adolescents, (2) improving efficiency and accuracy of communication, (3) promoting open and adaptive communication, (4) supporting parents in managing care, and (5) bolstering clinical relationships. Participants described eight themes of problems caused by portal access: (1) creating emotional distress and confusion, (2) increasing workload and changing workflows, (3) threatening adolescent confidentiality, (4) adolescents lacking interest to engage, (5) diminishing clinical relationship, (6) misusing portal messages, (7) diminishing quality of sensitive documentation, and (8) parents losing access to adolescents' records. Participants described three themes related to accommodations they made as a result of portal access: (1) modifying note writing, (2) providing anticipatory guidance about viewing results, and (3) adapting workflows. Some portal functions created either benefits or problems depending on the clinical context.

CONCLUSION

Oncologists identified benefits and problems created by portal use, which were sometimes in tension, depending on the clinical context. To make portals useful, we must take steps to mitigate risks while preserving functionality for parents and adolescent patients.

Unsolicited Patient Complaints Following the 21st Century Cures Act Information-Blocking Rule

Importance

The 21st Century Cures Act includes an information-blocking rule (IBR) that requires health systems to provide patients with immediate access to their health information in the electronic medical record upon request. Patients accessing their health information before they receive an explanation from their health care team may experience confusion and may be more likely to share unsolicited patient complaints (UPCs) with their health care organization.

Objective

To evaluate the quantity of UPCs about physicians before and after IBR implementation and to identify themes in UPCs that may identify patient confusion, fear, or anger related to the release of information.

Design, Setting, and Participants

This retrospective cohort study was conducted with an interrupted time-series analysis of UPCs spanning January 1, 2020, to June 30, 2022. The data were obtained from a single academic medical center, Vanderbilt University Medical Center, at which the IBR was implemented on January 20, 2021. Data analysis was performed from January 11 to July 15, 2023.

Exposure

Implementation of the IBR on January 20, 2021.

Main Outcomes and Measures

The primary outcome was the monthly rate of UPCs before and after IBR implementation. A qualitative analysis was performed for UPCs received after IBR implementation. The Wilcoxon rank-sum test was used to compare monthly complaints between the pre- and post-IBR groups. The Pearson χ2 test was used to compare proportions of complaints by UPC category between time periods.

Results

The medical center received 8495 UPCs during the study period: 3022 over 12 months before and 5473 over 18 months after institutional IBR implementation. There was no difference in the monthly proportions of UPCs per 1000 patient encounters before (median, 0.81 [IQR, 0.75-0.88]) and after (median, 0.83 [IQR, 0.77-0.89]) IBR implementation (difference in medians, -0.02 [95% CI, -0.12 to 0.07]; P =.86). Segmented regression analysis revealed no difference in monthly UPCs (β [SE], 0.03 [0.09]; P =.72).

Conclusions and Relevance

In this cohort study, implementation of the Cures Act IBR was not associated with an increase in monthly rates of UPCs. These findings suggest that review of UPCs identified as IBR-specific complaints may allow clinicians and organizations to prepare patients that their test and procedure results may be available before clinicians are able to review them and respond.

Patient Preferences With Regard to Care Structures for Cervical or Vulvar Dysplasia in Certified Dysplasia Clinics in Germany

BACKGROUND/AIM

The aim of this study was to evaluate patient preferences regarding cervical dysplasia clinics. Specifically, preferences in terms of diagnostic and therapeutic pathways as well as logistical and structural aspects were addressed to recognize unmet needs and improve existing structures of cervical dysplasia care.

PATIENTS AND METHODS

This questionnaire-based study was conducted between June and December 2022 at an academic medical center in Southwestern Germany. A total of 226 patients who had an appointment at the certified dysplasia clinic were included.

RESULTS

The vast majority of patients (74.8%) preferred counseling at the certified dysplasia clinic in the case of an abnormal finding of the cervix or labia. A prompt appointment (within a maximum of 4 weeks), a timely notification about test results (within a maximum of 2 weeks), a travel time <60 minutes and seeing the same doctor during follow-up appointments were recognized as important aspects. While about half of the patients (53.5%) were indifferent to the sex of the gynecologist, almost all of the remaining patients stated they would prefer to be seen by a female doctor (44.3% female doctor vs. 2.2% male doctor).

CONCLUSION

Most women expect very timely appointments and result notifications. Moreover, they favor short travel times and continuity of care. The identified patient preferences should be considered to increase patient satisfaction and quality of care when developing and optimizing management at specialized dysplasia clinics.

Clinical decision support and electronic interventions to improve care quality in chronic liver diseases and cirrhosis

Significant quality gaps exist in the management of chronic liver diseases and cirrhosis. Clinical decision support systems-information-driven tools based in and launched from the electronic health record-are attractive and potentially scalable prospective interventions that could help standardize clinical care in hepatology. Yet, clinical decision support systems have had a mixed record in clinical medicine due to issues with interoperability and compatibility with clinical workflows. In this review, we discuss the conceptual origins of clinical decision support systems, existing applications in liver diseases, issues and challenges with implementation, and emerging strategies to improve their integration in hepatology care.

The State-of-the-Art of Patient Portals: Adapting to External Factors, Addressing Barriers, and Innovating

BACKGROUND AND OBJECTIVE

Recent external factors-the 21st Century Cures Act and the coronavirus disease 2019 (COVID-19) pandemic-have stimulated major changes in the patient portal landscape. The objective of this state-of-the-art review is to describe recent developments in the patient portal literature and to identify recommendations and future directions for the design, implementation, and evaluation of portals.

METHODS

To focus this review on salient contemporary issues, we elected to center it on four topics: (1) 21st Century Cures Act's impact on patient portals (e.g., Open Notes); (2) COVID-19's pandemic impact on portals; (3) proxy access to portals; and (4) disparities in portal adoption and use. We conducted targeted PubMed searches to identify recent empirical studies addressing these topics, used a two-part screening process to determine relevance, and conducted thematic analyses.

RESULTS

Our search identified 174 unique papers, 74 were relevant empirical studies and included in this review. Among these papers, we identified 10 themes within our four a priori topics, including preparing for and understanding the consequences of increased patient access to their electronic health information (Cures Act); developing, deploying, and evaluating new virtual care processes (COVID-19); understanding current barriers to formal proxy use (proxy access); and addressing disparities in portal adoption and use (disparities).

CONCLUSION

Our results suggest that the recent trends toward understanding the implications of immediate access to most test results, exploring ways to close gaps in portal adoption and use among different sub-populations, and finding ways to leverage portals to improve health and health care are the next steps in the maturation of patient portals and are key areas that require more research. It is important that health care organizations share their innovative portal efforts, so that successful measures can be tested in other contexts, and progress can continue.

"I don't think it should take you three days to tell me my baby is dead." A case of fetal demise: unintended consequences of immediate release of information

The 21st Century Cures Act (Cures Act) information blocking regulations mandate timely patient access to their electronic health information. In most healthcare systems, this technically requires immediate electronic release of test results and clinical notes directly to patients. Patients could potentially be distressed by receiving upsetting results through an electronic portal rather than from a clinician. We present a case from 2018, several years prior to the implementation of the Cures Act. A patient was notified of fetal demise detected by ultrasound through her electronic health record (EHR) patient portal before her clinician received the result. We discuss the patient's ensuing complaint and healthcare system response. This unusual and dramatic case of fetal demise is relevant today because it underscores the importance of involving a patient and family advisory council in decision-making. It also highlights the value of "anticipatory guidance" as a routine clinical practice in this era of immediate access to test results.

Feasibility and acceptability of ChatGPT generated radiology report summaries for cancer patients

Objective

Patients now have direct access to their radiology reports, which can include complex terminology and be difficult to understand. We assessed ChatGPT's ability to generate summarized MRI reports for patients with prostate cancer and evaluated physician satisfaction with the artificial intelligence (AI)-summarized report.

Methods

We used ChatGPT to summarize five full MRI reports for patients with prostate cancer performed at a single institution from 2021 to 2022. Three summarized reports were generated for each full MRI report. Full MRI and summarized reports were assessed for readability using Flesch-Kincaid Grade Level (FK) score. Radiation oncologists were asked to evaluate the AI-summarized reports via an anonymous questionnaire. Qualitative responses were given on a 1-5 Likert-type scale. Fifty newly diagnosed prostate cancer patient MRIs performed at a single institution were additionally assessed for physician online portal response rates.

Results

Fifteen summarized reports were generated from five full MRI reports using ChatGPT. The median FK score for the full MRI reports and summarized reports was 9.6 vs. 5.0, (p < 0.05), respectively. Twelve radiation oncologists responded to our questionnaire. The mean [SD] ratings for summarized reports were factual correctness (4.0 [0.6], understanding 4.0 [0.7]), completeness (4.1 [0.5]), potential for harm (3.5 [0.9]), overall quality (3.4 [0.9]), and likelihood to send to patient (3.1 [1.1]). Current physician online portal response rates were 14/50 (28%) at our institution.

Conclusions

We demonstrate a novel application of ChatGPT to summarize MRI reports at a reading level appropriate for patients. Physicians were likely to be satisfied with the summarized reports with respect to factual correctness, ease of understanding, and completeness. Physicians were less likely to be satisfied with respect to potential for harm, overall quality, and likelihood to send to patients. Further research is needed to optimize ChatGPT's ability to summarize radiology reports and understand what factors influence physician trust in AI-summarized reports.