1
|
Bartek B, Lou S, Kannampallil T. Measuring the Cognitive Effort Associated with Task Switching in Routine EHR-based Tasks. J Biomed Inform 2023; 141:104349. [PMID: 37015304 DOI: 10.1016/j.jbi.2023.104349] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 03/22/2023] [Accepted: 03/29/2023] [Indexed: 04/06/2023]
Abstract
OBJECTIVE Clinical work involves performing overlapping, time-sensitive tasks that frequently require clinicians to switch their attention between multiple tasks. We developed a methodological approach using EHR-based audit logs to determine switch costs-the cognitive burden associated with task switching-and assessed its magnitude during routine EHR-based clinical tasks. METHOD Physician trainees (N=75) participated in a longitudinal study where they provided access to their EHR-based audit logs. Physicians' audit log actions were used to create a taxonomy of EHR tasks. These tasks were transformed into task sequences and the time spent on each task in a sequence was computed. Within these task sequences, instances of task switching (i.e., switching from one task to the next) and non-switching were identified. The primary outcome of interest was the time spent on a post-switch task. Using a mixed-effects regression model, we compared the durations of post-switch and non-switch tasks. RESULTS 2,781,679 audit log events over 117,822 sessions from 75 physicians were analyzed. Physicians spent most time on chart review (Median (IQR)=5,439 (2,492-8,336) seconds), note review (1,936 (827-3,321) seconds), and navigating the EHR interface (1,048 (365.5-2,006) seconds) daily. Post task switch activity times were greater for documentation (Median increase=5 seconds), order entry (Median increase=3 seconds) and results review (Median increase=3 seconds). Mixed-effects regression showed that time spent on tasks were longer following a task switch (β=0.03; 95% CIlower= 0.027, CIupper=0.034), with greater post-swtich task times for imaging, order entry, note review, handoff, note entry, chart review and best practice advisory tasks. DISCUSSION Increased task switching time-an indicator of the cognitive burden associated with switching between tasks-is prevalent in routine EHR-based tasks. We discuss the cumulative impact of incremental switch costs have on overall EHR workload, wellness, and error rates. Relying on theoretical cognitive foundations, we suggest pragmatic design considerations for mitigating the effects of cognitive burden associated with task switching.
Collapse
Affiliation(s)
| | - Sunny Lou
- Institute for Informatics; Department of Anesthesiology, School of Medicine
| | - Thomas Kannampallil
- Institute for Informatics; Department of Anesthesiology, School of Medicine; Department of Computer Science and Engineering, McKelvey School of Engineering, Washington University in St Louis, St Louis, MO, USA.
| |
Collapse
|
2
|
Brown RJL, Michalowski M. Nurses' Utilization of Information Resources for Patient Care Tasks: A Survey of Critical Care Nurses in an Urban Hospital Setting. Comput Inform Nurs 2022; 40:691-698. [PMID: 35483103 PMCID: PMC9547811 DOI: 10.1097/cin.0000000000000908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Critical care nurses manage complex patient care interventions under dynamic, time-sensitive and constrained conditions, yet clinical decision support systems for nurses are limited compared with advanced practice healthcare providers. In this work, we study and analyze nurses' information-seeking behaviors to inform the development of a clinical decision support system that supports nurses. Nurses from an urban midwestern hospital were recruited to complete an online survey containing eight open-ended questions about resource utilization for various nursing tasks and open space for additional insights. Frequencies and percentages were calculated for resource type, bivariate analyses using Pearson's χ2 test were conducted for differences in resources utilization by years of experience, and content analysis of free text was completed. Forty-five nurses (response rate, 19.6%) identified 38 unique resources, which we organized into a resource taxonomy. Institutional applications were the most common type of resource used (35.6% of all responses) but accounted for only 15.4% of respondents' "go-to resources," suggesting potential areas for improvement. Our findings highlight that knowing where to look for information, the existence of comprehensive information, and fast and easy retrieval of information are key resource seeking attributes that must be considered when designing a clinical decision support system.
Collapse
Affiliation(s)
- Rebecca J L Brown
- Author Affiliations: University of Minnesota School of Nursing, Minneapolis (Dr Brown); and Minneapolis VA Healthcare System, Minnesota (Drs Brown and Michalowski)
| | | |
Collapse
|
3
|
Huilgol YS, Adler‐Milstein J, Ivey SL, Hong JC. Opportunities to use electronic health record audit logs to improve cancer care. Cancer Med 2022; 11:3296-3303. [PMID: 35348298 PMCID: PMC9468426 DOI: 10.1002/cam4.4690] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Revised: 01/21/2022] [Accepted: 03/10/2022] [Indexed: 12/11/2022] Open
Abstract
The rapid adoption of electronic health records (EHRs) has created extensive repositories of digitized data that can be used to inform improvements in care delivery, processes, and patient outcomes. While the clinical data captured in EHRs are widely used for such efforts, EHRs also capture audit log data that reflect how users interact with the EHR to deliver care. Automatically collected audit log data provide a unique opportunity for new insights into EHR user behavior and decision‐making processes. Here, we provide an overview of audit log data and examples that could be used to improve oncology care and outcomes in four domains: diagnostic reasoning and consumption, care team collaboration and communication, patient outcomes and experience, and provider burnout/fatigue. This data source could identify gaps in performance and care, physician uptake of EHR features that enhance decision‐making, and integration of data trends for oncology. Ensuring researchers and oncologists are familiar with the data's potential and developing the data engineering capacity to utilize this rich data source, will expand the breadth of research to improve cancer care.
Collapse
Affiliation(s)
- Yash S. Huilgol
- UC Berkeley‐UCSF Joint Medical Program University of California Berkeley California USA
- School of Medicine University of California San Francisco California USA
| | - Julia Adler‐Milstein
- School of Medicine University of California San Francisco California USA
- Center for Clinical Informatics and Improvement Research (CLIIR) University of California San Francisco California USA
| | - Susan L. Ivey
- UC Berkeley‐UCSF Joint Medical Program University of California Berkeley California USA
- School of Public Health University of California Berkeley California USA
| | - Julian C. Hong
- Bakar Computational Health Sciences Institute University of California San Francisco California USA
- Department of Radiation Oncology University of California San Francisco California USA
| |
Collapse
|
4
|
King AJ, Calzoni L, Tajgardoon M, Cooper GF, Clermont G, Hochheiser H, Visweswaran S. A simple electronic medical record system designed for research. JAMIA Open 2021; 4:ooab040. [PMID: 34345801 PMCID: PMC8325484 DOI: 10.1093/jamiaopen/ooab040] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2020] [Revised: 03/23/2021] [Accepted: 05/05/2021] [Indexed: 11/14/2022] Open
Abstract
With the extensive deployment of electronic medical record (EMR) systems, EMR usability remains a significant source of frustration to clinicians. There is a significant research need for software that emulates EMR systems and enables investigators to conduct laboratory-based human–computer interaction studies. We developed an open-source software package that implements the display functions of an EMR system. The user interface emphasizes the temporal display of vital signs, medication administrations, and laboratory test results. It is well suited to support research about clinician information-seeking behaviors and adaptive user interfaces in terms of measures that include task accuracy, time to completion, and cognitive load. The Simple EMR System is freely available to the research community and is on GitHub.
Collapse
Affiliation(s)
- Andrew J King
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA.,Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Luca Calzoni
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | | | - Gregory F Cooper
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA.,Intelligent Systems Program, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Gilles Clermont
- Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Harry Hochheiser
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA.,Intelligent Systems Program, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA.,Intelligent Systems Program, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| |
Collapse
|
5
|
Interprofessional Training and Communication Practices Among Clinicians in the Postoperative ICU Handoff. Jt Comm J Qual Patient Saf 2020; 47:242-249. [PMID: 33451897 DOI: 10.1016/j.jcjq.2020.12.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Revised: 12/02/2020] [Accepted: 12/04/2020] [Indexed: 11/22/2022]
Abstract
BACKGROUND Operating room (OR)-to-ICU handoffs require coordinated communication between clinicians with different professional backgrounds. However, individual studies have not simultaneously evaluated handoff training and OR-to-ICU handoff practices among interprofessional clinicians that participate in these team-based handoffs. METHODS The objective of this study was to characterize communication training, practices, and preferences of interprofessional clinicians who engage in OR-to-ICU handoffs. The researchers conducted a mixed methods cohort study using surveys (quantitative) and semistructured interviews (qualitative). Surveys aimed to quantitatively assess the quality of prior handoff training, preferences for clinical information in handoffs, and participation in various handoff activities. Interviews aimed to elicit more in-depth clinician perspectives on these topics through open-ended discussion. The frontline clinicians who were surveyed and interviewed included surgery and anesthesia residents, registered nurses, and advanced practice providers who worked in two ICUs at an urban academic medical center in the United States. RESULTS In a survey with a 71.8% response rate (130/181), 45.7% (32/70) of residents, 17.4% (4/23) of certified registered nurse anesthetists (CRNAs), 83.3% (10/12) of ICU nurse practitioners (NPs), and 81.0% (17/21) of ICU RNs indicated that their clinical degree-granting education had not provided adequate preparation for OR-to-ICU handoffs. On-the-job training was deemed not adequate preparation by 35.7% (25/70) of residents, 21.7% (5/23) of CRNAs, 58.3% (7/12) of ICU NPs, and 23.8% (5/21) of ICU RNs. Through 30 semistructured interviews, clinicians from all professions expressed interest in interprofessional communication education and in understanding the perspectives and priorities of care team members in OR-to-ICU handoffs. Clinicians also highlighted the potential value of interprofessional communication training taking place early in a clinical career, during degree-granting education. CONCLUSION Clinicians exhibit profession-based differences in OR-to-ICU handoff training, practices, and information needs. Education focused on interprofessional communication is a potential approach to facilitate improved OR-to-ICU handoff communication.
Collapse
|
6
|
Calzoni L, Clermont G, Cooper GF, Visweswaran S, Hochheiser H. Graphical Presentations of Clinical Data in a Learning Electronic Medical Record. Appl Clin Inform 2020; 11:680-691. [PMID: 33058103 PMCID: PMC7560537 DOI: 10.1055/s-0040-1709707] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023] Open
Abstract
BACKGROUND Complex electronic medical records (EMRs) presenting large amounts of data create risks of cognitive overload. We are designing a Learning EMR (LEMR) system that utilizes models of intensive care unit (ICU) physicians' data access patterns to identify and then highlight the most relevant data for each patient. OBJECTIVES We used insights from literature and feedback from potential users to inform the design of an EMR display capable of highlighting relevant information. METHODS We used a review of relevant literature to guide the design of preliminary paper prototypes of the LEMR user interface. We observed five ICU physicians using their current EMR systems in preparation for morning rounds. Participants were interviewed and asked to explain their interactions and challenges with the EMR systems. Findings informed the revision of our prototypes. Finally, we conducted a focus group with five ICU physicians to elicit feedback on our designs and to generate ideas for our final prototypes using participatory design methods. RESULTS Participating physicians expressed support for the LEMR system. Identified design requirements included the display of data essential for every patient together with diagnosis-specific data and new or significantly changed information. Respondents expressed preferences for fishbones to organize labs, mouseovers to access additional details, and unobtrusive alerts minimizing color-coding. To address the concern about possible physician overreliance on highlighting, participants suggested that non-highlighted data should remain accessible. Study findings led to revised prototypes, which will inform the development of a functional user interface. CONCLUSION In the feedback we received, physicians supported pursuing the concept of a LEMR system. By introducing novel ways to support physicians' cognitive abilities, such a system has the potential to enhance physician EMR use and lead to better patient outcomes. Future plans include laboratory studies of both the utility of the proposed designs on decision-making, and the possible impact of any automation bias.
Collapse
Affiliation(s)
- Luca Calzoni
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, United States
| | - Gilles Clermont
- Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, United States
| | - Gregory F Cooper
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, United States
- Intelligent Systems Program, University of Pittsburgh, Pittsburgh, Pennsylvania, United States
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, United States
- Intelligent Systems Program, University of Pittsburgh, Pittsburgh, Pennsylvania, United States
| | - Harry Hochheiser
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, United States
- Intelligent Systems Program, University of Pittsburgh, Pittsburgh, Pennsylvania, United States
| |
Collapse
|
7
|
Krawiec C, Stetter C, Kong L, Haidet P. Impact of Patient Census and Admission Mortality on Pediatric Intensive Care Unit Attending Electronic Health Record Activity: A Preliminary Study. Appl Clin Inform 2020; 11:226-234. [PMID: 32215894 DOI: 10.1055/s-0040-1705108] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
BACKGROUND Physicians may spend a significant amount of time using the electronic health record (EHR), but this is understudied in the pediatric intensive care unit (PICU). The objective of this study is to quantify PICU attending physician EHR usage and determine its association with patient census and mortality scores. METHODS During the year 2016, total EHR, chart review, and documentation times of 7 PICU physicians were collected retrospectively utilizing an EHR-embedded time tracking software package. We examined associations between documentation times and patient census and maximum admission mortality scores. Odds ratios (ORs) are reported per 1-unit increase in patient census and mortality scores. RESULTS Overall, total daily EHR usage time (median time [hh:mm] [25th, 75th percentile]) was 2:10 (1:31, 3:08). For all hours (8 a.m.-8 a.m.), no strong association was noted between total EHR time, chart review, and documentation times and patient census, Pediatric Index of Mortality 2 (PIM2), or Pediatric Risk of Mortality 3 (PRISM3) scores. For regular hours (8 a.m.-7 p.m.), no strong association was noted between total EHR, chart review, and documentation times and patient census, PIM2, or PRISM3 scores. When patient census was higher, the odds of EHR after-hour usage (7 p.m.-8 a.m.) was higher (OR 1.262 [1.135, 1.403], p < 0.0001), but there were no increased odds with PIM2 (OR 1.090 [0.956, 1.242], p = 0.20) and PRISM3 (OR 1.010 [0.984, 1.036], p = 0.47) scores. A subset of physicians spent less time performing EHR-related tasks when patient census and admission mortality scores were elevated. CONCLUSION We performed a novel evaluation of physician EHR workflow in our PICU. Our pediatric critical care physicians spend approximately 2 hours (out of an expected 10-hour shift) each service day using the EHR, but there was no strong or consistent association between EHR usage and patient census or mortality scores. Future larger scale studies are needed to ensure validity of these results.
Collapse
Affiliation(s)
- Conrad Krawiec
- Pediatric Critical Care Medicine, Department of Pediatrics, Penn State Milton S. Hershey Medical Center, Penn State Hershey College of Medicine, Penn State Hershey Children's Hospital, Hershey, Pennsylvania, United States
| | - Christy Stetter
- Department of Public Health Sciences, Pennsylvania State University College of Medicine, Hershey, Pennsylvania, United States
| | - Lan Kong
- Department of Public Health Sciences, Pennsylvania State University College of Medicine, Hershey, Pennsylvania, United States
| | - Paul Haidet
- Office for Scholarship in Learning and Education Research, Pennsylvania State University College of Medicine, Hershey, Pennsylvania, United States.,Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pennsylvania, United States.,Department of Humanities, Pennsylvania State University College of Medicine, Hershey, Pennsylvania, United States
| |
Collapse
|
8
|
Ruppel H, Bhardwaj A, Manickam RN, Adler-Milstein J, Flagg M, Ballesca M, Liu VX. Assessment of Electronic Health Record Search Patterns and Practices by Practitioners in a Large Integrated Health Care System. JAMA Netw Open 2020; 3:e200512. [PMID: 32142128 PMCID: PMC7060491 DOI: 10.1001/jamanetworkopen.2020.0512] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
IMPORTANCE The electronic health record (EHR) is a source of practitioner dissatisfaction in part because of challenges with information retrieval. To improve data accessibility, a better understanding of practitioners' information needs within individual patient records is needed. OBJECTIVE To assess EHR users' searches using data from a large integrated health care system. DESIGN, SETTING, AND PARTICIPANTS This retrospective cross-sectional analysis used EHR search data from Kaiser Permanente Northern California, an integrated health care delivery system with more than 4.4 million members. Users' EHR search activity data were obtained from April 1, 2018, to May 15, 2019. MAIN OUTCOMES AND MEASURES Search term frequency was grouped by user and practitioner types. Network analyses were performed of co-occurring search terms within a single search episode, and centrality measures for search terms (degree and betweenness centrality) were calculated. RESULTS A total of 12 313 047 search activities (including 4 328 330 searches and 7 984 717 result views) conducted by 34 735 unique users within 977 160 unique patient EHRs were identified. In aggregate, users searched for 208 374 unique search terms and conducted a median of 4 searches (interquartile range, 1-28 searches). Of all 97 367 active EHR users, 34 735 (35.7%) conducted at least 1 search. However, of all 12 968 active EHR physician users, 9801 (75.6%) conducted at least 1 search, and of all 1908 active pharmacist users, 1402 (73.5%) conducted at least 1 search. The top 3 most commonly searched terms were statin (75 017 searches [1.7%]), colonoscopy (73 545 [1.7%]), and pft (54 990 [1.3%]). However, wide variation in top searches were noted across practitioner groups. Terms searched most often with another term in a single linked search episode included statin, lisinopril, colonoscopy, gabapentin, and aspirin. CONCLUSIONS AND RELEVANCE Although physicians and pharmacists were the most active users of EHR searches, search volume and frequently searched terms varied considerably by and within user role. Further customization of the EHR interface may help leverage users' search content and patterns to improve targeted information retrieval.
Collapse
Affiliation(s)
- Halley Ruppel
- Division of Research, Kaiser Permanente Northern California, Oakland
| | - Aashish Bhardwaj
- Division of Research, Kaiser Permanente Northern California, Oakland
| | - Raj N. Manickam
- Division of Research, Kaiser Permanente Northern California, Oakland
| | | | - Marc Flagg
- The Permanente Medical Group, Oakland, California
| | | | - Vincent X. Liu
- Division of Research, Kaiser Permanente Northern California, Oakland
- The Permanente Medical Group, Oakland, California
| |
Collapse
|
9
|
Krawiec C. Why Residency Programs Should Not Ignore the Electronic Heath Record after Adoption. PERSPECTIVES IN HEALTH INFORMATION MANAGEMENT 2019; 16:1d. [PMID: 31908628 PMCID: PMC6931052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
During residency training, one of the tools residents learn to use is the electronic health record (EHR). The EHR contains up-to-date medical data that are crucial to the care of the patient; thus the provider must know what is pertinent, where to locate it, and how to efficiently document the data for ongoing communication of patient care. Because institutions may have different EHR vendors, EHR workflow study data are often obtained in single institutions, with a limited number of participants and specialties. Increasing our understanding of the subtleties of residents' EHR usage not only can help educators understand how residents use the EHR but also may provide information on another cognitive factor to assess residents' performance. This, however, will only occur when EHR skills are considered an important part of residency training and we ask our EHR vendors to help us develop validated electronic tools to assess EHR performance.
Collapse
|
10
|
Bordley J, Sakata KK, Bierman J, McGrath K, Mulanax A, Nguyen L, Mohan V, Gold JA. Use of a Novel, Electronic Health Record-Centered, Interprofessional ICU Rounding Simulation to Understand Latent Safety Issues. Crit Care Med 2019; 46:1570-1576. [PMID: 29957710 DOI: 10.1097/ccm.0000000000003302] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
OBJECTIVES The electronic health record is a primary source of information for all professional groups participating in ICU rounds. We previously demonstrated that, individually, all professional groups involved in rounds have significant blind spots in recognition of patient safety issues in the electronic health record. However, it is unclear how team dynamics impacts identification and verbalization of viewed data. Therefore, we created an ICU rounding simulation to assess how the interprofessional team recognized and reported data and its impact on decision-making. DESIGN Each member of the ICU team reviewed a simulated ICU chart in the electronic health record which contained embedded patient safety issues. The team conducted simulated rounds according to the ICU's existing rounding script and was assessed for recognition of safety issues. SETTING Academic medical center. SUBJECTS ICU residents, nurses, and pharmacists. INTERVENTION None. MEASUREMENTS AND MAIN RESULTS Twenty-eight teams recognized 68.6% of safety issues with only 50% teams having the primary diagnosis in their differential. Individually, interns, nurses, and pharmacists recognized 30.4%, 15.6%, and 19.6% of safety items, respectively. However, there was a negative correlation between the intern's performance and the nurse's or the pharmacist's performance within a given team. The wide variance in recognition of data resulted in wide variance in orders. Overall, there were 21.8 orders requested and 21.6 orders placed per case resulting in 3.6 order entry inconsistencies/case. Between the two cases, there were 145 distinct orders place with 43% being unique to a specific team and only 2% placed by all teams. CONCLUSIONS Although significant blind spots exist in the interprofessional team's ability to recognize safety issues in the electronic health record, the inclusion of other professional groups does serve as a partial safety net to improve recognition. Electronic health record-based, ICU rounding simulations can serve as a test-bed for innovations in ICU rounding structure and data collection.
Collapse
Affiliation(s)
- James Bordley
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Oregon Health and Science University, Portland, OR
| | - Knewton K Sakata
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Oregon Health and Science University, Portland, OR
| | - Jesse Bierman
- Department of Pharmacy, Oregon Health and Science University, Portland, OR
| | - Karess McGrath
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Oregon Health and Science University, Portland, OR
| | - Ashley Mulanax
- Department of Nursing, Oregon Health and Science University, Portland, OR
| | - Linh Nguyen
- Department of Nursing, Oregon Health and Science University, Portland, OR
| | - Vishnu Mohan
- Department of Medical Informatics and Clinical Epidemiology, Oregon Health and Science University, Portland, OR
| | - Jeffrey A Gold
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Oregon Health and Science University, Portland, OR.,Department of Medical Informatics and Clinical Epidemiology, Oregon Health and Science University, Portland, OR
| |
Collapse
|
11
|
Roch A, Blanchard PY, Courte A, Dray S, Farkas JC, Poiroux L, Soury-Lavergne A, Bollaert PE. Quelle place pour des IDE en pratique avancée en soins critiques ? MEDECINE INTENSIVE REANIMATION 2019. [DOI: 10.3166/rea-2019-0099] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Le métier d’IDE en pratique avancée (IPA) a été créé en France, et 12 universités ont été habilitées en 2018 à délivrer le diplôme d’État d’IPA, de niveau master 2. De nombreux arguments plaident en faveur de la formation d’IPA en soins critiques (IPASC) : les IDE représentent une force disponible de professionnels de santé dont les compétences peuvent être étendues par des formations appropriées, dans un environnement de complexité technique croissante ; il est nécessaire d’améliorer l’attractivité des IDE pour la réanimation; il existe un manque d’effectifs médicaux en réanimation et une difficulté à assurer une permanence des soins de qualité dans certains services ; enfin, les IPASC existent déjà dans de nombreux pays. Le rôle clinique spécifique pourra comporter des activités d’évaluation clinique, de réalisation de gestes techniques, de prescriptions thérapeutiques, de consultation en et hors réanimation. Le rôle d’encadrement pourra comporter la rédaction des procédures de prescriptions et de soins, la formation et l’encadrement technique des IDE, l’évaluation des pratiques professionnelles et la recherche. Enfin, les IPASC pourraient participer à la fiabilisation de la permanence des soins dans certains services. Le cadre d’activité de l’IPASC, mis en place, à la carte, selon un protocole d’organisation défini avec l’équipe du service, devra ainsi répondre aux objectifs fixés par la création de cette nouvelle profession : améliorer l’accès aux soins, promouvoir une plus grande qualité des soins, améliorer l’attractivité et les perspectives de carrière des IDE dans un cadre de maîtrise des coûts de santé.
Collapse
|
12
|
King AJ, Cooper GF, Hochheiser H, Clermont G, Hauskrecht M, Visweswaran S. Using Machine Learning to Predict the Information Seeking Behavior of Clinicians Using an Electronic Medical Record System. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2018; 2018:673-682. [PMID: 30815109 PMCID: PMC6371238] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Poor electronic medical record (EMR) usability is detrimental to both clinicians and patients. A better EMR would provide concise, context sensitive patient data, but doing so entails the difficult task of knowing which data are relevant. To determine the relevance of patient data in different contexts, we collect and model the information seeking behavior of clinicians using a learning EMR (LEMR) system. Sufficient data were collected to train predictive models for 80 different targets (e.g., glucose level, heparin administration) and 27 of them had AUROC values of greater than 0.7. These results are encouraging considering the high variation in information seeking behavior (intraclass correlation 0.40). We plan to apply these models to a new set of patient cases and adapt the LEMR interface to highlight relevant patient data, and thus provide concise, context sensitive data.
Collapse
|
13
|
Reed P. Previous mindfulness experience interacts with brief mindfulness induction when reducing stimulus overselectivity. APPLIED COGNITIVE PSYCHOLOGY 2018. [DOI: 10.1002/acp.3474] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Phil Reed
- Department of Psychology; Swansea University; Swansea UK
| |
Collapse
|
14
|
Kannampallil TG, Denton CA, Shapiro JS, Patel VL. Efficiency of Emergency Physicians: Insights from an Observational Study using EHR Log Files. Appl Clin Inform 2018; 9:99-104. [PMID: 30184241 DOI: 10.1055/s-0037-1621705] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Abstract
OBJECTIVE With federal mandates and incentives since the turn of this decade, electronic health records (EHR) have been widely adopted and used for clinical care. Over the last several years, we have seen both positive and negative perspectives on its use. Using an analysis of log files of EHR use, we investigated the nature of EHR use and their effect on an emergency department's (ED) throughput and efficiency. METHODS EHR logs of time spent by attending physicians on EHR-based activities over a 6-week period (n = 2,304 patients) were collected. For each patient encounter, physician activities in the EHR were categorized into four activities: documentation, review, orders, and navigation. Four ED-based performance metrics were also captured: door-to-provider time, door-to-doctor time, door-to-disposition time, and length of stay (LOS). Association between the four EHR-based activities and corresponding ED performance metrics were evaluated. RESULTS We found positive correlations between physician review of patient charts, and door-to-disposition time (r = 0.43, p < 0.05), and with LOS (r = 0.48, p < 0.05). There were no statistically significant associations between any of the other performance metrics and EHR activities. CONCLUSION The results highlight that longer time spent on reviewing information on the EHR is potentially associated with decreased ED throughput efficiency. Balancing these competing goals is often a challenge of physicians, and its implications for patient safety is discussed.
Collapse
|
15
|
Nolan ME, Siwani R, Helmi H, Pickering BW, Moreno-Franco P, Herasevich V. Health IT Usability Focus Section: Data Use and Navigation Patterns among Medical ICU Clinicians during Electronic Chart Review. Appl Clin Inform 2017; 8:1117-1126. [PMID: 29241249 DOI: 10.4338/aci-2017-06-ra-0110] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023] Open
Abstract
Background A detailed understanding of electronic health record (EHR) workflow patterns and information use is necessary to inform user-centered design of critical care information systems. While developing a longitudinal medical record visualization tool to facilitate electronic chart review (ECR) for medical intensive care unit (MICU) clinicians, we found inadequate research on clinician–EHR interactions.
Objective We systematically studied EHR information use and workflow among MICU clinicians to determine the optimal selection and display of core data for a revised EHR interface.
Methods We conducted a direct observational study of MICU clinicians performing ECR for unfamiliar patients during their routine daily practice at an academic medical center. Using a customized manual data collection instrument, we unobtrusively recorded the content and sequence of EHR data reviewed by clinicians.
Results We performed 32 ECR observations among 24 clinicians. The median (interquartile range [IQR]) chart review duration was 9.2 (7.3–14.7) minutes, with the largest time spent reviewing clinical notes (44.4%), laboratories (13.3%), imaging studies (11.7%), and searching/scrolling (9.4%). Historical vital sign and intake/output data were never viewed in 31% and 59% of observations, respectively. Clinical notes and diagnostic reports were browsed ≥10 years in time for 60% of ECR sessions. Clinicians viewed a median of 7 clinical notes, 2.5 imaging studies, and 1.5 diagnostic studies, typically referencing a select few subtypes. Clinicians browsed a median (IQR) of 26.5 (22.5–37.25) data screens to complete their ECR, demonstrating high variability in navigation patterns and frequent back-and-forth switching between screens. Nonetheless, 47% of ECRs begin with review of clinical notes, which were also the most common navigation destination.
Conclusion Electronic chart review centers around the viewing of clinical notes among MICU clinicians. Convoluted workflows and prolonged searching activities indicate room for system improvement. Using study findings, specific design recommendations to enhance usability for critical care information systems are provided.
Collapse
Affiliation(s)
- Matthew E Nolan
- Division of Pulmonary and Critical Care, Mayo Clinic, Rochester, Minnesota, United States
| | - Rizwan Siwani
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, Minnesota, United States
| | - Haytham Helmi
- Department of Transplantation, Mayo Clinic, Jacksonville, Florida, United States
| | - Brian W Pickering
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, Minnesota, United States
| | - Pablo Moreno-Franco
- Department of Transplantation, Mayo Clinic, Jacksonville, Florida, United States
| | - Vitaly Herasevich
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, Minnesota, United States
| |
Collapse
|
16
|
Special issue on cognitive informatics methods for interactive clinical systems. J Biomed Inform 2017; 71:207-210. [PMID: 28602905 DOI: 10.1016/j.jbi.2017.06.003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2017] [Accepted: 06/02/2017] [Indexed: 12/19/2022]
|
17
|
Balancing volume and duration of information consumption by physicians: The case of health information exchange in critical care. J Biomed Inform 2017; 71:1-15. [PMID: 28502910 DOI: 10.1016/j.jbi.2017.05.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2016] [Revised: 05/07/2017] [Accepted: 05/08/2017] [Indexed: 11/22/2022]
Abstract
BACKGROUND The realization of the potential benefits of health information exchange systems (HIEs) for emergency departments (EDs) depends on the way these systems are actually used. The attributes of volume of information and duration of information processing are important for the study of HIE use patterns in the ED, as cognitive load and time constraints may result in a trade-off between these attributes. Experts and non-experts often use different problem-solving strategies, which may be consequential for their system use patterns. Little previous research focuses on the trade-off between volume and duration of system use or on the factors that affect it, including user expertise. OBJECTIVES This study aims at exploring the trade-off of volume and duration of use, examining whether this relationship differs between experts and non-experts, and identifying factors that are associated with use patterns characterized by volume and duration. METHODS The research objectives are pursued in the context of critically-ill patients, treated at a busy ED in the period 2010-2012. The primary source of internal and external data is an HIE linked to 14 hospitals, over 1300 clinics, and other clinical facilities. We define four use profiles based on the attributes of duration and volume: quick and basic, quick and deep, slow and basic, and slow and deep. The volume and duration of use are computed using HIE log files as the number of screens and the time per screen, respectively. Each session is then classified into a specific profile based on distances from predefined profile centroids. Experts are physicians that are board-certified in emergency medicine. We test the distribution of use profiles and their associations with multiple variables that describe the patient, physician, situation, information available in the HIE system, and use dynamics within the encounter. RESULTS The quick and basic profile is the most prevalent. While available admission summaries are associated with quick and basic use, lab and imaging results are associated with slower or deeper use. Physicians who are the first to use the system or are sole users during an encounter are less inclined to quick and deep use. These effects are intensified for experts. DISCUSSION A trade-off between volume and duration is identified. While system use is overall similar for experts and non-experts, the circumstances in which a certain profile is more likely to be observed vary across these two groups. Information availability and multiple-physician dynamics within the encounter emerge as important for the prediction of use profiles. The findings of this study provide implications for the design, implementation, and research of HIE use.
Collapse
|
18
|
Abraham J, Kannampallil TG, Patel VL, Patel B, Almoosa KF. Impact of Structured Rounding Tools on Time Allocation During Multidisciplinary Rounds: An Observational Study. JMIR Hum Factors 2016; 3:e29. [PMID: 27940423 PMCID: PMC5182443 DOI: 10.2196/humanfactors.6642] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2016] [Revised: 11/23/2016] [Accepted: 11/29/2016] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Recent research has shown evidence of disproportionate time allocation for patient communication during multidisciplinary rounds (MDRs). Studies have shown that patients discussed later during rounds receive lesser time. OBJECTIVE The aim of our study was to investigate whether disproportionate time allocation effects persist with the use of structured rounding tools. METHODS Using audio recordings of rounds (N=82 patients), we compared time allocation and communication breakdowns between a problem-based Subjective, Objective, Assessment, and Plan (SOAP) and a system-based Handoff Intervention Tool (HAND-IT) rounding tools. RESULTS We found no significant linear dependence of the order of patient presentation on the time spent or on communication breakdowns for both structured tools. However, for the problem-based tool, there was a significant linear relationship between the time spent on discussing a patient and the number of communication breakdowns (P<.05)--with an average of 1.04 additional breakdowns with every 120 seconds in discussion. CONCLUSIONS The use of structured rounding tools potentially mitigates disproportionate time allocation and communication breakdowns during rounds, with the more structured HAND-IT, almost completely eliminating such effects. These results have potential implications for planning, prioritization, and training for time management during MDRs.
Collapse
Affiliation(s)
- Joanna Abraham
- Department of Biomedical and Health Information Sciences, University of Illinois at Chicago, Chicago, IL, United States
| | - Thomas G Kannampallil
- Department of Family Medicine, University of Illinois at Chicago, Chicago, IL, United States
| | - Vimla L Patel
- Center for Cognitive Studies in Medicine and Public Health, New York Academy of Medicine, New York, NY, United States
| | - Bela Patel
- Division of Critical Care Medicine, Department of Internal Medicine, University of Texas Health Science Center, Houston, TX, United States
| | | |
Collapse
|
19
|
Kannampallil TG, Abraham J, Patel VL. Methodological framework for evaluating clinical processes: A cognitive informatics perspective. J Biomed Inform 2016; 64:342-351. [DOI: 10.1016/j.jbi.2016.11.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2016] [Revised: 11/10/2016] [Accepted: 11/11/2016] [Indexed: 01/10/2023]
|
20
|
Wright MC, Dunbar S, Macpherson BC, Moretti EW, Del Fiol G, Bolte J, Taekman JM, Segall N. Toward Designing Information Display to Support Critical Care. A Qualitative Contextual Evaluation and Visioning Effort. Appl Clin Inform 2016; 7:912-929. [PMID: 27704138 PMCID: PMC5228134 DOI: 10.4338/aci-2016-03-ra-0033] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2016] [Accepted: 08/23/2016] [Indexed: 11/23/2022] Open
Abstract
OBJECTIVES Electronic health information overload makes it difficult for providers to quickly find and interpret information to support care decisions. The purpose of this study was to better understand how clinicians use information in critical care to support the design of improved presentation of electronic health information. METHODS We conducted a contextual analysis and visioning project. We used an eye-tracker to record 20 clinicians' information use activities in critical care settings. We played video recordings back to clinicians in retrospective cued interviews and queried: 1) context and goals of information use, 2) impacts of current display design on use, and 3) processes related to information use. We analyzed interview transcripts using grounded theory-based content analysis techniques and identified emerging themes. From these, we conducted a visioning activity with a team of subject matter experts and identified key areas for focus of design and research for future display designs. RESULTS Analyses revealed four unique critical care information use activities including new patient assessment, known patient status review, specific directed information seeking, and review and prioritization of multiple patients. Emerging themes were primarily related to a need for better representation of dynamic data such as vital signs and laboratory results, usability issues associated with reducing cognitive load and supporting efficient interaction, and processes for managing information. Visions for the future included designs that: 1) provide rapid access to new information, 2) organize by systems or problems as well as by current versus historical patient data, and 3) apply intelligence toward detecting and representing change and urgency. CONCLUSIONS The results from this study can be used to guide the design of future acute care electronic health information display. Additional research and collaboration is needed to refine and implement intelligent graphical user interfaces to improve clinical information organization and prioritization to support care decisions.
Collapse
Affiliation(s)
- Melanie C Wright
- Melanie C. Wright, PhD, Program Director, Patient Safety Research, Trinity Health and Saint Alphonsus Health System, 1055 N. Curtis Rd, Boise ID 83702, , Phone: 208-367-7399
| | | | | | | | | | | | | | | |
Collapse
|
21
|
Abraham J, Kannampallil T, Brenner C, Lopez KD, Almoosa KF, Patel B, Patel VL. Characterizing the structure and content of nurse handoffs: A Sequential Conversational Analysis approach. J Biomed Inform 2016; 59:76-88. [DOI: 10.1016/j.jbi.2015.11.009] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2015] [Revised: 11/19/2015] [Accepted: 11/20/2015] [Indexed: 12/01/2022]
|
22
|
Mitsch C, Huber P, Kriechbaum K, Scholda C, Duftschmid G, Wrba T, Schmidt-Erfurth U. eHealth 2015 Special Issue: Impact of Electronic Health Records on the Completeness of Clinical Documentation Generated during Diabetic Retinopathy Consultations. Appl Clin Inform 2015; 6:478-87. [PMID: 26448793 DOI: 10.4338/aci-2014-11-ra-0104] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2015] [Accepted: 05/11/2015] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND Two years ago, the Diabetic Retinopathy (DRP) and Traumatology clinic of the Department of Ophthalmology and Optometrics at the Medical University of Vienna, Austria switched from paper-based to electronic health records. A customized electronic health record system (EHR-S) was implemented. OBJECTIVES To assess the completeness of information documented electronically compared with manually during patient visits. METHODS The Preferred Practice Pattern for Diabetic Retinopathy published by the American Academy of Ophthalmology was distilled into a list of medical features grouped into categories to be assessed and documented during the management of patients with DRP. The last seventy paper-based records and all electronic records generated since the switch were analyzed and graded for the presence of features on the list and the resulting scores compared. RESULTS In all categories, clinical documentation was more complete in the EHR group. CONCLUSIONS In our setting, the implementation of an EHR-S showed a statistically significant positive impact on documentation completeness.
Collapse
Affiliation(s)
- C Mitsch
- Medical University of Vienna , Department of Ophthalmology and Optometrics, Vienna, Austria
| | - P Huber
- Medical University of Vienna , Department of Ophthalmology and Optometrics, Vienna, Austria
| | - K Kriechbaum
- Medical University of Vienna , Department of Ophthalmology and Optometrics, Vienna, Austria
| | - C Scholda
- Medical University of Vienna , Department of Ophthalmology and Optometrics, Vienna, Austria
| | - G Duftschmid
- Medical University of Vienna , Center for Medical Statistics, Informatics, and Intelligent Systems, Vienna, Austria
| | - T Wrba
- Medical University of Vienna , Center for Medical Statistics, Informatics, and Intelligent Systems, Vienna, Austria
| | - U Schmidt-Erfurth
- Medical University of Vienna , Department of Ophthalmology and Optometrics, Vienna, Austria
| |
Collapse
|
23
|
Patel VL, Kannampallil TG. Cognitive informatics in biomedicine and healthcare. J Biomed Inform 2014; 53:3-14. [PMID: 25541081 DOI: 10.1016/j.jbi.2014.12.007] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2014] [Revised: 12/12/2014] [Accepted: 12/14/2014] [Indexed: 12/21/2022]
Abstract
Cognitive Informatics (CI) is a burgeoning interdisciplinary domain comprising of the cognitive and information sciences that focuses on human information processing, mechanisms and processes within the context of computing and computer applications. Based on a review of articles published in the Journal of Biomedical Informatics (JBI) between January 2001 and March 2014, we identified 57 articles that focused on topics related to cognitive informatics. We found that while the acceptance of CI into the mainstream informatics research literature is relatively recent, its impact has been significant - from characterizing the limits of clinician problem-solving and reasoning behavior, to describing coordination and communication patterns of distributed clinical teams, to developing sustainable and cognitively-plausible interventions for supporting clinician activities. Additionally, we found that most research contributions fell under the topics of decision-making, usability and distributed team activities with a focus on studying behavioral and cognitive aspects of clinical personnel, as they performed their activities or interacted with health information systems. We summarize our findings within the context of the current areas of CI research, future research directions and current and future challenges for CI researchers.
Collapse
Affiliation(s)
- Vimla L Patel
- Center for Cognitive Studies in Medicine and Public Health, The New York Academy of Medicine, 1216 5th Avenue, New York, NY 10029, United States.
| | - Thomas G Kannampallil
- Department of Family Medicine, College of Medicine, University of Illinois at Chicago, 1919 W Taylor St (M/C 663), Chicago, IL 60612, United States.
| |
Collapse
|
24
|
Patel VL, Kannampallil TG. Human factors and health information technology: current challenges and future directions. Yearb Med Inform 2014; 9:58-66. [PMID: 25123724 DOI: 10.15265/iy-2014-0005] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
OBJECTIVES Recent federal mandates and incentives have spurred the rapid growth, development and adoption of health information technology (HIT). While providing significant benefits for better data integration, organization, and availability, recent reports have raised questions regarding their potential to cause medication errors, decreased clinician performance, and lowered efficiency. The goal of this survey article is to (a) examine the theoretical and foundational models of human factors and ergonomics (HFE) that are being advocated for achieving patient safety and quality, and their use in the evaluation of healthcare systems; (b) and the potential for macroergonomic HFE approaches within the context of current research in biomedical informatics. METHODS We reviewed literature (2007-2013) on the use of HFE approaches in healthcare settings, from databases such as Pubmed, CINAHL, and Cochran. RESULTS Based on the review, we discuss the systems-oriented models, their use in the evaluation of HIT, and examples of their use in the evaluation of EHR systems, clinical workflow processes, and medication errors. We also discuss the opportunities for better integrating HFE methods within biomedical informatics research and its potential advantages. CONCLUSIONS The use of HFE methods is still in its infancy - better integration of HFE within the design lifecycle, and quality improvement efforts can further the ability of informatics researchers to address the key concerns regarding the complexity in clinical settings and develop HIT solutions that are designed within the social fabric of the considered setting.
Collapse
Affiliation(s)
- V L Patel
- Vimla L. Patel, Center for Cognitive Studies, in Medicine and Public Health, The New York Academy of Medicine, 1216 5th Avenue, New York, NY, E-mail:
| | | |
Collapse
|