1
|
Cobert J, Mills H, Lee A, Gologorskaya O, Espejo E, Jeon SY, Boscardin WJ, Heintz TA, Kennedy CJ, Ashana DC, Chapman AC, Raghunathan K, Smith AK, Lee SJ. Measuring Implicit Bias in ICU Notes Using Word-Embedding Neural Network Models. Chest 2024; 165:1481-1490. [PMID: 38199323 PMCID: PMC11317817 DOI: 10.1016/j.chest.2023.12.031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 12/12/2023] [Accepted: 12/29/2023] [Indexed: 01/12/2024] Open
Abstract
BACKGROUND Language in nonmedical data sets is known to transmit human-like biases when used in natural language processing (NLP) algorithms that can reinforce disparities. It is unclear if NLP algorithms of medical notes could lead to similar transmissions of biases. RESEARCH QUESTION Can we identify implicit bias in clinical notes, and are biases stable across time and geography? STUDY DESIGN AND METHODS To determine whether different racial and ethnic descriptors are similar contextually to stigmatizing language in ICU notes and whether these relationships are stable across time and geography, we identified notes on critically ill adults admitted to the University of California, San Francisco (UCSF), from 2012 through 2022 and to Beth Israel Deaconess Hospital (BIDMC) from 2001 through 2012. Because word meaning is derived largely from context, we trained unsupervised word-embedding algorithms to measure the similarity (cosine similarity) quantitatively of the context between a racial or ethnic descriptor (eg, African-American) and a stigmatizing target word (eg, nonco-operative) or group of words (violence, passivity, noncompliance, nonadherence). RESULTS In UCSF notes, Black descriptors were less likely to be similar contextually to violent words compared with White descriptors. Contrastingly, in BIDMC notes, Black descriptors were more likely to be similar contextually to violent words compared with White descriptors. The UCSF data set also showed that Black descriptors were more similar contextually to passivity and noncompliance words compared with Latinx descriptors. INTERPRETATION Implicit bias is identifiable in ICU notes. Racial and ethnic group descriptors carry different contextual relationships to stigmatizing words, depending on when and where notes were written. Because NLP models seem able to transmit implicit bias from training data, use of NLP algorithms in clinical prediction could reinforce disparities. Active debiasing strategies may be necessary to achieve algorithmic fairness when using language models in clinical research.
Collapse
Affiliation(s)
- Julien Cobert
- Anesthesia Service, San Francisco VA Health Care System, University of California, San Francisco, San Francisco, CA; Department of Anesthesia and Perioperative Care, University of California, San Francisco, San Francisco, CA.
| | - Hunter Mills
- Bakar Computational Health Sciences Institute, University of California, San Francisco, San Francisco, CA
| | - Albert Lee
- Bakar Computational Health Sciences Institute, University of California, San Francisco, San Francisco, CA
| | - Oksana Gologorskaya
- Bakar Computational Health Sciences Institute, University of California, San Francisco, San Francisco, CA
| | - Edie Espejo
- Division of Geriatrics, University of California, San Francisco, San Francisco, CA
| | - Sun Young Jeon
- Division of Geriatrics, University of California, San Francisco, San Francisco, CA
| | - W John Boscardin
- Division of Geriatrics, University of California, San Francisco, San Francisco, CA
| | - Timothy A Heintz
- School of Medicine, University of California, San Diego, San Diego, CA
| | - Christopher J Kennedy
- Department of Psychiatry, Harvard Medical School, Boston, MA; Center for Precision Psychiatry, Massachusetts General Hospital, Boston, MA
| | - Deepshikha C Ashana
- Division of Pulmonary, Allergy, and Critical Care Medicine, Duke University, Durham, NC
| | - Allyson Cook Chapman
- Department of Medicine, the Division of Critical Care and Palliative Medicine, University of California, San Francisco, San Francisco, CA; Department of Surgery, University of California, San Francisco, San Francisco, CA
| | - Karthik Raghunathan
- Department of Anesthesia and Perioperative Care, Duke University, Durham, NC
| | - Alex K Smith
- Department of Geriatrics, Palliative, and Extended Care, Veterans Affairs Medical Center, University of California, San Francisco, San Francisco, CA; Division of Geriatrics, University of California, San Francisco, San Francisco, CA
| | - Sei J Lee
- Division of Geriatrics, University of California, San Francisco, San Francisco, CA
| |
Collapse
|
2
|
Chang A, Xian X, Liu MT, Zhao X. Health Communication through Positive and Solidarity Messages Amid the COVID-19 Pandemic: Automated Content Analysis of Facebook Uses. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:6159. [PMID: 35627696 PMCID: PMC9141526 DOI: 10.3390/ijerph19106159] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 05/15/2022] [Accepted: 05/16/2022] [Indexed: 12/31/2022]
Abstract
The COVID-19 outbreak has caused significant stress in our lives, which potentially increases frustration, fear, and resentful emotions. Managing stress is complex, but helps to alleviate negative psychological effects. In order to understand how the public coped with stress during the COVID-19 pandemic, we used Macao as a case study and collected 104,827 COVID-19 related posts from Facebook through data mining, from 1 January to 31 December 2020. Divominer, a big-data analysis tool supported by computational algorithm, was employed to identify themes and facilitate machine coding and analysis. A total of 60,875 positive messages were identified, with 24,790 covering positive psychological themes, such as "anti-epidemic", "solidarity", "hope", "gratitude", "optimism", and "grit". Messages that mentioned "anti-epidemic", "solidarity", and "hope" were the most prevalent, while different crisis stages, key themes and media elements had various impacts on public involvement. To the best of our knowledge, this is the first-ever study in the Chinese context that uses social media to clarify the awareness of solidarity. Positive messages are needed to empower social media users to shoulder their shared responsibility to tackle the crisis. The findings provide insights into users' needs for improving their subjective well-being to mitigate the negative psychological impact of the pandemic.
Collapse
Affiliation(s)
- Angela Chang
- Department of Communication, Faculty of Social Sciences, University of Macau, Macao, China; (X.X.); (X.Z.)
- Institute of Communication and Health, Lugano University, 6900 Lugano, Switzerland
| | - Xuechang Xian
- Department of Communication, Faculty of Social Sciences, University of Macau, Macao, China; (X.X.); (X.Z.)
- Department of Communication, Zhaoqing University, Zhaoqing 526060, China
| | - Matthew Tingchi Liu
- Department of Management and Marketing, Faculty of Business Administration, University of Macau, Macao, China;
| | - Xinshu Zhao
- Department of Communication, Faculty of Social Sciences, University of Macau, Macao, China; (X.X.); (X.Z.)
| |
Collapse
|