1
|
Matt JE, Rizzo DM, Javed A, Eppstein MJ, Manukyan V, Gramling C, Dewoolkar AM, Gramling R. An Acoustical and Lexical Machine-Learning Pipeline to Identify Connectional Silences. J Palliat Med 2023; 26:1627-1633. [PMID: 37440175 DOI: 10.1089/jpm.2023.0087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/14/2023] Open
Abstract
Context: Developing scalable methods for conversation analytics is essential for health care communication science and quality improvement. Purpose: To assess the feasibility of automating the identification of a conversational feature, Connectional Silence, which is associated with important patient outcomes. Methods: Using audio recordings from the Palliative Care Communication Research Initiative cohort study, we develop and test an automated measurement pipeline comprising three machine-learning (ML) tools-a random forest algorithm and a custom convolutional neural network that operate in parallel on audio recordings, and subsequently a natural language processing algorithm that uses brief excerpts of automated speech-to-text transcripts. Results: Our ML pipeline identified Connectional Silence with an overall sensitivity of 84% and specificity of 92%. For Emotional and Invitational subtypes, we observed sensitivities of 68% and 67%, and specificities of 95% and 97%, respectively. Conclusion: These findings support the capacity for coordinated and complementary ML methods to fully automate the identification of Connectional Silence in natural hospital-based clinical conversations.
Collapse
Affiliation(s)
- Jeremy E Matt
- Graduate Program in Complex Systems and Data Science, College of Engineering and Mathematical Sciences, University of Vermont, Burlington, Vermont, USA
| | - Donna M Rizzo
- Department of Civil and Environmental Engineering, University of Vermont, Burlington, Vermont, USA
| | - Ali Javed
- Division of Cardiovascular Medicine, Department of Medicine, Stanford University School of Medicine, Stanford University, Stanford, California, USA
| | - Margaret J Eppstein
- Department of Computer Science, University of Vermont, Burlington, Vermont, USA
| | | | - Cailin Gramling
- Graduate Program in Complex Systems and Data Science, College of Engineering and Mathematical Sciences, University of Vermont, Burlington, Vermont, USA
| | - Advik Mandar Dewoolkar
- Department of Electrical and Biomedical Engineering, University of Vermont, Burlington, Vermont, USA
| | - Robert Gramling
- Department of Family Medicine, University of Vermont, Burlington, Vermont, USA
| |
Collapse
|
2
|
Mossman B, Perry LM, Gerhart JI, McLouth LE, Lewson AB, Hoerger M. Emotional distress predicts palliative cancer care attitudes: The unique role of anger. Psychooncology 2023; 32:692-700. [PMID: 36799130 PMCID: PMC10164101 DOI: 10.1002/pon.6113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Revised: 01/21/2023] [Accepted: 02/02/2023] [Indexed: 02/18/2023]
Abstract
OBJECTIVE Although palliative care can mitigate emotional distress, distressed patients may be less likely to engage in timely palliative care. This study aims to investigate the role of emotional distress in palliative care avoidance by examining the associations of anger, anxiety, and depression with palliative care attitudes. METHODS Patients (N = 454) with heterogeneous cancer diagnoses completed an online survey on emotional distress and palliative care attitudes. Emotional distress was measured using the Patient-Reported Outcomes Measurement Information System anger, anxiety, and depression scales. The Palliative Care Attitudes Scale was used to measure palliative care attitudes. Regression models tested the impact of a composite emotional distress score calculated from all three symptom measures, as well as individual anger, anxiety, and depression scores, on palliative care attitudes. All models controlled for relevant demographic and clinical covariates. RESULTS Regression results revealed that patients who were more emotionally distressed had less favorable attitudes toward palliative care (p < 0.001). In particular, patients who were angrier had less favorable attitudes toward palliative care (p = 0.013) while accounting for depression, anxiety, and covariates. Across analyses, women had more favorable attitudes toward palliative care than men, especially with regard to beliefs about palliative care effectiveness. CONCLUSIONS Anger is a key element of emotional distress and may lead patients to be more reluctant toward timely utilization of palliative care. Although psycho-oncology studies routinely assess depression or anxiety, more attention to anger is warranted. More research is needed on how best to address anger and increase timely utilization of palliative cancer care.
Collapse
Affiliation(s)
- Brenna Mossman
- Department of Psychology, Tulane University, New Orleans, LA
| | - Laura M. Perry
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL
| | - James I. Gerhart
- Department of Psychology, Central Michigan University, Mount Pleasant, Michigan
| | - Laurie E. McLouth
- Department of Behavioral Science, Markey Cancer Center, Center for Health Equity Transformation, University of Kentucky College of Medicine, Lexington, KY
| | - Ashley B. Lewson
- Department of Psychology, Indiana University-Purdue University Indianapolis, Indianapolis, IN
| | - Michael Hoerger
- Department of Psychology, Tulane University, New Orleans, LA
- Departments of Psychiatry and Medicine, Tulane Cancer Center, and Freeman School of Business, Tulane University, New Orleans, LA
| |
Collapse
|
3
|
Cheung KL, Smoger S, Tamura MK, Stapleton RD, Rabinowitz T, LaMantia MA, Gramling R. Content of Tele-Palliative Care Consultations with Patients Receiving Dialysis. J Palliat Med 2022; 25:1208-1214. [PMID: 35254866 PMCID: PMC9347393 DOI: 10.1089/jpm.2021.0539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023] Open
Abstract
Background: Little is known about the content of communication in palliative care telehealth conversations in the dialysis population. Understanding the content and process of these conversations may lead to insights about how palliative care improves quality of life. Methods: We conducted a qualitative analysis of video recordings obtained during a pilot palliative teleconsultation program. We recruited patients receiving dialysis from five facilities affiliated with an academic medical center. Palliative care clinicians conducted teleconsultation using a wall-mounted screen with a camera mounted on a pole and positioned mid-screen in the line of sight to facilitate direct eye contact. Patients used an iPad that was attached to an IV pole positioned next to the dialysis chair. Conversations were coded using a preexisting framework of themes and content from the Serious Illness Conversation Guide (SICG) and revised Edmonton Symptom Assessment System-Renal. Results: We recruited 39 patients to undergo a telepalliative care consultation while receiving dialysis, 34 of whom completed the teleconsultation. Specialty palliative care clinicians (3 physicians and 1 nurse practitioner) conducted 35 visits with 34 patients. Median (interquartile range) duration of conversation was 42 (28-57) minutes. Most frequently discussed content included sources of strength (91%), critical abilities (88%), illness understanding (85%), fears and worries (85%), what family knows (85%), fatigue (77%), and pain (65%). Process features such as summarizing statements (85%) and making a recommendation (82%) were common, whereas connectional silence (56%), and emotion expression (21%) occurred less often. Conclusions: Unscripted palliative care conversations in outpatient dialysis units through telemedicine exhibited many domains recommended by the SICG, with less frequent discussion of symptoms. Emotion expression was uncommon for these conversations that occurred in an open setting.
Collapse
Affiliation(s)
- Katharine L. Cheung
- Divisions of Nephrology, Department of Medicine, Larner College of Medicine, The University of Vermont, Burlington, Vermont, USA.,Address correspondence to: Katharine L. Cheung, MD, PhD, Division of Nephrology, Department of Medicine, Larner College of Medicine at The University of Vermont, 1 South Prospect Street, 2309 UHC Med-Nephrology, Burlington, VT 05401, USA
| | - Samantha Smoger
- Department of Biology, The University of Vermont, Burlington, Vermont, USA
| | - Manjula Kurella Tamura
- Division of Nephrology, Geriatric Research, Education, and Clinical Center, Veterans Affairs Palo Alto Health Care System, Palo Alto, California, USA
| | - Renee D. Stapleton
- Divisions of Pulmonary and Critical Care, and Department of Medicine, Larner College of Medicine, The University of Vermont, Burlington, Vermont, USA
| | - Terry Rabinowitz
- Department of Psychiatry, Larner College of Medicine, The University of Vermont, Burlington, Vermont, USA
| | - Michael A. LaMantia
- Divisions of Geriatrics, Department of Medicine, Larner College of Medicine, The University of Vermont, Burlington, Vermont, USA
| | - Robert Gramling
- Division of Palliative Medicine, Department of Family Medicine, Larner College of Medicine, The University of Vermont, Burlington, Vermont, USA
| |
Collapse
|
4
|
Tarbi EC, Blanch-Hartigan D, van Vliet LM, Gramling R, Tulsky JA, Sanders JJ. Toward a basic science of communication in serious illness. PATIENT EDUCATION AND COUNSELING 2022; 105:1963-1969. [PMID: 35410737 DOI: 10.1016/j.pec.2022.03.019] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Revised: 03/09/2022] [Accepted: 03/24/2022] [Indexed: 06/14/2023]
Abstract
High-quality communication can mitigate suffering during serious illness. Innovations in theory and technology present the opportunity to advance serious illness communication research, moving beyond inquiry that links broad communication constructs to health outcomes toward operationalizing and understanding the impact of discrete communication functions on human experience. Given the high stakes of communication during serious illness, we see a critical need to develop a basic science approach to serious illness communication research. Such an approach seeks to link "what actually happens during a conversation" - the lexical and non-lexical communication content elements, as well as contextual factors - with the emotional and cognitive experiences of patients, caregivers, and clinicians. This paper defines and justifies a basic science approach to serious illness communication research and outlines investigative and methodological opportunities in this area. A systematic understanding of the building blocks of serious illness communication can help identify evidence-informed communication strategies that promote positive patient outcomes, shape more targeted communication skills training for clinicians, and lead to more tailored and meaningful serious illness care.
Collapse
Affiliation(s)
- Elise C Tarbi
- Dana-Farber Cancer Institute, Department of Psychosocial Oncology and Palliative Care, Boston, USA.
| | | | | | - Robert Gramling
- University of Vermont. Department of Family Medicine, Burlington, USA.
| | - James A Tulsky
- Dana-Farber Cancer Institute, Department of Psychosocial Oncology and Palliative Care, Boston, USA; Brigham and Women's Hospital, Division of Palliative Medicine, Department of Medicine, Boston, USA.
| | - Justin J Sanders
- McGill University, Division of Palliative Care, Department of Family Medicine, Montreal, Canada.
| |
Collapse
|
5
|
Gramling CJ, Durieux BN, Clarfeld LA, Javed A, Matt JE, Manukyan V, Braddish T, Wong A, Wills J, Hirsch L, Straton J, Cheney N, Eppstein MJ, Rizzo DM, Gramling R. Epidemiology of Connectional Silence in specialist serious illness conversations. PATIENT EDUCATION AND COUNSELING 2022; 105:2005-2011. [PMID: 34799186 DOI: 10.1016/j.pec.2021.10.032] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/22/2021] [Revised: 10/27/2021] [Accepted: 10/28/2021] [Indexed: 06/13/2023]
Abstract
CONTEXT Human connection can reduce suffering and facilitate meaningful decision-making amid the often terrifying experience of hospitalization for advanced cancer. Some conversational pauses indicate human connection, but we know little about their prevalence, distribution or association with outcomes. PURPOSE To describe the epidemiology of Connectional Silence during serious illness conversations in advanced cancer. METHODS We audio-recorded 226 inpatient palliative care consultations at two academic centers. We identified pauses lasting 2+ seconds and distinguished Connectional Silences from other pauses, sub-categorized as either Invitational (ICS) or Emotional (ECS). We identified treatment decisional status pre-consultation from medical records and post-consultation via clinicians. Patients self-reported quality-of-life before and one day after consultation. RESULTS Among all 6769 two-second silences, we observed 328 (4.8%) ECS and 240 (3.5%) ICS. ECS prevalence was associated with decisions favoring fewer disease-focused treatments (ORadj: 2.12; 95% CI: 1.12, 4.06). Earlier conversational ECS was associated with improved quality-of-life (p = 0.01). ICS prevalence was associated with clinicians' prognosis expectations. CONCLUSIONS Connectional Silences during specialist serious illness conversations are associated with decision-making and improved patient quality-of-life. Further work is necessary to evaluate potential causal relationships. PRACTICE IMPLICATIONS Pauses offer important opportunities to advance the science of human connection in serious illness decision-making.
Collapse
Affiliation(s)
| | | | | | - Ali Javed
- Department of Computer Science, University of Vermont, Burlington, VT, USA
| | - Jeremy E Matt
- Complex Systems & Data Science, University of Vermont, Burlington, VT, USA
| | | | - Tess Braddish
- Department of Family Medicine, University of Vermont, Burlington, VT, USA
| | - Ann Wong
- University of Vermont, Burlington, VT, USA
| | | | | | | | - Nicholas Cheney
- Department of Computer Science, University of Vermont, Burlington, VT, USA
| | | | - Donna M Rizzo
- Department of Civil Engineering, University of Vermont, Burlington, VT, USA
| | - Robert Gramling
- Department of Family Medicine, University of Vermont, Burlington, VT, USA.
| |
Collapse
|
6
|
Edelen MO, Rodriguez A, Huang W, Gramling R, Ahluwalia SC. A novel Scale to Assess Palliative Care Patients' Experience of Feeling Heard and Understood. J Pain Symptom Manage 2022; 63:689-697.e1. [PMID: 35017018 DOI: 10.1016/j.jpainsymman.2022.01.002] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Revised: 01/03/2022] [Accepted: 01/04/2022] [Indexed: 02/06/2023]
Abstract
CONTEXT Patient experience of palliative care serves as an important indicator of quality and patient-centeredness. OBJECTIVES To develop a novel patient-reported scale measuring ambulatory palliative care patients' experience of feeling heard and understood by their providers. METHODS We used self-reported patient experience data collected via mixed-mode survey administration. We conducted an exploratory factor analysis (EFA) and an expert panel ranking exercise to reduce the 10-item set based on underlying dimensionality. We then used item response theory (IRT) to calibrate remaining items based on psychometric properties and test information and precision. We considered item-level fit and examined the standardized local dependence chi-square statistics. We evaluated candidate items for differential item functioning by survey mode. We evaluated the test-retest reliability and validity of the final scale. RESULTS The EFA yielded a single factor (9/10 items had loadings > 0.80 on the single factor). We removed two items with the lowest factor loadings and ranked by the expert panel as being least reflective of the overall construct. IRT calibration of the remaining eight items showed high slopes (range 2.66 - 5.18); location parameters were all negative (range -0.90 - -0.36). We removed two more items based on local dependence indices and item-level fit. Combining psychometric information with the expert ratings we established the final 4-item scale, which was reliable (Cronbach's alpha = 0.84; polychoric correlation coefficient = 0.72) and had good convergent validity. CONCLUSIONS This novel multi-item Feeling Heard and Understood scale can be used to measure and improve ambulatory palliative care patient experience.
Collapse
Affiliation(s)
- Maria O Edelen
- Behavioral & Policy Sciences Department, RAND Corporation, Boston, Massachusetts, USA
| | - Anthony Rodriguez
- Behavioral & Policy Sciences Department, RAND Corporation, Boston, Massachusetts, USA
| | - Wenjing Huang
- Behavioral & Policy Sciences Department, RAND Corporation, Boston, Massachusetts, USA
| | - Robert Gramling
- University of Vermont, Department of Family Medicine, Burlington, Vermont
| | - Sangeeta C Ahluwalia
- Behavioral & Policy Sciences Department, RAND Corporation, Santa Monica, California, USA.
| |
Collapse
|
7
|
Clarfeld LA, Gramling R, Rizzo DM, Eppstein MJ. A general model of conversational dynamics and an example application in serious illness communication. PLoS One 2021; 16:e0253124. [PMID: 34197490 PMCID: PMC8248661 DOI: 10.1371/journal.pone.0253124] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2020] [Accepted: 05/29/2021] [Indexed: 11/19/2022] Open
Abstract
Conversation has been a primary means for the exchange of information since ancient times. Understanding patterns of information flow in conversations is a critical step in assessing and improving communication quality. In this paper, we describe COnversational DYnamics Model (CODYM) analysis, a novel approach for studying patterns of information flow in conversations. CODYMs are Markov Models that capture sequential dependencies in the lengths of speaker turns. The proposed method is automated and scalable, and preserves the privacy of the conversational participants. The primary function of CODYM analysis is to quantify and visualize patterns of information flow, concisely summarized over sequential turns from one or more conversations. Our approach is general and complements existing methods, providing a new tool for use in the analysis of any type of conversation. As an important first application, we demonstrate the model on transcribed conversations between palliative care clinicians and seriously ill patients. These conversations are dynamic and complex, taking place amidst heavy emotions, and include difficult topics such as end-of-life preferences and patient values. We use CODYMs to identify normative patterns of information flow in serious illness conversations, show how these normative patterns change over the course of the conversations, and show how they differ in conversations where the patient does or doesn’t audibly express anger or fear. Potential applications of CODYMs range from assessment and training of effective healthcare communication to comparing conversational dynamics across languages, cultures, and contexts with the prospect of identifying universal similarities and unique “fingerprints” of information flow.
Collapse
Affiliation(s)
- Laurence A. Clarfeld
- Department of Computer Science, University of Vermont, Burlington, VT, United States of America
- * E-mail:
| | - Robert Gramling
- Department of Family Medicine, University of Vermont, Burlington, VT, United States of America
| | - Donna M. Rizzo
- Department of Civil and Environmental Engineering, University of Vermont, Burlington, VT, United States of America
- Vermont Complex Systems Center, University of Vermont, Burlington, VT, United States of America
| | - Margaret J. Eppstein
- Department of Computer Science, University of Vermont, Burlington, VT, United States of America
- Vermont Complex Systems Center, University of Vermont, Burlington, VT, United States of America
| |
Collapse
|