What makes AI 'intelligent' and 'caring'? Exploring affect and relationality across three sites of intelligence and care

Navigating artificial intelligence in care homes: Competing stakeholder views of trust and logics of care

The COVID-19 pandemic shed light on systemic issues plaguing care (nursing) homes, from staff shortages to substandard healthcare. Artificial Intelligence (AI) technologies, including robots and chatbots, have been proposed as solutions to such issues. Yet, socio-ethical concerns about the implications of AI for health and care practices have also been growing among researchers and practitioners. At a time of AI promise and concern, it is critical to understand how those who develop and implement these technologies perceive their use and impact in care homes. Combining a sociological approach to trust with Annemarie Mol's logic of care and Jeanette Pol's concept of fitting, we draw on 18 semi-structured interviews with care staff, advocates, and AI developers to explore notions of human-AI care. Our findings show positive perceptions and experiences of AI in care homes, but also ambivalence. While integrative care incorporating humans and technology was salient across interviewees, we also identified experiential, contextual, and knowledge divides between AI developers and care staff. For example, developers lacked experiential knowledge of care homes' daily functioning and constraints, influencing how they designed AI. Care staff demonstrated limited experiential knowledge of AI or more critical views about contexts of use, affecting their trust in these technologies. Different understandings of 'good care' were evident, too: 'warm' care was sometimes linked to human care and 'cold' care to technology. In conclusion, understandings and experiences of AI are marked by different logics of sociotechnical care and related levels of trust in these sensitive settings.

Artificial Intelligence in Medicine: A Caution About Good Intentions and Where It May Lead

Implementing Artificial Intelligence in medicine is revolutionizing how medicine is practiced. It has much promise in bringing about improved clinical outcomes and efficiency while decreasing costs. There are also concerns and unintended consequences that are being realized and significant efforts to consider ethical principles in the implementation of Artificial Intelligence in medicine. One potential consequence may be the loss of what has been described as the soul of medicine: the physician-patient relationship. This relationship is especially precious in the context of what the US Surgeon General Vivek H. Murthy MD has called an "Epidemic of Loneliness and Isolation." This commentary describes considerations and potential steps to protect this vital relationship while implementing Artificial Intelligence approaches to improving patient care. If not vigilant, Artificial Intelligence may unintentionally erode the physician-patient relationship resulting in physician/patient isolation.

Clearing the Fog: A Scoping Literature Review on the Ethical Issues Surrounding Artificial Intelligence-Based Medical Devices

The use of AI in healthcare has sparked much debate among philosophers, ethicists, regulators and policymakers who raised concerns about the implications of such technologies. The presented scoping review captures the progression of the ethical and legal debate and the proposed ethical frameworks available concerning the use of AI-based medical technologies, capturing key themes across a wide range of medical contexts. The ethical dimensions are synthesised in order to produce a coherent ethical framework for AI-based medical technologies, highlighting how transparency, accountability, confidentiality, autonomy, trust and fairness are the top six recurrent ethical issues. The literature also highlighted how it is essential to increase ethical awareness through interdisciplinary research, such that researchers, AI developers and regulators have the necessary education/competence or networks and tools to ensure proper consideration of ethical matters in the conception and design of new AI technologies and their norms. Interdisciplinarity throughout research, regulation and implementation will help ensure AI-based medical devices are ethical, clinically effective and safe. Achieving these goals will facilitate successful translation of AI into healthcare systems, which currently is lagging behind other sectors, to ensure timely achievement of health benefits to patients and the public.

Justice at the Forefront: Cultivating felt accountability towards Artificial Intelligence among healthcare professionals

The advent of AI has ushered in a new era of patient care, but with it emerges a contentious debate surrounding accountability for algorithmic medical decisions. Within this discourse, a spectrum of views prevails, ranging from placing accountability on AI solution providers to laying it squarely on the shoulders of healthcare professionals. In response to this debate, this study, grounded in the mutualistic partner choice (MPC) model of the evolution of morality, seeks to establish a configurational framework for cultivating felt accountability towards AI among healthcare professionals. This framework underscores two pivotal conditions: AI ethics enactment and trusting belief in AI and considers the influence of organizational complexity in the implementation of this framework. Drawing on Fuzzy-set Qualitative Comparative Analysis (fsQCA) of a sample of 401 healthcare professionals, this study reveals that a) focusing justice and autonomy in AI ethics enactment along with building trusting belief in AI reliability and functionality reinforces healthcare professionals' sense of felt accountability towards AI, b) fostering felt accountability towards AI necessitates ensuring the establishment of trust in its functionality for high complexity hospitals, and c) prioritizing justice in AI ethics enactment and trust in AI reliability is essential for low complexity hospitals.

Implications of conscious AI in primary healthcare

The conversation about consciousness of artificial intelligence (AI) is an ongoing topic since 1950s. Despite the numerous applications of AI identified in healthcare and primary healthcare, little is known about how a conscious AI would reshape its use in this domain. While there is a wide range of ideas as to whether AI can or cannot possess consciousness, a prevailing theme in all arguments is uncertainty. Given this uncertainty and the high stakes associated with the use of AI in primary healthcare, it is imperative to be prepared for all scenarios including conscious AI systems being used for medical diagnosis, shared decision-making and resource management in the future. This commentary serves as an overview of some of the pertinent evidence supporting the use of AI in primary healthcare and proposes ideas as to how consciousnesses of AI can support or further complicate these applications. Given the scarcity of evidence on the association between consciousness of AI and its current state of use in primary healthcare, our commentary identifies some directions for future research in this area including assessing patients', healthcare workers' and policy-makers' attitudes towards consciousness of AI systems in primary healthcare settings.

Speed, accuracy, and efficiency: The promises and practices of digitization in pathology

Digitization is often presented in policy discourse as a panacea to a multitude of contemporary problems, not least in healthcare. How can policy promises relating to digitization be assessed and potentially countered in particular local contexts? Based on a study in Denmark, we suggest scrutinizing the politics of digitization by comparing policy promises about the future with practitioners' experience in the present. While Denmark is one of the most digitalized countries in the world, digitization of pathology has only recently been given full policy attention. As pathology departments are faced with an increased demand for pathology analysis and a shortage of pathologists, Danish policymakers have put forward digitization as a way to address these challenges. Who is it that wants to digitize pathology, why, and how does digitization unfold in routine work practices? Using online search and document analysis, we identify actors and analyze the policy promises describing expectations associated with digitization. We then use interviews and observations to juxtapose these expectations with observations of everyday pathology practices as experienced by pathologists. We show that policymakers expect digitization to improve speed, patient safety, and diagnostic accuracy, as well as efficiency. In everyday practice, however, digitization does not deliver on these expectations. Fulfillment of policy expectations instead hinges on the types of artificial intelligence (AI) applications that are still to be developed and implemented. Some pathologists remark that AI might work in the easy cases, but this would leave them with only the difficult cases, which they consider too burdensome. Our particular mode of juxtaposing policy and practice throws new light on the political work done by policy promises and helps to explain why the discipline of pathology does not seem to easily lend itself to the digital embrace.

Artificial Intelligence With Robotics in Healthcare: A Narrative Review of Its Viability in India

This short review focuses on the emerging role of artificial intelligence (AI) with robotics in the healthcare sector. It may have particular utility for India, which has limited access to healthcare providers for a large growing population and limited health resources in rural India. AI works with an amalgamation of enormous amounts of data using fast and complex algorithms. This permits the software to quickly adapt the pattern of the data characteristics. It has the possibility to collide with most of the facets of the health system which may range from discovery to prediction and deterrence. The use of AI with robotics in the healthcare sector has shown a remarkable rising trend in the past few years. Functions like assistance with surgery, streamlining hospital logistics, and conducting routine checkups are some of the tasks that may be managed with great efficiency using artificial intelligence in urban and rural hospitals across the country. AI in the healthcare sector is advantageous in terms of ensuring exclusive patient care, safe working conditions where healthcare providers are at a lower risk of getting infected, and perfectly organized operational tasks. As the healthcare segment is globally recognized as one of the most dynamic and biggest industries, it tends to expedite development through modernization and original approaches. The future of this lucrative industry is looking forward to a great revolution aiming to create intelligent machines that work and respond like human beings. The future perspective of AI and robotics in the healthcare sector encompasses the care of elderly people, drug discovery, diagnosis of deadly diseases, a boost in clinical trials, remote patient monitoring, prediction of epidemic outbreaks, etc. However, the viability of using robotics in healthcare may be questionable in terms of expenditure, skilled workforce, and the conventional mindset of people. The biggest challenge is the replication of these technologies to the smaller towns and rural areas so that these facilities may reach the larger segment of the entire population of the country. This review aims to examine the adaptability and viability of these new technologies in the Indian scenario and identify the major challenges.

Beyond the hype: 'acceptable futures' for AI and robotic technologies in healthcare

AI and robotic technologies attract much hype, including utopian and dystopian future visions of technologically driven provision in the health and care sectors. Based on 30 interviews with scientists, clinicians and other stakeholders in the UK, Europe, USA, Australia, and New Zealand, this paper interrogates how those engaged in developing and using AI and robotic applications in health and care characterize their future promise, potential and challenges. We explore the ways in which these professionals articulate and navigate a range of high and low expectations, and promissory and cautionary future visions, around AI and robotic technologies. We argue that, through these articulations and navigations, they construct their own perceptions of socially and ethically 'acceptable futures' framed by an 'ethics of expectations.' This imbues the envisioned futures with a normative character, articulated in relation to the present context. We build on existing work in the sociology of expectations, aiming to contribute towards better understanding of how technoscientific expectations are navigated and managed by professionals. This is particularly timely since the COVID-19 pandemic gave further momentum to these technologies.

Artificial intelligence technologies and compassion in healthcare: A systematic scoping review

Background

Advances in artificial intelligence (AI) technologies, together with the availability of big data in society, creates uncertainties about how these developments will affect healthcare systems worldwide. Compassion is essential for high-quality healthcare and research shows how prosocial caring behaviors benefit human health and societies. However, the possible association between AI technologies and compassion is under conceptualized and underexplored.

Objectives

The aim of this scoping review is to provide a comprehensive depth and a balanced perspective of the emerging topic of AI technologies and compassion, to inform future research and practice. The review questions were: How is compassion discussed in relation to AI technologies in healthcare? How are AI technologies being used to enhance compassion in healthcare? What are the gaps in current knowledge and unexplored potential? What are the key areas where AI technologies could support compassion in healthcare?

Materials and methods

A systematic scoping review following five steps of Joanna Briggs Institute methodology. Presentation of the scoping review conforms with PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews). Eligibility criteria were defined according to 3 concept constructs (AI technologies, compassion, healthcare) developed from the literature and informed by medical subject headings (MeSH) and key words for the electronic searches. Sources of evidence were Web of Science and PubMed databases, articles published in English language 2011-2022. Articles were screened by title/abstract using inclusion/exclusion criteria. Data extracted (author, date of publication, type of article, aim/context of healthcare, key relevant findings, country) was charted using data tables. Thematic analysis used an inductive-deductive approach to generate code categories from the review questions and the data. A multidisciplinary team assessed themes for resonance and relevance to research and practice.

Results

Searches identified 3,124 articles. A total of 197 were included after screening. The number of articles has increased over 10 years (2011, n = 1 to 2021, n = 47 and from Jan-Aug 2022 n = 35 articles). Overarching themes related to the review questions were: (1) Developments and debates (7 themes) Concerns about AI ethics, healthcare jobs, and loss of empathy; Human-centered design of AI technologies for healthcare; Optimistic speculation AI technologies will address care gaps; Interrogation of what it means to be human and to care; Recognition of future potential for patient monitoring, virtual proximity, and access to healthcare; Calls for curricula development and healthcare professional education; Implementation of AI applications to enhance health and wellbeing of the healthcare workforce. (2) How AI technologies enhance compassion (10 themes) Empathetic awareness; Empathetic response and relational behavior; Communication skills; Health coaching; Therapeutic interventions; Moral development learning; Clinical knowledge and clinical assessment; Healthcare quality assessment; Therapeutic bond and therapeutic alliance; Providing health information and advice. (3) Gaps in knowledge (4 themes) Educational effectiveness of AI-assisted learning; Patient diversity and AI technologies; Implementation of AI technologies in education and practice settings; Safety and clinical effectiveness of AI technologies. (4) Key areas for development (3 themes) Enriching education, learning and clinical practice; Extending healing spaces; Enhancing healing relationships.

Conclusion

There is an association between AI technologies and compassion in healthcare and interest in this association has grown internationally over the last decade. In a range of healthcare contexts, AI technologies are being used to enhance empathetic awareness; empathetic response and relational behavior; communication skills; health coaching; therapeutic interventions; moral development learning; clinical knowledge and clinical assessment; healthcare quality assessment; therapeutic bond and therapeutic alliance; and to provide health information and advice. The findings inform a reconceptualization of compassion as a human-AI system of intelligent caring comprising six elements: (1) Awareness of suffering (e.g., pain, distress, risk, disadvantage); (2) Understanding the suffering (significance, context, rights, responsibilities etc.); (3) Connecting with the suffering (e.g., verbal, physical, signs and symbols); (4) Making a judgment about the suffering (the need to act); (5) Responding with an intention to alleviate the suffering; (6) Attention to the effect and outcomes of the response. These elements can operate at an individual (human or machine) and collective systems level (healthcare organizations or systems) as a cyclical system to alleviate different types of suffering. New and novel approaches to human-AI intelligent caring could enrich education, learning, and clinical practice; extend healing spaces; and enhance healing relationships.

Implications

In a complex adaptive system such as healthcare, human-AI intelligent caring will need to be implemented, not as an ideology, but through strategic choices, incentives, regulation, professional education, and training, as well as through joined up thinking about human-AI intelligent caring. Research funders can encourage research and development into the topic of AI technologies and compassion as a system of human-AI intelligent caring. Educators, technologists, and health professionals can inform themselves about the system of human-AI intelligent caring.

A meta-ethnography investigating relational influences on mental health and cancer-related health care interventions for racially minoritised people in the UK

OBJECTIVE

Despite calls to increase the 'cultural competence' of health care providers, racially minoritised people continue to experience a range of problems when it comes to health care, including discrimination. While relevant qualitative meta-syntheses have suggested better ways forward for health care for racialised minorities, many have lacked conceptual depth, and none have specifically investigated the relational dimensions involved in care. We set out to investigate the social and cultural influences on health care interventions, focusing on psychological approaches and/or cancer care to inform the trial of a new psychological therapy for those living with or beyond cancer.

METHOD

A meta-ethnography approach was used to examine the relevant qualitative studies, following Noblit and Hare, and guided by patient involvement throughout. Papers were analysed between September 2018 and February 2023, with some interruptions caused by the Covid pandemic. The following databases were searched: Ovid MEDLINE, EBSCO CINAHL, Ovid Embase, EBSCO PsycINFO, Proquest Sociology Collection (including Applied Social Sciences Index & Abstracts (ASSIA), Sociological Abstracts and Sociology Database), EBSCO SocINDEX, Ovid AMED, and Web of Science. The systematic review protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) (ID: CRD42018107695), and reporting follows the eMERGe Reporting Guidance for meta-ethnographies (France et al. 2019).

RESULTS

Twenty-nine journal papers were included in the final review. Themes (third-order constructs) developed in the paper include the centrality of the patient-practitioner relationship; how participants give meaning to their illness in connection to others; how families (rather than individuals) may make health decisions; how links with a higher power and spiritual/religious others can play a role in coping; and the ways in which a hierarchy of help-seeking develops, frequently with the first port of call being the resources of oneself. Participants in studies had a need to avoid being 'othered' in their care, valuing practitioners that connected with them, and who were able to recognise them as whole and complex (sometimes described in relational languages like 'love'). Complex family-based health decision-making and/or the importance of relations with non-human interactants (e.g. God, spiritual beings) were frequently uncovered, not to mention the profoundly emergent nature of stigma, whereby families could be relatively safe havens for containing and dealing with health challenges. A conceptual framework of 'animated via (frequently hidden) affective relationality' emerged in the final synthesis, bringing all themes together, and drawing attention to the emergent nature of the salient issues facing minoritised patients in health care interactions.

CONCLUSION

Our analysis is important because it sheds light on the hitherto buried relational forces animating and producing the specific issues facing racially minoritised patients, which study participants thought were largely overlooked, but to which professionals can readily relate (given the universal nature of human relations). Thus, training around the affective relationality of consultations could be a fruitful avenue to explore to improve care of diverse patients.