The (Im)perfect Automation Schema: Who Is Trusted More, Automated or Human Decision Support?
HUMAN FACTORS 2023:187208231197347. [PMID:
37632728 DOI:
10.1177/00187208231197347]
[Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/28/2023]
Abstract
OBJECTIVE
This study's purpose was to better understand the dynamics of trust attitude and behavior in human-agent interaction.
BACKGROUND
Whereas past research provided evidence for a perfect automation schema, more recent research has provided contradictory evidence.
METHOD
To disentangle these conflicting findings, we conducted an online experiment using a simulated medical X-ray task. We manipulated the framing of support agents (i.e., artificial intelligence (AI) versus expert versus novice) between-subjects and failure experience (i.e., perfect support, imperfect support, back-to-perfect support) within subjects. Trust attitude and behavior as well as perceived reliability served as dependent variables.
RESULTS
Trust attitude and perceived reliability were higher for the human expert than for the AI than for the human novice. Moreover, the results showed the typical pattern of trust formation, dissolution, and restoration for trust attitude and behavior as well as perceived reliability. Forgiveness after failure experience did not differ between agents.
CONCLUSION
The results strongly imply the existence of an imperfect automation schema. This illustrates the need to consider agent expertise for human-agent interaction.
APPLICATION
When replacing human experts with AI as support agents, the challenge of lower trust attitude towards the novel agent might arise.
Collapse