To Err is Automation: Can Trust be Repaired by the Automated Driving System After its Failure?
Failures of the automated driving system (ADS) in automated vehicles (AVs) can damage driver–ADS cooperation (e.g., causing trust damage) and traffic safety. Researchers suggest infusing a human-like ability, active trust repair, into automated systems, to mitigate broken trust and other negative impacts resulting from their failures. Trust repair is regarded as a key ergonomic design in automated systems. Trust repair strategies (e.g., apology) are examined and supported by some evidence in controlled environments, however, rarely subjected to empirical evaluations in more naturalistic environments. To fill this gap, we conducted a test track study, invited participants (<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">N</i> = 257) to experience an ADS failure, and tested the influence of the ADS’ trust repair on trust and other psychological responses. Half of participants (<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</i> = 128) received the ADS’ verbal message (consisting of apology, explanation, and promise) by a human voice (<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</i> = 63) or by Apple's Siri (<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</i> = 65) after its failure. We measured seven psychological responses to AVs and ADS [e.g., trust and behavioral intention (BI)]. We found that both strategies cannot repair damaged trust. The human-voice-repair strategy can to some degree mitigate other detrimental influences (e.g., reductions in BI) resulting from the ADS failure, but this effect is only notable among participants without substantial driving experience. It points to the importance of conducting ecologically valid and field studies for validating human-like trust repair strategies in human–automation interaction and of developing trust repair strategies specific to safety-critical situations.
Authors
- Zhigang Xu (ORCID: https://orcid.org/0000-0002-8479-4973)
- Yueying Chu (ORCID: https://orcid.org/0009-0007-7757-4554)
- Peng Liu (ORCID: https://orcid.org/0000-0003-4929-0531)
- Guanqun Wang (ORCID: https://orcid.org/0000-0003-1301-624X)
Institutions
- Chang'an University (CN)
- Zhejiang University (CN)
Publication Details
- Journal
- IEEE Transactions on Human-Machine Systems
- Published
- 2024-08-13
- DOI
- https://doi.org/10.1109/thms.2024.3434680
- Citations
- 7
- Primary Topic
- Blockchain Technology Applications and Security
- Type
- article
- Field-Weighted Citation Impact
- 5.45
Funders
- National Natural Science Foundation of China