Identity Disclosure and Anthropomorphism in Voice Chatbot Design: A Field Experiment

Fueled by the widespread adoption of algorithms and artificial intelligence, the use of chatbots has become increasingly popular in various business contexts. In this paper, we study how to effectively and appropriately use voice chatbots, particularly by leveraging the two design features identity disclosure and anthropomorphism, and evaluate their impact on the firm operational performance. In collaboration with a large truck-sharing platform, we conducted a field experiment that randomly assigned 11,000 truck drivers to receive outbound calls from the voice chatbot dispatcher of our focal platform. Our empirical results suggest that disclosing the identity of the chatbot at the beginning of the conversation negatively affects operational performance, leading to around 11% reduction in the response probability. However, humanizing the voice chatbot by adding our proposed anthropomorphism features (i.e., interjections and filler words) significantly improves response probability, conversation length, and the probability of order acceptance intention by over 5.6%, 24.9%, and 10.1%, respectively. Moreover, even when the chatbot’s identity is disclosed along with humanizing features, the operational outcomes still improve. This finding suggests that enhancing anthropomorphism may potentially counteract the negative effects of chatbot identity disclosure. Finally, we propose one plausible explanation for the performance improvement—the enhanced trust between humans and algorithms—and provide empirical evidence that drivers are more likely to disclose information to chatbot dispatchers with anthropomorphism features. Our proposed anthropomorphism improvement solutions are currently being implemented and utilized by our collaborator platform. This paper was accepted by Felipe Caro, Special Issue on the Human-Algorithm Connection. Funding: This study is supported by the National Natural Science Foundation of China [Grants 72172169 and 91646125], Program for Innovation Research at the Central University of Finance and Economic, and Shanghai Pujiang Program. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2022.03833 .

Authors

Institutions

Publication Details

Journal
Management Science
Published
2024-08-26
DOI
https://doi.org/10.1287/mnsc.2022.03833
Citations
28
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
9.73
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Identity Disclosure and Anthropomorphism in Voice Chatbot Design: A Field Experiment

Yuqian Xu, Hongyan Dai, Wanfeng Yan
28 citations
Management Science
AI in Service Interactions
9.73
article

Identity Disclosure and Anthropomorphism in Voice Chatbot Design: A Field Experiment

Yuqian Xu, Hongyan Dai, Wanfeng Yan
article en
28 citations

Abstract

Fueled by the widespread adoption of algorithms and artificial intelligence, the use of chatbots has become increasingly popular in various business contexts. In this paper, we study how to effectively and appropriately use voice chatbots, particularly by leveraging the two design features identity disclosure and anthropomorphism, and evaluate their impact on the firm operational performance. In collaboration with a large truck-sharing platform, we conducted a field experiment that randomly assigned 11,000 truck drivers to receive outbound calls from the voice chatbot dispatcher of our focal platform. Our empirical results suggest that disclosing the identity of the chatbot at the beginning of the conversation negatively affects operational performance, leading to around 11% reduction in the response probability. However, humanizing the voice chatbot by adding our proposed anthropomorphism features (i.e., interjections and filler words) significantly improves response probability, conversation length, and the probability of order acceptance intention by over 5.6%, 24.9%, and 10.1%, respectively. Moreover, even when the chatbot’s identity is disclosed along with humanizing features, the operational outcomes still improve. This finding suggests that enhancing anthropomorphism may potentially counteract the negative effects of chatbot identity disclosure. Finally, we propose one plausible explanation for the performance improvement—the enhanced trust between humans and algorithms—and provide empirical evidence that drivers are more likely to disclose information to chatbot dispatchers with anthropomorphism features. Our proposed anthropomorphism improvement solutions are currently being implemented and utilized by our collaborator platform. This paper was accepted by Felipe Caro, Special Issue on the Human-Algorithm Connection. Funding: This study is supported by the National Natural Science Foundation of China [Grants 72172169 and 91646125], Program for Innovation Research at the Central University of Finance and Economic, and Shanghai Pujiang Program. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2022.03833 .

Management ScienceVol. 72(1)
Yuncheng University (CN), University of North Carolina at Chapel Hill (US), Central University of Finance and Economics (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 2%
AI in Service Interactions
9.73
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.