Higher Precision Is Not Always Better: Search Algorithm and Consumer Engagement

On decentralized e-commerce platforms, search algorithms play a critical role in matching buyers and sellers. A typical search algorithm routinely refines and improves its catalog of data to increase search precision, but the effects of a more precise search are little known. We evaluate such effects via a 2019 quasiexperiment on a world-leading e-commerce platform in which the search algorithm refined some product categories into finer subgroups to allocate consumer queries to more relevant product listings. Our data cover millions of consumers’ search and purchase behaviors over six months across multiple search sessions and product categories, enabling us to investigate trade-offs over time and across categories. We find that a more precise search algorithm improves consumers’ click-through and purchase rates drastically and instantaneously, but it comes at the cost of a significant decrease in consumer engagement and unplanned purchases over a longer time horizon. On average, consumers who used to spend more time searching now conduct 5.5% fewer searches, spend 4.1% less time on the platform, and decrease their spending on related categories by 2.2% in the week after the search precision increases. Our examination of the mechanisms behind these consequences calls for more careful search algorithm designs that account for not only instant conversion based on search precision but also consumer engagement and sellers’ strategic responses in the longer horizon. This paper was accepted by Anindya Ghose, information systems. Funding: This work was supported by the Key Program of the National Natural Science Foundation of China [Grants 72141305 and 72192803] and the Ministry of Education, People’s Republic of China (Fundamental Research Funds for the Central Universities), both to L. Fang. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2023.00478 .

Authors

Institutions

Publication Details

Journal
Management Science
Published
2024-10-28
DOI
https://doi.org/10.1287/mnsc.2023.00478
Citations
6
Primary Topic
Consumer Market Behavior and Pricing
Type
article
Field-Weighted Citation Impact
2.19
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Higher Precision Is Not Always Better: Search Algorithm and Consumer Engagement

Mo Xiao, Mingfeng Lin, Lu Fang, Zhou Wei
6 citations
Management Science
Consumer Market Behavior and Pricing
2.19
article

Higher Precision Is Not Always Better: Search Algorithm and Consumer Engagement

Mo Xiao, Mingfeng Lin, Lu Fang, Zhou Wei
article en
6 citations

Abstract

On decentralized e-commerce platforms, search algorithms play a critical role in matching buyers and sellers. A typical search algorithm routinely refines and improves its catalog of data to increase search precision, but the effects of a more precise search are little known. We evaluate such effects via a 2019 quasiexperiment on a world-leading e-commerce platform in which the search algorithm refined some product categories into finer subgroups to allocate consumer queries to more relevant product listings. Our data cover millions of consumers’ search and purchase behaviors over six months across multiple search sessions and product categories, enabling us to investigate trade-offs over time and across categories. We find that a more precise search algorithm improves consumers’ click-through and purchase rates drastically and instantaneously, but it comes at the cost of a significant decrease in consumer engagement and unplanned purchases over a longer time horizon. On average, consumers who used to spend more time searching now conduct 5.5% fewer searches, spend 4.1% less time on the platform, and decrease their spending on related categories by 2.2% in the week after the search precision increases. Our examination of the mechanisms behind these consequences calls for more careful search algorithm designs that account for not only instant conversion based on search precision but also consumer engagement and sellers’ strategic responses in the longer horizon. This paper was accepted by Anindya Ghose, information systems. Funding: This work was supported by the Key Program of the National Natural Science Foundation of China [Grants 72141305 and 72192803] and the Ministry of Education, People’s Republic of China (Fundamental Research Funds for the Central Universities), both to L. Fang. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2023.00478 .

Management ScienceVol. 71(7)
Georgia Institute of Technology (US), University of Arizona (US), Research Center for Rural Economy (CN)
Openalex Percentile: Top 11%
Consumer Market Behavior and Pricing
2.19
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.