Neutral Pivoting: Strong Bias Correction for Shared Information

In the absence of historical data for use as forecasting inputs, decision makers often ask a panel of judges to predict the outcome of interest, leveraging the wisdom of the crowd [Surowiecki J (2005) The Wisdom of Crowds (Anchor, New York)]. Even if the crowd is large and skilled, shared information can bias the simple mean of judges’ estimates. Addressing the issue of bias, Palley and Soll [Palley AB, Soll JB (2019) Extracting the wisdom of crowds when information is shared. Management Sci. 65(5):2291–2309] introduces a novel approach called pivoting. Pivoting can take several forms, most notably the powerful and reliable minimal pivot. We build on the intuition of the minimal pivot and propose a more aggressive bias correction known as the neutral pivot. The neutral pivot achieves the largest bias correction of its class that both avoids the need to directly estimate crowd composition or skill and maintains a smaller expected squared error than the simple mean for all considered settings. Empirical assessments on real data sets confirm the effectiveness of the neutral pivot compared with current methods. Funding: This research includes calculations carried out on HPC resources supported in part by the National Science Foundation through major research instrumentation [Grant 1625061] and by the US Army Research Laboratory [contract number W911NF-16-2-0189]. Supplemental Material: The online appendix is available at https://doi.org/10.1287/deca.2024.0227 .

Authors

Institutions

Publication Details

Journal
Decision Analysis
Published
2024-12-27
DOI
https://doi.org/10.1287/deca.2024.0227
Citations
1
Primary Topic
Forecasting Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.49
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Neutral Pivoting: Strong Bias Correction for Shared Information

Joseph Rilling
1 citations
Decision Analysis
Forecasting Techniques and Applications
0.49
article

Neutral Pivoting: Strong Bias Correction for Shared Information

Joseph Rilling
article en
1 citations

Abstract

In the absence of historical data for use as forecasting inputs, decision makers often ask a panel of judges to predict the outcome of interest, leveraging the wisdom of the crowd [Surowiecki J (2005) The Wisdom of Crowds (Anchor, New York)]. Even if the crowd is large and skilled, shared information can bias the simple mean of judges’ estimates. Addressing the issue of bias, Palley and Soll [Palley AB, Soll JB (2019) Extracting the wisdom of crowds when information is shared. Management Sci. 65(5):2291–2309] introduces a novel approach called pivoting. Pivoting can take several forms, most notably the powerful and reliable minimal pivot. We build on the intuition of the minimal pivot and propose a more aggressive bias correction known as the neutral pivot. The neutral pivot achieves the largest bias correction of its class that both avoids the need to directly estimate crowd composition or skill and maintains a smaller expected squared error than the simple mean for all considered settings. Empirical assessments on real data sets confirm the effectiveness of the neutral pivot compared with current methods. Funding: This research includes calculations carried out on HPC resources supported in part by the National Science Foundation through major research instrumentation [Grant 1625061] and by the US Army Research Laboratory [contract number W911NF-16-2-0189]. Supplemental Material: The online appendix is available at https://doi.org/10.1287/deca.2024.0227 .

Decision AnalysisVol. 22(2)
Temple University (US)
Peace, Justice and strong institutions
Openalex Percentile: Top 27%
Forecasting Techniques and Applications
0.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.