Papers › The Surprising Benefits of Base Rate Neglect in Robust Aggregation

The Surprising Benefits of Base Rate Neglect in Robust Aggregation

19 Jun 2024arXiv:2406.13490archive 2025-07-28

Yuqing Kong, Shu Wang, Ying Wang

Robust aggregation integrates predictions from multiple experts without knowledge of the experts' information structures. Prior work assumes experts are Bayesian, providing predictions as perfect posteriors based on their signals. However, real-world experts often deviate systematically from Bayesian reasoning. Our work considers experts who tend to ignore the base rate. We find that a certain degree of base rate neglect helps with robust forecast aggregation. Specifically, we consider a forecast aggregation problem with two experts who each predict a binary world state after observing private signals. Unlike previous work, we model experts exhibiting base rate neglect, where they incorporate the base rate information to degree λ∈[0,1], with λ=0 indicating complete ignorance and λ=1 perfect Bayesian updating. To evaluate aggregators' performance, we adopt Arieli et al. (2018)'s worst-case regret model, which measures the maximum regret across the set of considered information structures compared to an omniscient benchmark. Our results reveal the surprising V-shape of regret as a function of λ. That is, predictions with an intermediate incorporating degree of base rate λ<1 can counter-intuitively lead to lower regret than perfect Bayesian posteriors with λ=1. We additionally propose a new aggregator with low regret robust to unknown λ. Finally, we conduct an empirical study to test the base rate neglect model and evaluate the performance of various aggregators.

PaperPDFCode

Code

EconCSPKU/Probability-Task-Data officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

BASESET

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections