If people weighed AI advice the way they weigh a stranger's passing opinion, a narrowed option set would matter less. The literature on automation bias and algorithm appreciation suggests they do not: people tend to over-rely on automated and algorithmic advice — sometimes more than on human advice — and to scale back their own search for alternatives. That is the condition under which silent narrowing does the most damage: the options that were dropped are the ones the user never thinks to look for.
Humans and Automation: Use, Misuse, Disuse, Abuse
Parasuraman & Riley · Human Factors · 1997 · doi:10.1518/001872097778543886
The foundational framing of automation misuse — over-reliance, complacency, and automation bias — as a distinct failure mode from outright error. Establishes that trusted automation reshapes how operators attend to a problem, often suppressing independent checking. The mechanism that makes a quietly narrowed option set consequential rather than merely cosmetic.
doi.org/10.1518/001872097778543886 →
Algorithm appreciation: People prefer algorithmic to human judgment
Logg, Minson & Moore · OBHDP · 2019 · doi:10.1016/j.obhdp.2018.12.005
Across experiments, people often weight identical advice more heavily when told it comes from an algorithm than from a person. If algorithmic advice is granted extra authority, then whatever that advice omits is omitted with extra weight — sharpening, not softening, the stakes of option narrowing.
doi.org/10.1016/j.obhdp.2018.12.005 →
To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-Making
Buçinca, Malaya & Gajos · CSCW · 2021 · arXiv:2102.09692
Shows people overrely on AI suggestions even when those suggestions are wrong, and that deliberately slowing engagement (cognitive forcing) reduces it. Evidence that over-reliance is the default rather than the exception — and that what the interface chooses to surface materially shapes the decision.
arxiv.org/abs/2102.09692 →