Human bias in algorithm design

Algorithms are designed to learn user preferences by observing user behaviour. This causes algorithms to fail to reflect user preferences when psychological biases affect user decision making. For algorithms to enhance social welfare, algorithm design needs to be psychologically informed.

Saved in:
Bibliographic Details
Published inNature human behaviour Vol. 7; no. 11; pp. 1822 - 1824
Main Authors Morewedge, Carey K., Mullainathan, Sendhil, Naushan, Haaya F., Sunstein, Cass R., Kleinberg, Jon, Raghavan, Manish, Ludwig, Jens O.
Format Journal Article
LanguageEnglish
Published London Nature Publishing Group UK 01.11.2023
Nature Publishing Group
Subjects
4014/4045
4014/477/2811
Algorithms
Behavioral Sciences
Bias
Biomedical and Life Sciences
Comment
Decision making
Design
Designers
Experimental Psychology
Humans
Life Sciences
Microeconomics
Neurosciences
Personality and Social Psychology
Rationality
Recommender systems
Social networks
Social welfare
User behavior
Online AccessGet full text

Cover

More Information
Summary:Algorithms are designed to learn user preferences by observing user behaviour. This causes algorithms to fail to reflect user preferences when psychological biases affect user decision making. For algorithms to enhance social welfare, algorithm design needs to be psychologically informed.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:2397-3374
2397-3374
DOI:10.1038/s41562-023-01724-4