Harnessing the Wisdom of Crowds

When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate earnings forecast platform (Estimize.com). By tracking user activities, we monitor the amount of public information a user views before maki...

Full description

Saved in:
Bibliographic Details
Published inManagement science Vol. 66; no. 5; pp. 1847 - 1867
Main Authors Da, Zhi, Huang, Xing
Format Journal Article
LanguageEnglish
Published Linthicum INFORMS 01.05.2020
Institute for Operations Research and the Management Sciences
Subjects
Online AccessGet full text
ISSN0025-1909
1526-5501
DOI10.1287/mnsc.2019.3294

Cover

Loading…
Abstract When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate earnings forecast platform (Estimize.com). By tracking user activities, we monitor the amount of public information a user views before making an earnings forecast. We find that the more public information users view, the less weight they put on their own private information. Although this improves the accuracy of individual forecasts, it reduces the accuracy of the group consensus forecast because useful private information is prevented from entering the consensus. To address endogeneity concerns related to a user’s information acquisition choice, we collaborate with Estimize.com to run experiments that restrict the information available to randomly selected stocks and users. The experiments confirm that “independent” forecasts result in a more accurate consensus. Estimize.com was convinced to switch to a “blind” platform from November 2015 on. The findings suggest that the wisdom of crowds can be better harnessed by encouraging independent voices from among group members and that more public information disclosure may not always improve group decision making. This paper was accepted by Renee Adams, finance.
AbstractList When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate earnings forecast platform (Estimize.com). By tracking user activities, we monitor the amount of public information a user views before making an earnings forecast. We find that the more public information users view, the less weight they put on their own private information. Although this improves the accuracy of individual forecasts, it reduces the accuracy of the group consensus forecast because useful private information is prevented from entering the consensus. To address endogeneity concerns related to a user's information acquisition choice, we collaborate with Estimize.com to run experiments that restrict the information available to randomly selected stocks and users. The experiments confirm that "independent" forecasts result in a more accurate consensus. Estimize.com was convinced to switch to a "blind" platform from November 2015 on. The findings suggest that the wisdom of crowds can be better harnessed by encouraging independent voices from among group members and that more public information disclosure may not always improve group decision making.
When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate earnings forecast platform (Estimize.com). By tracking user activities, we monitor the amount of public information a user views before making an earnings forecast. We find that the more public information users view, the less weight they put on their own private information. Although this improves the accuracy of individual forecasts, it reduces the accuracy of the group consensus forecast because useful private information is prevented from entering the consensus. To address endogeneity concerns related to a user’s information acquisition choice, we collaborate with Estimize.com to run experiments that restrict the information available to randomly selected stocks and users. The experiments confirm that “independent” forecasts result in a more accurate consensus. Estimize.com was convinced to switch to a “blind” platform from November 2015 on. The findings suggest that the wisdom of crowds can be better harnessed by encouraging independent voices from among group members and that more public information disclosure may not always improve group decision making. This paper was accepted by Renee Adams, finance.
Author Huang, Xing
Da, Zhi
Author_xml – sequence: 1
  givenname: Zhi
  surname: Da
  fullname: Da, Zhi
  organization: Mendoza College of Business, University of Notre Dame, Notre Dame, Indiana 46556
– sequence: 2
  givenname: Xing
  orcidid: 0000-0002-3911-5820
  surname: Huang
  fullname: Huang, Xing
  organization: Olin Business School, Washington University in St. Louis, St. Louis, Missouri 63130
BookMark eNqFkEtLAzEURoNUsK1u3Trgesa8H0spaoWCG8VlSPPQlE5Skyniv7dDXQni6m7O-S6cGZiknDwAlwh2CEtx06dqOwyR6ghW9ARMEcO8ZQyiCZhCiFmLFFRnYFbrBkIopOBTcLU0JflaY3prhnffvMbqct_k0CxK_nT1HJwGs63-4ufOwcv93fNi2a6eHh4Xt6vWUsKHljMpIVFEBYYc5dwG5RxfY26FdcQoqwQxWFnmuORoTYnwMhjjMeKKCszIHFwfd3clf-x9HfQm70s6vNSYQk6gkggeKHqkbMm1Fh-0jYMZYk5DMXGrEdRjCj2m0GMKPaY4aN0vbVdib8rX30J7FGIKufT1P_4baOhvtQ
CitedBy_id crossref_primary_10_2139_ssrn_4700311
crossref_primary_10_1080_15427560_2022_2138395
crossref_primary_10_2139_ssrn_4810600
crossref_primary_10_1007_s11053_022_10074_3
crossref_primary_10_2139_ssrn_4801695
crossref_primary_10_2139_ssrn_3656583
crossref_primary_10_2308_TAR_2023_0117
crossref_primary_10_1017_S0022109020000721
crossref_primary_10_1016_j_dss_2023_114129
crossref_primary_10_1007_s42113_024_00200_0
crossref_primary_10_2139_ssrn_3612922
crossref_primary_10_2308_TAR_2021_0055
crossref_primary_10_2139_ssrn_3195877
crossref_primary_10_1108_RBF_09_2021_0176
crossref_primary_10_2139_ssrn_5036829
crossref_primary_10_2139_ssrn_3533736
crossref_primary_10_3390_jrfm16020113
crossref_primary_10_1109_ACCESS_2024_3357114
crossref_primary_10_2139_ssrn_3444144
crossref_primary_10_1287_mnsc_2022_01102
crossref_primary_10_2139_ssrn_3640794
crossref_primary_10_1007_s11408_022_00415_w
crossref_primary_10_2139_ssrn_3720758
crossref_primary_10_2139_ssrn_3837049
crossref_primary_10_1016_j_jacceco_2020_101363
crossref_primary_10_2139_ssrn_4637004
crossref_primary_10_2139_ssrn_3758359
crossref_primary_10_2139_ssrn_3514826
crossref_primary_10_1126_sciadv_abf4393
crossref_primary_10_1287_mnsc_2023_4818
crossref_primary_10_1038_s41598_024_52176_3
crossref_primary_10_1093_poq_nfab017
crossref_primary_10_1007_s11192_024_05090_4
crossref_primary_10_1016_j_techfore_2023_122543
crossref_primary_10_1057_s41291_022_00190_6
crossref_primary_10_2139_ssrn_4202792
crossref_primary_10_1108_CAFR_10_2023_0124
crossref_primary_10_2139_ssrn_3965749
crossref_primary_10_1016_j_pacfin_2024_102401
crossref_primary_10_2308_JFR_2022_021
crossref_primary_10_1002_smj_3450
crossref_primary_10_1016_j_jebo_2024_106817
crossref_primary_10_1016_j_frl_2020_101747
crossref_primary_10_1016_j_jfineco_2021_06_025
crossref_primary_10_1111_1911_3846_12852
crossref_primary_10_2139_ssrn_3777306
crossref_primary_10_1111_jpg_12771
crossref_primary_10_2139_ssrn_4528456
crossref_primary_10_2139_ssrn_4742174
crossref_primary_10_2139_ssrn_3776935
crossref_primary_10_1093_rcfs_cfab014
crossref_primary_10_2139_ssrn_4171375
crossref_primary_10_3390_info14090518
crossref_primary_10_1016_j_jbef_2021_100619
crossref_primary_10_1146_annurev_financial_110921_013217
crossref_primary_10_2139_ssrn_3136150
crossref_primary_10_2139_ssrn_3743657
crossref_primary_10_3233_JIFS_230395
crossref_primary_10_1016_j_inffus_2023_03_013
crossref_primary_10_1093_rapstu_raae016
crossref_primary_10_2139_ssrn_4629865
crossref_primary_10_1016_j_elerap_2022_101159
crossref_primary_10_2139_ssrn_3925198
crossref_primary_10_1287_mnsc_2021_4127
crossref_primary_10_1287_mnsc_2022_02575
crossref_primary_10_1126_sciadv_adp1528
crossref_primary_10_2139_ssrn_4634986
crossref_primary_10_1016_j_jedc_2023_104636
crossref_primary_10_1108_IJPSM_02_2021_0050
crossref_primary_10_1287_mnsc_2021_02928
crossref_primary_10_2139_ssrn_3858423
crossref_primary_10_1002_joom_1179
crossref_primary_10_1016_j_jfineco_2024_103870
crossref_primary_10_2139_ssrn_3882239
crossref_primary_10_2139_ssrn_4806692
crossref_primary_10_1093_rcfs_cfac017
crossref_primary_10_2139_ssrn_4642935
crossref_primary_10_1093_qje_qjaa026
crossref_primary_10_1038_s41598_023_28597_x
crossref_primary_10_1002_mde_3863
crossref_primary_10_1016_j_omega_2023_103015
crossref_primary_10_1080_07421222_2020_1831762
crossref_primary_10_2139_ssrn_2826911
crossref_primary_10_2139_ssrn_4645002
crossref_primary_10_2139_ssrn_4666240
crossref_primary_10_2139_ssrn_4035960
crossref_primary_10_1017_epi_2021_13
crossref_primary_10_2139_ssrn_4172208
crossref_primary_10_4018_JGIM_325505
crossref_primary_10_2139_ssrn_4241505
crossref_primary_10_2139_ssrn_4940230
crossref_primary_10_1108_JICES_02_2020_0021
Cites_doi 10.1111/1468-036X.00207
10.1162/00335530360698469
10.1016/S0165-4101(98)00016-0
10.1016/j.jfineco.2005.08.002
10.1257/mic.2.4.221
10.1093/rfs/7.1.97
10.1086/261849
10.2307/2601032
10.2307/2118364
10.1111/j.1467-937X.2009.00594.x
10.1093/rfs/hhu001
10.1016/j.jfineco.2018.08.004
10.1016/j.jfineco.2005.07.006
10.2307/2946656
10.1111/j.1540-6261.2005.00731.x
10.1287/mnsc.49.12.1636.25109
10.1016/j.jfineco.2017.03.009
10.1093/rfs/hhj007
10.2308/accr-51865
10.1257/jep.26.3.157
10.1007/s11166-007-9020-y
10.1111/0034-6527.00290
10.1093/rfs/12.4.653
10.1111/1540-6261.00526
10.1111/1475-679X.12121
10.1016/S0304-405X(00)00076-3
10.1093/qje/qju021
10.1111/0022-1082.00103
10.1111/j.1475-679X.2010.00387.x
ContentType Journal Article
Copyright Copyright Institute for Operations Research and the Management Sciences May 2020
Copyright_xml – notice: Copyright Institute for Operations Research and the Management Sciences May 2020
DBID AAYXX
CITATION
8BJ
FQK
JBE
DOI 10.1287/mnsc.2019.3294
DatabaseName CrossRef
International Bibliography of the Social Sciences (IBSS)
International Bibliography of the Social Sciences
International Bibliography of the Social Sciences
DatabaseTitle CrossRef
International Bibliography of the Social Sciences (IBSS)
DatabaseTitleList International Bibliography of the Social Sciences (IBSS)
CrossRef

DeliveryMethod fulltext_linktorsrc
Discipline Business
EISSN 1526-5501
EndPage 1867
ExternalDocumentID 10_1287_mnsc_2019_3294
mnsc20193294
Genre Research Articles
GroupedDBID 08R
0R1
1AW
1OL
29M
2AX
3EH
3R3
3V.
4
4.4
41
5GY
6XO
7WY
7X5
85S
8AO
8FI
8FJ
8FL
8VB
AABCJ
AAIKC
AAPBV
AAYJJ
ABBHK
ABEFU
ABIVO
ABNOP
ABPPZ
ABSIS
ABTRL
ABUFD
ABUWG
ABZEH
ACDCL
ACHQT
ACNCT
ACTDY
ACVYA
ACYGS
ADBBV
ADDCT
ADGDI
ADNFJ
AEILP
AENEX
AETEA
AEUPB
AFDAS
AFFDN
AFFNX
AFKRA
AJPNJ
AKVCP
ALMA_UNASSIGNED_HOLDINGS
AQNXB
AQSKT
AQUVI
AZQEC
B-7
BBAFP
BENPR
BEZIV
BPHCQ
BVXVI
CBXGM
CCKSF
CS3
CWXUR
CYVLN
DU5
DWQXO
EBA
EBE
EBO
EBR
EBS
EBU
ECR
EHE
EJD
EMK
EPL
F20
F5P
FH7
FRNLG
FYUFA
G8K
GENNL
GNUQQ
GROUPED_ABI_INFORM_ARCHIVE
GROUPED_ABI_INFORM_COMPLETE
GROUPED_ABI_INFORM_RESEARCH
GUPYA
HGD
HVGLF
H~9
IAO
IEA
IGG
IOF
IPO
ISM
ITC
JAV
JBC
JPL
JSODD
JST
K6
K60
L8O
LI
M0C
M0T
M2M
MV1
N95
NEJ
NIEAY
P-O
P2P
PQEST
PQQKQ
PQUKI
PRINS
PROAC
QWB
REX
RNS
RPU
SA0
SJN
TH9
TN5
U5U
UKR
VOH
VQA
WH7
X
XFK
XHC
XI7
XXP
XZL
Y99
YCJ
YNT
YZZ
ZCG
ZL0
-~X
.-4
18M
41~
AAAZS
AAMNW
AAWTO
AAXLS
AAYOK
AAYXX
ABAWQ
ABDNZ
ABDPE
ABKVW
ABLWH
ABXSQ
ABYYQ
ACGFO
ACHJO
ACXJH
ADEPB
ADMHG
ADNWM
ADULT
AEGXH
AEMOZ
AFAIT
AFTQD
AGKTX
AHAJD
AHQJS
AIAGR
ALIPV
APTMU
ASMEE
BAAKF
CCPQU
CITATION
IPC
IPSME
IPY
ISL
JAAYA
JBMMH
JBZCM
JENOY
JHFFW
JKQEH
JLEZI
JLXEF
JPPEU
K1G
K6~
LPU
OFU
PHGZM
PHGZT
PQBIZ
PQBZA
PSYQQ
UKHRP
XSW
YYP
8BJ
FQK
JBE
ID FETCH-LOGICAL-c436t-658803939f51d466cf9dd6b26c7cd3a9c973a29c5d6861b437e8faae216947253
ISSN 0025-1909
IngestDate Sat Aug 16 11:41:18 EDT 2025
Tue Jul 01 02:55:08 EDT 2025
Thu Apr 24 23:12:53 EDT 2025
Wed Jan 06 02:47:50 EST 2021
IsPeerReviewed true
IsScholarly true
Issue 5
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c436t-658803939f51d466cf9dd6b26c7cd3a9c973a29c5d6861b437e8faae216947253
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-3911-5820
PQID 2406309810
PQPubID 40737
PageCount 21
ParticipantIDs proquest_journals_2406309810
crossref_citationtrail_10_1287_mnsc_2019_3294
crossref_primary_10_1287_mnsc_2019_3294
informs_primary_10_1287_mnsc_2019_3294
ProviderPackageCode Y99
RPU
NIEAY
CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2020-05-01
PublicationDateYYYYMMDD 2020-05-01
PublicationDate_xml – month: 05
  year: 2020
  text: 2020-05-01
  day: 01
PublicationDecade 2020
PublicationPlace Linthicum
PublicationPlace_xml – name: Linthicum
PublicationTitle Management science
PublicationYear 2020
Publisher INFORMS
Institute for Operations Research and the Management Sciences
Publisher_xml – name: INFORMS
– name: Institute for Operations Research and the Management Sciences
References B20
B21
B22
B23
B24
B25
B26
B27
B28
B29
B30
B31
B32
B11
B33
B12
B34
B13
B35
B14
B36
B15
B37
B16
B38
B17
B39
B18
B19
B1
B2
B3
B4
B5
B6
B7
B8
B9
Anderson LR (B4) 1997; 87
Surowiecki J (B39) 2005
Scharfstein DS (B34) 1990; 80
Cote JM (B17) 1997; 9
Sunstein CR (B36) 2005; 80
References_xml – ident: B12
– ident: B9
– ident: B35
– ident: B14
– ident: B3
– ident: B20
– ident: B1
– ident: B27
– ident: B7
– ident: B5
– ident: B29
– ident: B25
– ident: B23
– ident: B21
– ident: B18
– ident: B16
– ident: B31
– ident: B33
– ident: B37
– ident: B39
– ident: B8
– ident: B36
– ident: B11
– ident: B13
– ident: B2
– ident: B26
– ident: B4
– ident: B28
– ident: B6
– ident: B24
– ident: B22
– ident: B17
– ident: B32
– ident: B15
– ident: B30
– ident: B34
– ident: B19
– ident: B38
– ident: B25
  doi: 10.1111/1468-036X.00207
– ident: B18
  doi: 10.1162/00335530360698469
– ident: B30
  doi: 10.1016/S0165-4101(98)00016-0
– ident: B32
  doi: 10.1016/j.jfineco.2005.08.002
– ident: B20
  doi: 10.1257/mic.2.4.221
– ident: B37
  doi: 10.1093/rfs/7.1.97
– ident: B9
  doi: 10.1086/261849
– ident: B27
  doi: 10.2307/2601032
– ident: B5
  doi: 10.2307/2118364
– ident: B1
  doi: 10.1111/j.1467-937X.2009.00594.x
– ident: B13
  doi: 10.1093/rfs/hhu001
– ident: B23
  doi: 10.1016/j.jfineco.2018.08.004
– volume: 80
  start-page: 465
  issue: 3
  year: 1990
  ident: B34
  publication-title: Amer. Econom. Rev.
– ident: B8
  doi: 10.1016/j.jfineco.2005.07.006
– ident: B19
  doi: 10.2307/2946656
– ident: B16
  doi: 10.1111/j.1540-6261.2005.00731.x
– ident: B6
  doi: 10.1287/mnsc.49.12.1636.25109
– ident: B3
  doi: 10.1016/j.jfineco.2017.03.009
– ident: B14
  doi: 10.1093/rfs/hhj007
– ident: B7
  doi: 10.2308/accr-51865
– ident: B11
  doi: 10.1257/jep.26.3.157
– ident: B12
  doi: 10.1007/s11166-007-9020-y
– volume: 80
  start-page: 962
  year: 2005
  ident: B36
  publication-title: New York University aw Rev.
– ident: B29
  doi: 10.1111/0034-6527.00290
– ident: B31
  doi: 10.1093/rfs/12.4.653
– year: 2005
  ident: B39
  publication-title: The Wisdom of Crowds
– volume: 87
  start-page: 847
  issue: 5
  year: 1997
  ident: B4
  publication-title: Amer. Econom. Rev.
– ident: B26
  doi: 10.1111/1540-6261.00526
– ident: B28
  doi: 10.1111/1475-679X.12121
– ident: B38
  doi: 10.1016/S0304-405X(00)00076-3
– volume: 9
  start-page: 20
  year: 1997
  ident: B17
  publication-title: Behav. Res. Accounting
– ident: B21
  doi: 10.1093/qje/qju021
– ident: B24
  doi: 10.1111/0022-1082.00103
– ident: B15
  doi: 10.1111/j.1475-679X.2010.00387.x
SSID ssj0007876
Score 2.5460927
Snippet When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate...
SourceID proquest
crossref
informs
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 1847
SubjectTerms Crowds
Decision making
Earnings
earnings forecast
Estimating techniques
Group decision making
herding
Information processing
naïve learning
social learning
Social networks
Tracking
Wisdom
wisdom of crowds
Title Harnessing the Wisdom of Crowds
URI https://www.proquest.com/docview/2406309810
Volume 66
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3LT8MgGCc6o_FifMa3PRg9GLRAoeWoRrN4MMZo3K1pgcYluhk3L_71fhTabjrj40IaArTwg-9BvwdC-4ZoqRVoJzKMchxxk-NESI0TmTHDQmljpllri2vRvo-uOrzTJMErvUuG-bF6n-hX8h9UoQ5wtV6yf0C2HhQq4BnwhRIQhvJXGLezV0upKo-nh-5A959LAwtQrp0HbyV4NmYuR57pNXfU5Q-Kx26DsL9D7lRszd8K0LCxwaut9DkGZu_IkfHEjQoMGgkZpX4u54lHmY-QMlD94hG2aAPfTSS51F5aXD73BjYgJJHHjLqsxeOxrT_xnNoS0OogMEJq-6e2f2r7T6MZCmI_baGZs4vrm9uatwJ5EVUSXjs7H4YTRjgZ_4IxMWPWBaEdfOG3pRBxt4gWvPQfnDool9CU6S2jucr5YAXtNYgGgGjgEA36ReAQXUX3lxd3523sU1hgFTExxCDfJdb7WRac6EgIVUitRU6FipVmmVQyZhmVimuRCJJHLDZJkWWGEiGjmHK2hlq9fs-soyAxpIhJFpYabqh5ohRlRVwUEc-p0eEGwtWMU-Xju9s0I0_p5DXeQId1-xcX2eTblgd-AX9suF2tb-qPySC1IiMc-oSEm79-4xaabzb1NmoNX9_MDgh_w3zX74gPAgxToA
linkProvider ProQuest
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Harnessing+the+Wisdom+of+Crowds&rft.jtitle=Management+science&rft.au=Da%2C+Zhi&rft.au=Huang%2C+Xing&rft.date=2020-05-01&rft.issn=0025-1909&rft.eissn=1526-5501&rft.volume=66&rft.issue=5&rft.spage=1847&rft.epage=1867&rft_id=info:doi/10.1287%2Fmnsc.2019.3294&rft.externalDBID=n%2Fa&rft.externalDocID=10_1287_mnsc_2019_3294
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0025-1909&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0025-1909&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0025-1909&client=summon