Harnessing the Wisdom of Crowds
When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate earnings forecast platform (Estimize.com). By tracking user activities, we monitor the amount of public information a user views before maki...
Saved in:
Published in | Management science Vol. 66; no. 5; pp. 1847 - 1867 |
---|---|
Main Authors | , |
Format | Journal Article |
Language | English |
Published |
Linthicum
INFORMS
01.05.2020
Institute for Operations Research and the Management Sciences |
Subjects | |
Online Access | Get full text |
ISSN | 0025-1909 1526-5501 |
DOI | 10.1287/mnsc.2019.3294 |
Cover
Loading…
Abstract | When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate earnings forecast platform (Estimize.com). By tracking user activities, we monitor the amount of public information a user views before making an earnings forecast. We find that the more public information users view, the less weight they put on their own private information. Although this improves the accuracy of individual forecasts, it reduces the accuracy of the group consensus forecast because useful private information is prevented from entering the consensus. To address endogeneity concerns related to a user’s information acquisition choice, we collaborate with Estimize.com to run experiments that restrict the information available to randomly selected stocks and users. The experiments confirm that “independent” forecasts result in a more accurate consensus. Estimize.com was convinced to switch to a “blind” platform from November 2015 on. The findings suggest that the wisdom of crowds can be better harnessed by encouraging independent voices from among group members and that more public information disclosure may not always improve group decision making.
This paper was accepted by Renee Adams, finance. |
---|---|
AbstractList | When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate earnings forecast platform (Estimize.com). By tracking user activities, we monitor the amount of public information a user views before making an earnings forecast. We find that the more public information users view, the less weight they put on their own private information. Although this improves the accuracy of individual forecasts, it reduces the accuracy of the group consensus forecast because useful private information is prevented from entering the consensus. To address endogeneity concerns related to a user's information acquisition choice, we collaborate with Estimize.com to run experiments that restrict the information available to randomly selected stocks and users. The experiments confirm that "independent" forecasts result in a more accurate consensus. Estimize.com was convinced to switch to a "blind" platform from November 2015 on. The findings suggest that the wisdom of crowds can be better harnessed by encouraging independent voices from among group members and that more public information disclosure may not always improve group decision making. When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate earnings forecast platform (Estimize.com). By tracking user activities, we monitor the amount of public information a user views before making an earnings forecast. We find that the more public information users view, the less weight they put on their own private information. Although this improves the accuracy of individual forecasts, it reduces the accuracy of the group consensus forecast because useful private information is prevented from entering the consensus. To address endogeneity concerns related to a user’s information acquisition choice, we collaborate with Estimize.com to run experiments that restrict the information available to randomly selected stocks and users. The experiments confirm that “independent” forecasts result in a more accurate consensus. Estimize.com was convinced to switch to a “blind” platform from November 2015 on. The findings suggest that the wisdom of crowds can be better harnessed by encouraging independent voices from among group members and that more public information disclosure may not always improve group decision making. This paper was accepted by Renee Adams, finance. |
Author | Huang, Xing Da, Zhi |
Author_xml | – sequence: 1 givenname: Zhi surname: Da fullname: Da, Zhi organization: Mendoza College of Business, University of Notre Dame, Notre Dame, Indiana 46556 – sequence: 2 givenname: Xing orcidid: 0000-0002-3911-5820 surname: Huang fullname: Huang, Xing organization: Olin Business School, Washington University in St. Louis, St. Louis, Missouri 63130 |
BookMark | eNqFkEtLAzEURoNUsK1u3Trgesa8H0spaoWCG8VlSPPQlE5Skyniv7dDXQni6m7O-S6cGZiknDwAlwh2CEtx06dqOwyR6ghW9ARMEcO8ZQyiCZhCiFmLFFRnYFbrBkIopOBTcLU0JflaY3prhnffvMbqct_k0CxK_nT1HJwGs63-4ufOwcv93fNi2a6eHh4Xt6vWUsKHljMpIVFEBYYc5dwG5RxfY26FdcQoqwQxWFnmuORoTYnwMhjjMeKKCszIHFwfd3clf-x9HfQm70s6vNSYQk6gkggeKHqkbMm1Fh-0jYMZYk5DMXGrEdRjCj2m0GMKPaY4aN0vbVdib8rX30J7FGIKufT1P_4baOhvtQ |
CitedBy_id | crossref_primary_10_2139_ssrn_4700311 crossref_primary_10_1080_15427560_2022_2138395 crossref_primary_10_2139_ssrn_4810600 crossref_primary_10_1007_s11053_022_10074_3 crossref_primary_10_2139_ssrn_4801695 crossref_primary_10_2139_ssrn_3656583 crossref_primary_10_2308_TAR_2023_0117 crossref_primary_10_1017_S0022109020000721 crossref_primary_10_1016_j_dss_2023_114129 crossref_primary_10_1007_s42113_024_00200_0 crossref_primary_10_2139_ssrn_3612922 crossref_primary_10_2308_TAR_2021_0055 crossref_primary_10_2139_ssrn_3195877 crossref_primary_10_1108_RBF_09_2021_0176 crossref_primary_10_2139_ssrn_5036829 crossref_primary_10_2139_ssrn_3533736 crossref_primary_10_3390_jrfm16020113 crossref_primary_10_1109_ACCESS_2024_3357114 crossref_primary_10_2139_ssrn_3444144 crossref_primary_10_1287_mnsc_2022_01102 crossref_primary_10_2139_ssrn_3640794 crossref_primary_10_1007_s11408_022_00415_w crossref_primary_10_2139_ssrn_3720758 crossref_primary_10_2139_ssrn_3837049 crossref_primary_10_1016_j_jacceco_2020_101363 crossref_primary_10_2139_ssrn_4637004 crossref_primary_10_2139_ssrn_3758359 crossref_primary_10_2139_ssrn_3514826 crossref_primary_10_1126_sciadv_abf4393 crossref_primary_10_1287_mnsc_2023_4818 crossref_primary_10_1038_s41598_024_52176_3 crossref_primary_10_1093_poq_nfab017 crossref_primary_10_1007_s11192_024_05090_4 crossref_primary_10_1016_j_techfore_2023_122543 crossref_primary_10_1057_s41291_022_00190_6 crossref_primary_10_2139_ssrn_4202792 crossref_primary_10_1108_CAFR_10_2023_0124 crossref_primary_10_2139_ssrn_3965749 crossref_primary_10_1016_j_pacfin_2024_102401 crossref_primary_10_2308_JFR_2022_021 crossref_primary_10_1002_smj_3450 crossref_primary_10_1016_j_jebo_2024_106817 crossref_primary_10_1016_j_frl_2020_101747 crossref_primary_10_1016_j_jfineco_2021_06_025 crossref_primary_10_1111_1911_3846_12852 crossref_primary_10_2139_ssrn_3777306 crossref_primary_10_1111_jpg_12771 crossref_primary_10_2139_ssrn_4528456 crossref_primary_10_2139_ssrn_4742174 crossref_primary_10_2139_ssrn_3776935 crossref_primary_10_1093_rcfs_cfab014 crossref_primary_10_2139_ssrn_4171375 crossref_primary_10_3390_info14090518 crossref_primary_10_1016_j_jbef_2021_100619 crossref_primary_10_1146_annurev_financial_110921_013217 crossref_primary_10_2139_ssrn_3136150 crossref_primary_10_2139_ssrn_3743657 crossref_primary_10_3233_JIFS_230395 crossref_primary_10_1016_j_inffus_2023_03_013 crossref_primary_10_1093_rapstu_raae016 crossref_primary_10_2139_ssrn_4629865 crossref_primary_10_1016_j_elerap_2022_101159 crossref_primary_10_2139_ssrn_3925198 crossref_primary_10_1287_mnsc_2021_4127 crossref_primary_10_1287_mnsc_2022_02575 crossref_primary_10_1126_sciadv_adp1528 crossref_primary_10_2139_ssrn_4634986 crossref_primary_10_1016_j_jedc_2023_104636 crossref_primary_10_1108_IJPSM_02_2021_0050 crossref_primary_10_1287_mnsc_2021_02928 crossref_primary_10_2139_ssrn_3858423 crossref_primary_10_1002_joom_1179 crossref_primary_10_1016_j_jfineco_2024_103870 crossref_primary_10_2139_ssrn_3882239 crossref_primary_10_2139_ssrn_4806692 crossref_primary_10_1093_rcfs_cfac017 crossref_primary_10_2139_ssrn_4642935 crossref_primary_10_1093_qje_qjaa026 crossref_primary_10_1038_s41598_023_28597_x crossref_primary_10_1002_mde_3863 crossref_primary_10_1016_j_omega_2023_103015 crossref_primary_10_1080_07421222_2020_1831762 crossref_primary_10_2139_ssrn_2826911 crossref_primary_10_2139_ssrn_4645002 crossref_primary_10_2139_ssrn_4666240 crossref_primary_10_2139_ssrn_4035960 crossref_primary_10_1017_epi_2021_13 crossref_primary_10_2139_ssrn_4172208 crossref_primary_10_4018_JGIM_325505 crossref_primary_10_2139_ssrn_4241505 crossref_primary_10_2139_ssrn_4940230 crossref_primary_10_1108_JICES_02_2020_0021 |
Cites_doi | 10.1111/1468-036X.00207 10.1162/00335530360698469 10.1016/S0165-4101(98)00016-0 10.1016/j.jfineco.2005.08.002 10.1257/mic.2.4.221 10.1093/rfs/7.1.97 10.1086/261849 10.2307/2601032 10.2307/2118364 10.1111/j.1467-937X.2009.00594.x 10.1093/rfs/hhu001 10.1016/j.jfineco.2018.08.004 10.1016/j.jfineco.2005.07.006 10.2307/2946656 10.1111/j.1540-6261.2005.00731.x 10.1287/mnsc.49.12.1636.25109 10.1016/j.jfineco.2017.03.009 10.1093/rfs/hhj007 10.2308/accr-51865 10.1257/jep.26.3.157 10.1007/s11166-007-9020-y 10.1111/0034-6527.00290 10.1093/rfs/12.4.653 10.1111/1540-6261.00526 10.1111/1475-679X.12121 10.1016/S0304-405X(00)00076-3 10.1093/qje/qju021 10.1111/0022-1082.00103 10.1111/j.1475-679X.2010.00387.x |
ContentType | Journal Article |
Copyright | Copyright Institute for Operations Research and the Management Sciences May 2020 |
Copyright_xml | – notice: Copyright Institute for Operations Research and the Management Sciences May 2020 |
DBID | AAYXX CITATION 8BJ FQK JBE |
DOI | 10.1287/mnsc.2019.3294 |
DatabaseName | CrossRef International Bibliography of the Social Sciences (IBSS) International Bibliography of the Social Sciences International Bibliography of the Social Sciences |
DatabaseTitle | CrossRef International Bibliography of the Social Sciences (IBSS) |
DatabaseTitleList | International Bibliography of the Social Sciences (IBSS) CrossRef |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Business |
EISSN | 1526-5501 |
EndPage | 1867 |
ExternalDocumentID | 10_1287_mnsc_2019_3294 mnsc20193294 |
Genre | Research Articles |
GroupedDBID | 08R 0R1 1AW 1OL 29M 2AX 3EH 3R3 3V. 4 4.4 41 5GY 6XO 7WY 7X5 85S 8AO 8FI 8FJ 8FL 8VB AABCJ AAIKC AAPBV AAYJJ ABBHK ABEFU ABIVO ABNOP ABPPZ ABSIS ABTRL ABUFD ABUWG ABZEH ACDCL ACHQT ACNCT ACTDY ACVYA ACYGS ADBBV ADDCT ADGDI ADNFJ AEILP AENEX AETEA AEUPB AFDAS AFFDN AFFNX AFKRA AJPNJ AKVCP ALMA_UNASSIGNED_HOLDINGS AQNXB AQSKT AQUVI AZQEC B-7 BBAFP BENPR BEZIV BPHCQ BVXVI CBXGM CCKSF CS3 CWXUR CYVLN DU5 DWQXO EBA EBE EBO EBR EBS EBU ECR EHE EJD EMK EPL F20 F5P FH7 FRNLG FYUFA G8K GENNL GNUQQ GROUPED_ABI_INFORM_ARCHIVE GROUPED_ABI_INFORM_COMPLETE GROUPED_ABI_INFORM_RESEARCH GUPYA HGD HVGLF H~9 IAO IEA IGG IOF IPO ISM ITC JAV JBC JPL JSODD JST K6 K60 L8O LI M0C M0T M2M MV1 N95 NEJ NIEAY P-O P2P PQEST PQQKQ PQUKI PRINS PROAC QWB REX RNS RPU SA0 SJN TH9 TN5 U5U UKR VOH VQA WH7 X XFK XHC XI7 XXP XZL Y99 YCJ YNT YZZ ZCG ZL0 -~X .-4 18M 41~ AAAZS AAMNW AAWTO AAXLS AAYOK AAYXX ABAWQ ABDNZ ABDPE ABKVW ABLWH ABXSQ ABYYQ ACGFO ACHJO ACXJH ADEPB ADMHG ADNWM ADULT AEGXH AEMOZ AFAIT AFTQD AGKTX AHAJD AHQJS AIAGR ALIPV APTMU ASMEE BAAKF CCPQU CITATION IPC IPSME IPY ISL JAAYA JBMMH JBZCM JENOY JHFFW JKQEH JLEZI JLXEF JPPEU K1G K6~ LPU OFU PHGZM PHGZT PQBIZ PQBZA PSYQQ UKHRP XSW YYP 8BJ FQK JBE |
ID | FETCH-LOGICAL-c436t-658803939f51d466cf9dd6b26c7cd3a9c973a29c5d6861b437e8faae216947253 |
ISSN | 0025-1909 |
IngestDate | Sat Aug 16 11:41:18 EDT 2025 Tue Jul 01 02:55:08 EDT 2025 Thu Apr 24 23:12:53 EDT 2025 Wed Jan 06 02:47:50 EST 2021 |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 5 |
Language | English |
LinkModel | OpenURL |
MergedId | FETCHMERGED-LOGICAL-c436t-658803939f51d466cf9dd6b26c7cd3a9c973a29c5d6861b437e8faae216947253 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
ORCID | 0000-0002-3911-5820 |
PQID | 2406309810 |
PQPubID | 40737 |
PageCount | 21 |
ParticipantIDs | proquest_journals_2406309810 crossref_citationtrail_10_1287_mnsc_2019_3294 crossref_primary_10_1287_mnsc_2019_3294 informs_primary_10_1287_mnsc_2019_3294 |
ProviderPackageCode | Y99 RPU NIEAY CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 2020-05-01 |
PublicationDateYYYYMMDD | 2020-05-01 |
PublicationDate_xml | – month: 05 year: 2020 text: 2020-05-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | Linthicum |
PublicationPlace_xml | – name: Linthicum |
PublicationTitle | Management science |
PublicationYear | 2020 |
Publisher | INFORMS Institute for Operations Research and the Management Sciences |
Publisher_xml | – name: INFORMS – name: Institute for Operations Research and the Management Sciences |
References | B20 B21 B22 B23 B24 B25 B26 B27 B28 B29 B30 B31 B32 B11 B33 B12 B34 B13 B35 B14 B36 B15 B37 B16 B38 B17 B39 B18 B19 B1 B2 B3 B4 B5 B6 B7 B8 B9 Anderson LR (B4) 1997; 87 Surowiecki J (B39) 2005 Scharfstein DS (B34) 1990; 80 Cote JM (B17) 1997; 9 Sunstein CR (B36) 2005; 80 |
References_xml | – ident: B12 – ident: B9 – ident: B35 – ident: B14 – ident: B3 – ident: B20 – ident: B1 – ident: B27 – ident: B7 – ident: B5 – ident: B29 – ident: B25 – ident: B23 – ident: B21 – ident: B18 – ident: B16 – ident: B31 – ident: B33 – ident: B37 – ident: B39 – ident: B8 – ident: B36 – ident: B11 – ident: B13 – ident: B2 – ident: B26 – ident: B4 – ident: B28 – ident: B6 – ident: B24 – ident: B22 – ident: B17 – ident: B32 – ident: B15 – ident: B30 – ident: B34 – ident: B19 – ident: B38 – ident: B25 doi: 10.1111/1468-036X.00207 – ident: B18 doi: 10.1162/00335530360698469 – ident: B30 doi: 10.1016/S0165-4101(98)00016-0 – ident: B32 doi: 10.1016/j.jfineco.2005.08.002 – ident: B20 doi: 10.1257/mic.2.4.221 – ident: B37 doi: 10.1093/rfs/7.1.97 – ident: B9 doi: 10.1086/261849 – ident: B27 doi: 10.2307/2601032 – ident: B5 doi: 10.2307/2118364 – ident: B1 doi: 10.1111/j.1467-937X.2009.00594.x – ident: B13 doi: 10.1093/rfs/hhu001 – ident: B23 doi: 10.1016/j.jfineco.2018.08.004 – volume: 80 start-page: 465 issue: 3 year: 1990 ident: B34 publication-title: Amer. Econom. Rev. – ident: B8 doi: 10.1016/j.jfineco.2005.07.006 – ident: B19 doi: 10.2307/2946656 – ident: B16 doi: 10.1111/j.1540-6261.2005.00731.x – ident: B6 doi: 10.1287/mnsc.49.12.1636.25109 – ident: B3 doi: 10.1016/j.jfineco.2017.03.009 – ident: B14 doi: 10.1093/rfs/hhj007 – ident: B7 doi: 10.2308/accr-51865 – ident: B11 doi: 10.1257/jep.26.3.157 – ident: B12 doi: 10.1007/s11166-007-9020-y – volume: 80 start-page: 962 year: 2005 ident: B36 publication-title: New York University aw Rev. – ident: B29 doi: 10.1111/0034-6527.00290 – ident: B31 doi: 10.1093/rfs/12.4.653 – year: 2005 ident: B39 publication-title: The Wisdom of Crowds – volume: 87 start-page: 847 issue: 5 year: 1997 ident: B4 publication-title: Amer. Econom. Rev. – ident: B26 doi: 10.1111/1540-6261.00526 – ident: B28 doi: 10.1111/1475-679X.12121 – ident: B38 doi: 10.1016/S0304-405X(00)00076-3 – volume: 9 start-page: 20 year: 1997 ident: B17 publication-title: Behav. Res. Accounting – ident: B21 doi: 10.1093/qje/qju021 – ident: B24 doi: 10.1111/0022-1082.00103 – ident: B15 doi: 10.1111/j.1475-679X.2010.00387.x |
SSID | ssj0007876 |
Score | 2.5460927 |
Snippet | When will a large group provide an accurate answer to a question involving quantity estimation? We empirically examine this question on a crowd-based corporate... |
SourceID | proquest crossref informs |
SourceType | Aggregation Database Enrichment Source Index Database Publisher |
StartPage | 1847 |
SubjectTerms | Crowds Decision making Earnings earnings forecast Estimating techniques Group decision making herding Information processing naïve learning social learning Social networks Tracking Wisdom wisdom of crowds |
Title | Harnessing the Wisdom of Crowds |
URI | https://www.proquest.com/docview/2406309810 |
Volume | 66 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3LT8MgGCc6o_FifMa3PRg9GLRAoeWoRrN4MMZo3K1pgcYluhk3L_71fhTabjrj40IaArTwg-9BvwdC-4ZoqRVoJzKMchxxk-NESI0TmTHDQmljpllri2vRvo-uOrzTJMErvUuG-bF6n-hX8h9UoQ5wtV6yf0C2HhQq4BnwhRIQhvJXGLezV0upKo-nh-5A959LAwtQrp0HbyV4NmYuR57pNXfU5Q-Kx26DsL9D7lRszd8K0LCxwaut9DkGZu_IkfHEjQoMGgkZpX4u54lHmY-QMlD94hG2aAPfTSS51F5aXD73BjYgJJHHjLqsxeOxrT_xnNoS0OogMEJq-6e2f2r7T6MZCmI_baGZs4vrm9uatwJ5EVUSXjs7H4YTRjgZ_4IxMWPWBaEdfOG3pRBxt4gWvPQfnDool9CU6S2jucr5YAXtNYgGgGjgEA36ReAQXUX3lxd3523sU1hgFTExxCDfJdb7WRac6EgIVUitRU6FipVmmVQyZhmVimuRCJJHLDZJkWWGEiGjmHK2hlq9fs-soyAxpIhJFpYabqh5ohRlRVwUEc-p0eEGwtWMU-Xju9s0I0_p5DXeQId1-xcX2eTblgd-AX9suF2tb-qPySC1IiMc-oSEm79-4xaabzb1NmoNX9_MDgh_w3zX74gPAgxToA |
linkProvider | ProQuest |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Harnessing+the+Wisdom+of+Crowds&rft.jtitle=Management+science&rft.au=Da%2C+Zhi&rft.au=Huang%2C+Xing&rft.date=2020-05-01&rft.issn=0025-1909&rft.eissn=1526-5501&rft.volume=66&rft.issue=5&rft.spage=1847&rft.epage=1867&rft_id=info:doi/10.1287%2Fmnsc.2019.3294&rft.externalDBID=n%2Fa&rft.externalDocID=10_1287_mnsc_2019_3294 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0025-1909&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0025-1909&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0025-1909&client=summon |