Criticism as asynchronous collaboration: An example from social science research

I discuss a published paper in political science that made a claim that aroused skepticism. The reanalysis is an example of how we, as consumers as well as producers of science, can engage with published work. This can be viewed as a sort of collaboration performed implicitly between the authors of...

Full description

Saved in:
Bibliographic Details
Published inStat (International Statistical Institute) Vol. 11; no. 1
Main Author Gelman, Andrew
Format Journal Article
LanguageEnglish
Published The Hague Wiley Subscription Services, Inc 01.12.2022
Subjects
Online AccessGet full text
ISSN2049-1573
2049-1573
DOI10.1002/sta4.464

Cover

Loading…
Abstract I discuss a published paper in political science that made a claim that aroused skepticism. The reanalysis is an example of how we, as consumers as well as producers of science, can engage with published work. This can be viewed as a sort of collaboration performed implicitly between the authors of a published paper and later researchers who want to understand or use the published work.
AbstractList I discuss a published paper in political science that made a claim that aroused skepticism. The reanalysis is an example of how we, as consumers as well as producers of science, can engage with published work. This can be viewed as a sort of collaboration performed implicitly between the authors of a published paper and later researchers who want to understand or use the published work.
Author Gelman, Andrew
Author_xml – sequence: 1
  givenname: Andrew
  orcidid: 0000-0002-6975-2601
  surname: Gelman
  fullname: Gelman, Andrew
  email: gelman@stat.columbia.edu
  organization: Columbia University
BookMark eNp1kE9LAzEQxYMoWGvBjxDw4mXrJJtsN95K8R8UFKznkJ1maco2qckW7bd313oQURiYOfzezJt3Ro598JaQCwZjBsCvU2vEWBTiiAw4CJUxOcmPf8ynZJTSGgCY5Cov8gF5nkXXOnRpQ03qau9xFYMPu0QxNI2pQjStC_6GTj21H2azbSytY9jQFNCZhiZ01qOl0SZrIq7OyUltmmRH331IXu9uF7OHbP50_zibzjPkPBeZhOWyAAsCFeNYMVHLCrCQhlnkktWmzFkFqncJtuBKKlMqUTKUNUwEq_MhuTzs3cbwtrOp1euwi747qXmpIC8nQsmOGh8ojCGlaGuNrv16qI3GNZqB7oPTfXC6C64TXP0SbKPbmLj_C80O6Ltr7P5fTr8spqLnPwEU5X2W
CitedBy_id crossref_primary_10_1080_02691728_2023_2177128
crossref_primary_10_1177_20531680231166457
Cites_doi 10.1016/j.jebo.2019.09.003
10.1511/2014.111.460
10.1016/j.jcorpfin.2021.101991
10.1177/2053168015569830
10.1177/1745691612459058
10.1177/0146167217729162
10.1511/2009.79.310
10.1017/psrm.2019.63
10.1038/nrn3475
10.1016/j.jtbi.2006.07.017
10.1037/a0021524
10.1177/0956797611417632
ContentType Journal Article
Copyright 2022 John Wiley & Sons, Ltd.
Copyright_xml – notice: 2022 John Wiley & Sons, Ltd.
DBID AAYXX
CITATION
7SC
8FD
JQ2
L7M
L~C
L~D
DOI 10.1002/sta4.464
DatabaseName CrossRef
Computer and Information Systems Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Computer and Information Systems Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Advanced Technologies Database with Aerospace
ProQuest Computer Science Collection
Computer and Information Systems Abstracts Professional
DatabaseTitleList Computer and Information Systems Abstracts

CrossRef
DeliveryMethod fulltext_linktorsrc
EISSN 2049-1573
EndPage n/a
ExternalDocumentID 10_1002_sta4_464
STA4464
Genre article
GroupedDBID 05W
0R~
1OC
31~
33P
50Y
8-1
AAESR
AAHHS
AAHQN
AAIHA
AAMNL
AANHP
AANLZ
AAYCA
AAZKR
ABCUV
ABDBF
ABJNI
ACCFJ
ACCZN
ACGFS
ACPOU
ACRPL
ACUHS
ACXQS
ACYXJ
ADBBV
ADKYN
ADNMO
ADXAS
ADZMN
AEEZP
AEIGN
AEQDE
AEUYR
AFBPY
AFFPM
AFWVQ
AFZJQ
AHBTC
AITYG
AIURR
AIWBW
AJBDE
ALMA_UNASSIGNED_HOLDINGS
ALUQN
ALVPJ
AMYDB
ASPBG
AZVAB
BDRZF
BFHJK
BMXJE
BRXPI
D-B
DCZOG
EBS
EJD
G-S
GODZA
HGLYW
HZ~
LATKE
LEEKS
LITHE
LOXES
LUTES
LYRES
MEWTI
MY.
MY~
O9-
OK1
P2W
ROL
SUPJJ
WBKPD
WOHZO
WXSBR
WYJ
ZZTAW
AAYXX
AEYWJ
AGHNM
AGQPQ
AGYGG
AMVHM
CITATION
7SC
8FD
AAMMB
AEFGJ
AGXDD
AIDQK
AIDYY
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c2234-50dd60e04c912cb14f5b0c65a1ec251fa831b0929360e62959a89481c5f0741f3
ISSN 2049-1573
IngestDate Fri Jul 25 12:10:40 EDT 2025
Tue Jul 01 03:07:36 EDT 2025
Thu Apr 24 23:09:42 EDT 2025
Wed Jan 22 16:19:58 EST 2025
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c2234-50dd60e04c912cb14f5b0c65a1ec251fa831b0929360e62959a89481c5f0741f3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-6975-2601
PQID 2890387495
PQPubID 2034131
PageCount 12
ParticipantIDs proquest_journals_2890387495
crossref_citationtrail_10_1002_sta4_464
crossref_primary_10_1002_sta4_464
wiley_primary_10_1002_sta4_464_STA4464
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate December 2022
2022-12-00
20221201
PublicationDateYYYYMMDD 2022-12-01
PublicationDate_xml – month: 12
  year: 2022
  text: December 2022
PublicationDecade 2020
PublicationPlace The Hague
PublicationPlace_xml – name: The Hague
PublicationTitle Stat (International Statistical Institute)
PublicationYear 2022
Publisher Wiley Subscription Services, Inc
Publisher_xml – name: Wiley Subscription Services, Inc
References 2021; 9
2015; 2
2021; 69
2007; 244
2013; 14
2009; 97
2017; 37
2011
2020
2019
2011; 22
2017
2016
2018; 44
2012; 7
2011; 100
2019; 167
2014; 102
e_1_2_7_6_1
e_1_2_7_5_1
e_1_2_7_4_1
e_1_2_7_3_1
e_1_2_7_9_1
e_1_2_7_8_1
e_1_2_7_7_1
e_1_2_7_19_1
Kahneman D. (e_1_2_7_14_1) 2011
e_1_2_7_18_1
Gelman A. (e_1_2_7_10_1) 2017; 37
e_1_2_7_17_1
e_1_2_7_16_1
e_1_2_7_2_1
e_1_2_7_15_1
e_1_2_7_13_1
e_1_2_7_12_1
e_1_2_7_11_1
Simonsohn U. (e_1_2_7_20_1) 2016
References_xml – year: 2011
– volume: 69
  start-page: 101991
  year: 2021
  article-title: Does unionization affect the manager‐shareholder conflict? Evidence from firm‐specific stock price crash risk
  publication-title: Journal of Corporate Finance
– volume: 14
  start-page: 365
  year: 2013
  end-page: 376
  article-title: Power failure: why small sample size undermines the reliability of neuroscience
  publication-title: Nature Reviews Neuroscience
– volume: 244
  start-page: 133
  year: 2007
  end-page: 140
  article-title: Beautiful parents have more daughters: A further implication of the generalized Trivers‐Willard hypothesis
  publication-title: Journal of Theoretical Biology
– volume: 7
  start-page: 615
  year: 2012
  end-page: 631
  article-title: Scientific utopia II. Restructuring incentives and practices to promote truth over publishability
  publication-title: Perspectives on Psychological Science
– volume: 2
  start-page: 1
  year: 2015
  end-page: 7
  article-title: Evidence on the deleterious impact of sustained use of polynomial regression on causal inference
  publication-title: Research and Politics
– year: 2020
– volume: 102
  start-page: 460
  year: 2014
  end-page: 465
  article-title: The statistical crisis in science
  publication-title: American Scientist
– volume: 22
  start-page: 1359
  year: 2011
  end-page: 1366
  article-title: False‐positive psychology: Undisclosed flexibility in data collection and analysis allow presenting anything as significant
  publication-title: Psychological Science
– volume: 9
  start-page: 658
  year: 2021
  end-page: 664
  article-title: Longevity returns to political office
  publication-title: Political Science Research and Methods
– volume: 97
  start-page: 310
  year: 2009
  end-page: 316
  article-title: Of beauty, sex, and power: Statistical challenges in estimating small effects
  publication-title: American Scientist
– year: 2016
  publication-title: P‐hacked Hypotheses Are Deceivingly Robust
– year: 2017
– volume: 167
  start-page: 18
  year: 2019
  end-page: 32
  article-title: Run for your life? The effect of close elections on the life expectancy of politicians
  publication-title: Journal of Economic Behavior & Organization
– volume: 44
  start-page: 16
  year: 2018
  end-page: 23
  article-title: The failure of null hypothesis significance testing when studying incremental changes, and what to do about it
  publication-title: Personality and Social Psychology Bulletin
– volume: 100
  start-page: 407
  year: 2011
  end-page: 425
  article-title: Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect
  publication-title: Journal of Personality and Social Psychology
– year: 2019
– volume: 37
  start-page: 225
  year: 2017
  end-page: 456
  article-title: Why high‐order polynomials should not be used in regression discontinuity designs
  publication-title: Journal of Business and Economic Statistics
– ident: e_1_2_7_8_1
– ident: e_1_2_7_4_1
  doi: 10.1016/j.jebo.2019.09.003
– ident: e_1_2_7_11_1
  doi: 10.1511/2014.111.460
– ident: e_1_2_7_16_1
  doi: 10.1016/j.jcorpfin.2021.101991
– volume: 37
  start-page: 225
  year: 2017
  ident: e_1_2_7_10_1
  article-title: Why high‐order polynomials should not be used in regression discontinuity designs
  publication-title: Journal of Business and Economic Statistics
– ident: e_1_2_7_13_1
  doi: 10.1177/2053168015569830
– ident: e_1_2_7_18_1
  doi: 10.1177/1745691612459058
– ident: e_1_2_7_7_1
  doi: 10.1177/0146167217729162
– ident: e_1_2_7_6_1
– ident: e_1_2_7_12_1
  doi: 10.1511/2009.79.310
– ident: e_1_2_7_17_1
– ident: e_1_2_7_2_1
  doi: 10.1017/psrm.2019.63
– ident: e_1_2_7_5_1
  doi: 10.1038/nrn3475
– ident: e_1_2_7_9_1
– ident: e_1_2_7_15_1
  doi: 10.1016/j.jtbi.2006.07.017
– year: 2016
  ident: e_1_2_7_20_1
  publication-title: P‐hacked Hypotheses Are Deceivingly Robust
– ident: e_1_2_7_3_1
  doi: 10.1037/a0021524
– ident: e_1_2_7_19_1
  doi: 10.1177/0956797611417632
– volume-title: Thinking Fast and Slow
  year: 2011
  ident: e_1_2_7_14_1
SSID ssj0001529363
Score 2.2344506
Snippet I discuss a published paper in political science that made a claim that aroused skepticism. The reanalysis is an example of how we, as consumers as well as...
SourceID proquest
crossref
wiley
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
SubjectTerms causal inference
Collaboration
Cooperation
regression
social sciences
subject areas
Title Criticism as asynchronous collaboration: An example from social science research
URI https://onlinelibrary.wiley.com/doi/abs/10.1002%2Fsta4.464
https://www.proquest.com/docview/2890387495
Volume 11
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1dS8MwFA26vfgiiorTKRFEnzqzNOla3zp1DkER3GBvpc1SfBhV3AT113vz0a5lG0xhlBHSst6Tj3Pvcs9F6JxwKaQfq6IZouOwlAsnkV4K8wr2grQz9mmg8p0fn7z-kD2M-Ghe5k5nl8ySlvhZmlfyH1ShDXBVWbJ_QLZ4KDTAd8AXroAwXNfC2NQp0GUupvD5zoSSulWHWivw2uCf_IqVFLDJKLGx8jyrx2r-vJa5quKhmoBWgoaqVYs7a5EOe9KgFE-4lxMbVC2dlbRhBUpLRzT06kPBdXDa3NQZacklbfny2V4YJmYjLbaZhVXaqL4C-2UtZjTMq0LYRR--qpfegF8GITizbBPVKfgItIbqYfe225uH2DhwGV1Lr_jhufwwoVf5g6uEZO5llH0VTTYGO2jbegk4NJDvog2Z7aHnAm4cT3EZblyB-xqHGbZgYwU2NmBjCzbOwd5Hw97d4Kbv2IIYjgAWxxxOxmOPSMJEAFMrgcnEEyI8HrelAJ6axr7bTkig3ppIjwY8iH2lxiN4qphj6h6gWvaWyUOEhQCbEZdJ5gUMWFzgs9R1UybHiRvAot9Al7lVImHV4lXRkklkdK5ppOwXgf0a6Kzo-W4UUpb0aeaGjez8mUbqL27X74CH3kAX2tgr748s1EfrdjxGW_NB3US12cenPAH2OEtO7Sj5BZrqbog
linkProvider EBSCOhost
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Criticism+as+asynchronous+collaboration%3A+An+example+from+social+science+research&rft.jtitle=Stat+%28International+Statistical+Institute%29&rft.au=Gelman%2C+Andrew&rft.date=2022-12-01&rft.issn=2049-1573&rft.eissn=2049-1573&rft.volume=11&rft.issue=1&rft.epage=n%2Fa&rft_id=info:doi/10.1002%2Fsta4.464&rft.externalDBID=10.1002%252Fsta4.464&rft.externalDocID=STA4464
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2049-1573&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2049-1573&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2049-1573&client=summon