Navigating the review process through the holier than thou

[...]suppressed hypothesis tests might bias the population of observed effects meta-analysts include in a review. [...]suppressed hypotheses might increase the possibility that others repeat the same flawed test in the future (i.e., ignorance of history). [...]there might be cases where an explanati...

Full description

Saved in:
Bibliographic Details
Published inIndustrial and organizational psychology Vol. 13; no. 1; pp. 72 - 75
Main Author Vancouver, Jeffrey B.
Format Journal Article
LanguageEnglish
Published Bowling Green Cambridge University Press 01.03.2020
Subjects
Online AccessGet full text

Cover

Loading…
Abstract [...]suppressed hypothesis tests might bias the population of observed effects meta-analysts include in a review. [...]suppressed hypotheses might increase the possibility that others repeat the same flawed test in the future (i.e., ignorance of history). [...]there might be cases where an explanation for findings not predicted by the authors seems clear to the reviewer, but apparently unfamiliar to the authors who are perhaps less familiar with the literature. Does it serve the science to make sure the author’s misunderstandings are made public? [...]if the hypothesis is retrieved from the existing literature, does exposing the ignorance of the author serve science? I do not see how.
AbstractList [...]suppressed hypothesis tests might bias the population of observed effects meta-analysts include in a review. [...]suppressed hypotheses might increase the possibility that others repeat the same flawed test in the future (i.e., ignorance of history). [...]there might be cases where an explanation for findings not predicted by the authors seems clear to the reviewer, but apparently unfamiliar to the authors who are perhaps less familiar with the literature. Does it serve the science to make sure the author’s misunderstandings are made public? [...]if the hypothesis is retrieved from the existing literature, does exposing the ignorance of the author serve science? I do not see how.
Author Vancouver, Jeffrey B.
Author_xml – sequence: 1
  givenname: Jeffrey B.
  surname: Vancouver
  fullname: Vancouver, Jeffrey B.
BookMark eNo9kE9LxDAQxYOs4O7qxU9Q8Ca0Tv40Sb3J4qqw6EXPIY1pm2VtatKu-O3NuuJl5jHzeDP8FmjW-94idImhwIDFjfNDQYBAIU_QHIuS5RWjbPavCT9Dixi3AJwSYHN0-6z3rtWj69ts7GwW7N7Zr2wI3tgY0yj4qe1-V53fORuS1H0qfjpHp43eRXvx15fobX3_unrMNy8PT6u7TW4IlmNu6rrRpaS8qTWWvBLEwHttAShlkhNJpJacl4xiS5gQIKikFW5kZUxZE13SJbo65qanPicbR7X1U-jTSUVoxVO0ECK5ro8uE3yMwTZqCO5Dh2-FQR3YqMRGHdgoSX8ACAxXXQ
Cites_doi 10.1037/gpr0000128
10.1126/science.1103024
10.1017/CBO9780511807862.002
10.1017/iop.2019.121
10.1207/s15327957pspr0203_4
ContentType Journal Article
Copyright Society for Industrial and Organizational Psychology, Inc. 2020
Copyright_xml – notice: Society for Industrial and Organizational Psychology, Inc. 2020
DBID AAYXX
CITATION
3V.
7WY
7WZ
7XB
87Z
88G
8FI
8FJ
8FK
8FL
ABUWG
AFKRA
AZQEC
BENPR
BEZIV
CCPQU
DWQXO
FRNLG
FYUFA
F~G
GHDGH
GNUQQ
K60
K6~
L.-
M0C
M2M
PQBIZ
PQBZA
PQEST
PQQKQ
PQUKI
PSYQQ
Q9U
DOI 10.1017/iop.2020.8
DatabaseName CrossRef
ProQuest Central (Corporate)
ABI/INFORM Collection
ABI/INFORM Global (PDF only)
ProQuest Central (purchase pre-March 2016)
ABI/INFORM Global (Alumni Edition)
Psychology Database (Alumni)
Hospital Premium Collection
Hospital Premium Collection (Alumni Edition)
ProQuest Central (Alumni) (purchase pre-March 2016)
ABI/INFORM Collection (Alumni Edition)
ProQuest Central (Alumni)
ProQuest Central
ProQuest Central Essentials
ProQuest Central
ProQuest Business Premium Collection
ProQuest One Community College
ProQuest Central Korea
Business Premium Collection (Alumni)
Health Research Premium Collection
ABI/INFORM Global (Corporate)
Health Research Premium Collection (Alumni)
ProQuest Central Student
ProQuest Business Collection (Alumni Edition)
ProQuest Business Collection
ABI/INFORM Professional Advanced
ABI/INFORM Global
Psychology Database
ProQuest One Business
ProQuest One Business (Alumni)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest One Psychology
ProQuest Central Basic
DatabaseTitle CrossRef
ABI/INFORM Global (Corporate)
ProQuest Business Collection (Alumni Edition)
ProQuest One Business
ProQuest One Psychology
ProQuest Central Student
ProQuest Central Essentials
ProQuest Central (Alumni Edition)
ProQuest One Community College
ABI/INFORM Complete
ProQuest Central
ABI/INFORM Professional Advanced
Health Research Premium Collection
ProQuest Central Korea
ABI/INFORM Complete (Alumni Edition)
Business Premium Collection
ABI/INFORM Global
ABI/INFORM Global (Alumni Edition)
ProQuest Central Basic
ProQuest One Academic Eastern Edition
ProQuest Hospital Collection
Health Research Premium Collection (Alumni)
ProQuest Psychology Journals (Alumni)
ProQuest Business Collection
ProQuest Hospital Collection (Alumni)
ProQuest Psychology Journals
ProQuest One Academic UKI Edition
ProQuest One Business (Alumni)
ProQuest One Academic
ProQuest Central (Alumni)
Business Premium Collection (Alumni)
DatabaseTitleList ABI/INFORM Global (Corporate)
Database_xml – sequence: 1
  dbid: BENPR
  name: ProQuest Central
  url: https://www.proquest.com/central
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Business
EISSN 1754-9434
EndPage 75
ExternalDocumentID 10_1017_iop_2020_8
Genre Commentary
GroupedDBID .3N
.Y3
05W
09C
09D
09E
0R~
10A
1OC
29I
31~
3V.
4.4
50Z
52S
5GY
7WY
8-0
8-1
8FI
8FJ
8FL
8VB
930
A04
AAAZR
AABES
AABWE
AACJH
AAGFV
AAHHS
AAKTX
AALKF
AAONW
AAPYI
AARAB
AASVR
AAUKB
AAYXX
ABBXD
ABJNI
ABQTM
ABROB
ABTND
ABUWG
ABVZP
ABYPY
ABYSC
ABZCX
ACABY
ACBMC
ACBWZ
ACCFJ
ACDLN
ACFCP
ACGFS
ACRPL
ACUIJ
ACXQS
ACYXJ
ACYZP
ACZBM
ACZBN
ACZUX
ADBBV
ADDNB
ADFEC
ADKIL
ADOVH
ADTCA
ADVJH
ADZOD
AEBAK
AEEZP
AEHGV
AENGE
AEQDE
AEYYC
AFBPY
AFFNX
AFFUJ
AFKQG
AFKRA
AFKRZ
AFLOS
AFLVW
AFZJQ
AGABE
AGHGI
AGJUD
AHQXX
AHRGI
AIGNW
AIHIV
AIOIP
AISIE
AIWBW
AJAOE
AJBDE
AJCYY
AJPFC
AJQAS
AKVCP
ALIPV
ALMA_UNASSIGNED_HOLDINGS
AMPWD
ANFVQ
AOWSX
AQJOH
ASPBG
ATUCA
AUXHV
AVDNQ
AVWKF
AZBYB
AZFZN
AZQEC
BAFTC
BBLKV
BDRZF
BENPR
BEZIV
BLZWO
BMAJL
BPHCQ
BVXVI
CAG
CBIIA
CCPQU
CCQAD
CFAFE
CGMFO
CHEAL
CITATION
CJCSC
COF
CS3
DCZOG
DOHLZ
DWQXO
EBS
EJD
FEDTE
FRNLG
FYUFA
G-S
G50
GNUQQ
GODZA
GROUPED_ABI_INFORM_COMPLETE
HOVLH
HVGLF
HZ~
IH6
IOEEP
IS6
JHPGK
JOSPZ
JPPIE
JQKCU
JRMXA
K1G
K60
K6~
KCGVB
KFECR
LH4
LW6
LW7
M0C
M2M
MY~
N04
N06
NF~
NIKVX
OIG
PQBIZ
PQBZA
PQQKQ
PROAC
PSYQQ
Q.N
QB0
QWB
R.K
RCA
ROL
S6U
SAAAG
SUPJJ
T9M
UKHRP
UT1
WFFJZ
XG1
ZL0
ZYDXJ
~WP
7XB
8FK
L.-
PQEST
PQUKI
Q9U
ID FETCH-LOGICAL-c218t-cbbfa5836fba186972c0dbe00334862828a8665431e24770738391f89cc5b2a53
IEDL.DBID BENPR
ISSN 1754-9426
IngestDate Sun Dec 01 10:30:57 EST 2024
Fri Dec 06 05:34:01 EST 2024
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
License https://www.cambridge.org/core/terms
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c218t-cbbfa5836fba186972c0dbe00334862828a8665431e24770738391f89cc5b2a53
PQID 2396583777
PQPubID 996338
PageCount 4
ParticipantIDs proquest_journals_2396583777
crossref_primary_10_1017_iop_2020_8
PublicationCentury 2000
PublicationDate 2020-03-00
20200301
PublicationDateYYYYMMDD 2020-03-01
PublicationDate_xml – month: 03
  year: 2020
  text: 2020-03-00
PublicationDecade 2020
PublicationPlace Bowling Green
PublicationPlace_xml – name: Bowling Green
PublicationTitle Industrial and organizational psychology
PublicationYear 2020
Publisher Cambridge University Press
Publisher_xml – name: Cambridge University Press
References S1754942620000085_ref4
S1754942620000085_ref5
S1754942620000085_ref2
Köhler (S1754942620000085_ref3) 2020; 13
S1754942620000085_ref1
Shadish (S1754942620000085_ref6) 2002
References_xml – ident: S1754942620000085_ref5
  doi: 10.1037/gpr0000128
– volume-title: Experimental and quasi-experimentation designs for generalized causal inference
  year: 2002
  ident: S1754942620000085_ref6
  contributor:
    fullname: Shadish
– ident: S1754942620000085_ref4
  doi: 10.1126/science.1103024
– ident: S1754942620000085_ref1
  doi: 10.1017/CBO9780511807862.002
– volume: 13
  year: 2020
  ident: S1754942620000085_ref3
  article-title: Supporting robust, rigorous, and reliable reviewing as the cornerstone of our profession: Introducing a competency framework for peer review
  publication-title: Industrial and Organizational Psychology: Perspectives on Science and Practice
  doi: 10.1017/iop.2019.121
  contributor:
    fullname: Köhler
– ident: S1754942620000085_ref2
  doi: 10.1207/s15327957pspr0203_4
SSID ssj0063204
Score 2.20756
Snippet [...]suppressed hypothesis tests might bias the population of observed effects meta-analysts include in a review. [...]suppressed hypotheses might increase the...
SourceID proquest
crossref
SourceType Aggregation Database
StartPage 72
SubjectTerms Hypotheses
Researchers
Theory
Title Navigating the review process through the holier than thou
URI https://www.proquest.com/docview/2396583777
Volume 13
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3PS8MwFH7oBuJF_InTKQG9xrVpmzReRGVjeBgiDnYLSZqKl3a6zb_flzZFdvHSHgKFvjTv-_L68n0AtzJHEiCsoDorBE2NlVRaF1Fj0qiIncR70-U749N5-rLIFqHgtgptlV1ObBJ1UVtfIx-xxMuUJEKIh-UX9a5R_u9qsNDYhT6LkzzvQf9pPHt963IxT1hjIIgYmVKJYNQJlMZi9Fl7uUoW3eXbkLSdkRuYmRzCQeCH5LGd0CPYcdUx7HXt6SdwP9M_jSpG9UGQu5H26AlZtv3-JNjuNEOY1xDziK-N46XenMJ8Mn5_ntLgf0AtAu-aWmNKje_MS6O9c5RgNiqM8_ZrKW5EcK-kvVodUgDHUiFwsSLbictcWpsZprPkDHpVXblzIMhyClyavHQR8h8mpOXcFEyb2PFIOD2Amy4EatnKXKi2_0soDJTygVL5AIZddFT41Ffqb2Iu_h--hH3_mLaBawi99ffGXSGir811mLZfuk6fcg
link.rule.ids 314,780,784,21388,27924,27925,33744,43805,74302
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3PS8MwFH7oBupF_InTqQW9xrXpj7ReRGVj6iwiG-wWkjQVL211m3-_L22K7OKlPQQKfWne9-X15fsArpMYSQBTjIgwYySQKiGJ0i6RMnAzTyd4r7t802g8C57n4dwW3Ba2rbLNiXWizkplauQD6huZEp8xdld9EeMaZf6uWguNTega5fSwA92HYfr23ubiyKe1gSBiZEASBKNWoNRjg8_SyFVS9yZeh6T1jFzDzGgPdi0_dO6bCd2HDV0cwFbbnn4It6n4qVUxig8HuZvTHD1xqqbf37G2O_UQ5jXEPMfUxvFSro5gNhpOH8fE-h8QhcC7JErKXOA7R7kUxjmKUeVmUhv7tQA3IrhXEkatDimApgFjuFiR7Xh5nCgVSipC_xg6RVnoE3CQ5WS4NKNcu8h_KEtUFMmMCunpyGVa9OCqDQGvGpkL3vR_MY6B4iZQPO5Bv40Ot5_6gv9NzOn_w5ewPZ6-TvjkKX05gx3zyKaZqw-d5fdKnyO6L-WFncJfUECiWg
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1dS8MwFL3oBsMX8ROnUwv6GtembdL6In5szA_KEAd7C0maii_tdJu_35s2RXzxpX0IFHpvc89JenIPwGWaIAngmhMZ55xESqck1cYnSkV-HpgU77XKN2OTWfQ0j-dO_7R0ssq2JtaFOq-03SMf0tC2KQk558PCySKmD-ObxSexDlL2T6uz09iELqKiTzvQvRtl09e2LrOQ1maCiJcRSRGY2malAR9-VLZ1JfWvkr_w9Lc615Az3oFtxxW92ya5u7Bhyj3otVL1fbjO5HfdIaN895DHec0xFG_RaP89Z8FTD2GNQ_zz7D45Xqr1AczGo7f7CXFeCEQjCK-IVqqQ-P6sUNK6SHGq_VwZa8UW4aIE103Sdq5DOmBoxDlOXGQ-QZGkWseKyjg8hE5ZleYIPGQ8OU5TVhgfuRDlqWZM5VSqwDCfG9mHizYEYtG0vBCNFowLDJSwgRJJHwZtdIT77JfiN0nH_w-fQw-zJ14es-cT2LJPbHRdA-isvtbmFIF-pc5cBn8ArOmmhw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Navigating+the+review+process+through+the+holier+than+thou&rft.jtitle=Industrial+and+organizational+psychology&rft.au=Vancouver%2C+Jeffrey+B&rft.date=2020-03-01&rft.pub=Cambridge+University+Press&rft.issn=1754-9426&rft.eissn=1754-9434&rft.volume=13&rft.issue=1&rft.spage=72&rft.epage=75&rft_id=info:doi/10.1017%2Fiop.2020.8&rft.externalDBID=HAS_PDF_LINK
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1754-9426&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1754-9426&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1754-9426&client=summon