Limitations of PET-PEESE and Other Meta-Analysis Methods

A novel meta-regression method, precision-effect test and precision-effect estimate with standard errors (PET-PEESE), predicts and explains recent high-profile failures to replicate in psychology. The central purpose of this article is to identify the limitations of PET-PEESE for application to soci...

Full description

Saved in:
Bibliographic Details
Published inSocial psychological & personality science Vol. 8; no. 5; pp. 581 - 591
Main Author Stanley, T. D.
Format Journal Article
LanguageEnglish
Published Los Angeles, CA SAGE Publications 01.07.2017
SAGE PUBLICATIONS, INC
Subjects
Errors
Meta-analysis
Personality psychology
Social psychology
random effects
meta-analysis
publication bias
PET-PEESE
weighted least squares
Online AccessGet full text

Cover

More Information
Summary:A novel meta-regression method, precision-effect test and precision-effect estimate with standard errors (PET-PEESE), predicts and explains recent high-profile failures to replicate in psychology. The central purpose of this article is to identify the limitations of PET-PEESE for application to social/personality psychology. Using typical conditions found in social/personality research, our simulations identify three areas of concern. PET-PEESE performs poorly in research areas where there are only a few studies, all studies use small samples, and where there is very high heterogeneity of results from study to study. Nonetheless, the statistical properties of conventional meta-analysis approaches are much worse than PET-PEESE under these same conditions. Our simulations suggest alterations to conventional research practice and ways to moderate PET-PEESE weaknesses.
ISSN:1948-5506
1948-5514
DOI:10.1177/1948550617693062