Kernel regression coefficients for practical significance

Quantitative researchers often use Student's t-test (and its p-values) to claim that a particular regressor is important (statistically significantly) for explaining the variation in a response variable. A study is subject to the p-hacking problem when its author relies too much on formal stati...

Full description

Saved in:
Bibliographic Details
Published inJournal of risk and financial management Vol. 15; no. 1; pp. 1 - 13
Main Author Vinod, Hrishikesh D
Format Journal Article
LanguageEnglish
Published Basel MDPI 01.01.2022
MDPI AG
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:Quantitative researchers often use Student's t-test (and its p-values) to claim that a particular regressor is important (statistically significantly) for explaining the variation in a response variable. A study is subject to the p-hacking problem when its author relies too much on formal statistical significance while ignoring the size of what is at stake. We suggest reporting estimates using nonlinear kernel regressions and the standardization of all variables to avoid p-hacking. We are filling an essential gap in the literature because p-hacking-related papers do not even mention kernel regressions or standardization. Although our methods have general applicability in all sciences, our illustrations refer to risk management for a cross-section of firms and financial management in macroeconomic time series. We estimate nonlinear, nonparametric kernel regressions for both examples to illustrate the computation of scale-free generalized partial correlation coefficients (GPCCs). We suggest supplementing the usual p-values by 'practical significance' revealed by scale-free GPCCs. We show that GPCCs also yield new pseudo regression coefficients to measure each regressor's relative (nonlinear) contribution in a kernel regression.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1911-8074
1911-8066
1911-8074
DOI:10.3390/jrfm15010032