The Driver Behaviour Questionnaire as accident predictor; A methodological re-meta-analysis

• Published in: Journal of safety research Vol. 55; pp. 185 - 212
• Main Authors: af Wåhlberg, A.E., Barraclough, P., Freeman, J.
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.12.2015; Elsevier Science Ltd
• Subjects: Accidents, Traffic - statistics & numerical data; Automobile drivers; Automobile Driving - psychology; Automobile Driving - statistics & numerical data; Behavior; Bias; Common method variance; Dissemination bias; Driver Behavior Questionnaire; Exposure; Forecasting; Humans; Meta-analysis; Prevention; Questionnaires; Research Design; Risk-Taking; Safety research; Self Report; Surveys and Questionnaires; Traffic accidents & safety; Traffic violations; Violations; Common method variance; Exposure; Driver Behavior Questionnaire; Dissemination bias; Self-report
• ISSN: 0022-4375; 1879-1247
• DOI: 10.1016/j.jsr.2015.08.003

The Manchester Driver Behaviour Questionnaire (DBQ) is the most commonly used self-report tool in traffic safety research and applied settings. It has been claimed that the violation factor of this instrument predicts accident involvement, which was supported by a previous meta-analysis. However, that analysis did not test for methodological effects, or include unpublished results. The present study re-analysed studies on prediction of accident involvement from DBQ factors, including lapses, and many unpublished effects. Tests of various types of dissemination bias and common method variance were undertaken. Outlier analysis showed that some effects were probably not reliable data, but excluding them did not change the results. For correlations between violations and crashes, tendencies for published effects to be larger than unpublished ones and for effects to decrease over time were observed, but were not significant. Also, using the mean of accidents as proxy for effect indicated that studies where effects for violations are not reported have smaller effect sizes. These differences indicate dissemination bias. Studies using self-reported accidents as dependent variables had much larger effects than those using recorded accident data. Also, zero-order correlations were larger than partial correlations controlled for exposure. Similarly, violations/accidents effects were strong only when there was also a strong correlation between accidents and exposure. Overall, the true effect is probably very close to zero (r<.07) for violations versus traffic accident involvement, depending upon which tendencies are controlled for. Methodological factors and dissemination bias have inflated the published effect sizes of the DBQ. Strong evidence of various artefactual effects is apparent. A greater level of care should be taken if the DBQ continues to be used in traffic safety research. Also, validation of self-reports should be more comprehensive in the future, taking into account the possibility of common method variance. •A meta-analysis of published and many unpublished effects of the DBQ as accident predictor was undertaken.•DBQ effect sizes have been inflated by common method variance, lack of control for exposure, and probably dissemination bias.•The DBQ probably suffers from a fault in the item construction, which creates common method variance effects.