A Hitchhiker's guide to statistical tests for assessing randomized algorithms in software engineering

• Published in: Software testing, verification & reliability Vol. 24; no. 3; pp. 219 - 250
• Main Authors: Arcuri, Andrea, Briand, Lionel
• Format: Journal Article
• Language: English
• Published: Chichester Blackwell Publishing Ltd 01.05.2014; Wiley Subscription Services, Inc
• Subjects: Algorithms; Bonferroni adjustment; Computer programs; confidence interval; effect size; Empirical analysis; Guidelines; nonparametric test; parametric test; Software; Software engineering; statistical difference; Statistical tests; survey; systematic review; Tasks

SUMMARYRandomized algorithms are widely used to address many types of software engineering problems, especially in the area of software verification and validation with a strong emphasis on test automation. However, randomized algorithms are affected by chance and so require the use of appropriate s...