A Unified Test Case Prioritization Approach

• Published in: ACM transactions on software engineering and methodology Vol. 24; no. 2; pp. 1 - 31
• Main Authors: Hao, Dan, Zhang, Lingming, Zhang, Lu, Rothermel, Gregg, Mei, Hong
• Format: Journal Article
• Language: English
• Published: 01.12.2014
• Subjects: C (programming language); Covering; Faults; Filled plastics; Java (programming language); Mathematical models; Programming; Regression; Strategy
• ISSN: 1049-331X; 1557-7392
• DOI: 10.1145/2685614

Test case prioritization techniques attempt to reorder test cases in a manner that increases the rate at which faults are detected during regression testing. Coverage-based test case prioritization techniques typically use one of two overall strategies: a total strategy or an additional strategy . These strategies prioritize test cases based on the total number of code (or code-related) elements covered per test case and the number of additional (not yet covered) code (or code-related) elements covered per test case, respectively. In this article, we present a unified test case prioritization approach that encompasses both the total and additional strategies. Our unified test case prioritization approach includes two models ( basic and extended ) by which a spectrum of test case prioritization techniques ranging from a purely total to a purely additional technique can be defined by specifying the value of a parameter referred to as the f p value. To evaluate our approach, we performed an empirical study on 28 Java objects and 40 C objects, considering the impact of three internal factors (model type, choice of f p value, and coverage type) and three external factors (coverage granularity, test case granularity, and programming/testing paradigm), all of which can be manipulated by our approach. Our results demonstrate that a wide range of techniques derived from our basic and extended models with uniform f p values can outperform purely total techniques and are competitive with purely additional techniques. Considering the influence of each internal and external factor studied, the results demonstrate that various values of each factor have nontrivial influence on test case prioritization techniques.