Evaluation of Move Method Refactorings Recommendation Algorithms: Are We Doing It Right?

• Published in: 2019 IEEE/ACM 3rd International Workshop on Refactoring (IWoR) pp. 23 - 26
• Main Authors: Novozhilov, Evgenii, Veselov, Ivan, Pravilov, Mikhail, Bryksin, Timofey
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2019
• Subjects: algorithms evaluation; automatic refactoring recommendation; code smells; dataset generation; feature envy; move method refactoring
• DOI: 10.1109/IWoR.2019.00012

Previous studies introduced various techniques for detecting Move Method refactoring opportunities. However, different authors have different evaluations, which leads to the fact that results reported by different papers do not correlate with each other and it is almost impossible to understand which algorithm works better in practice. In this paper, we provide an overview of existing evaluation approaches for Move Method refactoring recommendation algorithms, as well as discuss their advantages and disadvantages. We propose a tool that can be used for generating large synthetic datasets suitable for both algorithms evaluation and building complex machine learning models for Move Method refactoring recommendation.