Automation and intelligent scheduling of distributed system functional testing Model-based functional testing in practice

• Published in: International journal on software tools for technology transfer Vol. 19; no. 3; pp. 281 - 308
• Main Authors: Hillah, Lom Messan, Maesano, Ariele-Paolo, De Rosa, Fabio, Kordon, Fabrice, Wuillemin, Pierre-Henri, Fontanelli, Riccardo, Bona, Sergio Di, Guerri, Davide, Maesano, Libero
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.06.2017; Springer Nature B.V; Springer Verlag
• Subjects: Automation; Computer networks; Computer Science; Formal specifications; Functional testing; Maintenance; MBTCloud; Scheduling; Software Engineering; Software Engineering/Programming and Operating Systems; Temporal logic; Test equipment; Theory of Computation; Test automation; Model-based test generation; Test planning; Service testing; Test prioritisation; Test scheduling
• ISSN: 1433-2779; 1433-2787
• DOI: 10.1007/s10009-016-0440-3

This paper presents the approach to functional test automation of services (black-box testing) and service architectures (grey-box testing) that has been developed within the MIDAS project and is accessible on the MIDAS SaaS. In particular, the algorithms and techniques adopted for addressing input and oracle generation, dynamic scheduling, and session planning issues supporting service functional test automation are illustrated. More specifically, the paper details: (i) the test input generation based on formal methods and temporal logic specifications, (ii) the test oracle generation based on service formal specifications, (iii) the dynamic scheduling of test cases based on probabilistic graphical reasoning, and (iv) the reactive, evidence-based planning of test sessions with on-the-fly generation of new test cases. Finally, the utilisation of the MIDAS prototype for the functional test of operational services and service architectures in the healthcare industry is reported and assessed. A planned evolution of the technology deals with the testing and troubleshooting of distributed systems that integrate connected objects.