Combinatorial methods for testing Internet of Things smart home systems
Summary In this paper, we report on applying combinatorial testing to Internet of Things (IoT) home automation hub systems. We detail how to create a dedicated input parameter model of an IoT home automation hub system for use with combinatorial test case generation strategies. Further, we developed...
Saved in:
Published in | Software testing, verification & reliability Vol. 32; no. 2 |
---|---|
Main Authors | , , , , , |
Format | Journal Article |
Language | English |
Published |
Chichester
Wiley Subscription Services, Inc
01.03.2022
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | Summary
In this paper, we report on applying combinatorial testing to Internet of Things (IoT) home automation hub systems. We detail how to create a dedicated input parameter model of an IoT home automation hub system for use with combinatorial test case generation strategies. Further, we developed an automated test execution framework and two test oracles for evaluation purposes. We applied and evaluated our proposed methodological approach to a real‐world IoT system and analysed the obtained results of various combinatorial test sets with different properties generated based on the derived input model. Additionally, we compare these results to a random testing approach. Our empirical testing evaluations revealed multiple errors in the tested devices and also showed that all considered approaches performed nearly equally well.
The graphical depicts a combinatorial methodology for testing Internet of Things systems in the case of a hub‐based home automation system represented as a star graph. |
---|---|
Bibliography: | Funding information National Institute of Standards and Technology; FFG |
ISSN: | 0960-0833 1099-1689 |
DOI: | 10.1002/stvr.1805 |