An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices

• Published in: International journal of human-computer studies Vol. 62; no. 4; pp. 487 - 520
• Main Authors: Barnard, Leon, Yi, Ji Soo, Jacko, Julie A., Sears, Andrew
• Format: Journal Article
• Language: English
• Published: London Elsevier Ltd 01.04.2005; Elsevier
• Subjects: Applied sciences; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Computers; Context; Context-aware; Empirical; Evaluation; Exact sciences and technology; Human-computer interaction; Mobile communications; Mobile computing; Mobility; Networks; Software; User interface; Wireless communications; Context; Mobility; Evaluation; Context-aware; Empirical; Mobile computing; User interface; Context aware; Variance analysis
• ISSN: 1071-5819; 1095-9300
• DOI: 10.1016/j.ijhcs.2004.12.002

There is a clear need for evaluation methods that are specifically suited to mobile device evaluation, largely due to the vast differences between traditional desktop computing and mobile computing. One difference of particular interest that needs to be accounted for is that mobile computing devices are frequently used while the user is in motion, in contrast to desktop computing. This study aims to validate the appropriateness of two evaluation methods that vary in representativeness of mobility, one that uses a treadmill to simulate motion and another that uses a controlled walking scenario. The results lead to preliminary guidelines based on study objectives for researchers wishing to use more appropriate evaluation methodologies for empirical, data-driven mobile computing studies. The guidelines indicate that using a treadmill for mobile evaluation can yield representative performance measures, whereas a controlled walking scenario is more likely to adequately simulate the actual user experience.