Design evaluation of information appliances using augmented reality-based tangible interaction

• Published in: Computers in industry Vol. 64; no. 7; pp. 854 - 868
• Main Authors: Park, Hyungjun, Moon, Hee-Cheol
• Format: Journal Article
• Language: English
• Published: Kidlington Elsevier B.V 01.09.2013; Elsevier; Elsevier Sequoia S.A
• Subjects: Applied sciences; Augmented reality; Computer peripherals; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Design engineering; Design evaluation; Exact sciences and technology; Hand occlusion resolving; Handheld computers; Human-computer interaction; Information appliances; Real time; Simple and cost-effective setup; Software; Studies; Tangible user interaction; User experience; Tangible user interaction; Hand occlusion resolving; Information appliances; Design evaluation; Simple and cost-effective setup; Augmented reality; Used machinery; Occlusion; Visualization; Costs; Information system; Autoregressive model; Immersion; Work holder; User interface; Virtual reality; Finger; Regression analysis; Clamping; Terminal; Color image; Interactive system; Experimental result; Skin; Information layout; Occultation; User behavior
• ISSN: 0166-3615; 1872-6194
• DOI: 10.1016/j.compind.2013.05.006

•Design evaluation using tangible augmented reality (AR) interaction is proposed.•We exploit the good use of tangible objects without hardwired connections.•It provides better visual immersion without hand occlusion.•It also supports more tangible interaction with sense of touch.•We devise a simple and cost-effective AR setup to improve user experience. In this paper, we propose an approach to tangible augmented reality (AR) based design evaluation of information appliances, which not only exploits the use of tangible objects without hardwired connections to provide better visual immersion and support more tangible interaction, but also facilitates the adoption of a simple and low cost AR environment setup to improve user experience and performance. To enhance the visual immersion, we develop a solution for resolving hand occlusion in which skin color information is exploited with the use of the tangible objects to detect the hand regions properly. To improve the tangible interaction with the sense of touch, we introduce the use of product- and fixture-type objects, which provides the feelings of holding the product in his or her hands and touching buttons with his or her index fingertip in the AR setup. To improve user experience and performance in view of hardware configuration, we devise to adopt a simple and cost-effective AR setup that properly meets guidelines such as viewing size and distance, working posture, viewpoint matching, and camera movement. From experimental results, we found that the AR setup is good to improve the user experience and performance in design evaluation of handheld information appliances. We also found that the tangible interaction combined with the hand occlusion solver in the AR setup is very useful to improve tangible interaction and immersive visualization of virtual products while making the user experience the shapes and functions of the products well and comfortably.