Gestures that people can understand and use

Recent advances in computing devices push researchers to envision new interaction modalities that go beyond traditional mouse and keyboard input. Typical examples are large displays for which researchers hope to create more “natural” means of interaction by using human gestures and body movements as...

Full description

Saved in:
Bibliographic Details
Published inJournal of visual languages and computing Vol. 25; no. 5; pp. 572 - 576
Main Authors Ardito, Carmelo, Costabile, Maria Francesca, Jetter, Hans-Christian
Format Journal Article
LanguageEnglish
Published Elsevier Ltd 01.10.2014
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:Recent advances in computing devices push researchers to envision new interaction modalities that go beyond traditional mouse and keyboard input. Typical examples are large displays for which researchers hope to create more “natural” means of interaction by using human gestures and body movements as input. In this article, we reflect about this goal of designing gestures that people can easily understand and use and how designers of gestural interaction can capitalize on the experience of 30 years of research on visual languages to achieve it. Concretely, we argue that gestures can be regarded as “visual expressions to convey meaning” and thus are a visual language. Based on what we have learned from visual language research in the past, we then explain why the design of a generic gesture set or language that spans many applications and devices is likely to fail. We also discuss why we recommend using gestural manipulations that enable users to directly manipulate on-screen objects instead of issuing commands with symbolic gestures whose meaning varies among different users, contexts, and cultures. •Point of view on the design of gestures for human–computer interaction.•Gestural languages as visual languages: capitalizing on experience of VL research.•Stimulating publications in JVLC of articles on gestural interaction.
ISSN:1045-926X
1095-8533
DOI:10.1016/j.jvlc.2014.07.002