Investigating Differences in Gaze and Typing Behavior Across Writing Genres

• Published in: International journal of human-computer interaction Vol. 38; no. 6; pp. 541 - 561
• Main Authors: Wang, Jun, Fu, Eugene Y., Ngai, Grace, Leong, Hong Va
• Format: Journal Article
• Language: English
• Published: Norwood Taylor & Francis 03.04.2022; Lawrence Erlbaum Associates, Inc
• Subjects: Behavior; Eye movements; Support vector machines; Typing; Writing
• ISSN: 1044-7318; 1532-7590; 1044-7318
• DOI: 10.1080/10447318.2021.1952801

Writing is one of the most common activities undertaken on a computer, and the activity of writing has been widely studied. Given that writing is an intensively cognitive process, it makes sense that the type of writing that is being produced would have an effect on the writer's gaze and typing behaviors. However, only a few studies have explored this relationship. In this paper, we study the gaze-typing behaviors, specifically, the coordination between eye gaze and typing dynamics, of writers who are producing original articles in different genres: reminiscent, logical and creative. Our study focuses on Chinese typing, particularly via the Pinyin input method, which generates text via a two step method, and requires additional cognitive processes compared to typing in phonographic languages such as English. Our study involves 46 native Chinese speakers of varying ages from children to elderly. Our method deploys statistics- and sequence-based features to infer the mental state of the author during the writing process. The statistics-based features focus on modeling the overall gaze-typing behaviors during the process and the sequence-based features focus on the transition of the gaze-typing behaviors as the piece of writing progresses. Using a linear support-vector machine, we achieve an overall accuracy over 88% for the article-genre detection by using a leave-one-subject-out cross-validation evaluation.