GestureTeach: A gesture guided online teaching interactive model

• Published in: Computer animation and virtual worlds Vol. 35; no. 1
• Main Authors: Liu, Hongjun, Yao, Chao, Zhang, Yalan, Ban, Xiaojuan
• Format: Journal Article
• Language: English
• Published: Chichester Wiley Subscription Services, Inc 01.01.2024
• Subjects: Animation; animation generation; Effectiveness; gesture recognition; Handwriting; online education; Online instruction; Sketches; Students; Teachers; Teaching; Teaching methods
• ISSN: 1546-4261; 1546-427X
• DOI: 10.1002/cav.2218

Online education has become more popular and effective due to the availability of high‐speed internet and technological innovations, which allow people from different locations to access educational resources and opportunities. However, online classes often face challenges such as limited interactivity and display options, which can affect the quality and effectiveness of the online learning experience. In this article, we propose GestureTeach, a new pedagogical paradigm that enables free handwriting interaction and animation generation for online teaching. GestureTeach uses gestures as a natural and intuitive way of interaction, which enhances the teacher's intention expression and the student's engagement. GestureTeach also generates animations from handwritten sketches, which improves the display effects of the interaction and the student's knowledge comprehension. We conducted a two‐stage study with 15 teachers and 90 students to evaluate the effectiveness of GestureTeach in facilitating classroom interaction. The results show that GestureTeach is preferred by both teachers and students over traditional online teaching methods and has the potential to transform the online teaching landscape by providing a seamless and interactive experience. We propose GestureTeach, a new pedagogical paradigm that enables free handwriting interaction and animation generation for online teaching. GestureTeach uses gestures as a natural and intuitive way of interaction, which enhances the teacher's intention expression and the student's engagement. GestureTeach also generates animations from handwritten sketches, which improves the display effects of the interaction and the student's knowledge comprehension.