Enhanced Hand Gesture Recognition using Optimized Preprocessing and VGG16-Based Deep Learning Model

• Published in: 2024 10th International Conference on Communication and Signal Processing (ICCSP) pp. 1101 - 1105
• Main Authors: Manoharan, Jayamohan, Sivagnanam, Yuvaraj
• Format: Conference Proceeding
• Language: English
• Published: IEEE 12.04.2024
• Subjects: Adaptation models; Attention Mechanism; CNN; Deep Learning; Feature extraction; Gesture recognition; Hand Gesture; Human computer interaction; Pipelines; Training; Transfer learning; VGG16
• ISSN: 2836-1873
• DOI: 10.1109/ICCSP60870.2024.10543590

This research paper highlights advancements in hand gesture recognition, particularly addressing challenges related to adaptability to dynamic gestures. A meticulous approach is adopted, focusing on comprehensive preprocessing tasks such as image resizing, numerical array conversion, and pixel normalization. Leveraging the pre-trained VGG16 model from ImageNet via transfer learning enhances the model's pattern recognition capabilities. An attention mechanism is introduced post-VGG16 to further augment the model's ability to capture intricate details, emphasizing crucial features for classification. The sequential model built upon the VGG16 base, enriched with custom layers like flattening, ReLU activation, dropout, and SoftMax activation, is central to our methodology. The novelty of our research lies in the integration of innovative preprocessing techniques, model architecture, and attention mechanisms, ensuring robustness in recognizing intricate hand gestures. Evaluation of the Hand Gesture Recognition Image (HaGRID) dataset yields an accuracy of 85.13%, validating the efficacy of our approach in real-world scenarios. This research significantly contributes to the field by offering a refined model tailored for accurate hand gesture classification, promising advancements in human-computer interaction and related domains.