Adaptive Sign Language Recognition for Deaf Users: Integrating Markov Chains with Niching Genetic Algorithm

• Published in: AI (Basel) Vol. 6; no. 8; p. 189
• Main Authors: Al-Saidi, Muslem, Ballagi, Áron, Hassen, Oday Ali, Darwish, Saad M.
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.08.2025
• Subjects: Accuracy; Communication; Convergence; Deafness; Deep learning; Feature selection; Genetic algorithms; Genetic diversity; gesture dynamics and variability; Markov analysis; Markov Chain optimization; Markov chains; Neural networks; Niching Genetic Algorithm (NGA); Optimization; Optimization techniques; Public spaces; Recognition; Robustness (mathematics); Sign language; subject-independent sign language recognition; Transition probabilities
• ISSN: 2673-2688; 2673-2688
• DOI: 10.3390/ai6080189

Sign language recognition (SLR) plays a crucial role in bridging the communication gap between deaf individuals and the hearing population. However, achieving subject-independent SLR remains a significant challenge due to variations in signing styles, hand shapes, and movement patterns among users. Traditional Markov Chain-based models struggle with generalizing across different signers, often leading to reduced recognition accuracy and increased uncertainty. These limitations arise from the inability of conventional models to effectively capture diverse gesture dynamics while maintaining robustness to inter-user variability. To address these challenges, this study proposes an adaptive SLR framework that integrates Markov Chains with a Niching Genetic Algorithm (NGA). The NGA optimizes the transition probabilities and structural parameters of the Markov Chain model, enabling it to learn diverse signing patterns while avoiding premature convergence to suboptimal solutions. In the proposed SLR framework, GA is employed to determine the optimal transition probabilities for the Markov Chain components operating across multiple signing contexts. To enhance the diversity of the initial population and improve the model’s adaptability to signer variations, a niche model is integrated using a Context-Based Clearing (CBC) technique. This approach mitigates premature convergence by promoting genetic diversity, ensuring that the population maintains a wide range of potential solutions. By minimizing gene association within chromosomes, the CBC technique enhances the model’s ability to learn diverse gesture transitions and movement dynamics across different users. This optimization process enables the Markov Chain to better generalize subject-independent sign language recognition, leading to improved classification accuracy, robustness against signer variability, and reduced misclassification rates. Experimental evaluations demonstrate a significant improvement in recognition performance, reduced error rates, and enhanced generalization across unseen signers, validating the effectiveness of the proposed approach.