A Game Theoretic Approach for Addressing Domain-Shift in Big-Data

• Published in: IEEE transactions on big data Vol. 8; no. 6; pp. 1610 - 1621
• Main Authors: Raghavan, Krishnan, Jagannathan, Sarangapani, Samaranayake, V. A.
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.12.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation models; Artificial neural networks; Big Data; Classifiers; Cost function; Distortion; Domain shift; Domains; exploratory learning; Game theory; Games; Machine learning; Nash Equilibrium; Optimization; Testing; Training; two player zero sum game; Zero sum games
• ISSN: 2332-7790; 2372-2096
• DOI: 10.1109/TBDATA.2021.3077832

In this article, a novel approach is presented to mitigate the issue of domain shift observed in big-data classification. Since little information is available about the shift, we introduce a "distortion model", and obtain additional data-samples to represent the shift. Next, a deep neural network (DNN), referred as "classifier," is used to compensate for the shift by learning through these additional samples while maintaining performance on training samples. As the exact magnitude of domain shift is uncertain, we compensate for the optimal expected shift by formulating a zero-sum game. In the proposed game, the distortion model is viewed as the maximizing player which increases the domain shift while the classifier becomes the minimizing player that reduces the impact of domain shift on learning. The Nash solution of the game, whose existence is demonstrated mathematically, provides the domain shift and its optimal adaptation through the classifier. To solve the proposed game for the Nash solution, a direct error-driven learning scheme is introduced where a cost function is derived and solved for each layer in the DNN and the distortion model. Comprehensive mathematical and simulation study is presented to demonstrate the efficacy of the approach.