Human Memory Update Strategy: A Multi-Layer Template Update Mechanism for Remote Visual Monitoring

• Published in: IEEE transactions on multimedia Vol. 23; pp. 2188 - 2198
• Main Authors: Liu, Shuai, Wang, Shuai, Liu, Xinyu, Gandomi, Amir H., Daneshmand, Mahmoud, Muhammad, Khan, De Albuquerque, Victor Hugo C.
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Artificial intelligence; Correlation; Feature extraction; filtering algorithm; Filtering algorithms; Filtration; human memory; Memory; Monitoring; Multilayers; Multimedia; Multimedia environment; Real time; Real-time systems; Remote monitoring; Robustness; Template matching; template update; visual monitoring; Visualization
• ISSN: 1520-9210; 1941-0077
• DOI: 10.1109/TMM.2021.3065580

In the era of rapid development of artificial intelligence, the integration of multimedia and human-artificial intelligence has become an important research hotspot. Especially in the multimedia environment, effective remote visual monitoring has become the exploration direction of many scholars. The use of traditional correlation filtering (CF) algorithm for real-time monitoring in the context of multimedia is a practical strategy. However, most existing filtering-based visual monitoring algorithms still have the problem of insufficient robustness and effectiveness. Therefore, by considering the strategy of updating human memory, this paper proposes a multi-layer template update mechanism to achieve effective monitoring in a multimedia environment. In this strategy, the weighted template of the high-confidence matching memory is used as the confidence memory, and the unweighted template of the low-confidence matching memory is used as the cognitive memory. Through the alternate use of confidence memory, matching memory, and cognitive memory, it is ensured that the target will not be lost during the monitoring process. Experimental results show that this strategy does not affect the speed (still real-time) and improves the robustness in the multimedia background.