Relational reinforcement learning and recurrent neural network with state classification to solve joint attention

• Published in: The 2011 International Joint Conference on Neural Networks pp. 1222 - 1229
• Main Authors: da Silva, R. R., Romero, R. A. F.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.07.2011
• Subjects: Computer architecture; Humans; Joints; Learning; Learning systems; Robot kinematics
• ISBN: 1424496357; 9781424496358
• ISSN: 2161-4393; 2161-4407
• DOI: 10.1109/IJCNN.2011.6033363

Joint attention is an important non verbal communication learned by humans in a period of childhood. One learning method has been explored to provide this learning ability in robots is known as reinforcement learning. However, the use of this method using a Markov Decision Process model has problems. In this article, we have enhanced our robotic architecture, which is inspired on behavior analysis, to provide to the robot or agent, the capacity of joint attention using combination of relational reinforcement learning and recurrent neural network with state classification. We have incorporated this improvement as learning mechanism in our architecture to simulate joint attention. Then, a set of empirical evaluations has been conducted in the social interactive simulator for performing the task of joint attention. The performance of this algorithm have been compared with the Q-Learning algorithm, contingency learning algorithm and ETG algorithm. The experimental results show that this new method is better than other algorithms evaluated by us for joint attention problem.