Learning Faster by Discovering and Exploiting Object Similarities

• Published in: International journal of advanced robotic systems Vol. 10; no. 3
• Main Authors: Janež, Tadej, Žabkar, Jure, Možina, Martin, Bratko, Ivan
• Format: Journal Article
• Language: English
• Published: London, England SAGE Publications 01.03.2013; Sage Publications Ltd; SAGE Publishing
• Subjects: Algorithms; Analogies; Artificial intelligence; Complexity; Datasets; Decision trees; Error reduction; Experiments; Machine learning; Robots; Learning Speed; Learning by Experimentation; Domain Complexity; Machine Learning; Autonomous Learning Agents
• ISSN: 1729-8806; 1729-8814
• DOI: 10.5772/54659

In this paper we explore the question: “Is it possible to speed up the learning process of an autonomous agent by performing experiments in a more complex environment (i.e., an environment with a greater number of different objects)?” To this end, we use a simple robotic domain, where the robot has to learn a qualitative model predicting the change in the robot's distance to an object. To quantify the environment's complexity, we defined cardinal complexity as the number of objects in the robot's world, and behavioural complexity as the number of objects' distinct behaviours. We propose Error reduction merging (ERM), a new learning method that automatically discovers similarities in the structure of the agent's environment. ERM identifies different types of objects solely from the data measured and merges the observations of objects that behave in the same or similar way in order to speed up the agent's learning. We performed a series of experiments in worlds of increasing complexity. The results in our simple domain indicate that ERM was capable of discovering structural similarities in the data which indeed made the learning faster, clearly superior to conventional learning. This observed trend occurred with various machine learning algorithms used inside the ERM method.