Path planning in unknown environment with kernel smoothing and reinforcement learning for multi-agent systems

• Published in: 2015 12th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE) pp. 1 - 6
• Main Authors: Luviano Cruz, David, Wen Yu
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.10.2015
• Subjects: Markov processes; Multi-agent systems
• DOI: 10.1109/ICEEE.2015.7357900

In unknown environment, path planning of multiagent systems is difficult. The popular methods for the path planning, such as reinforcement learning (RL), do not work for these two cases: unknown environment and multi-agent. In this paper, we use a special intelligent method, kernel smoothing, to estimate the unknown environment, and combine it with the reinforcement learning technique. The advantage of the combination of the reinforcement learning and the kernel smoothing technique is we do not need to repeat RL for the unvisited state. The path planning process has three stages: 1) the reinforcement learning is applied to generate the training samples; 2) the model is trained by the kernel smoothing method; 3) the trained model gives an approximate action to agents. Experiment results show the proposed algorithm can generate desired paths in the unknown environment for multiple agents.