Online Learning Based Control for Mobile Vehicle to Avoid Static Obstacles via Kernel Based Safe Dynamic Model

This paper addresses the path planning for mobile vehicle subject to state constraint i.e., avoiding static obstacles by finding the kernel based safe dynamic model by using the Gaussian kernel via online sampling and without knowing the dynamic of the system to extract the benefit of model free rei...

Full description

Saved in:
Bibliographic Details
Published in2024 7th International Conference on Advanced Algorithms and Control Engineering (ICAACE) pp. 811 - 816
Main Authors Kanwal, Somia, Basheer, Ambreen
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.03.2024
Subjects
Barrier function
Gussian kernel
Heuristic algorithms
local planning to solve curse of dimensnality issue
Mathematical models
Optimal control
Path planning
Planning
Reinforcement Learning
safe dynamic model
Simulation
static Obstacle avoidance
System dynamics
Online AccessGet full text

Cover

More Information
Summary:This paper addresses the path planning for mobile vehicle subject to state constraint i.e., avoiding static obstacles by finding the kernel based safe dynamic model by using the Gaussian kernel via online sampling and without knowing the dynamic of the system to extract the benefit of model free reinforcement learning. A proper reward function is designed to find the collision free optimal path at each time step. A proper barrier function which is function of distance in term of feature of controller to avoid collision with obstacle is augmented in reward function. At each time step, safe optimal control policy is find locally by generating safe samples around the vicinity of the current state to solve the curse of dimensionality issue and then, solving Bellman optimality equation like Q-learning algorithm that used the safe kernel based dynamic model, hence combine the effect of model based reinforcement learning at this point. Finally, simulation results demonstrate the validity of the proposed algorithm.
DOI:10.1109/ICAACE61206.2024.10548449