Safe Policy Synthesis in Multi-Agent POMDPs via Discrete-Time Barrier Functions

• Published in: 2019 IEEE 58th Conference on Decision and Control (CDC) pp. 4797 - 4803
• Main Authors: Ahmadi, Mohamadreza, Singletary, Andrew, Burdick, Joel W., Ames, Aaron D.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.12.2019
• ISSN: 2576-2370
• DOI: 10.1109/CDC40024.2019.9030241

A multi-agent partially observable Markov decision process (MPOMDP) is a modeling paradigm used for high-level planning of heterogeneous autonomous agents subject to uncertainty and partial observation. Despite their modeling efficiency, MPOMDPs have not received significant attention in safety-critical settings. In this paper, we use barrier functions to design policies for MPOMDPs that ensure safety. Notably, our method does not rely on discretizations of the belief space, or finite memory. To this end, we formulate sufficient and necessary conditions for the safety of a given set based on discrete-time barrier functions (DTBFs) and we demonstrate that our formulation also allows for Boolean compositions of DTBFs for representing more complicated safe sets. We show that the proposed method can be implemented online by a sequence of one-step greedy algorithms as a standalone safe controller or as a safety-filter given a nominal planning policy. We illustrate the efficiency of the proposed methodology based on DTBFs using a high-fidelity simulation of heterogeneous robots.