Diversifying agent's behaviors in interactive decision models

• Published in: International journal of intelligent systems Vol. 37; no. 12; pp. 12035 - 12056
• Main Authors: Pan, Yinghui, Zhang, Hanyi, Zeng, Yifeng, Ma, Biyang, Tang, Jing, Ming, Zhong
• Format: Journal Article
• Language: English
• Published: New York Hindawi Limited 01.12.2022
• Subjects: Agents (artificial intelligence); Artificial intelligence; Behavior; behavior diversity; Decision making; Domains; Environment models; Feature extraction; intelligent agents; Intelligent systems; interactive behaviors; Multiagent systems
• ISSN: 0884-8173; 1098-111X
• DOI: 10.1002/int.23075

Modeling other agents' behaviors plays an important role in decision models for interactions among multiple agents. To optimize its own decisions, a subject agent needs to model what other agents act simultaneously in an uncertain environment. However, modeling insufficiency occurs when the agents are competitive and the subject agent cannot get full knowledge about other agents. Even when the agents are collaborative, they may not share their true behaviors due to their privacy concerns. Most of the recent research still assumes that the agents have common knowledge about their environments and a subject agent has the true behavior of other agents in its mind. Consequently, the resulting techniques are not applicable in many practical problem domains. In this article, we investigate into diversifying behaviors of other agents in the subject agent's decision model before their interactions. The challenges lie in generating and measuring new behaviors of other agents. Starting with prior knowledge about other agents' behaviors, we use a linear reduction technique to extract representative behavioral features from the known behaviors. We subsequently generate their new behaviors by expanding the features and propose two diversity measurements to select top‐K $K$ behaviors. We demonstrate the performance of the new techniques in two well‐studied problem domains. The top‐K $K$ behavior selection embarks the study of unknown behaviors in multiagent decision making and inspires investigation of diversifying agents' behaviors in competitive agent interactions. This study will contribute to intelligent systems dealing with unknown unknowns in an open artificial intelligence world.