Using word embeddings to generate data-driven human agent decision-making from natural language

• Published in: GeoInformatica Vol. 23; no. 2; pp. 221 - 242
• Main Authors: Runck, Bryan C., Manson, Steven, Shook, Eric, Gini, Maria, Jordan, Nicholas
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.04.2019; Springer; Springer Nature B.V
• Subjects: Agent-based models; Analysis; Cognition; Cognitive ability; Computer Science; Data; Data Structures and Information Theory; Decision making; Decision theory; Earth and Environmental Science; Geographical Information Systems/Cartography; Geography; Information Storage and Retrieval; Labour; Language; Model accuracy; Modelling; Multimedia Information Systems; Natural language; Natural language processing; Problem solving; Reproducibility; Translating; Unstructured data; Decision-making; Natural language processing; Word embedding; Agent-based model
• ISSN: 1384-6175; 1573-7624
• DOI: 10.1007/s10707-019-00345-2

Generating replicable and empirically valid models of human decision-making is crucial for the scientific accuracy and reproducibility of agent-based models. A two-fold challenge in developing models of decision-making is a lack of high resolution and high quality behavioral data and the need for more transparent means of translating these data into models. A common and largely successful approach to modeling is hand-crafting agent decision heuristics from qualitative field interviews. This empirically-based, qualitative approach successfully incorporates contextual decision making, heterogeneous preferences, and decision strategies. However, it is labor intensive and often leads to models that are hard to replicate, thereby limiting the scale and scope over which such methods can be usefully applied. A potential solution to these problems is provided by new approaches in natural language processing, which can use textual sources ranging from field interview transcripts to unstructured data from the web to capture and represent human cognition. Here we use word embeddings, a vector-based representation of language, to create agents that reason using similarity comparison. This approach proves to be effective at mirroring theoretical expectations for human decision biases across a range of natural language decision-making tasks. We provide a proof-of-concept agent-based model that illustrates how the agents we create can be readily deployed to study cultural diffusion. The agent-based model replicates previously found results with the added benefit of qualitative interpretability. The agent architecture we propose is able to mirror human likelihood assessments from natural language and offers a new way to model agent cognitive processes for a broad array of agent-based modeling use cases.