Optimal foraging strategies can be learned

• Published in: New journal of physics Vol. 26; no. 1; pp. 13010 - 13022
• Main Authors: Muñoz-Gil, Gorka, López-Incera, Andrea, Fiderer, Lukas J, Briegel, Hans J
• Format: Journal Article
• Language: English
• Published: Bristol IOP Publishing 01.01.2024
• Subjects: Animals; Foraging behavior; Lévy foraging hypothesis; optimal search strategies; Optimization; Physics; Questions; reinforcement learning; Search methods
• ISSN: 1367-2630; 1367-2630
• DOI: 10.1088/1367-2630/ad19a8

Abstract The foraging behavior of animals is a paradigm of target search in nature. Understanding which foraging strategies are optimal and how animals learn them are central challenges in modeling animal foraging. While the question of optimality has wide-ranging implications across fields such as economy, physics, and ecology, the question of learnability is a topic of ongoing debate in evolutionary biology. Recognizing the interconnected nature of these challenges, this work addresses them simultaneously by exploring optimal foraging strategies through a reinforcement learning (RL) framework. To this end, we model foragers as learning agents. We first prove theoretically that maximizing rewards in our RL model is equivalent to optimizing foraging efficiency. We then show with numerical experiments that, in the paradigmatic model of non-destructive search, our agents learn foraging strategies which outperform the efficiency of some of the best known strategies such as Lévy walks. These findings highlight the potential of RL as a versatile framework not only for optimizing search strategies but also to model the learning process, thus shedding light on the role of learning in natural optimization processes.