Satisfiability transition in asymmetric neural networks
Abstract Asymmetry in the synaptic interactions between neurons plays a crucial role in determining the memory storage and retrieval properties of recurrent neural networks. In this work, we analyze the problem of storing random memories in a network of neurons connected by a synaptic matrix with a...
Saved in:
Published in | Journal of physics. A, Mathematical and theoretical Vol. 55; no. 30; pp. 305001 - 305034 |
---|---|
Main Authors | , , |
Format | Journal Article |
Language | English |
Published |
IOP Publishing
29.07.2022
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | Abstract
Asymmetry in the synaptic interactions between neurons plays a crucial role in determining the memory storage and retrieval properties of recurrent neural networks. In this work, we analyze the problem of storing random memories in a network of neurons connected by a synaptic matrix with a definite degree of asymmetry. We study the corresponding satisfiability and clustering transitions in the space of solutions of the constraint satisfaction problem associated with finding synaptic matrices given the memories. We find, besides the usual SAT/UNSAT transition at a critical number of memories to store in the network, an additional transition for very asymmetric matrices, where the competing constraints (definite asymmetry vs memories storage) induce enough frustration in the problem to make it impossible to solve. This finding is particularly striking in the case of a single memory to store, where no quenched disorder is present in the system. |
---|---|
Bibliography: | JPhysA-117467.R1 |
ISSN: | 1751-8113 1751-8121 |
DOI: | 10.1088/1751-8121/ac79e5 |