Memristor-Based Operant Conditioning Neural Network With Blocking and Competition Effects

• Published in: IEEE transactions on industrial informatics Vol. 20; no. 8; pp. 10209 - 10218
• Main Authors: Sun, Junwei, Yue, Yi, Wang, Yingcong, Wang, Yanfeng
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.08.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Artificial intelligence; Biomimetics; Bionic learning; blocking effect; Circuits; Conditioning (learning); Logic gates; Machine learning; memristor; Memristors; Neural networks; operating conditions; overshadowing effect; Threshold voltage; Training; Voltage control
• ISSN: 1551-3203; 1941-0050
• DOI: 10.1109/TII.2024.3393975

Operant conditioning is an important learning mechanism for organisms, as well as a basic theory for reinforcement learning in artificial intelligence. Although there are already some memristive neural circuits for operant conditioning, they can only process a single stimulus and cannot handle multiple inputs simultaneously. This article proposes a multi-input operant conditioning neural network that incorporates blocking and competing effects. This network can achieve the blocking and overshadowing effects in the presence of multiple inputs and learn efficiently in complex environments. In addition, it incorporates time differences between signals and excitations, random exploration, feedback learning, experience memory, decision-making based on experience, and adaptive learning in low-reward environments. Finally, the feasibility of the proposed circuit function is verified through PSPICE simulation. This work provides an implementation idea for the hardware implementation of artificial intelligence.