A Closed-form Solution for Weight Optimization in Fully-connected Feed-forward Neural Networks

• Published in: arXiv.org
• Main Authors: Tomic, Slavisa, João Pedro Matos-Carvalho, Beko, Marko
• Format: Paper
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 17.06.2024
• Subjects: Back propagation networks; Closed form solutions; Exact solutions; Iterative methods; Mapping; Neural networks; Optimization; Run time (computers)

This work addresses weight optimization problem for fully-connected feed-forward neural networks. Unlike existing approaches that are based on back-propagation (BP) and chain rule gradient-based optimization (which implies iterative execution, potentially burdensome and time-consuming in some cases)...