DEVICE AND METHOD OF TRAINING FULLY-CONNECTED NEURAL NETWORK

• Main Authors: CHOU CHUN-NAN, CHANG EDWARD, CHEN SHENG-WEI
• Format: Patent
• Language: Chinese; English
• Published: 16.08.2019
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; PHYSICS

A computing device for training a fully-connected neural network (FCNN) comprises at least one storage device; and at least one processing circuit, coupled to the at least one storage device. The at least one storage device stores, and the at least one processing circuit is configured to execute instructions of: computing a block-diagonal approximation of a positive-curvature Hessian (BDA-PCH) matrix of the FCNN; and computing at least one update direction of the BDA-PCH matrix according to an expectation approximation conjugated gradient (EA-CG) method. 一种计算装置，用来训练全连接神经网络，包含有至少一存储装置；以及至少一处理电路，耦接于该至少一存储装置。该至少一存储装置用来存储，以及该至少一处理电路被配置来执行存储于该至少一存储装置中的以下指令：计算该全连接神经网络的块对角近似的正曲率海森矩阵；以及根据期望近似共轭梯度方法，计算该块对角近似的正曲率海森矩阵的至少一更新方向。