WEIGHT INITIALIZATION FOR MACHINE LEARNING MODELS

• Main Authors: RUTENBURG, ILIA, BITTMANN, RAN MOSHE, BOBOVICH, LEONID, KEMELMAKHER, MICHAEL
• Format: Patent
• Language: English
• Published: 20.09.2018
• Subjects: CALCULATING; COMPUTING; COUNTING; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS

In one respect, there is provided a system that may include a processor and a memory. The memory may be configured to store instructions that results in operations when executed by the processor. The operations may include: processing an image set with a convolutional neural network configured to detect, in the image set, a first feature and a second feature; determining a respective effectiveness of the first feature and the second feature in enabling the convolutional neural network to classify images in the image set; determining, based at least on the respective effectiveness of the first feature and the second feature, a first initial weight for the first feature and a second initial weight for the second feature; and initializing the convolutional neural network for training, the initialization of the convolutional neural network comprising configuring the convolutional neural network to apply the first initial weight and the second initial weight.