ONLINE TRAINING AND UPDATE OF FACTORIZATION MACHINES USING ALTERNATING LEAST SQUARES OPTIMIZATION

• Main Authors: Mao, Xueyu, Li, Sheng, Mitra, Saayan, Sarkhel, Somdeb, Swaminathan, Viswanathan
• Format: Patent
• Language: English
• Published: 09.12.2021
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; PHYSICS

Techniques are disclosed for training of factorization machines (FMs) using a streaming mode alternating least squares (ALS) optimization. A methodology implementing the techniques according to an embodiment includes receiving a datapoint that includes a feature vector and an associated target value. The feature vector includes user identification, subject matter identification, and a context. The target value identifies an opinion of the user relative to the subject matter. The method further includes applying an FM to the feature vector to generate an estimate of the target value, and updating parameters of the FM for training of the FM. The parameter update is based on application of a streaming mode ALS optimization to: the datapoint; the estimate of the target value; and to an updated summation of intermediate calculated terms generated by application of the streaming mode ALS optimization to previously received datapoints associated with prior parameter updates of the FM. Online Streaming Data Streaming mode 110 ALS Optimization . Training and Update Module Datapoint 120 (x, y) Update Parameters '_ _Estimate Factorization A o Machine y Initial Parameters Batch mode ALS Optimization Training Module