MULTI-EVENT TIME-SERIES ENCODING

• Main Authors: POKHREL, ASLESHA, ZUBERI, SABA, LABACH, ALEXANDER JACOB, VOLKOVS, MAKSIMS
• Format: Patent
• Language: English; French
• Published: 30.03.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES; ELECTRIC DIGITAL DATA PROCESSING; HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATIONTECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING ORPROCESSING OF MEDICAL OR HEALTHCARE DATA; INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTEDFOR SPECIFIC APPLICATION FIELDS; PHYSICS; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR

To improve processing of the multi-event time-series data, information about each event type is aggregated for a group of time bins, such that an event bin embedding represents the occurring events of that type in the time bin. The event bin embedding may be based on an aggregated event value summarizing the values of that event type in the bin and a count of those events. The event bin embeddings across event types and time bins may be combined with an embedding for static data about the data instance and a representation token for input to an encoder. The encoder may apply an event-focused sublayer and a time-focused sublayer that attend to respective dimensions of the encoder. The model may be initially trained with self-supervised learning with time and event masking and then fine-tuned for particular applications.