DATA RECOMMENDER USING LINEAGE TO PROPAGATE VALUE INDICATORS

• Main Authors: BHATTACHARYA, SUPARNA, ZDANKUS, JANICE M, SUDHAKARAN, SONU, DUNNING, TED, BOWDEN, GLYN, NEASE, LIN A
• Format: Patent
• Language: English
• Published: 21.12.2023
• Subjects: CALCULATING; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

Systems and methods provide a system that gathers information about data as it progresses through data processing pipelines of data analysis projects. The data analytics system derives value indicators and implicit metadata from the data processing pipelines. For example, the data analytics system may derive value indicators and implicit metadata from data-related products themselves, semantic analysis of the code/processing steps used to process the data-related products, the structure of data processing pipelines, and human behavior related to production and usage of data-related products. Once a new data analysis project is initiated, the data analytics system gathers parameters and characteristics about the new data analysis project and references the value indicators and implicit metadata to recommend useful processing steps, datasets, and/or other data-related products for the new data analysis project.