INTEGRATING EXECUTION OF COMPUTING ANALYTICS WITHIN A MAPREDUCE PROCESSING ENVIRONMENT

• Main Authors: OSBORN, MARK DAVID, INTERRANTE, JOHN A, POOL, ERIC, PUIG, ERNEST CHARLES
• Format: Patent
• Language: English; French; German
• Published: 02.03.2016
• Subjects: CALCULATING; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

Embodiments of the disclosure can include MapReduce systems and methods with integral mapper and reducer compute runtime environments. An example system with an integral reducer compute runtime environment can include mappers (225) and reducers (250) executable on a computer cluster (215). The mappers can be operable to receive raw input data (245) and generate first input data based on the raw input data (245). The mappers (225) can be operable to generate first result data based on the first input data. Based on the first result data, the mappers (225) can be operable to generate (K, V) pairs (275). The reducers (250) can be operable to receive the (K, V) pairs (275) and generate second input data based on the (K, V) pairs (275). The reducers (250) can be operable to transmit the second input data to integral compute runtime environment being run within the reducers (250) and operable to generate second result data based on the second input data. Based on the second result data, the reducers (250) can be operable to generate output data.