A prediction-based dynamic replication strategy for data-intensive applications

• Published in: Computers & electrical engineering Vol. 57; pp. 281 - 293
• Main Authors: Nagarajan, Vijaya, Maluk Mohamed, Mulk Abdul
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier Ltd 01.01.2017; Elsevier BV
• Subjects: Access time; Association rules; Computational grids; Computer simulation; Data mining; Data replication; Geographical distribution; Intelligent Replica Manager; Middleware; Modified apriori algorithm; Prediction; Predictions; Replication; Scheduling; Servers; Storage capacity; Strategy; Replication; Association rules; Modified apriori algorithm; Prediction; Intelligent Replica Manager
• ISSN: 0045-7906; 1879-0755
• DOI: 10.1016/j.compeleceng.2016.11.036

•Intelligent Replica Manager – a new strategy for prediction-based dynamic replication is proposed.•Multi-criteria based replication algorithm is proposed for replica placement.•Modified apriori algorithm is designed for frequent datasets prediction.•Comparison with existing prediction-based dynamic replication methods.•Comparison and testing of the proposed strategy with other strategies for different job size. Data-intensive applications produce huge amount of data sets which need to be analyzed among geographically distributed nodes in grid computing environment. Data replication is essential in this environment to reduce the data access latency and to improve the data availability across several grid sites. In this work, an Intelligent Replica Manager (IRM) is designed and incorporated in the middleware of the grid for scheduling data-intensive applications. IRM uses a Multi-criteria based replication algorithm which considers multiple parameters like storage capacity, bandwidth and communication cost of the neighboring sites before taking decisions for the selection and placement of replica. Additionally, future needs of the grid site are predicted in advance using modified apriori algorithm, which is an association rule based mining technique. This IRM based strategy reduces the data availability time, data access time and make span. The simulation results prove that the proposed strategy outperforms the existing strategies.