Estimating Instantaneous Cache Hit Ratio Using Markov Chain Analysis

• Published in: IEEE/ACM transactions on networking Vol. 21; no. 5; pp. 1472 - 1483
• Main Authors: Gomaa, Hazem, Messier, Geoffrey G., Williamson, Carey, Davies, Robert
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.10.2013; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Analysis; Analytical models; Caching; IEEE transactions; Markov chain; Markov processes; Probability; Product introduction; replacement policy; Steady-state; Studies; Transient analysis; Web; Web servers
• ISSN: 1063-6692; 1558-2566
• DOI: 10.1109/TNET.2012.2227338

This paper introduces a novel analytical model for estimating the cache hit ratio as a function of time. The cache may not reach the steady-state hit ratio when the number of Web objects, object popularity, and/or caching resources themselves are subject to change. Hence, the only way to quantify the hit ratio experienced by Web users is to calculate the instantaneous hit ratio. The proposed analysis considers a single Web cache with infinite or finite capacity. For a cache with finite capacity, two replacement policies are considered: Least Recently Used (LRU) and First-In-First-Out (FIFO). Based on the insights from the proposed analytical model, we propose a new replacement policy, called Frequency-Based-FIFO (FB-FIFO). The results show that FB-FIFO outperforms both LRU and FIFO, assuming that the number of Web objects is fixed. Assuming that new popular objects are generated periodically, the results show that FB-FIFO adapts faster than LRU and FIFO to the changes in the popularity of the cached objects when the cache capacity is large relative to the number of newly generated objects.