Self-similarity in World Wide Web traffic: evidence and possible causes

• Published in: IEEE/ACM transactions on networking Vol. 5; no. 6; pp. 835 - 846
• Main Authors: Crovella, M.E., Bestavros, A.
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.12.1997; Association for Computing Machinery; Institute of Electrical and Electronics Engineers
• Subjects: Applied sciences; Exact sciences and technology; Intelligent networks; Internet; Local area networks; Network servers; Tail; Telecommunication traffic; Telecommunications; Telecommunications and information theory; Teleprocessing networks. Isdn; Traffic control; Valuation and optimization of characteristics. Simulation; Web server; Web sites; World Wide Web; Teletraffic; Internet; Computer network; World wide web
• ISSN: 1063-6692; 1558-2566
• DOI: 10.1109/90.650143

The notion of self-similarity has been shown to apply to wide-area and local-area network traffic. We show evidence that the subset of network traffic that is due to World Wide Web (WWW) transfers can show characteristics that are consistent with self-similarity, and we present a hypothesized explanation for that self-similarity. Using a set of traces of actual user executions of NCSA Mosaic, we examine the dependence structure of WWW traffic. First, we show evidence that WWW traffic exhibits behavior that is consistent with self-similar traffic models. Then we show that the self-similarity in such traffic can be explained based on the underlying distributions of WWW document sizes, the effects of caching and user preference in file transfer, the effect of user "think time", and the superimposition of many such transfers in a local-area network. To do this, we rely on empirically measured distributions both from client traces and from data independently collected at WWW servers.