Architecture Design of Subject-Oriented Web Crawler

• Published in: 2013 Fourth International Conference on Intelligent Systems Design and Engineering Applications pp. 174 - 177
• Main Authors: Cao Xin, Zhang Yong, Zhang Fuyan, Ni Changbao
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.11.2013
• Subjects: Astronomical Image; Computer architecture; Crawlers; HTML; Image Segmentation; Instruction sets; Memory; Mutual Information; PCNN; Search engines; Sockets

In response to the defects of traditional search engines of which it will return a large amount of information when users search keywords, and it's hard to get the useful information, thus propose the thought of subject division, that is the subject-oriented search engine.Subject crawler is the...