Webpage content acquisition method, terminal equipment and readable storage medium

• Main Author: JIANG LINYU
• Format: Patent
• Language: Chinese; English
• Published: 21.12.2021
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention discloses a webpage content obtaining method, terminal equipment and a readable storage medium. The webpage content obtaining method comprises: binding at least two IP addresses; obtaining a target webpage address from a webpage address queue, wherein the number of the to-be-crawled webpage addresses stored in the webpage address queue is smaller than or equal to the number of the bound IP addresses; obtaining a target IP address corresponding to the target webpage address from the bound IP addresses; and crawling webpage content corresponding to the target webpage address through the target IP address. According to the invention, the webpage content obtaining efficiency can be improved. 本发明公开了一种网页内容的获取方法、终端设备及可读存储介质，所述网页内容的获取方法包括：绑定至少两个IP地址；从网页地址队列中获取目标网页地址，其中，所述网页地址队列中存放的待爬取网页地址的数量小于或等于绑定的所述IP地址的数量；在绑定的所述IP地址中获取所述目标网页地址对应的目标IP地址；通过所述目标IP地址爬取所述目标网页地址对应的网页内容。本发明能够提高网页内容的获取效率。