Anti-crawler method based on JSON data interaction

• Main Authors: DU KE, LI CHANGHAN
• Format: Patent
• Language: Chinese; English
• Published: 02.02.2024
• Subjects: CALCULATING; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention discloses an anti-crawler method based on JSON (JavaScript Object Noise) data interaction, which comprises the following steps: adding noise data and configurable noise data rules, wrapping the data in an HTML (Hypertext Markup Language) structure noise label, complication the data as much as possible, adding the noise data, and enabling crawlers not to directly analyze contents, so that the data interaction efficiency is improved. The back-end data can be rendered through the front-end JS technology, so that a front-end page is not affected, and the effects of configuration and flexibility are achieved; the crawler cost is greatly improved, the crawler efficiency is reduced, and the anti-crawling capability of the website is effectively improved. 本发明公开了一种基于JSON数据交互的反爬虫方法，通过加入噪声数据和可配置噪声数据规则，将数据包裹在HTML结构噪声标签中，能尽可能的将数据复杂化，增加噪声数据，能够让爬虫无法直接解析内容，并且能够通过前端JS技术对后端数据进行渲染保前端页面不受影响，且实现配置、灵活多变的效果；大大提高了爬虫成本，降低爬虫效率，有效提高了网站反爬能力。