A Focused Crawler Model Based on Mutation Improving Particle Swarm Optimization Algorithm

Abstract

The focused crawler is the key technology of the focused search engine. The current focused crawler is prone to poor adaptability and low search accuracy in the process of crawling the webpage. For these reasons, we proposes a focused crawler model (VRPSOFC) based on mutation improving particle swarm optimization. First, get three seed pages based on the click rate of the topic-related page. Then, get the four weighted documents of the seed pages. Finally, using the focused crawler model based on mutation improving particle swarm optimization algorithm to crawl the webpage, the results of the analysis show that the focused crawler model has a significant improvement in the precision of optimization.