The Noise Reduction Method of Web Pages Based on Image Features

Abstract

Same layer webpage have similar presentation styles and noise blocks. The first step of data mining is to remove noise blocks from web pages. Different from traditional similarity measurement method based on DOM trees, a noise removal method based on image features is proposed in this paper. In this method, web pages are processed as images. And then, all of image features can be flexibly used as criteria to measure similarity of noise blocks. As a result, noise blocks and information blocks can be distinguished after measuring similarity, and the reduction of noise is realized. The results of experiment demonstrate that this method is accurate and reliable and it can support joint measurement of multiple image features. Keywordsnoise reduction; web data mining; image features