An efficient web document clustering algorithm for building dynamic similarity profile in Similarity-aware web caching

Abstract

Discovering and establishing similarities among web documents have been one of the key research streams in web usage mining community in the recent years. The knowledge obtained from the exercise can be used for many applications such as optimizing web cache organization and improving the quality of web document pre-fetching. This paper presents an efficient matrix-based method to cluster web documents based on a predetermined similarity threshold. Our preliminary experiments have demonstrated that the new algorithm outperforms existing algorithms. The clustered web documents are then applied to a Similarity-aware web content management system, facilitating offline building of the similarity-ware web caches and online updating similarity profiles of the system.