Distributed caching strategy for hot news propagation based on data engineering processing

Abstract

In order to improve the performance of the hot news collection and propagation of hotspot news, we aim at improving the performance and solve the opinion collection and propagation bottleneck by analyzing the demand and framework of current hot news supported systems. Then, a corresponding opinion collection and propagation optimization framework and strategy are proposed with a distributed hotspot caching system is designed and implemented. On the basis of the existing distributed search engine, a cache server is added between the overall hotspot query processing server and each cluster sub-query processing server, so that we can improve the caching and searching efficiency greatly. The experimental results show that after using the proposed distributed caching system and strategy for hot news propagation, the processing capacity of the hot news system has been greatly enhanced.