Adaptive Context Caching for Efficient Distributed Context Management Systems

Abstract

We contend that performance metrics-driven adaptive context caching has a profound impact on performance efficiency in distributed context management systems (CMS). This paper proposes an adaptive context caching approach based on (i) a model of economics-inspired expected returns of caching particular items, and (ii) learning from historical context caching performance, i.e., our approach adaptively (with respect to statistics on historical performance) caches "context" with the objective of minimizing the cost incurred by a CMS in responding to context queries. Our novel algorithm enables context queries and sub-queries to reuse and repurpose cached context in an efficient manner, different from traditional data caching. The paper also proposes heuristics and adaptive policies such as eviction and context cache memory scaling. The method is evaluated using a synthetically generated load of sub-queries inspired by a real-world scenario. We further investigate optimal adaptive caching configurations under different settings. This paper presents and discusses our findings that the proposed statistical selective caching method reaches short-term cost optimality fast under massively volatile queries. The proposed method outperforms related algorithms by up to 47.9% in cost efficiency.