Inductive relation prediction with information bottleneck

Abstract

Inductive relation prediction is an important learning task for knowledge graph completion that aims to infer new facts from existing ones. Previous works that focus on path-based are naturally limited in expressive. The methods based on graph neural network framework consider all paths thus improving the performance. However, fusing all paths information may extract features that are spuriously correlated with the prediction. By analogy to the human reasoning process, we observe that only a small subset of the critical paths determine the prediction. In this work, we propose a novel framework that extracts such critical paths to make inductive relation prediction on Knowledge Graph with Graph Information Bottleneck (KG-GIB). KG-GIB is the first attempt to advance the Graph Information Bottleneck (GIB) for inductive relation prediction. Derived from the GIB principle, KG-GIB extracts critical paths which preserves task-relevant paths and blocks information from task-irrelevant paths. The extracted critical paths are expected to be more generalizable and interpretable. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of KG-GIB.