Chinese image description evaluation method based on target domain semantic constraints

Abstract

To address the problems of insufficient accuracy and difficulty of application in the current Chinese image description field, this paper proposes an evaluation method based on semantic constraints in the target domain. Unlike previous research, this method acts on the output stage of the model, and based on the extraction of key semantics in the target application domain, it is constrained by the macroscopic semantic space of that domain or by introducing external semantic information from other visual tasks. The experiments show that the proposed method effectively improves the semantic coherence between the model output description sentences and the input images in the target domain, and is helpful for the practical application of image description in specific domains.