Application Research of Attention Mechanism in Machine Reading Comprehension

Abstract

In recent years, machine reading comprehension has become one of the latest and most popular topics in natural language processing, attention mechanism has been widely used as an important method for extracting relevant information from articles in machine reading comprehension. This paper aims to summarize the development process of the attention mechanism and its application in machine reading comprehension. On the basis of the introduction of the derivation process of the attention mechanism, the network framework and the weight calculation method of the input data, it further introduces three kinds of attention-based Mechanisms for machine reading comprehension models. Finally, the future development trend of the attention mechanism in the field of machine reading comprehension is analyzed. The attention mechanism can help the model to extract important information and make the model make more accurate judgments. In the future, it will be more widely used in various tasks of machine reading comprehension.