Intra-and-inter Sentence Attention Model for Enhanced Question Answering System

Abstract

Task-oriented question answering dialogue systems have been an important branch of conversational systems for oral language, where they first understand the query requested by users, and the models are demanded to seek for answers within the context considering the query information. Previous work models the semantic and syntactic information without taking the interaction into consideration. In this paper, we propose an intra-and-inter sentence attention framework, equipped with self-attention mechanism, which enables the model to focus more on a small part of the context and enhances the model capability of extracting the interactive information. Our experiments are based on the Stanford Question Answering Dataset (SQuAD) and the experimental result shows that our model achieves 68.5 EM and 77.7 F1 score, which verifies how the proposed model improves on the dataset.