Sentiment Analysis of Chinese Product Reviews Based on BERT Word Vector and Hierarchical Bidirectional LSTM

Abstract

Sentiment analysis data on Chinese shopping comments has gained much attention in recent years. Many previous studies focus on the relationship between words in a single sentence but ignore the context relationship between sentences. To better serve this problem, we propose a method based on Bidirectional Encoder Representations from Transformers (BERT) pre-training language model, Hierarchical Bi-directional Long Short-Term Memory (Hierarchical Bi-LSTM) and attention mechanism for Chinese sentiment analysis. We first use BERT pretraining language model to obtained word vector, then applies Hierarchical Bi-LSTM model to extract contextual feature from sentences and words. Finally, we inj ect attention mechanism to highlight key information. Base on the experimental results, our method achieves more idealistic performance.