LMTCSG: Multilabel Text Classification Combining Sequence-Based and GNN-Based Features

Since multilabel text classification datasets often face the problem of label imbalance, therefore, using either sequence-based deep learning (DL) model or graph neural network (GNN)-based DL model alone will not achieve satisfactory classification results. To solve the above problem, firstly, two coattention networks are constructed to simultaneously obtain the sequence-based and GNN-based eigenvectors. Second, labels are added to the graph as global features, and a graph data augmentation strategy is proposed. When obtaining GNN-based eigenvectors, at first, connection and attention weights are obtained through adjacency matrix and the attention of neighborhoods. Then, node features are updated based on convolution and multihead attention, respectively. Multiple comparison experiments on four benchmark datasets prove that the model constructed in this article achieves the optimal classification results and can solve the label imbalance problem.