Deep Learning for Natural Language Processing and Language Modelling

Abstract

The article presents an example of practical application of deep learning methods for language processing and modelling. Development of statistical language models helps to predict a sequence of recognized words and phonemes, and can be used for improving speech processing and speech recognition. However, currently the field of language modelling is shifting from statistical language modelling methods to neural networks and deep learning methods. Therefore, one of the methods of effective language modelling with the use of deep learning techniques is presented in this paper. Presented results concerns the modelling of the Polish language but the achieved research results and conclusions can also be applied to language modelling application for other languages.