How we can use text classification in the Back-Office environment of a bank as ‘business as usual’ solution

Abstract

Natural Language Processing nowadays provides scientists with many research areas and opportunities, but as with most applied sciences, our goal in Natural Language Processing is to refine the underlying science and technology until it can be used reliably for business purposes. Transformer models, such as GPT or BERT, are currently showing outstanding results in the field of natural-language processing, but they require huge computational power and data to teach, but these conditions can only be met by larger research centers and large companies, and their inaccuracy makes them unsuitable for use as a ‘business as usual’ (BAU) solution. In this paper, we present a solution that is able to overcome these problems by focusing on accuracy and usability, and that can also bring a new perspective to the process of teaching deep learning models.