Multi-Objective Deep Q-Network Control for Actively Lubricated Bearings

Abstract

This paper aims to study and demonstrate the possibilities of using reinforcement learning for the synthesis of multi-objective controllers for radial actively lubricated hybrid fluid film bearings (ALHBs), which are considered to be complex multi-physical systems. In addition to the rotor displacement control problem being typically solved for active bearings, the proposed approach also includes power losses due to friction and lubricant pumping in ALHBs among the control objectives to be minimized by optimizing the lubrication modes. The multi-objective controller was synthesized using the deep Q-network (DQN) learning technique. An optimal control policy was determined by the DQN agent during its repetitive interaction with the simulation model of the rotor system with ALHBs. The calculations were sped up by replacing the numerical model of an ALHB with its surrogate ANN-based counterpart and by predicting the shaft displacements in response to operation of two independent control loops. The controller synthesized considering the formulated reward function for DQN agent is able to find a stable shaft position that reduces power losses by almost half compared to the losses observed when using a passive system. It also is able to prevent the established limit of the minimum fluid film thickness being exceeded to avoid possible system damage, for example, when the rotor is unbalanced during the operation. Analysis of the development process and the results obtained allowed us to draw conclusions about the main advantages and disadvantages of the considered approach, and also allowed us to identify some important directions for further research.