A chemistry load balancing model for OpenFOAM

Abstract

Efficient simulation tools are crucial for studying complex systems such as reacting flows where computational costs of computing chemical reaction rates can vastly exceed the costs for the integration of the convective and diffusive transport terms. Load imbalance in parallel computing poses a significant challenge for massively parallel reacting flow simulations. In response, a novel load balancing library has been developed to enhance OpenFOAM's solver performance in parallel environments. This library seamlessly integrates with OpenFOAM, offering ease of use and applicability to any OpenFOAM reacting solver incorporating finite-rate chemistry. In addition, it supports the standard and the dynamic adaptive chemistry model (TDAC) of OpenFOAM.

The newly developed load-balanced standard and TDAC models address significant load imbalances by exchanging information between processes via MPI calls and tracking ODE solution times on a cell level. The TDAC model introduces dual tables on each core and enables immediate addition of computed solutions, enhancing computational efficiency. Validation on various test cases, including simulations on the HLRS Hawk supercomputer with up to 8000 cores, confirms identical results compared to the original unbalanced models, with notable speed-up factors of up to 6 for the standard and 5 for the TDAC model. Despite non-linear scaling at lower cell count per processor, load-balanced models consistently outperform unbalanced counterparts, making them the preferred choice for reacting flow simulations in OpenFOAM.